Slicer3:TimeSeries and Multi-Volume Data - Revision history

Grundlett: Text replacement - "http://www.slicer.org/slicerWiki/index.php/" to "https://www.slicer.org/wiki/"

2017-07-10T18:07:09Z

Text replacement - "http://www.slicer.org/slicerWiki/index.php/" to "https://www.slicer.org/wiki/"

Marianna: Unprotected "Slicer3:TimeSeries and Multi-Volume Data"

2008-05-20T17:59:29Z

Unprotected "Slicer3:TimeSeries and Multi-Volume Data"

Marianna at 17:59, 20 May 2008

2008-05-20T17:59:12Z

Marianna: Unprotected "Slicer3:TimeSeries and Multi-Volume Data"

2008-05-20T17:58:06Z

Unprotected "Slicer3:TimeSeries and Multi-Volume Data"

Marianna: Replacing page with ''''Note:''' We are migrating this content to the slicer.org domain - The newer page is [http://www.slicer.org/slicerWiki/index.php/Slicer3:TimeSeries_...'

2008-05-20T17:57:50Z

Replacing page with '<big>'''Note:''' We are migrating this content to the slicer.org domain - <font color="orange">The newer page is [http://www.slicer.org/slicerWiki/index.php/Slicer3:TimeSeries_...'

Pieper: /* Feature ideas */

2008-03-31T17:55:34Z

Feature ideas

Blezek: /* Data format testing */

2008-03-08T03:43:27Z

Data format testing

Blezek: /* Data format testing */

2008-03-02T02:36:27Z

Data format testing

Blezek: /* Data format testing */

2008-02-25T05:13:05Z

Data format testing

Blezek: /* Data format testing */

2008-02-25T05:10:05Z

Data format testing

← Older revision		Revision as of 18:07, 10 July 2017
Line 1:		Line 1:
−	<big>'''Note:''' We are migrating this content to the slicer.org domain - <font color="orange">The newer page is [~~http~~://www.slicer.org/~~slicerWiki/index.php~~/Slicer3:TimeSeries_and_Multi-Volume_Data here]</font></big>	+	<big>'''Note:''' We are migrating this content to the slicer.org domain - <font color="orange">The newer page is [https://www.slicer.org/wiki/Slicer3:TimeSeries_and_Multi-Volume_Data here]</font></big>

← Older revision		Revision as of 17:59, 20 May 2008
Line 1:		Line 1:
−	<big>'''Note:''' We are migrating this content to the slicer.org domain - <font color="orange">The newer page is [http://www.slicer.org/slicerWiki/index.php/Slicer3:TimeSeries_and_Multi-Volume_Data~~#Hierarchical_Management_of_Large_Data_Sets~~ here]</font></big>	+	<big>'''Note:''' We are migrating this content to the slicer.org domain - <font color="orange">The newer page is [http://www.slicer.org/slicerWiki/index.php/Slicer3:TimeSeries_and_Multi-Volume_Data here]</font></big>

← Older revision		Revision as of 17:57, 20 May 2008
Line 1:		Line 1:
−	'''~~[[Slicer3~~:~~Developers#Slicer_3_Projects \| Back to Slicer3 Projects List ]]~~'''	+	<big>'''Note:''' We are migrating this content to the slicer.org domain - <font color="orange">The newer page is [http://www.slicer.org/slicerWiki/index.php/Slicer3:TimeSeries_and_Multi-Volume_Data#Hierarchical_Management_of_Large_Data_Sets here]</font></big>
−
−	~~== Slicer3 support for TimeSeries and Multi-Volume Data==~~
−
−	~~=== Feature ideas ===~~
−
−	~~Just a collection of ideas related~~ to ~~time series data in no particular order.~~
−
−	* Would like to dynamically load data in a background thread to minimize memory requirements
−	** Need to understand how this will impact performance, i.e. can we page through the ~~slices in real time?~~
−	* Flexible processing
−	** Volume by volume
−	** Slice by Slice (would require a "block of bytes" format like NRRD, Analyze, or NIFTI)
−
−	~~=== Multi-volume Viewing Use Cases ===~~
−
−	~~[[media:ViewingEssentialsGE.ppt \| This presentation]] describes some of the use cases for multiple volumes within Slicer3.~~
−
−	~~=== Potentially useful codes ===~~
−
−	* [http://www.vtk.org~~/doc/nightly/html/classvtkMultiGroupDataSet.html VTK 5.1 multi~~-~~group data set]~~
−	* [http://www.~~vtk~~.org/~~doc~~/~~nightly/html/classvtkTemporalDataSet.html VTK 5.1 temporal data set]~~
−	* [http://www.insight-journal.org/InsightJournalManager/view_reviews.php~~?back=admin_publications_toolkits.php&pubid=164 VTK code from Inria ]~~
−
−	~~=== Proposed Data Model ===~~
−
−	~~=== Use Cases ===~~
−
−	~~Need to evaluate these use cases to address the most useful~~/common scenarios to design the system. Each use case must be catagorized from 4 (Required) down to 1 (Nice to have). In all cases, we desire to handle datasets much larger than memory, yet maintain full interactivity for the user. Flexibility of processing must be a priority.
−
−	~~# User pages through same slice from all volumes in acquisition orientation~~
−	~~# User pages through reformatted slice from all volumes~~
−	~~# Process one pixel at a time through all volumes~~
−	~~## Process in an "accumulator" mode~~
−	~~## Process by analyzing whole time course of voxel (could possibly be done slice at a time?)~~
−	~~# Process one slice at a time through all volumes~~
−	~~# Process one volume at a time through all volumes (same as previous?)~~
−	~~# Render dynamic time series, e.g. cardiac data~~
−
−	~~=== Data format testing ===~~
−
−	~~Three different data formats were tested.~~
−
−	~~# SQLite, an embedded SQL database~~
−	~~# HDF5, a standard scientific file format~~
−	~~# Raw, a simple raw reading and writing of 8K chunks~~
−
−	~~Results~~
−	~~{\| border="1"~~
−	\|- ~~bgcolor="~~#~~abcdef"~~
−	~~! Software !! Write performance (256x256x10x16) !! Read performance (256x256 slice, averaged over 1000 slices)~~
−	\|-
−	~~\| SQLite~~
−	~~\| 1.3sec~~
−	~~\| 0.017sec~~
−	\|-
−	~~\| HDF5~~
−	~~\| 2.6sec~~
−	~~\| 0.017sec~~
−	\|-
−	~~\|Raw~~
−	~~\| 0.6sec~~
−	~~\| 0.004sec~~
−	\|}
−
−	~~Reading and writing directly results in approximately 4x speedup over SQLite and HDF5.~~ ~~This will be the approach for the class design.~~
−
−	~~=== Mock-ups and ideas ===~~
−
−	~~[[image:Ron-TimeSeriesMockup.png\|thumb\|300px~~]]
−
−
−	~~Ron's mock-up for time series layout using the light box capability in Slicer 3:~~
−
−	* Layout: green and yellow are a single box. Red shows a single zoomed in image, selected by clicking
−	* alignment through registration or adjusting TS1 versus TS2 (or 3) by dragging one of them left or right
−
−	~~=== Existing GUI Resources ===~~
−
−	Below are interface elements for which GUI resources already exist. The Basic Controller and Cine Controller are not attached to any logic or data structures. The Interval Browser is part of Slicer2.6.
−
−	~~[[image:BasicController.png]]~~
−
−	~~[[image:CineDisplay5.png]]~~
−
−	~~[[image:Ibrowser.png]]~~
−
−
−	~~== Hierarchical Management of Large Data Sets ==~~
−
−	~~From an earlier discussion:~~
−
−
−	''Here are some notes for our discussion about a project to address the need to browse through large volumetric datasets interactively. The particular issue that I think needs to be addressed is matching the data passing through the display pipeline to the actual resolution of the display windows or texture maps.''
−
−	''For example, if you have a 8k x 8k x 8k volume data set, and you want to view it in a 1k by 1k window with arbitrary slice planes, the current classes in VTK and ITK would require loading the full 512 Gigapixels of data into memory and then pulling out the 1k by 1k slice plane, which on almost any computer would require a lot of virtual memory paging, if its possible at all. Assuming your reslice plane is different then the way the volume is laid out in memory, there will be a high level of cache misses and memory thrashing. A similar issue occurs when zooming in to a small section within a large volume -- in order to extract the volume of interest, the full volume must be read into memory.''
−
−	''A better way to approach this problem is to preprocess the volume data so that a hierarchy of different resolutions are available (full size, 1/2 size, 1/4 size, etc) and the volume data can be decomposed into blocks so that only the necessary parts are read in order to display the currently selected view. There is a large literature on these types of techniques. Google Maps/~~Earth are good example of this technique applied to a large database with good interactive feel.''~~
−
−	''I'd like to see a project to implement this approach inside VTK (and, possibly, ITK). There have been a few attempts in the past (DataCutter at OSU, is similar, I believe, but the code doesn't appear to be available and so far the people I've been asking at BWH, GE, Kitware don't know the details -- this is something I can research more).''
−
−	~~''What I have in mind is four related tools: (1) a preprocessor to build a hierarchical volume datastructure~~/database, (2) a server that will take requests for a given extent at a given resolution and provide back the volume data, (3) a demo web site that will allow interactive browsing through large data sets, and (4) an implementation in slicer to load and display these multi-resolution volumes for interactive visualization.''

@@ Line 12: / Line 12: @@
 ** Volume by volume
 ** Slice by Slice (would require a "block of bytes" format like NRRD, Analyze, or NIFTI)
 === Potentially useful codes ===

@@ Line 47: / Line 47: @@
 ! Software !! Write performance (256x256x10x16) !! Read performance (256x256 slice, averaged over 1000 slices)
 |-
-| SQLite || 1.3sec || 0.017sec
+| SQLite
-| HDF5   || 2.6sec ||  0.017sec
+| 1.3sec
-| Raw    || 0.6sec || 0.004sec
+| 0.017sec
 |}

← Older revision	Revision as of 17:59, 20 May 2008
(No difference)

← Older revision	Revision as of 17:58, 20 May 2008
(No difference)

@@ Line 45: / Line 45: @@
 {| border="1"
 |- bgcolor="#abcdef"
-! Software !! Write performance (256x256x10x16) !! Read performance (average per 256x256 slice)
+! Software !! Write performance (256x256x10x16) !! Read performance (256x256 slice, averaged over 1000 slices)
 |-
-| Coming soon || Entry2 || Entry3
+| SQLite || 1.3sec || 0.017sec
 |}
 === Mock-ups and ideas ===

← Older revision		Revision as of 05:10, 25 February 2008
Line 43:		Line 43:

	Results		Results
		+	{\| border="1"
		+	\|- bgcolor="#abcdef"
		+	! Software !! Write performance (256x256x10x16) !! Read performance (average per 256x256 slice)
		+	\|-
		+	\| Entry1 \|\| Entry2 \|\| Entry3
		+	\|-
		+	\| Entry1 \|\| Entry2 \|\| Entry3
		+	\|}

	=== Mock-ups and ideas ===		=== Mock-ups and ideas ===