Difference between revisions of "Projects:TumorModeling"

From NAMIC Wiki
Jump to: navigation, search
 
(22 intermediate revisions by 2 users not shown)
Line 3: Line 3:
 
= Modeling tumor growth in patients with glioma =
 
= Modeling tumor growth in patients with glioma =
  
[[Image:Multimodal_glioma.png|thumb|left|350px| Figure 1: Multi-modal image data from a patient with low-grade glioma. A large number of different modalities and derived parameter volumes are acquired during the monitoring of tumor growth.]]
+
 
  
 
We are interested in developing computational methods for the assimilation of magnetic resonance image data into physiological models of glioma - the most frequent primary brain tumor - for a patient-adaptive modeling of tumor growth.
 
We are interested in developing computational methods for the assimilation of magnetic resonance image data into physiological models of glioma - the most frequent primary brain tumor - for a patient-adaptive modeling of tumor growth.
  
 +
This aims at two directions: First, it aims at making complex information from longitudinal multi-modal data set accessible for diagnostic radiology through physiological models. This will allow us to estimate features such as degree of infiltration, speed of growth, or mass effect in a quantitative fashion; for therapy it will allow us to identify regions at risk for progression. Second, it aims at providing the means to test different macroscopic tumor models from theoretical biology on real clinical data.
  
This aims at two directions: First, it aims at making complex information from longitudinal multimodal data set accessible for diagnostic radiology through physiological models. This will allow to estimate features such as degree of infiltration, speed of growth, or mass effect in a quantitative fashion; for therapy it will allow to identify regions at risk for progression. Second, it aims at providing the means to test different macroscopic tumor models from theoretical biology on real clinical data.
+
The project has three main aims: 1) the automated segmentation of tumors in large multi-modal image data sets to make information of different MR image modalities accessible for the tumor model,  2) the development of methods for the image-based estimation of parameters in reaction-diffusion type models of tumor growth, and 3) the processing and analysis of magnetic resonance spectroscopic images (MRSI) as a potential application of the tumor model.
  
 +
[[Image:Multimodal_glioma.png|thumb|center|350px| Figure 1: Multi-modal image data from a patient with low-grade glioma. A large number of different modalities and derived parameter volumes are acquired during the monitoring of tumor growth.]]
  
To realize these aims, the project comprises a number of aspects -- automated segmentation of tumors in large multimodal image data sets, making information of different MR image modalities accessible for the tumor model, with a focus on the processing of magnetic resonance spectroscopic images (MRSI), and the development of methods for the image-based estimation of parameters in reaction-diffusion type models of tumor growth.
+
= Tumor segmentation in large multimodal data sets =
  
  
  
== Segmenting tumors in large multimodal data sets ==
 
[[Image:Tumor_segmentation_lesion_atlas.png|thumb|left|300px| Figure 2: Tumor segmentation - by human rater (red, green, blue) and our methods (black). The right image shows the lesion atlas.]]
 
  
To segment all MR image volumes available for a patient we developed an approach for learning patient-specific lesion atlases (Figure 2) with limited user interaction. Figure 2 shows the manual segmentation of the tumor from different raters (red, green, blue) and the automatic segmentation using the patient-specific lesion atlas (black) in T1-MRI, T1-MRI and the fractional anisotropy map from DTI.  
+
To segment all MR image volumes available for a patient we developed an approach for learning patient-specific lesion atlases (Figure 2) with limited user interaction. Figure 2 shows the manual segmentation of the tumor from different raters (red, green, blue) and the automatic segmentation using the patient-specific lesion atlas (black) in T1-MRI, T1-MRI and the fractional anisotropy map from DTI.
  
'''Reference:''' ''Menze BH, Van Leemput K, Lashkari D, Weber MA, Ayache N and Golland P. A generative model for brain tumor segmentation in multi-modal images. Proc MICCAI 2010. LNCS 6362, 151-59''
+
[[Image:Tumor_segmentation_lesion_atlas.png|thumb|center|300px| Figure 2: Tumor segmentation - by human rater (red, green, blue) and our methods (black). The right image shows the lesion atlas.]]
 +
 
 +
= Image-based modeling of tumor growth =
  
  
== Image-based modeling of tumor growth ==
 
[[Image:fisher-state-space_tumor-shapes.png|thumb|left|300px| Figure 3: Variation of tumor shapes for different parameterizations of the Fisher-Kolmogorov tumor model. All tumors have the same size, they vary in Diffusivity 'D' and proliferation 'rho'. In our approach this shape information is used to infer general properties of the tumor.]]
 
  
 
We propose a joint generative model of tumor growth and of image observation that naturally handles multi-modal and longitudinal data. We use the model for analyzing imaging data in patients with glioma. The tumor growth model is based on a Fisher-Kolmogorov reaction-diffusion framework. Model personalization relies only on a forward model for the growth process and on image likelihood. We take advantage of an adaptive sparse grid approximation for efficient inference via Markov Chain Monte Carlo sampling. The approach can be used for integrating information from different multi-modal imaging protocols and can easily be adapted to other tumor growth models.
 
We propose a joint generative model of tumor growth and of image observation that naturally handles multi-modal and longitudinal data. We use the model for analyzing imaging data in patients with glioma. The tumor growth model is based on a Fisher-Kolmogorov reaction-diffusion framework. Model personalization relies only on a forward model for the growth process and on image likelihood. We take advantage of an adaptive sparse grid approximation for efficient inference via Markov Chain Monte Carlo sampling. The approach can be used for integrating information from different multi-modal imaging protocols and can easily be adapted to other tumor growth models.
  
'''Reference:''' ''Menze BH, Van Leemput K, Honkela A, Konukoglu E, Weber MA, Ayache N and Golland P. A generative approach for image-based modeling of tumor growth. Proc IPMI 2011. LNCS, to appear.''
+
Figure 4 illustrates the adaptive grid sampling of the parameter space for a modeled tumor. The size of the green sampling points indicates how often the indicated location parameter of the tumor model was evaluated under different parametrizations. The ground truth is indicated by the pink cross. Most adaptively chosen sampling points are close to the ground truth. The figure also shows isolines of tumor cell density (red), the predicted extensions of the T2 hyper-intense area (yellow) and tissue boundaries (black).
 +
 
 +
Figure 5 shows results of the proposed approach: Green samples are obtained from the proposed sparse grid approach while blue sample are obtained via standard MCMC. Black circles indicate means of the two distributions. Ground truth for A and B are indicated by the pink cross. In D the previously estimated speed of growth [7] is shown by the pink line. The sparse grid sampling approximation performs better than the direct MCMC (A-B). Estimates correlate well with priviously published results, but provide a more accurate characterization of the state of disease (D).
 +
 
 +
{|
 +
|[[Image:fisher-state-space_tumor-shapes.png|thumb|left|300px| Figure 3: Variation of tumor shapes for different parameterizations of the Fisher-Kolmogorov tumor model. All tumors have the same size, they vary in Diffusivity 'D' and proliferation 'rho'. In our approach this shape information is used to infer general properties of the tumor.]]
 +
| [[Image:Sampling_spatial-parameters.png‎|thumb|left|230px| Figure 4: Adaptive grid sampling of the parameter space for a modeled tumor.  Green dots show sampling points. Red and yellow lines show isolines of tumor cell infiltration. (Also see text above.)]]
 +
|[[Image:Results_Tumor-Model.png|thumb|left|500px| Figure 5: MCMC sampling results for 'D' and 'rho' using different synthetic and real data sets. The proposed method (green samples) shows less variation when compared to the standard sampling approach (blue) and is at least as close to the ground truth (pink). (Also see text above.) ]]
 +
|}
  
 +
= Processing magnetic resonance spectroscopic images =
  
  
== Processing magnetic resonance spectroscopic images ==
+
[[Image:Sivic_slicer_slc_mets.jpg|thumb|center|300px| Figure 6: MRSI metabolite maps generated in Slicer-SIVIC module referenced to anatomical (FLAIR) image.]]
[[Image:Sivic_slicer_slc_mets.jpg|thumb|left|350px| Figure 4: MRSI metabolite maps generated in Slicer-SIVIC module referenced to anatomical (FLAIR) image.]]
 
  
To make the metabolic information of magnetic resonance spectroscopic images available for modeling the evolution of glioma growth we are implementing an [http://wiki.na-mic.org/Wiki/index.php/2011_Winter_Project_Week:MRSI_module_and_SIVIC_interface MRSI processing module] for Slicer.
+
To make the metabolic information of magnetic resonance spectroscopic images available for modeling the evolution of glioma growth we are implementing an [http://wiki.na-mic.org/Wiki/index.php/2011_Winter_Project_Week:MRSI_module_and_SIVIC_interface MRSI processing module] for Slicer jointly with  the [http://sourceforge.net/apps/trac/sivic/ SIVIC] project at UCSF.
 +
 
 +
We envision that physiological tumor models may be used to interpret MRSI, integrating the highly specific metabolic information of the spectroscopic images with other clinical MRI modalities in a principled fashion.
  
 
= Key Investigators =
 
= Key Investigators =
 +
 
* MIT: [http://people.csail.mit.edu/menze Bjoern Menze], [http://people.csail.mit.edu/tammy Tammy Riklin Raviv], [http://people.csail.mit.edu/koen Koen Van Leemput], [http://people.csail.mit.edu/polina Polina Golland]
 
* MIT: [http://people.csail.mit.edu/menze Bjoern Menze], [http://people.csail.mit.edu/tammy Tammy Riklin Raviv], [http://people.csail.mit.edu/koen Koen Van Leemput], [http://people.csail.mit.edu/polina Polina Golland]
 
* Harvard: William M. Wells
 
* Harvard: William M. Wells
 
* INRIA Sophia-Antipolis, France: Ezequiel Geremia, Olivier Clatz, Nicholas Ayache
 
* INRIA Sophia-Antipolis, France: Ezequiel Geremia, Olivier Clatz, Nicholas Ayache
 +
* Microsoft Research, UK: Ender Konukoglu
 
* DKFZ Heidelberg, Germany: Bram Stieltjes, Marc-Andre Weber
 
* DKFZ Heidelberg, Germany: Bram Stieltjes, Marc-Andre Weber
  
 
= Publications =
 
= Publications =
 
*[http://www.na-mic.org/publications/pages/display?search=Projects%3ATumorModeling&submit=Search&words=all&title=checked&keywords=checked&authors=checked&abstract=checked&sponsors=checked&searchbytag=checked| NA-MIC Publications Database on brain tumor segmentation and modeling]
 
*[http://www.na-mic.org/publications/pages/display?search=Projects%3ATumorModeling&submit=Search&words=all&title=checked&keywords=checked&authors=checked&abstract=checked&sponsors=checked&searchbytag=checked| NA-MIC Publications Database on brain tumor segmentation and modeling]

Latest revision as of 04:16, 2 April 2011

Home < Projects:TumorModeling
Back to NA-MIC Collaborations, MIT Algorithms

Modeling tumor growth in patients with glioma

We are interested in developing computational methods for the assimilation of magnetic resonance image data into physiological models of glioma - the most frequent primary brain tumor - for a patient-adaptive modeling of tumor growth.

This aims at two directions: First, it aims at making complex information from longitudinal multi-modal data set accessible for diagnostic radiology through physiological models. This will allow us to estimate features such as degree of infiltration, speed of growth, or mass effect in a quantitative fashion; for therapy it will allow us to identify regions at risk for progression. Second, it aims at providing the means to test different macroscopic tumor models from theoretical biology on real clinical data.

The project has three main aims: 1) the automated segmentation of tumors in large multi-modal image data sets to make information of different MR image modalities accessible for the tumor model, 2) the development of methods for the image-based estimation of parameters in reaction-diffusion type models of tumor growth, and 3) the processing and analysis of magnetic resonance spectroscopic images (MRSI) as a potential application of the tumor model.

Figure 1: Multi-modal image data from a patient with low-grade glioma. A large number of different modalities and derived parameter volumes are acquired during the monitoring of tumor growth.

Tumor segmentation in large multimodal data sets

To segment all MR image volumes available for a patient we developed an approach for learning patient-specific lesion atlases (Figure 2) with limited user interaction. Figure 2 shows the manual segmentation of the tumor from different raters (red, green, blue) and the automatic segmentation using the patient-specific lesion atlas (black) in T1-MRI, T1-MRI and the fractional anisotropy map from DTI.

Figure 2: Tumor segmentation - by human rater (red, green, blue) and our methods (black). The right image shows the lesion atlas.

Image-based modeling of tumor growth

We propose a joint generative model of tumor growth and of image observation that naturally handles multi-modal and longitudinal data. We use the model for analyzing imaging data in patients with glioma. The tumor growth model is based on a Fisher-Kolmogorov reaction-diffusion framework. Model personalization relies only on a forward model for the growth process and on image likelihood. We take advantage of an adaptive sparse grid approximation for efficient inference via Markov Chain Monte Carlo sampling. The approach can be used for integrating information from different multi-modal imaging protocols and can easily be adapted to other tumor growth models.

Figure 4 illustrates the adaptive grid sampling of the parameter space for a modeled tumor. The size of the green sampling points indicates how often the indicated location parameter of the tumor model was evaluated under different parametrizations. The ground truth is indicated by the pink cross. Most adaptively chosen sampling points are close to the ground truth. The figure also shows isolines of tumor cell density (red), the predicted extensions of the T2 hyper-intense area (yellow) and tissue boundaries (black).

Figure 5 shows results of the proposed approach: Green samples are obtained from the proposed sparse grid approach while blue sample are obtained via standard MCMC. Black circles indicate means of the two distributions. Ground truth for A and B are indicated by the pink cross. In D the previously estimated speed of growth [7] is shown by the pink line. The sparse grid sampling approximation performs better than the direct MCMC (A-B). Estimates correlate well with priviously published results, but provide a more accurate characterization of the state of disease (D).

Figure 3: Variation of tumor shapes for different parameterizations of the Fisher-Kolmogorov tumor model. All tumors have the same size, they vary in Diffusivity 'D' and proliferation 'rho'. In our approach this shape information is used to infer general properties of the tumor.
Figure 4: Adaptive grid sampling of the parameter space for a modeled tumor. Green dots show sampling points. Red and yellow lines show isolines of tumor cell infiltration. (Also see text above.)
Figure 5: MCMC sampling results for 'D' and 'rho' using different synthetic and real data sets. The proposed method (green samples) shows less variation when compared to the standard sampling approach (blue) and is at least as close to the ground truth (pink). (Also see text above.)

Processing magnetic resonance spectroscopic images

Figure 6: MRSI metabolite maps generated in Slicer-SIVIC module referenced to anatomical (FLAIR) image.

To make the metabolic information of magnetic resonance spectroscopic images available for modeling the evolution of glioma growth we are implementing an MRSI processing module for Slicer jointly with the SIVIC project at UCSF.

We envision that physiological tumor models may be used to interpret MRSI, integrating the highly specific metabolic information of the spectroscopic images with other clinical MRI modalities in a principled fashion.

Key Investigators

Publications