Difference between revisions of "Projects:MethodEvaluationValidation"

From NAMIC Wiki
Jump to: navigation, search
Line 9: Line 9:
 
[[Image:Cause07Competition.gif|thumb|300px|]]
 
[[Image:Cause07Competition.gif|thumb|300px|]]
  
We have developed an open source tool for the evaluation of 3D segmentation algorithms combining a variety of segmentation comparison methods with respect to the performance of human expert raters. This tool was employed during the workshop on  "3D Segmentation in the Clinic - A Grand Challenge", on October 26, 2007 held in conjunction with MICCAI 2007 and continues to be used in workshop attached websites on caudate segmentation (cause07.org) and liver segmentation (sliver07.org). On these webpages, you can browse the results of various systems, and read the respective papers and descriptions about the systems. Anybody can join the competition by registering a team, downloading the training and test datasets, and submitting the segmentation results.  
+
We have developed an open source tool for the evaluation of 3D segmentation algorithms combining a variety of segmentation comparison methods with respect to the performance of human expert raters. This tool was employed during the workshop on  "3D Segmentation in the Clinic - A Grand Challenge", on October 26, 2007 held in conjunction with MICCAI 2007 and continues to be used in workshop attached websites on caudate segmentation (cause07.org) and liver segmentation (sliver07.org). On these webpages, you can browse the results of various systems, and read the respective papers and descriptions about the systems. Anybody can join the competition by registering a team, downloading the training and test datasets, and submitting the segmentation results. The MICCAI 2007 workshop was organized in collaboration with Tobias Heimann (German Cancer Research Center, Liver Segmentation) and Bram van Ginneken (University of Utrecht, general organization & webpage development). There were close to 70 participants at the workshop with an overwhelmingly positive feedback.
  
The MICCAI 2007 workshop was organized in collaboration with Tobias Heimann (German Cancer Research Center, Liver Segmentation) and Bram van Ginneken (University of Utrecht, general organization & webpage development). There were close to 70 participants at the workshop with an overwhelmingly positive feedback. We plan to organize such evaluation workshops yearly with changing clinical application focus. This year, we will organize a brain lesion segmentation workshop (also in light of the MIND DBP 2 application).
+
A version adapted for lesion segmentation (light of the MIND DBP 2 application) was developed for the 2008 MICCAI workshop with special focus on lesion detection metrics. The workshop consisted on 3 challenges: Multiple Sclerosis lesion segmentation, Liver tumor segmentation and artery central lumen line extraction. Next to our team, the workshop was co-organized with the Children Hospital of Boston, Siemens Medical Systems and Erasmus University (Rotterdam, Netherlands). As in the previous year, the workshop was a full success and with over 70 participants MICCAI's largest workshop this year. The MS lesion segmentation is continued online.
  
 
= Key Investigators =
 
= Key Investigators =
Line 22: Line 22:
 
= Links =
 
= Links =
 
* [http://mbi.dkfz-heidelberg.de/grand-challenge2007 MICCAI 2007 workshop "3D Segmentation in the Clinic - A Grand Challenge"]
 
* [http://mbi.dkfz-heidelberg.de/grand-challenge2007 MICCAI 2007 workshop "3D Segmentation in the Clinic - A Grand Challenge"]
** [http://www.miccai2007.org/workshops/ General MICCAI 2007 workshop page ]
+
** [http://cause07.org/ Caudate Segmentation Evaluation (2007)]
* [http://cause07.org/ Caudate Segmentation Evaluation (2007)]
+
** [http://sliver07.org Segmentation of the Liver (2007)]
* [http://sliver07.org Segmentation of the Liver (2007)]
+
** [http://mbi.dkfz-heidelberg.de/grand-challenge2007/download/eval-src3.tar.gz Open source segmentation comparison tool]
* [http://mbi.dkfz-heidelberg.de/grand-challenge2007/download/eval-src3.tar.gz Open source segmentation comparison tool]
+
* [http://grand-challenge2008.bigr.nl  MICCAI 2008 workshop "3D Segmentation in the Clinic II - A Grand Challenge"
 +
** [http://www.ia.unc.edu/MSseg MS lesion segmentation]
 +
 
  
 
[[Category: Shape Analysis]] [[Category: Segmentation]]
 
[[Category: Shape Analysis]] [[Category: Segmentation]]

Revision as of 20:14, 29 October 2008

Home < Projects:MethodEvaluationValidation
Back to UNC Algorithms

Evaluation and Comparison of Medical Image Analysis Methods

In this project, we want to focus on the evaluation of medical image analysis methods for specific clinical applications in respect to development of evaluation methodology and the organization of venues promoting such comparison and validation studies.

Description

Cause07Competition.gif

We have developed an open source tool for the evaluation of 3D segmentation algorithms combining a variety of segmentation comparison methods with respect to the performance of human expert raters. This tool was employed during the workshop on "3D Segmentation in the Clinic - A Grand Challenge", on October 26, 2007 held in conjunction with MICCAI 2007 and continues to be used in workshop attached websites on caudate segmentation (cause07.org) and liver segmentation (sliver07.org). On these webpages, you can browse the results of various systems, and read the respective papers and descriptions about the systems. Anybody can join the competition by registering a team, downloading the training and test datasets, and submitting the segmentation results. The MICCAI 2007 workshop was organized in collaboration with Tobias Heimann (German Cancer Research Center, Liver Segmentation) and Bram van Ginneken (University of Utrecht, general organization & webpage development). There were close to 70 participants at the workshop with an overwhelmingly positive feedback.

A version adapted for lesion segmentation (light of the MIND DBP 2 application) was developed for the 2008 MICCAI workshop with special focus on lesion detection metrics. The workshop consisted on 3 challenges: Multiple Sclerosis lesion segmentation, Liver tumor segmentation and artery central lumen line extraction. Next to our team, the workshop was co-organized with the Children Hospital of Boston, Siemens Medical Systems and Erasmus University (Rotterdam, Netherlands). As in the previous year, the workshop was a full success and with over 70 participants MICCAI's largest workshop this year. The MS lesion segmentation is continued online.

Key Investigators

  • UNC Algorithms: Martin Styner

Publications

In Print

Links