ITK Registration Optimization/Testing And Backward Forward Compatibility - Revision history

Ibanez: /* Issues to Probe Further */

2007-07-31T11:54:39Z

Issues to Probe Further

Ibanez: /* Issues to Probe Further */

2007-07-31T02:07:53Z

Issues to Probe Further

Ibanez: /* Issues to Probe Further */

2007-07-31T00:18:14Z

Issues to Probe Further

Ibanez: /* Issues to Probe Further */

2007-07-31T00:17:55Z

Issues to Probe Further

Ibanez at 00:17, 31 July 2007

2007-07-31T00:17:30Z

Ibanez: /* Testing */

2007-07-30T23:54:25Z

Testing

Ibanez: /* Testing */

2007-07-30T23:44:06Z

Testing

Ibanez at 23:43, 30 July 2007

2007-07-30T23:43:02Z

Ibanez at 23:36, 30 July 2007

2007-07-30T23:36:02Z

New page

Backward Forward Compatibility

This page describes the testing framework used for verifying the backward/forward compatibility of the optimized classes developed in this project with the standard classes currently in ITK.

== Compatibility ==

;Backward Compatibility: A modified class is backward compatible with a given version "V", when applications that used the version "V" of the class, can adopt the new modified version of the class without having to change their source code to compile it, and by arriving to identical results when using the class at run-time.

;Forward Compatibility: A modified class is forward compatible,

@@ Line 68: / Line 68: @@
 == Issues to Probe Further ==
+* [http://public.kitware.com/dashboard.php?name=BWHITKOptimization Dashboard]
 * MattesMutualInformation + Translation + NearestNeighbors fails to register in both 000 and 111, this seems to indicate a problem in the computation of derivatives when a nearest neighbor interpolator is used
 * Disimilar convergence rates: In the combination of MeanSquares + Affine + Linear, the metric values per iteration of the optimizer converge about half speed in the 111 versus the 000 test. This seems to indicate a problem in the computation of derivatives. GNUplots of convergence rates have been added to the nightly tests. These plots should probably be converted to BatchMake plots.

← Older revision		Revision as of 02:07, 31 July 2007
Line 72:		Line 72:
	* Disimilar convergence rates: In the combination of MeanSquares + Affine + Linear, the metric values per iteration of the optimizer converge about half speed in the 111 versus the 000 test. This seems to indicate a problem in the computation of derivatives. GNUplots of convergence rates have been added to the nightly tests. These plots should probably be converted to BatchMake plots.		* Disimilar convergence rates: In the combination of MeanSquares + Affine + Linear, the metric values per iteration of the optimizer converge about half speed in the 111 versus the 000 test. This seems to indicate a problem in the computation of derivatives. GNUplots of convergence rates have been added to the nightly tests. These plots should probably be converted to BatchMake plots.
	* Butterfly effect: slight variation of a parameter changes the result of a registration: MeanSquares + Affine + BSpline interpolator, using a Step length of 1.0 the optimizer gets stuck in a point in the parametric space. See cvs log of [http://public.kitware.com/cgi-bin/viewcvs.cgi/Code/Tests/itkOptimized/CMakeLists.txt?root=BWHITKOptimization&r1=1.56&r2=1.57 Code/Testing/itkOptimized/CMakeLists.txt version 1.57]		* Butterfly effect: slight variation of a parameter changes the result of a registration: MeanSquares + Affine + BSpline interpolator, using a Step length of 1.0 the optimizer gets stuck in a point in the parametric space. See cvs log of [http://public.kitware.com/cgi-bin/viewcvs.cgi/Code/Tests/itkOptimized/CMakeLists.txt?root=BWHITKOptimization&r1=1.56&r2=1.57 Code/Testing/itkOptimized/CMakeLists.txt version 1.57]
		+	* Mutual Information metric 000 & 111 require a different number of samples. Is that an unfair comparison ?, knowing that computation time is a function of the number of samples.
		+	* LBFGSB Optimizer doesn't have the MaximizeOn() MinimizeOn() methods int is API. It minimizes by default. Therefore it can't be used for MutualInformation metric, since this metric must be Maximized.
		+	* LBFGS Optimizer doesn't have the methods GetValue(), GetDerivative(), GetCurrentIteration(),therefore it can not be used from the standard observer of the optimizer.
		+	* MutualInformation metric "could" have a method for negating the output, so that it could be use by minimizing optimizers.

@@ Line 71: / Line 71: @@
 * MattesMutualInformation + Translation + NearestNeighbors fails to register in both 000 and 111, this seems to indicate a problem in the computation of derivatives when a nearest neighbor interpolator is used
 * Disimilar convergence rates: In the combination of MeanSquares + Affine + Linear, the metric values per iteration of the optimizer converge about half speed in the 111 versus the 000 test. This seems to indicate a problem in the computation of derivatives. GNUplots of convergence rates have been added to the nightly tests. These plots should probably be converted to BatchMake plots.
-* Butterfly effect: slight variation of a parameter changes the result of a registration: MeanSquares + Affine + BSpline interpolator, using a Step length of 1.0 the optimizer gets stuck in a point in the parametric space. See cvs log of  [http://public.kitware.com/cgi-bin/viewcvs.cgi/Code/Tests/itkOptimized/CMakeLists.txt?root=BWHITKOptimization&r1=1.56&r2=1.57 | Code/Testing/itkOptimized/CMakeLists.txt version 1.57]
+* Butterfly effect: slight variation of a parameter changes the result of a registration: MeanSquares + Affine + BSpline interpolator, using a Step length of 1.0 the optimizer gets stuck in a point in the parametric space. See cvs log of  [http://public.kitware.com/cgi-bin/viewcvs.cgi/Code/Tests/itkOptimized/CMakeLists.txt?root=BWHITKOptimization&r1=1.56&r2=1.57 Code/Testing/itkOptimized/CMakeLists.txt version 1.57]

@@ Line 71: / Line 71: @@
 * MattesMutualInformation + Translation + NearestNeighbors fails to register in both 000 and 111, this seems to indicate a problem in the computation of derivatives when a nearest neighbor interpolator is used
 * Disimilar convergence rates: In the combination of MeanSquares + Affine + Linear, the metric values per iteration of the optimizer converge about half speed in the 111 versus the 000 test. This seems to indicate a problem in the computation of derivatives. GNUplots of convergence rates have been added to the nightly tests. These plots should probably be converted to BatchMake plots.
-* Butterfly effect: slight variation of a parameter changes the result of a registration: MeanSquares + Affine + BSpline interpolator, using a Step length of 1.0 the optimizer gets stuck in a point in the parametric space. See cvs log of Code/Testing/itkOptimized/CMakeLists.txt version 1.57 [http://public.kitware.com/cgi-bin/viewcvs.cgi/Code/Tests/itkOptimized/CMakeLists.txt?root=BWHITKOptimization&r1=1.56&r2=1.57]
+* Butterfly effect: slight variation of a parameter changes the result of a registration: MeanSquares + Affine + BSpline interpolator, using a Step length of 1.0 the optimizer gets stuck in a point in the parametric space. See cvs log of  [http://public.kitware.com/cgi-bin/viewcvs.cgi/Code/Tests/itkOptimized/CMakeLists.txt?root=BWHITKOptimization&r1=1.56&r2=1.57 | Code/Testing/itkOptimized/CMakeLists.txt version 1.57]

← Older revision		Revision as of 00:17, 31 July 2007
Line 66:		Line 66:
	\| BSplineDeformable \|\| LBFGSB \|\| RegularStepGradientDescent \|\| LBFGSB		\| BSplineDeformable \|\| LBFGSB \|\| RegularStepGradientDescent \|\| LBFGSB
	\|}		\|}
		+
		+	== Issues to Probe Further ==
		+
		+	* MattesMutualInformation + Translation + NearestNeighbors fails to register in both 000 and 111, this seems to indicate a problem in the computation of derivatives when a nearest neighbor interpolator is used
		+	* Disimilar convergence rates: In the combination of MeanSquares + Affine + Linear, the metric values per iteration of the optimizer converge about half speed in the 111 versus the 000 test. This seems to indicate a problem in the computation of derivatives. GNUplots of convergence rates have been added to the nightly tests. These plots should probably be converted to BatchMake plots.
		+	* Butterfly effect: slight variation of a parameter changes the result of a registration: MeanSquares + Affine + BSpline interpolator, using a Step length of 1.0 the optimizer gets stuck in a point in the parametric space. See cvs log of Code/Testing/itkOptimized/CMakeLists.txt version 1.57 [http://public.kitware.com/cgi-bin/viewcvs.cgi/Code/Tests/itkOptimized/CMakeLists.txt?root=BWHITKOptimization&r1=1.56&r2=1.57]

← Older revision		Revision as of 23:54, 30 July 2007
Line 30:		Line 30:

	These component were mixed in their optimized and non-optimized (standard) versions, in order to create regression tests comparing the result of the non-optimized versions with the results of the optimized versions.		These component were mixed in their optimized and non-optimized (standard) versions, in order to create regression tests comparing the result of the non-optimized versions with the results of the optimized versions.
		+
		+	Since this is a combinatorial problem, the source code of the tests was generated using CMake macros, that combines the components in different ways and prepares their corresponding initializations.
		+
		+	The choice of optimizers was '''mostly''' driven by the Transform, according to the following table:
		+
		+	{\| border="1"
		+	\|- bgcolor="#abcdef"
		+	! Transform !! Optimizer
		+	\|-
		+	\| Translation \|\| RegularStepGradientDescent
		+	\|-
		+	\| Rigid2D \|\| RegularStepGradientDescent
		+	\|-
		+	\| Rigid3D \|\| VersorRigid3DTransform
		+	\|-
		+	\| Affine \|\| RegularStepGradientDescent
		+	\|-
		+	\| BSplineDeformable \|\| LBFGSB
		+	\|}
		+
		+	However, inconsistencies in the '''current''' API of some metrics and some optimizers induced the following variations
		+
		+	{\| border="1"
		+	\|- bgcolor="#abcdef"
		+	! !! MeanSquares !! MutualInformation !! MattesMutualInformation
		+	\|-
		+	\| Translation \|\| RegularStepGradientDescent \|\| RegularStepGradientDescent \|\| RegularStepGradientDescent
		+	\|-
		+	\| Rigid2D \|\| RegularStepGradientDescent \|\| RegularStepGradientDescent \|\| RegularStepGradientDescent
		+	\|-
		+	\| Rigid3D \|\| VersorRigid3DTransform \|\| VersorRigid3DTransform \|\| VersorRigid3DTransform
		+	\|-
		+	\| Affine \|\| RegularStepGradientDescent \|\| RegularStepGradientDescent \|\| RegularStepGradientDescent
		+	\|-
		+	\| BSplineDeformable \|\| LBFGSB \|\| RegularStepGradientDescent \|\| LBFGSB
		+	\|}

← Older revision		Revision as of 23:44, 30 July 2007
Line 28:		Line 28:
	** Linear		** Linear
	** BSpline		** BSpline
		+
		+	These component were mixed in their optimized and non-optimized (standard) versions, in order to create regression tests comparing the result of the non-optimized versions with the results of the optimized versions.

@@ Line 1: / Line 1: @@
-Backward Forward Compatibility
+'''Backward Forward Compatibility'''
 This page describes the testing framework used for verifying the backward/forward compatibility of the optimized classes developed in this project with the standard classes currently in ITK.
@@ Line 7: / Line 7: @@
 ;Backward Compatibility: A modified class is backward compatible with a given version "V", when applications that used the version "V" of the class, can adopt the new modified version of the class without having to change their source code to compile it, and by arriving to identical results when using the class at run-time.
-;Forward Compatibility: A modified class is forward compatible,
+;Forward Compatibility: A modified class is forward compatible with a given version "V", when interactions based on the old API of the class are safely translated to the new API of the class.