American Institute of Mathematical Sciences

Advanced
April  2014, 10(2): 567-590. doi: 10.3934/jimo.2014.10.567

Multimodal image registration by elastic matching of edge sketches via optimal control

Angel Angelov 1, and  Marcus Wagner 2,

1. 

Otto-Hahn-Str. 15, D-30880 Laatzen, Germany
2. 

University of Leipzig, Department of Mathematics, P. O. B. 10 09 20, D-04009 Leipzig

Received  December 2012 Revised  August 2013 Published  October 2013

For the problem of multimodal image registration, an optimal control approach is presented. The geometrical information of the images will be transformed into weighted edge sketches, for which a linear-elastic or hyperelastic registration will be performed. For the numerical solution of this problem, we provide a direct method based on discretization methods and large-scale optimization techniques. A comparison of a separated and a joint access for the generation of the edge sketches and the determination of the matching deformation is made. The quality of the results obtained with the optimal control method competes well with those generated by a standard variational method.
Keywords: hard constraints, linear-elastic and hyperelastic regularization, optimal control problem, Multimodal image registration, direct methods..
Mathematics Subject Classification: Primary: 49J20, 68U10, 74B05, 74B20; Secondary: 26B25, 49M3.
Citation: Angel Angelov, Marcus Wagner. Multimodal image registration by elastic matching of edge sketches via optimal control. Journal of Industrial and Management Optimization, 2014, 10 (2) : 567-590. doi: 10.3934/jimo.2014.10.567
References:
[1]

A. Angelov, Multimodale Bildregistrierung durch elastisches Matching von Kantenskizzen, Diploma thesis, University of Münster, 2011.

[2]

B. Bourdin, Image segmentation with a finite element method, M2AN Mathematical Modelling and Numerical Analysis, 33 (1999), 229-244. doi: 10.1051/m2an:1999114.

[3]

C. Brune, H. Maurer and M. Wagner, Detection of intensity and motion edges within optical flow via multidimensional control, SIAM J. Imaging Sci., 2 (2009), 1190-1210. doi: 10.1137/080725064.

[4]

M. Burger, J. Modersitzki and L. Ruthotto, A hyperelastic regularization energy for image registration, SIAM J. Sci. Comput., 35 (2013), B132-B148. doi: 10.1137/110835955.

[5]

C. Clason, B. Jin and K. Kunisch, A semismooth Newton method for $L^1$ data fitting with automatic choice of regularization parameters and noise calibration, SIAM J. Imaging Sci., 3 (2010), 199-231. doi: 10.1137/090758003.

[6]

B. Dacorogna, Direct Methods in the Calculus of Variations, Second edition, Applied Mathematical Sciences, 78, Springer, New York, 2008.

[7]

M. Droske and M. Rumpf, A variational approach to nonrigid morphological image registration, SIAM J. Appl. Math., 64 (2004), 668-687. doi: 10.1137/S0036139902419528.

[8]

M. Droske and M. Rumpf, Multiscale joint segmentation and registration of image morphology, IEEE Trans. Pattern Recognition Machine Intelligence, 29 (2007), 2181-2194.

[9]

L. C. Evans and R. F. Gariepy, Measure Theory and Fine Properties of Functions, Studies in Advanced Mathematics, CRC Press, Boca Raton, FL, 1992.

[10]

B. Fischer and J. Modersitzki, Curvature based image registration, J. Math. Imaging Vision, 18 (2003), 81-85. doi: 10.1023/A:1021897212261.

[11]

R. Fourer, D. M. Gay and B. W. Kernighan, AMPL. A Modeling Language for Mathematical Programming, Second edition, Brooks/Cole-Thomson Learning, Pacific Grove, 2003.

[12]

L. Franek, M. Franek, H. Maurer and M. Wagner, A discretization method for the numerical solution of Dieudonné-Rashevsky type problems with application to edge detection within noisy image data, Opt. Control Appl. Meth., 33 (2012), 276-301. doi: 10.1002/oca.996.

[13]

L. A. Gallardo and M. A. Meju, Characterization of heterogeneous near-surface materials by joint 2D inversion of dc resistivity and seismic data, Geophysical Research Letters, 30 (2003). doi: 10.1029/2003GL017370.

[14]

H. Goering, H.-G. Roos and L. Tobiska, Finite-Element-Methode, Third edition, Akademie Verag, Berlin, 1993.

[15]

E. Haber and J. Modersitzki, Intensity gradient based registration and fusion of multi-modal images, Methods of Information in Medicine, 46 (2007), 292-299.

[16]

J. Han, B. Berkels, M. Rumpf, J. Hornegger, M. Droske, M. Fried, J. Scorzin and C. Schaller, A variational framework for joint image registration, denoising and edge detection, in Bildverarbeitung für die Medizin 2006 (eds. H. Handels, J. Ehrhardt, A. Horsch, H.-P. Meinzer and T. Tolxdorff) Springer, Berlin, 2006, 246-250.

[17]

S. Henn and K. Witsch, Iterative multigrid regularization techniques for image matching, SIAM J. Sci. Comput., 23 (2001), 1077-1093.

[18]

G. Hermosillo, C. Chefd'hotel and O. Faugeras, Variational methods for multimodal image matching, Int. J. Computer Vision, 50 (2002), 329-343.

[19]

M. Hintermüller and S. L. Keeling, Image registration and segmentation based on energy minimization, in Handbook of Optimization in Medicine (eds. P. M. Pardalos and H. E. Romeijn) Springer, New York, 2009, 213-252.

[20]

B. Jansen, Interior Point Techniques in Optimization, Kluwer, Dordrecht, 1997.

[21]

C. Laird and A. Wächter, Introduction to IPOPT: A Tutorial for Downloading, Installing, and Using IPOPT, Revision No. 1830. Available from: https://www.coin-or.org/Ipopt/~ex-port/2158/stable/3.9/Ipopt/doc/documentation.pdf (accessed 15.12.2012).

[22]

J. Min, M. Powell and K. W. Bowyer, Automated performance evaluation of range image segmentation algorithms, IEEE Trans. Systems, Man, and Cybernetics, Part B, 34 (2004), 263-271.

[23]

J. Modersitzki, Numerical Methods for Image Registration, Oxford University Press, Oxford, 2004.

[24]

J. Modersitzki, FAIR. Flexible Algorithms for Image Registration, SIAM, Philadelphia, 2009.

[25]

R. W. Ogden, Nonlinear elasticity, anisotropy, material stability and residual stresses in soft tissue, in Biomechanics of Soft Tissue in Cardiovascular Systems (eds. G. A. Holzapfel and R. W. Ogden), Springer, Wien, 2003, 65-108.

[26]

K. N. Plataniotis and A. N. Venetsanopoulos, Color Image Processing and Applications, Springer, Berlin, 2000.

[27]

H. Richter, Wahrscheinlichkeitstheorie, Second edition, Die Grundlehren der Mathematischen Wissenschaften, Band 86, Springer, Berlin-Heidelberg-New York, 1966.

[28]

O. Scherzer, M. Grasmair, H. Grossauer, M. Haltmeier and F. Lenzen, Variational Methods in Imaging, Springer, New York, 2009.

[29]

A. Wächter and L. T. Biegler, On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Math. Program. Ser. A, 106 (2006), 25-57.

[30]

M. Wagner, Elastic image registration in presence of polyconvex constraints, Karl-Franzens-Universität Graz, SFB-Report No. 2010-033. To appear in Proceedings of the International Workshop on Optimal Control in Image Processing, Heidelberg, Germany, May 31-June 1, 2010.

[31]

M. Wagner, A direct method for the solution of an optimal control problem arising from image registration, Numerical Algebra, Control and Optimization, 2 (2012), 487-510.

[32]

B. Zitová and J. Flusser, Image registration methods: A survey, Image and Vision Computing, 21 (2003), 977-1000.

show all references

References:
[1]

A. Angelov, Multimodale Bildregistrierung durch elastisches Matching von Kantenskizzen, Diploma thesis, University of Münster, 2011.

[2]

B. Bourdin, Image segmentation with a finite element method, M2AN Mathematical Modelling and Numerical Analysis, 33 (1999), 229-244. doi: 10.1051/m2an:1999114.

[3]

C. Brune, H. Maurer and M. Wagner, Detection of intensity and motion edges within optical flow via multidimensional control, SIAM J. Imaging Sci., 2 (2009), 1190-1210. doi: 10.1137/080725064.

[4]

M. Burger, J. Modersitzki and L. Ruthotto, A hyperelastic regularization energy for image registration, SIAM J. Sci. Comput., 35 (2013), B132-B148. doi: 10.1137/110835955.

[5]

C. Clason, B. Jin and K. Kunisch, A semismooth Newton method for $L^1$ data fitting with automatic choice of regularization parameters and noise calibration, SIAM J. Imaging Sci., 3 (2010), 199-231. doi: 10.1137/090758003.

[6]

B. Dacorogna, Direct Methods in the Calculus of Variations, Second edition, Applied Mathematical Sciences, 78, Springer, New York, 2008.

[7]

M. Droske and M. Rumpf, A variational approach to nonrigid morphological image registration, SIAM J. Appl. Math., 64 (2004), 668-687. doi: 10.1137/S0036139902419528.

[8]

M. Droske and M. Rumpf, Multiscale joint segmentation and registration of image morphology, IEEE Trans. Pattern Recognition Machine Intelligence, 29 (2007), 2181-2194.

[9]

L. C. Evans and R. F. Gariepy, Measure Theory and Fine Properties of Functions, Studies in Advanced Mathematics, CRC Press, Boca Raton, FL, 1992.

[10]

B. Fischer and J. Modersitzki, Curvature based image registration, J. Math. Imaging Vision, 18 (2003), 81-85. doi: 10.1023/A:1021897212261.

[11]

R. Fourer, D. M. Gay and B. W. Kernighan, AMPL. A Modeling Language for Mathematical Programming, Second edition, Brooks/Cole-Thomson Learning, Pacific Grove, 2003.

[12]

L. Franek, M. Franek, H. Maurer and M. Wagner, A discretization method for the numerical solution of Dieudonné-Rashevsky type problems with application to edge detection within noisy image data, Opt. Control Appl. Meth., 33 (2012), 276-301. doi: 10.1002/oca.996.

[13]

L. A. Gallardo and M. A. Meju, Characterization of heterogeneous near-surface materials by joint 2D inversion of dc resistivity and seismic data, Geophysical Research Letters, 30 (2003). doi: 10.1029/2003GL017370.

[14]

H. Goering, H.-G. Roos and L. Tobiska, Finite-Element-Methode, Third edition, Akademie Verag, Berlin, 1993.

[15]

E. Haber and J. Modersitzki, Intensity gradient based registration and fusion of multi-modal images, Methods of Information in Medicine, 46 (2007), 292-299.

[16]

J. Han, B. Berkels, M. Rumpf, J. Hornegger, M. Droske, M. Fried, J. Scorzin and C. Schaller, A variational framework for joint image registration, denoising and edge detection, in Bildverarbeitung für die Medizin 2006 (eds. H. Handels, J. Ehrhardt, A. Horsch, H.-P. Meinzer and T. Tolxdorff) Springer, Berlin, 2006, 246-250.

[17]

S. Henn and K. Witsch, Iterative multigrid regularization techniques for image matching, SIAM J. Sci. Comput., 23 (2001), 1077-1093.

[18]

G. Hermosillo, C. Chefd'hotel and O. Faugeras, Variational methods for multimodal image matching, Int. J. Computer Vision, 50 (2002), 329-343.

[19]

M. Hintermüller and S. L. Keeling, Image registration and segmentation based on energy minimization, in Handbook of Optimization in Medicine (eds. P. M. Pardalos and H. E. Romeijn) Springer, New York, 2009, 213-252.

[20]

B. Jansen, Interior Point Techniques in Optimization, Kluwer, Dordrecht, 1997.

[21]

C. Laird and A. Wächter, Introduction to IPOPT: A Tutorial for Downloading, Installing, and Using IPOPT, Revision No. 1830. Available from: https://www.coin-or.org/Ipopt/~ex-port/2158/stable/3.9/Ipopt/doc/documentation.pdf (accessed 15.12.2012).

[22]

J. Min, M. Powell and K. W. Bowyer, Automated performance evaluation of range image segmentation algorithms, IEEE Trans. Systems, Man, and Cybernetics, Part B, 34 (2004), 263-271.

[23]

J. Modersitzki, Numerical Methods for Image Registration, Oxford University Press, Oxford, 2004.

[24]

J. Modersitzki, FAIR. Flexible Algorithms for Image Registration, SIAM, Philadelphia, 2009.

[25]

R. W. Ogden, Nonlinear elasticity, anisotropy, material stability and residual stresses in soft tissue, in Biomechanics of Soft Tissue in Cardiovascular Systems (eds. G. A. Holzapfel and R. W. Ogden), Springer, Wien, 2003, 65-108.

[26]

K. N. Plataniotis and A. N. Venetsanopoulos, Color Image Processing and Applications, Springer, Berlin, 2000.

[27]

H. Richter, Wahrscheinlichkeitstheorie, Second edition, Die Grundlehren der Mathematischen Wissenschaften, Band 86, Springer, Berlin-Heidelberg-New York, 1966.

[28]

O. Scherzer, M. Grasmair, H. Grossauer, M. Haltmeier and F. Lenzen, Variational Methods in Imaging, Springer, New York, 2009.

[29]

A. Wächter and L. T. Biegler, On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming, Math. Program. Ser. A, 106 (2006), 25-57.

[30]

M. Wagner, Elastic image registration in presence of polyconvex constraints, Karl-Franzens-Universität Graz, SFB-Report No. 2010-033. To appear in Proceedings of the International Workshop on Optimal Control in Image Processing, Heidelberg, Germany, May 31-June 1, 2010.

[31]

M. Wagner, A direct method for the solution of an optimal control problem arising from image registration, Numerical Algebra, Control and Optimization, 2 (2012), 487-510.

[32]

B. Zitová and J. Flusser, Image registration methods: A survey, Image and Vision Computing, 21 (2003), 977-1000.

[1]

Marcus Wagner. A direct method for the solution of an optimal control problem arising from image registration. Numerical Algebra, Control and Optimization, 2012, 2 (3) : 487-510. doi: 10.3934/naco.2012.2.487
[2]

Xiangtuan Xiong, Jinmei Li, Jin Wen. Some novel linear regularization methods for a deblurring problem. Inverse Problems and Imaging, 2017, 11 (2) : 403-426. doi: 10.3934/ipi.2017019
[3]

Mohamed Aliane, Mohand Bentobache, Nacima Moussouni, Philippe Marthon. Direct method to solve linear-quadratic optimal control problems. Numerical Algebra, Control and Optimization, 2021, 11 (4) : 645-663. doi: 10.3934/naco.2021002
[4]

Lican Kang, Yanming Lai, Yanyan Liu, Yuan Luo, Jing Zhang. High-dimensional linear regression with hard thresholding regularization: Theory and algorithm. Journal of Industrial and Management Optimization, 2022  doi: 10.3934/jimo.2022034
[5]

Yangang Chen, Justin W. L. Wan. Numerical method for image registration model based on optimal mass transport. Inverse Problems and Imaging, 2018, 12 (2) : 401-432. doi: 10.3934/ipi.2018018
[6]

Huan Han. A variational model with fractional-order regularization term arising in registration of diffusion tensor image. Inverse Problems and Imaging, 2018, 12 (6) : 1263-1291. doi: 10.3934/ipi.2018053
[7]

Dana Paquin, Doron Levy, Eduard Schreibmann, Lei Xing. Multiscale Image Registration. Mathematical Biosciences & Engineering, 2006, 3 (2) : 389-418. doi: 10.3934/mbe.2006.3.389
[8]

Z. Foroozandeh, Maria do rosário de Pinho, M. Shamsi. On numerical methods for singular optimal control problems: An application to an AUV problem. Discrete and Continuous Dynamical Systems - B, 2019, 24 (5) : 2219-2235. doi: 10.3934/dcdsb.2019092
[9]

Frank Pörner, Daniel Wachsmuth. Tikhonov regularization of optimal control problems governed by semi-linear partial differential equations. Mathematical Control and Related Fields, 2018, 8 (1) : 315-335. doi: 10.3934/mcrf.2018013
[10]

Bartomeu Coll, Joan Duran, Catalina Sbert. Half-linear regularization for nonconvex image restoration models. Inverse Problems and Imaging, 2015, 9 (2) : 337-370. doi: 10.3934/ipi.2015.9.337
[11]

Zhao Yi, Justin W. L. Wan. An inviscid model for nonrigid image registration. Inverse Problems and Imaging, 2011, 5 (1) : 263-284. doi: 10.3934/ipi.2011.5.263
[12]

Piermarco Cannarsa, Hélène Frankowska, Elsa M. Marchini. On Bolza optimal control problems with constraints. Discrete and Continuous Dynamical Systems - B, 2009, 11 (3) : 629-653. doi: 10.3934/dcdsb.2009.11.629
[13]

Alina Toma, Bruno Sixou, Françoise Peyrin. Iterative choice of the optimal regularization parameter in TV image restoration. Inverse Problems and Imaging, 2015, 9 (4) : 1171-1191. doi: 10.3934/ipi.2015.9.1171
[14]

Xilu Wang, Xiaoliang Cheng. Continuous dependence and optimal control of a dynamic elastic-viscoplastic contact problem with non-monotone boundary conditions. Evolution Equations and Control Theory, 2022  doi: 10.3934/eect.2021064
[15]

Jia Cai, Guanglong Xu, Zhensheng Hu. Sketch-based image retrieval via CAT loss with elastic net regularization. Mathematical Foundations of Computing, 2020, 3 (4) : 219-227. doi: 10.3934/mfc.2020013
[16]

Xiaojun Zheng, Zhongdan Huan, Jun Liu. On the solvability of a semilinear higher-order elliptic problem for the vector field method in image registration. Communications on Pure and Applied Analysis, , () : -. doi: 10.3934/cpaa.2022068
[17]

Changjun Yu, Shuxuan Su, Yanqin Bai. On the optimal control problems with characteristic time control constraints. Journal of Industrial and Management Optimization, 2022, 18 (2) : 1305-1320. doi: 10.3934/jimo.2021021
[18]

Jiongmin Yong. A deterministic linear quadratic time-inconsistent optimal control problem. Mathematical Control and Related Fields, 2011, 1 (1) : 83-118. doi: 10.3934/mcrf.2011.1.83
[19]

Peter I. Kogut. On approximation of an optimal boundary control problem for linear elliptic equation with unbounded coefficients. Discrete and Continuous Dynamical Systems, 2014, 34 (5) : 2105-2133. doi: 10.3934/dcds.2014.34.2105
[20]

Zhen-Zhen Tao, Bing Sun. Space-time spectral methods for a fourth-order parabolic optimal control problem in three control constraint cases. Discrete and Continuous Dynamical Systems - B, 2022  doi: 10.3934/dcdsb.2022080

2020 Impact Factor: 1.801

Tools

Metrics

  • PDF downloads (60)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy