American Institute of Mathematical Sciences

Advanced
  • Previous Article
    Semi-automatic segmentation of NATURA 2000 habitats in Sentinel-2 satellite images by evolving open curves
  • DCDS-S Home
  • This Issue
  • Next Article
    Sharp consistency estimates for a pressure-Poisson problem with Stokes boundary value problems
March  2021, 14(3): 1017-1032. doi: 10.3934/dcdss.2020348

An automated segmentation of NATURA 2000 habitats from Sentinel-2 optical data

Karol Mikula 1,, , Jozef Urbán 1, , Michal Kollár 1, , Martin Ambroz 1, , Ivan Jarolímek 2, , Jozef Šibík 2, and  Mária Šibíková 2,

1. 

Department of Mathematics, Slovak University of Technology, Radlinského 11,810 05 Bratislava, Slovakia, Algoritmy:SK, s.r.o., Šulekova 6,811 06 Bratislava, Slovakia
2. 

Institute of Botany, Slovak Academy of Sciences, Dúbravská cesta 9,845 23 Bratislava, Slovakia

* Corresponding author

Received  December 2018 Revised  November 2019 Published  March 2021 Early access  May 2020

Fund Project: This work was supported by projects APVV-16-0431, APVV-15-0522, VEGA 1/0608/15 and ESA Contract No. 4000122575/17/NL/SC

In this paper, we present a mathematical model and numerical method designed for the segmentation of satellite images, namely to obtain in an automated way borders of Natura 2000 habitats from Sentinel-2 optical data. The segmentation model is based on the evolving closed plane curve approach in the Lagrangian formulation including the efficient treatment of topological changes. The model contains the term expanding the curve in its outer normal direction up to the region of habitat boundary edges, the term attracting the curve accurately to the edges and the smoothing term given by the influence of local curvature. For the numerical solution, we use the flowing finite volume method discretizing the arising advection-diffusion intrinsic partial differential equation including the asymptotically uniform tangential redistribution of curve grid points. We present segmentation results for satellite data from a selected area of Western Slovakia (Záhorie) where the so-called riparian forests represent the important European Natura 2000 habitat. The automatic segmentation results are compared with the semi-automatic segmentation performed by the botany expert and with the GPS tracks obtained in the field. The comparisons show the ability of our numerical model to segment the habitat areas with the accuracy comparable to the pixel resolution of the Sentinel-2 optical data.

Keywords: Image segmentation, curve evolution, numerical method, Natura 2000, satellite images, Sentinel-2.
Mathematics Subject Classification: Primary: 35R01, 65M08; Secondary: 35R37, 92F05.
Citation: Karol Mikula, Jozef Urbán, Michal Kollár, Martin Ambroz, Ivan Jarolímek, Jozef Šibík, Mária Šibíková. An automated segmentation of NATURA 2000 habitats from Sentinel-2 optical data. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 1017-1032. doi: 10.3934/dcdss.2020348
References:
[1]

M. Ambroz, M. Balažovjech, M. Medla and K. Mikula, Numerical modeling of wildland surface fire propagation by evolving surface curves, Adv. Comput. Math., 45 (2019), 1067-1103.  doi: 10.1007/s10444-018-9650-4.

[2]

M. Balažovjech, K. Mikula, M. Petrášová and J. Urbán, Lagrangean method with topological changes for numerical modelling of forest fire propagation, 19th Conference on Scientific Computing, Slovakia, 2012.

[3]

V. Caselles, R. Kimmel and G. Sapiro, Geodesic active contours, Internat. J. Comput. Vision, 22 (1997), 61-79.  doi: 10.1109/ICCV.1995.466871.

[4]

E. Faure et al., A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage, Nat. Commun., 7 (2016). doi: 10.1038/ncomms9674.

[5]

M.A. Finney, et al., FARSITE: Fire Area Simulator–model development and evaluation, U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station, Ogden, UT, 1998. doi: 10.2737/RMRS-RP-4.

[6]

T.Y. Hou, J. Lowengrub and M. Shelley, Removing the stiffness from interfacial flows with surface tension, J. Comput. Phys., 114 (1994), 312-338.  doi: 10.1006/jcph.1994.1170.

[7]

S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum and A. Yezzi, Conformal curvature flows: From phase transitions to active vision, Arch. Rational Mech. Anal., 134 (1996), 275-301.  doi: 10.1007/BF00379537.

[8]

M. Kimura, Numerical analysis for moving boundary problems using the boundary tracking method, Japan J. Indust. Appl. Math., 14 (1997), 373-398.  doi: 10.1007/BF03167390.

[9]

K. Mikula and M. Ohlberger, Inflow-implicit/outflow-explicit scheme for solving advection equations, in Finite Volumes for Complex Applications VI. Problems & Perspectives. Volume 1, 2, Springer Proc. Math., 4, Springer, Heidelberg, 2011,683–691. doi: 10.1007/978-3-642-20671-9_72.

[10]

K. Mikula, M. Ohlberger and J. Urbán, Inflow-implicit/outflow-explicit finite volume methods for solving advection equations, Appl. Numer. Math., 85 (2014), 16-37.  doi: 10.1016/j.apnum.2014.06.002.

[11]

K. Mikula and D. Ševčovič, Evolution of plane curves driven by a nonlinear function of curvature and anisotropy, SIAM J. Appl. Math., 61 (2001), 1473-1501.  doi: 10.1137/S0036139999359288.

[12]

K. Mikula and D. Ševčovič, A direct method for solving an anisotropic mean curvature flow of plane curves with an external force, Math. Methods Appl. Sci., 27 (2004), 1545-1565.  doi: 10.1002/mma.514.

[13]

K. Mikula, D. Ševčovič and M. Balažovjech, A simple, fast and stabilized flowing finite volume method for solving general curve evolution equations, Commun. Comput. Phys., 7 (2010), 195-211.  doi: 10.4208/cicp.2009.08.169.

[14]

K. Mikula and J. Urbán, New fast and stable Lagrangean method for image segmentation, 5th International Congress on Image and Signal Processing, Chongqing, China, 2012. doi: 10.1109/CISP.2012.6469852.

[15]

K. Mikula, et al., Report on semi-automatic segmentation methods and software tool for static data, ESA PECS project NaturaSat Deliverable 2.1, 2018.

[16]

G. Nakamura and R. Potthast, Inverse Modeling, IOP Expanding Physics, IOP Publishing, Bristol, 2015, 2053–2563. doi: 10.1088/978-0-7503-1218-9.

[17]

P. Pauš, M. Beneš, Algorithm for topological changes of parametrically described curves, Proceedings of ALGORITMY, 2009,176–184.

[18]

A. Sarti, R. Malladi and J. A. Sethian:, Subjective surfaces: A method for completing missing boundaries, Proc. Natl. Acad. Sci. USA, 97 (2000), 6258-6263.  doi: 10.1073/pnas.110135797.

show all references

References:
[1]

M. Ambroz, M. Balažovjech, M. Medla and K. Mikula, Numerical modeling of wildland surface fire propagation by evolving surface curves, Adv. Comput. Math., 45 (2019), 1067-1103.  doi: 10.1007/s10444-018-9650-4.

[2]

M. Balažovjech, K. Mikula, M. Petrášová and J. Urbán, Lagrangean method with topological changes for numerical modelling of forest fire propagation, 19th Conference on Scientific Computing, Slovakia, 2012.

[3]

V. Caselles, R. Kimmel and G. Sapiro, Geodesic active contours, Internat. J. Comput. Vision, 22 (1997), 61-79.  doi: 10.1109/ICCV.1995.466871.

[4]

E. Faure et al., A workflow to process 3D+time microscopy images of developing organisms and reconstruct their cell lineage, Nat. Commun., 7 (2016). doi: 10.1038/ncomms9674.

[5]

M.A. Finney, et al., FARSITE: Fire Area Simulator–model development and evaluation, U.S. Department of Agriculture, Forest Service, Rocky Mountain Research Station, Ogden, UT, 1998. doi: 10.2737/RMRS-RP-4.

[6]

T.Y. Hou, J. Lowengrub and M. Shelley, Removing the stiffness from interfacial flows with surface tension, J. Comput. Phys., 114 (1994), 312-338.  doi: 10.1006/jcph.1994.1170.

[7]

S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum and A. Yezzi, Conformal curvature flows: From phase transitions to active vision, Arch. Rational Mech. Anal., 134 (1996), 275-301.  doi: 10.1007/BF00379537.

[8]

M. Kimura, Numerical analysis for moving boundary problems using the boundary tracking method, Japan J. Indust. Appl. Math., 14 (1997), 373-398.  doi: 10.1007/BF03167390.

[9]

K. Mikula and M. Ohlberger, Inflow-implicit/outflow-explicit scheme for solving advection equations, in Finite Volumes for Complex Applications VI. Problems & Perspectives. Volume 1, 2, Springer Proc. Math., 4, Springer, Heidelberg, 2011,683–691. doi: 10.1007/978-3-642-20671-9_72.

[10]

K. Mikula, M. Ohlberger and J. Urbán, Inflow-implicit/outflow-explicit finite volume methods for solving advection equations, Appl. Numer. Math., 85 (2014), 16-37.  doi: 10.1016/j.apnum.2014.06.002.

[11]

K. Mikula and D. Ševčovič, Evolution of plane curves driven by a nonlinear function of curvature and anisotropy, SIAM J. Appl. Math., 61 (2001), 1473-1501.  doi: 10.1137/S0036139999359288.

[12]

K. Mikula and D. Ševčovič, A direct method for solving an anisotropic mean curvature flow of plane curves with an external force, Math. Methods Appl. Sci., 27 (2004), 1545-1565.  doi: 10.1002/mma.514.

[13]

K. Mikula, D. Ševčovič and M. Balažovjech, A simple, fast and stabilized flowing finite volume method for solving general curve evolution equations, Commun. Comput. Phys., 7 (2010), 195-211.  doi: 10.4208/cicp.2009.08.169.

[14]

K. Mikula and J. Urbán, New fast and stable Lagrangean method for image segmentation, 5th International Congress on Image and Signal Processing, Chongqing, China, 2012. doi: 10.1109/CISP.2012.6469852.

[15]

K. Mikula, et al., Report on semi-automatic segmentation methods and software tool for static data, ESA PECS project NaturaSat Deliverable 2.1, 2018.

[16]

G. Nakamura and R. Potthast, Inverse Modeling, IOP Expanding Physics, IOP Publishing, Bristol, 2015, 2053–2563. doi: 10.1088/978-0-7503-1218-9.

[17]

P. Pauš, M. Beneš, Algorithm for topological changes of parametrically described curves, Proceedings of ALGORITMY, 2009,176–184.

[18]

A. Sarti, R. Malladi and J. A. Sethian:, Subjective surfaces: A method for completing missing boundaries, Proc. Natl. Acad. Sci. USA, 97 (2000), 6258-6263.  doi: 10.1073/pnas.110135797.

Figure 1.  First row: the original image $ I^0 $ and smoothed image $ I^{\sigma_0} $. Second row: the visualization of $ g(\mathbf{x}) $, smoothed edge detector $ g_1(\mathbf{x}) $ and a zoom of the vector field $ -\nabla g_1(\mathbf{x}) $ where we see arrows pointing towards the edges in $ I^0 $. Third row: the functions $ H(\mathbf{x}) $ using (5) and $ g_2(\mathbf{x} ) $ evaluated by using the initial circle plotted in the Fourth row, left. Fourth row: the initial segmentation curve placed in $ I^0 $ and its time evolution until the final segmentation state (bottom right). In the middle image we see that the evolving curve undergoes topological changes which are resolved efficiently
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 2.  Closed planar curve discretization (left) corresponding to the uniform discretization of the unit circle (right)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 3.  Visualization of the curve discretization: curve grid points (red) and their midpoints. Finite volumes $ \mathbf{p}_{i-1}, \mathbf{p}_i, $ and $ \mathbf{p}_{i+1} $ are highlighted by green, brown and yellow color. Note that $ \mathbf{p}_i $ is not a straight line given by $ \mathbf{x}_{i-\frac{1}2} $ and $ \mathbf{x}_{i+\frac{1}2} $, but a broken line given by $ \mathbf{x}_{i-\frac{1}2} $, $ \mathbf{x}_{i} $ and $ \mathbf{x}_{i+\frac{1}2} $, see also [1]
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 4.  First row: the original image $ I^0 $ and smoothed image $ I^{\sigma_0} $. Second row: the visualization of the function $ g(\mathbf{x}) $ and smoothed edge detector $ g_1(\mathbf{x}) $. Third row: the function $ H(\mathbf{x}) $ and $ g_2(\mathbf{x}) $ evaluated by using the initial circle plotted in the Fourth row, left. Fourth row: the initial segmentation curve placed in $ I^0 $ (bottom left) and its time evolution (bottom middle) until the final segmentation state (bottom right) is reached
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 5.  First row: the original image $ I^0 $ and smoothed image $ I^{\sigma_0} $. Second row: the visualization of the function $ g(\mathbf{x}) $ and smoothed edge detector $ g_1(\mathbf{x}) $. Third row: the function $ H(\mathbf{x}) $ and $ g_2(\mathbf{x}) $ evaluated by using the initial circle plotted in the Fourth row, left. Fourth row: the initial segmentation curve placed in $ I^0 $ (bottom left) and its time evolution (bottom middle) until the final segmentation state (bottom right) is reached
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 6.  Left: the evolution of the segmentation curve from the initial circle to the final state. Right: the final automatic segmentation (red) together with the result of the semi-automatic segmentation (yellow) and the GPS track (light-blue)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 7.  Left: the evolution of the segmentation curve from the initial circle to the final state. Right: the final automatic segmentation (red) together with the result of the semi-automatic segmentation (yellow) and the GPS track (light-blue)
Figure Options

Download full-size image

Download as PowerPoint slide

Figure 8.  Left: the evolution of the segmentation curve from the initial circle to the final state. Right: the final automatic segmentation (red) together with the result of the semi-automatic segmentation (yellow) and the GPS track (light-blue)
Figure Options

Download full-size image

Download as PowerPoint slide

[1]

Karol Mikula, Jozef Urbán, Michal Kollár, Martin Ambroz, Ivan Jarolímek, Jozef Šibík, Mária Šibíková. Semi-automatic segmentation of NATURA 2000 habitats in Sentinel-2 satellite images by evolving open curves. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 1033-1046. doi: 10.3934/dcdss.2020231
[2]

Maika Goto, Kazunori Kuwana, Yasuhide Uegata, Shigetoshi Yazaki. A method how to determine parameters arising in a smoldering evolution equation by image segmentation for experiment's movies. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 881-891. doi: 10.3934/dcdss.2020233
[3]

Fan Jia, Xue-Cheng Tai, Jun Liu. Nonlocal regularized CNN for image segmentation. Inverse Problems and Imaging, 2020, 14 (5) : 891-911. doi: 10.3934/ipi.2020041
[4]

Yangang Chen, Justin W. L. Wan. Numerical method for image registration model based on optimal mass transport. Inverse Problems and Imaging, 2018, 12 (2) : 401-432. doi: 10.3934/ipi.2018018
[5]

Petr Pauš, Shigetoshi Yazaki. Segmentation of color images using mean curvature flow and parametric curves. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 1123-1132. doi: 10.3934/dcdss.2020389
[6]

Ye Yuan, Yan Ren, Xiaodong Liu, Jing Wang. Approach to image segmentation based on interval neutrosophic set. Numerical Algebra, Control and Optimization, 2020, 10 (1) : 1-11. doi: 10.3934/naco.2019028
[7]

Dominique Zosso, Jing An, James Stevick, Nicholas Takaki, Morgan Weiss, Liane S. Slaughter, Huan H. Cao, Paul S. Weiss, Andrea L. Bertozzi. Image segmentation with dynamic artifacts detection and bias correction. Inverse Problems and Imaging, 2017, 11 (3) : 577-600. doi: 10.3934/ipi.2017027
[8]

Matthew S. Keegan, Berta Sandberg, Tony F. Chan. A multiphase logic framework for multichannel image segmentation. Inverse Problems and Imaging, 2012, 6 (1) : 95-110. doi: 10.3934/ipi.2012.6.95
[9]

Macarena Boix, Begoña Cantó. Using wavelet denoising and mathematical morphology in the segmentation technique applied to blood cells images. Mathematical Biosciences & Engineering, 2013, 10 (2) : 279-294. doi: 10.3934/mbe.2013.10.279
[10]

Shi Yan, Jun Liu, Haiyang Huang, Xue-Cheng Tai. A dual EM algorithm for TV regularized Gaussian mixture model in image segmentation. Inverse Problems and Imaging, 2019, 13 (3) : 653-677. doi: 10.3934/ipi.2019030
[11]

Jianping Zhang, Ke Chen, Bo Yu, Derek A. Gould. A local information based variational model for selective image segmentation. Inverse Problems and Imaging, 2014, 8 (1) : 293-320. doi: 10.3934/ipi.2014.8.293
[12]

Lu Tan, Ling Li, Senjian An, Zhenkuan Pan. Nonlinear diffusion based image segmentation using two fast algorithms. Mathematical Foundations of Computing, 2019, 2 (2) : 149-168. doi: 10.3934/mfc.2019011
[13]

Ruiliang Zhang, Xavier Bresson, Tony F. Chan, Xue-Cheng Tai. Four color theorem and convex relaxation for image segmentation with any number of regions. Inverse Problems and Imaging, 2013, 7 (3) : 1099-1113. doi: 10.3934/ipi.2013.7.1099
[14]

Balázs Kósa, Karol Mikula, Markjoe Olunna Uba, Antonia Weberling, Neophytos Christodoulou, Magdalena Zernicka-Goetz. 3D image segmentation supported by a point cloud. Discrete and Continuous Dynamical Systems - S, 2021, 14 (3) : 971-985. doi: 10.3934/dcdss.2020351
[15]

Jie Huang, Xiaoping Yang, Yunmei Chen. A fast algorithm for global minimization of maximum likelihood based on ultrasound image segmentation. Inverse Problems and Imaging, 2011, 5 (3) : 645-657. doi: 10.3934/ipi.2011.5.645
[16]

Liam Burrows, Weihong Guo, Ke Chen, Francesco Torella. Reproducible kernel Hilbert space based global and local image segmentation. Inverse Problems and Imaging, 2021, 15 (1) : 1-25. doi: 10.3934/ipi.2020048
[17]

Michael Hintermüller, Monserrat Rincon-Camacho. An adaptive finite element method in $L^2$-TV-based image denoising. Inverse Problems and Imaging, 2014, 8 (3) : 685-711. doi: 10.3934/ipi.2014.8.685
[18]

Jia Li, Zuowei Shen, Rujie Yin, Xiaoqun Zhang. A reweighted $l^2$ method for image restoration with Poisson and mixed Poisson-Gaussian noise. Inverse Problems and Imaging, 2015, 9 (3) : 875-894. doi: 10.3934/ipi.2015.9.875
[19]

Karol Mikula, Róbert Špir, Nadine Peyriéras. Numerical algorithm for tracking cell dynamics in 4D biomedical images. Discrete and Continuous Dynamical Systems - S, 2015, 8 (5) : 953-967. doi: 10.3934/dcdss.2015.8.953
[20]

Weihao Shen, Wenbo Xu, Hongyang Zhang, Zexin Sun, Jianxiong Ma, Xinlong Ma, Shoujun Zhou, Shijie Guo, Yuanquan Wang. Automatic segmentation of the femur and tibia bones from X-ray images based on pure dilated residual U-Net. Inverse Problems and Imaging, 2021, 15 (6) : 1333-1346. doi: 10.3934/ipi.2020057

2021 Impact Factor: 1.865

Tools

Metrics

  • PDF downloads (324)
  • HTML views (327)
  • Cited by (0)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy