August  2013, 7(3): 885-906. doi: 10.3934/ipi.2013.7.885

Multi-view foreground segmentation via fourth order tensor learning

1. 

Centre for Mathematical Imaging and Vision and Department of Mathematics, Hong Kong Baptist University, Kowloon Tong, Hong Kong, China, China

2. 

School of Mathematics and Statistics, Lanzhou University, Gansu, China

Received  July 2012 Revised  April 2013 Published  September 2013

In this paper, we present a novel fuse-before-detect algorithm for multi-view foreground segmentation via fourth order tensor learning. By using several camera views, most of the existing algorithms first detect the various object features for each view and then fuse the data together for foreground segmentation or tracking. However, this kind of single view foreground segmentation algorithm always suffers from various environmental problems, such as reflection and shadow induced by shiny objects, especially floor and wall. These segmentation errors reduce the accuracy of the multi-view tracking algorithms. In the proposed algorithm, we first fuse multi-view camera data to a fourth-order tensor through multiple parallelized planes projections. An incremental fourth-order tensor learning algorithm is then employed to perform foreground segmentation in the fused tensor data. By collecting all the information from different views, this approach could restrain the specific environmental effects in each view and give better segmentation results. Experimental results are reported to show the performance of the proposed method is better than the state-of-the-art methods in challenged environments.
Citation: Michael K. Ng, Chi-Pan Tam, Fan Wang. Multi-view foreground segmentation via fourth order tensor learning. Inverse Problems and Imaging, 2013, 7 (3) : 885-906. doi: 10.3934/ipi.2013.7.885
References:
[1]

C. Stauffer and W. E. L. Grimson, Adaptive background mixture models for real-time tracking, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2 (1999), 246-252. doi: 10.1109/CVPR.1999.784637.

[2]

A. Elgammal, D. Harwood and L. Davis, Non-parametric model for background subtraction, Proceedings of the European Conference on Computer Vision, 1843 (2000), 751-767.

[3]

W. Hu, X. Li, X. Zhang, X. Shi, S. Maybank and Z. Zhang, Incremental tensor subspace learning and its applications to foreground segmentation and tracking, International Journal of Computer vision, 91 (2011), 303-327.

[4]

M. Taj and A. Cavallaro, Multi-view multi-object detection and tracking, Computer Vision, 285 (2010), 263-280. doi: 10.1007/978-3-642-12848-6_10.

[5]

S. M. Khan and M. Shah, Tracking multiple occluding people by localizing on multiple scene planes, IEEE Transaction on Pattren Analysis and Machine Intelligence, 31 (2009), 505-519. doi: 10.1109/TPAMI.2008.102.

[6]

A. Criminisi, I. Reid and A. Zisserman, Single view metrology, International Journal of Computer Vision, 40 (2000), 123-148.

[7]

L. De Lathauwer, B. De Moor and J. Vandewalle, On the best rank-1, and rank-($R_1$, $R_2$, ..., $R_n$) approximation of higher-order tensors, SIAM Journal of Matrix Analysis and Applications, 21 (2000), 1324-1342. doi: 10.1137/S0895479898346995.

[8]

R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision," Second edition, Cambridge Univ. Press, Cambridge, 2003.

[9]

D. A. Ross, J. Lim, R.-S. Lin and M.-H. Yang, Incremental learning for robust visual tracking, International Journal of Computer Vision, 77 (2008), 125-141. doi: 10.1007/s11263-007-0075-7.

[10]

B. Li, K. Peng, X. Ying and H. Zha, Simultaneous vanishing point detection and camera calibration from single images, in "Advances in Visual Computing," Lecture Notes in Computer Science, 6454, Springer, (2010), 151-160. doi: 10.1007/978-3-642-17274-8_15.

show all references

References:
[1]

C. Stauffer and W. E. L. Grimson, Adaptive background mixture models for real-time tracking, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2 (1999), 246-252. doi: 10.1109/CVPR.1999.784637.

[2]

A. Elgammal, D. Harwood and L. Davis, Non-parametric model for background subtraction, Proceedings of the European Conference on Computer Vision, 1843 (2000), 751-767.

[3]

W. Hu, X. Li, X. Zhang, X. Shi, S. Maybank and Z. Zhang, Incremental tensor subspace learning and its applications to foreground segmentation and tracking, International Journal of Computer vision, 91 (2011), 303-327.

[4]

M. Taj and A. Cavallaro, Multi-view multi-object detection and tracking, Computer Vision, 285 (2010), 263-280. doi: 10.1007/978-3-642-12848-6_10.

[5]

S. M. Khan and M. Shah, Tracking multiple occluding people by localizing on multiple scene planes, IEEE Transaction on Pattren Analysis and Machine Intelligence, 31 (2009), 505-519. doi: 10.1109/TPAMI.2008.102.

[6]

A. Criminisi, I. Reid and A. Zisserman, Single view metrology, International Journal of Computer Vision, 40 (2000), 123-148.

[7]

L. De Lathauwer, B. De Moor and J. Vandewalle, On the best rank-1, and rank-($R_1$, $R_2$, ..., $R_n$) approximation of higher-order tensors, SIAM Journal of Matrix Analysis and Applications, 21 (2000), 1324-1342. doi: 10.1137/S0895479898346995.

[8]

R. Hartley and A. Zisserman, "Multiple View Geometry in Computer Vision," Second edition, Cambridge Univ. Press, Cambridge, 2003.

[9]

D. A. Ross, J. Lim, R.-S. Lin and M.-H. Yang, Incremental learning for robust visual tracking, International Journal of Computer Vision, 77 (2008), 125-141. doi: 10.1007/s11263-007-0075-7.

[10]

B. Li, K. Peng, X. Ying and H. Zha, Simultaneous vanishing point detection and camera calibration from single images, in "Advances in Visual Computing," Lecture Notes in Computer Science, 6454, Springer, (2010), 151-160. doi: 10.1007/978-3-642-17274-8_15.

[1]

Xuefeng Shen, Khoa Tran, Melvin Leok. High-order symplectic Lie group methods on $ SO(n) $ using the polar decomposition. Journal of Computational Dynamics, 2022  doi: 10.3934/jcd.2022003

[2]

Shan Jiang, Li Liang, Meiling Sun, Fang Su. Uniform high-order convergence of multiscale finite element computation on a graded recursion for singular perturbation. Electronic Research Archive, 2020, 28 (2) : 935-949. doi: 10.3934/era.2020049

[3]

Lela Dorel. Glucose level regulation via integral high-order sliding modes. Mathematical Biosciences & Engineering, 2011, 8 (2) : 549-560. doi: 10.3934/mbe.2011.8.549

[4]

Guoshan Zhang, Peizhao Yu. Lyapunov method for stability of descriptor second-order and high-order systems. Journal of Industrial and Management Optimization, 2018, 14 (2) : 673-686. doi: 10.3934/jimo.2017068

[5]

Abdelwahab Bensouilah, Sahbi Keraani. Smoothing property for the $ L^2 $-critical high-order NLS Ⅱ. Discrete and Continuous Dynamical Systems, 2019, 39 (5) : 2961-2976. doi: 10.3934/dcds.2019123

[6]

Marc Wolff, Stéphane Jaouen, Hervé Jourdren, Eric Sonnendrücker. High-order dimensionally split Lagrange-remap schemes for ideal magnetohydrodynamics. Discrete and Continuous Dynamical Systems - S, 2012, 5 (2) : 345-367. doi: 10.3934/dcdss.2012.5.345

[7]

Kolade M. Owolabi, Abdon Atangana. High-order solvers for space-fractional differential equations with Riesz derivative. Discrete and Continuous Dynamical Systems - S, 2019, 12 (3) : 567-590. doi: 10.3934/dcdss.2019037

[8]

Marc Bonnet. Inverse acoustic scattering using high-order small-inclusion expansion of misfit function. Inverse Problems and Imaging, 2018, 12 (4) : 921-953. doi: 10.3934/ipi.2018039

[9]

Raymond H. Chan, Haixia Liang, Suhua Wei, Mila Nikolova, Xue-Cheng Tai. High-order total variation regularization approach for axially symmetric object tomography from a single radiograph. Inverse Problems and Imaging, 2015, 9 (1) : 55-77. doi: 10.3934/ipi.2015.9.55

[10]

Kai Jiang, Wei Si. High-order energy stable schemes of incommensurate phase-field crystal model. Electronic Research Archive, 2020, 28 (2) : 1077-1093. doi: 10.3934/era.2020059

[11]

Tarek Saanouni. Global well-posedness of some high-order semilinear wave and Schrödinger type equations with exponential nonlinearity. Communications on Pure and Applied Analysis, 2014, 13 (1) : 273-291. doi: 10.3934/cpaa.2014.13.273

[12]

Zheng Sun, José A. Carrillo, Chi-Wang Shu. An entropy stable high-order discontinuous Galerkin method for cross-diffusion gradient flow systems. Kinetic and Related Models, 2019, 12 (4) : 885-908. doi: 10.3934/krm.2019033

[13]

Phillip Colella. High-order finite-volume methods on locally-structured grids. Discrete and Continuous Dynamical Systems, 2016, 36 (8) : 4247-4270. doi: 10.3934/dcds.2016.36.4247

[14]

Andrey B. Muravnik. On the Cauchy problem for differential-difference parabolic equations with high-order nonlocal terms of general kind. Discrete and Continuous Dynamical Systems, 2006, 16 (3) : 541-561. doi: 10.3934/dcds.2006.16.541

[15]

Abdollah Borhanifar, Maria Alessandra Ragusa, Sohrab Valizadeh. High-order numerical method for two-dimensional Riesz space fractional advection-dispersion equation. Discrete and Continuous Dynamical Systems - B, 2021, 26 (10) : 5495-5508. doi: 10.3934/dcdsb.2020355

[16]

Lixuan Zhang, Xuefei Yang. On pole assignment of high-order discrete-time linear systems with multiple state and input delays. Discrete and Continuous Dynamical Systems - S, 2022  doi: 10.3934/dcdss.2022022

[17]

Roger P. de Moura, Ailton C. Nascimento, Gleison N. Santos. On the stabilization for the high-order Kadomtsev-Petviashvili and the Zakharov-Kuznetsov equations with localized damping. Evolution Equations and Control Theory, 2022, 11 (3) : 711-727. doi: 10.3934/eect.2021022

[18]

Ahmed El Kaimbillah, Oussama Bourihane, Bouazza Braikat, Mohammad Jamal, Foudil Mohri, Noureddine Damil. Efficient high-order implicit solvers for the dynamic of thin-walled beams with open cross section under external arbitrary loadings. Discrete and Continuous Dynamical Systems - S, 2019, 12 (6) : 1685-1708. doi: 10.3934/dcdss.2019113

[19]

Florian Schneider, Jochen Kall, Graham Alldredge. A realizability-preserving high-order kinetic scheme using WENO reconstruction for entropy-based moment closures of linear kinetic equations in slab geometry. Kinetic and Related Models, 2016, 9 (1) : 193-215. doi: 10.3934/krm.2016.9.193

[20]

Wenqiang Zhao, Yijin Zhang. High-order Wong-Zakai approximations for non-autonomous stochastic $ p $-Laplacian equations on $ \mathbb{R}^N $. Communications on Pure and Applied Analysis, 2021, 20 (1) : 243-280. doi: 10.3934/cpaa.2020265

2020 Impact Factor: 1.639

Metrics

  • PDF downloads (109)
  • HTML views (0)
  • Cited by (1)

Other articles
by authors

[Back to Top]