# American Institute of Mathematical Sciences

January  2021, 17(1): 51-66. doi: 10.3934/jimo.2019098

## Orthogonal intrinsic mode functions via optimization approach

 Faculty of Information Engineering, Guangdong University of Technology, Guangzhou, 510006, China

* Corresponding author: Bingo Wing-Kuen Ling

Received  January 2019 Revised  March 2019 Published  January 2021 Early access  July 2019

Fund Project: The first author is supported by NSF grant xx-xxxx

This paper proposes an optimization approach to find a set of orthogonal intrinsic mode functions (IMFs). In particular, an optimization problem is formulated in such a way that the total energy of the difference between the original IMFs and the corresponding obtained IMFs is minimized subject to both the orthogonal condition and the IMF conditions. This formulated optimization problem consists of an exclusive or constraint. This exclusive or constraint is further reformulated to an inequality constraint. Using the Lagrange multiplier approach, it is required to solve a linear matrix equation, a quadratic matrix equation and a highly nonlinear matrix equation only dependent on the orthogonal IMFs as well as a nonlinear matrix equation dependent on both the orthogonal IMFs and the Lagrange multipliers. To solve these matrix equations, the first three equations are considered. First, a new optimization problem is formulated in such a way that the error energy of the highly nonlinear matrix equation is minimized subject to the linear matrix equation and the quadratic matrix equation. By finding the nearly global optimal solution of this newly formulated optimization problem and checking whether the objective functional value evaluated at the obtained solution is close to zero or not, the orthogonal IMFs are found. Finally, by substituting the obtained orthogonal IMFs to the last matrix equation, this last matrix equation reduced to a linear matrix equation which is only dependent on the Lagrange multipliers. Therefore, the Lagrange multipliers can be found. Consequently, the solution of the original optimization problem is found. By repeating these procedures with different initial conditions, a nearly global optimal solution is obtained.

Citation: Xinpeng Wang, Bingo Wing-Kuen Ling, Wei-Chao Kuang, Zhijing Yang. Orthogonal intrinsic mode functions via optimization approach. Journal of Industrial and Management Optimization, 2021, 17 (1) : 51-66. doi: 10.3934/jimo.2019098
##### References:
 [1] Q. Chen, N. Huang, S. Riemenschneider and Y. Xu, A B-spline approach for empirical mode decompositions, Advanced on Comput. Math., 24 (2006), 171-195.  doi: 10.1007/s10444-004-7614-3. [2] L. E. Cheriyan and P. Janardhanan, Adaptive orthogonal signal decomposition based on empirical mode decomposition and empirical wavelet transform, 1st IRF International Conference, 9 (2014), 67-70. [3] P. Flandrin and P. Gonçalvès, Empirical mode decompositions as data-driven wavelet-like expansions, Int. J. of Wavelets, Multires. and Info. Processing, 2 (2004), 477-496.  doi: 10.1142/S0219691304000561. [4] P. Flandrin, G. Rilling and P. Gonçalvès, Empirical mode decomposition as a filter bank, IEEE Signal Processing Letters, 11 (2004), 112-114. [5] C. Y. Ho, B. W. Ling, Y. Q. Liu, P. K. Tam and K. L. Teo, Optimal design of magnitude responses of rational infinite impulse response filters, IEEE Transactions on Signal Processing, 54 (2006), 4039-4046.  doi: 10.1109/TSP.2006.880317. [6] N. E. Huang, Z. Shen, S. Long, M. Wu, H. Shih, Q. Zheng, N. Yen, C. Tung and H. Liu, The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis, Proceedings of the Royal Society London A: Math., Phys. and Engineering Sciences, 454 (1998), 903-955.  doi: 10.1098/rspa.1998.0193. [7] T. L. Huang, W. X. Ren and M. L. Lou, The orthogonal Hilbert-Huang transform and its application in earthquake motion recordings analysis, The 14th World Conference on Earthquake Engineering, 10 (2008), 17-18. [8] Y. Kopsinis and S. McLaughlin, Development of EMD-based denoising methods inspired by wavelet thresholding, IEEE Transactions on Signal Processing, 57 (2009), 1351-1362.  doi: 10.1109/TSP.2009.2013885. [9] Y. Kopsinis and S. McLaughlin, Investigation and performance enhancement of the empirical mode decomposition method based on a heuristic search optimization approach, IEEE Transactions on Signal Processing, 56 (2008), 1-13.  doi: 10.1109/TSP.2007.901155. [10] B. W. Ling, N. L. Tian, C. Y. Ho, W. C. Siu, K. L. Teo and Q. Y. Dai, Maximally decimated paraunitary linear phase FIR filter bank design via iterative SVD approach, IEEE Transactions on Signal Processing, 63 (2015), 466-481.  doi: 10.1109/TSP.2014.2371779. [11] P. Q. Muoi, D. N. Háo, P. Maass and M. Pidcock, Descent gradient methods for nonsmooth minimization problems in ill-posed problems, J. of Comput. and Appl. Math., 298 (2016), 105-122.  doi: 10.1016/j.cam.2015.11.039. [12] F. Rahpeymaii, M. Kimiaei and A. Bagheri, A limited memory quasi-Newton trust-region method for box constrained optimization, J. of Comput. and Appl. Math., 303 (2016), 105-118.  doi: 10.1016/j.cam.2016.02.026. [13] Q. S. Ren, Q. Yi and M. Y. Fang, Fast implementation of orthogonal empirical mode decomposition and its application into singular signal detection, IEEE International Conference on Signal Processing and Communications, 6 (2007), 1215-1218.  doi: 10.1109/ICSPC.2007.4728544. [14] Z. J. Yang, B. W. Ling and C. Bingham, Joint empirical mode decomposition and sparse binary programming for underlying trend extraction, IEEE Transactions on Instrumentation and Measurement, 62 (2013), 2673-2682.  doi: 10.1109/TIM.2013.2265451. [15] Z. J. Yang, B. W. Ling and C. Bingham, Trend extraction based on separations of consecutive empirical mode decomposition components in Hilbert marginal spectrum, Measurement, 46 (2013), 2481-2491.  doi: 10.1016/j.measurement.2013.04.071.

show all references

##### References:
 [1] Q. Chen, N. Huang, S. Riemenschneider and Y. Xu, A B-spline approach for empirical mode decompositions, Advanced on Comput. Math., 24 (2006), 171-195.  doi: 10.1007/s10444-004-7614-3. [2] L. E. Cheriyan and P. Janardhanan, Adaptive orthogonal signal decomposition based on empirical mode decomposition and empirical wavelet transform, 1st IRF International Conference, 9 (2014), 67-70. [3] P. Flandrin and P. Gonçalvès, Empirical mode decompositions as data-driven wavelet-like expansions, Int. J. of Wavelets, Multires. and Info. Processing, 2 (2004), 477-496.  doi: 10.1142/S0219691304000561. [4] P. Flandrin, G. Rilling and P. Gonçalvès, Empirical mode decomposition as a filter bank, IEEE Signal Processing Letters, 11 (2004), 112-114. [5] C. Y. Ho, B. W. Ling, Y. Q. Liu, P. K. Tam and K. L. Teo, Optimal design of magnitude responses of rational infinite impulse response filters, IEEE Transactions on Signal Processing, 54 (2006), 4039-4046.  doi: 10.1109/TSP.2006.880317. [6] N. E. Huang, Z. Shen, S. Long, M. Wu, H. Shih, Q. Zheng, N. Yen, C. Tung and H. Liu, The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis, Proceedings of the Royal Society London A: Math., Phys. and Engineering Sciences, 454 (1998), 903-955.  doi: 10.1098/rspa.1998.0193. [7] T. L. Huang, W. X. Ren and M. L. Lou, The orthogonal Hilbert-Huang transform and its application in earthquake motion recordings analysis, The 14th World Conference on Earthquake Engineering, 10 (2008), 17-18. [8] Y. Kopsinis and S. McLaughlin, Development of EMD-based denoising methods inspired by wavelet thresholding, IEEE Transactions on Signal Processing, 57 (2009), 1351-1362.  doi: 10.1109/TSP.2009.2013885. [9] Y. Kopsinis and S. McLaughlin, Investigation and performance enhancement of the empirical mode decomposition method based on a heuristic search optimization approach, IEEE Transactions on Signal Processing, 56 (2008), 1-13.  doi: 10.1109/TSP.2007.901155. [10] B. W. Ling, N. L. Tian, C. Y. Ho, W. C. Siu, K. L. Teo and Q. Y. Dai, Maximally decimated paraunitary linear phase FIR filter bank design via iterative SVD approach, IEEE Transactions on Signal Processing, 63 (2015), 466-481.  doi: 10.1109/TSP.2014.2371779. [11] P. Q. Muoi, D. N. Háo, P. Maass and M. Pidcock, Descent gradient methods for nonsmooth minimization problems in ill-posed problems, J. of Comput. and Appl. Math., 298 (2016), 105-122.  doi: 10.1016/j.cam.2015.11.039. [12] F. Rahpeymaii, M. Kimiaei and A. Bagheri, A limited memory quasi-Newton trust-region method for box constrained optimization, J. of Comput. and Appl. Math., 303 (2016), 105-118.  doi: 10.1016/j.cam.2016.02.026. [13] Q. S. Ren, Q. Yi and M. Y. Fang, Fast implementation of orthogonal empirical mode decomposition and its application into singular signal detection, IEEE International Conference on Signal Processing and Communications, 6 (2007), 1215-1218.  doi: 10.1109/ICSPC.2007.4728544. [14] Z. J. Yang, B. W. Ling and C. Bingham, Joint empirical mode decomposition and sparse binary programming for underlying trend extraction, IEEE Transactions on Instrumentation and Measurement, 62 (2013), 2673-2682.  doi: 10.1109/TIM.2013.2265451. [15] Z. J. Yang, B. W. Ling and C. Bingham, Trend extraction based on separations of consecutive empirical mode decomposition components in Hilbert marginal spectrum, Measurement, 46 (2013), 2481-2491.  doi: 10.1016/j.measurement.2013.04.071.
Original signal
Signal components
Normalized IMFs
Components obtained by the Gram Schmidt orthogonalization method
Components obtained by our proposed method
Orthogonal errors of all the IMFs $err_{orth}$
 Signal Our proposed method Gram Schmidt orthogonalization method [8] Normalization method $x(t)=\sin (2 \pi t) e^{-\frac{t^{2}}{2}}$$+e^{-t} \cos (2 \pi t) 0 0 1.3545  Signal Our proposed method Gram Schmidt orthogonalization method [8] Normalization method x(t)=\sin (2 \pi t) e^{-\frac{t^{2}}{2}}$$+e^{-t} \cos (2 \pi t)$ 0 0 1.3545
Errors between the total number of the extrema and the total number of the zero crossing points of all the IMFs $err_{ex_-zx}$
 Signal Our proposed method Gram Schmidt orthogonalization method [8] Normalization method $x(t)=\sin (2 \pi t) e^{-\frac{t^{2}}{2}}$$+e^{-t} \cos (2 \pi t) 0 25 0  Signal Our proposed method Gram Schmidt orthogonalization method [8] Normalization method x(t)=\sin (2 \pi t) e^{-\frac{t^{2}}{2}}$$+e^{-t} \cos (2 \pi t)$ 0 25 0
Errors between the total number of the extrema and the total number of the zero crossing points of all the IMFs $err_{ex_-zx}$
 Signal Our proposed method Gram Schmidt orthogonalization method [8] Normalization method $x(t)=\sin (2 \pi t) e^{-\frac{t^{2}}{2}}$$+e^{-t} \cos (2 \pi t) 0.9139\times10^{-4} 0.9801\times10^{-4} 0.6368\times10^{-4}  Signal Our proposed method Gram Schmidt orthogonalization method [8] Normalization method x(t)=\sin (2 \pi t) e^{-\frac{t^{2}}{2}}$$+e^{-t} \cos (2 \pi t)$ $0.9139\times10^{-4}$ $0.9801\times10^{-4}$ $0.6368\times10^{-4}$
 [1] A. M. Bagirov, Moumita Ghosh, Dean Webb. A derivative-free method for linearly constrained nonsmooth optimization. Journal of Industrial and Management Optimization, 2006, 2 (3) : 319-338. doi: 10.3934/jimo.2006.2.319 [2] Tengteng Yu, Xin-Wei Liu, Yu-Hong Dai, Jie Sun. Variable metric proximal stochastic variance reduced gradient methods for nonconvex nonsmooth optimization. Journal of Industrial and Management Optimization, 2022, 18 (4) : 2611-2631. doi: 10.3934/jimo.2021084 [3] Mohamed Aly Tawhid. Nonsmooth generalized complementarity as unconstrained optimization. Journal of Industrial and Management Optimization, 2010, 6 (2) : 411-423. doi: 10.3934/jimo.2010.6.411 [4] K. T. Arasu, Manil T. Mohan. Optimization problems with orthogonal matrix constraints. Numerical Algebra, Control and Optimization, 2018, 8 (4) : 413-440. doi: 10.3934/naco.2018026 [5] Siwei Yu, Jianwei Ma, Stanley Osher. Geometric mode decomposition. Inverse Problems and Imaging, 2018, 12 (4) : 831-852. doi: 10.3934/ipi.2018035 [6] René Henrion. Gradient estimates for Gaussian distribution functions: application to probabilistically constrained optimization problems. Numerical Algebra, Control and Optimization, 2012, 2 (4) : 655-668. doi: 10.3934/naco.2012.2.655 [7] Ahmet Sahiner, Gulden Kapusuz, Nurullah Yilmaz. A new smoothing approach to exact penalty functions for inequality constrained optimization problems. Numerical Algebra, Control and Optimization, 2016, 6 (2) : 161-173. doi: 10.3934/naco.2016006 [8] Jinying Ma, Honglei Xu. Empirical analysis and optimization of capital structure adjustment. Journal of Industrial and Management Optimization, 2020, 16 (3) : 1037-1047. doi: 10.3934/jimo.2018191 [9] Xueting Cui, Xiaoling Sun, Dan Sha. An empirical study on discrete optimization models for portfolio selection. Journal of Industrial and Management Optimization, 2009, 5 (1) : 33-46. doi: 10.3934/jimo.2009.5.33 [10] Juan Carlos De los Reyes, Carola-Bibiane Schönlieb. Image denoising: Learning the noise model via nonsmooth PDE-constrained optimization. Inverse Problems and Imaging, 2013, 7 (4) : 1183-1214. doi: 10.3934/ipi.2013.7.1183 [11] Jonathan H. Tu, Clarence W. Rowley, Dirk M. Luchtenburg, Steven L. Brunton, J. Nathan Kutz. On dynamic mode decomposition: Theory and applications. Journal of Computational Dynamics, 2014, 1 (2) : 391-421. doi: 10.3934/jcd.2014.1.391 [12] Steven L. Brunton, Joshua L. Proctor, Jonathan H. Tu, J. Nathan Kutz. Compressed sensing and dynamic mode decomposition. Journal of Computational Dynamics, 2015, 2 (2) : 165-191. doi: 10.3934/jcd.2015002 [13] Hao Zhang, Scott T. M. Dawson, Clarence W. Rowley, Eric A. Deem, Louis N. Cattafesta. Evaluating the accuracy of the dynamic mode decomposition. Journal of Computational Dynamics, 2020, 7 (1) : 35-56. doi: 10.3934/jcd.2020002 [14] Chunrong Chen, T. C. Edwin Cheng, Shengji Li, Xiaoqi Yang. Nonlinear augmented Lagrangian for nonconvex multiobjective optimization. Journal of Industrial and Management Optimization, 2011, 7 (1) : 157-174. doi: 10.3934/jimo.2011.7.157 [15] Xiaodi Bai, Xiaojin Zheng, Xiaoling Sun. A survey on probabilistically constrained optimization problems. Numerical Algebra, Control and Optimization, 2012, 2 (4) : 767-778. doi: 10.3934/naco.2012.2.767 [16] Giancarlo Bigi. Componentwise versus global approaches to nonsmooth multiobjective optimization. Journal of Industrial and Management Optimization, 2005, 1 (1) : 21-32. doi: 10.3934/jimo.2005.1.21 [17] Nobuko Sagara, Masao Fukushima. trust region method for nonsmooth convex optimization. Journal of Industrial and Management Optimization, 2005, 1 (2) : 171-180. doi: 10.3934/jimo.2005.1.171 [18] Rakesh Pilkar, Erik M. Bollt, Charles Robinson. Empirical mode decomposition/Hilbert transform analysis of postural responses to small amplitude anterior-posterior sinusoidal translations of varying frequencies. Mathematical Biosciences & Engineering, 2011, 8 (4) : 1085-1097. doi: 10.3934/mbe.2011.8.1085 [19] Ian D. Morris. Ergodic optimization for generic continuous functions. Discrete and Continuous Dynamical Systems, 2010, 27 (1) : 383-388. doi: 10.3934/dcds.2010.27.383 [20] Caglar S. Aksezer. On the sensitivity of desirability functions for multiresponse optimization. Journal of Industrial and Management Optimization, 2008, 4 (4) : 685-696. doi: 10.3934/jimo.2008.4.685

2021 Impact Factor: 1.411