# American Institute of Mathematical Sciences

• Previous Article
A mixed simulated annealing-genetic algorithm approach to the multi-buyer multi-item joint replenishment problem: advantages of meta-heuristics
• JIMO Home
• This Issue
• Next Article
Second order nonlinear impulsive time-variant systems with unbounded perturbation and optimal controls
January  2008, 4(1): 33-52. doi: 10.3934/jimo.2008.4.33

## Knot-optimizing spline networks (KOSNETS) for nonparametric regression

 1 School of Mathematics and Statistics, The University of Western Australia, 35 Stirling Highway, Crawley, WA 6009 2 CSIRO Mathematical and Information Sciences, Private Bag 5, Wembley, WA 6913, Australia 3 Department of Actuarial Studies, Macquarie University, Sydney, Australia

Received  July 2006 Revised  November 2007 Published  January 2008

In this paper we present a novel method for short term forecast of time series based on Knot-Optimizing Spline Networks (KOSNETS). The time series is first approximated by a nonlinear recurrent system. The resulting recurrent system is then approximated by feedforward $B$-spline networks, yielding a nonlinear optimization problem. In this optimization problem, both the knot points and the coefficients of the $B$-splines are decision variables so that the solution to the problem has both optimal coefficients and partition points. To demonstrate the usefulness and accuracy of the method, numerical simulations and tests using various model and real time series are performed. The numerical simulation results are compared with those from a well-known regression method, MARS. The comparison shows that our method outperforms MARS for nonlinear problems.
Citation: Song Wang, Quanxi Shao, Xian Zhou. Knot-optimizing spline networks (KOSNETS) for nonparametric regression. Journal of Industrial & Management Optimization, 2008, 4 (1) : 33-52. doi: 10.3934/jimo.2008.4.33
 [1] Christina Surulescu, Nicolae Surulescu. Modeling and simulation of some cell dispersion problems by a nonparametric method. Mathematical Biosciences & Engineering, 2011, 8 (2) : 263-277. doi: 10.3934/mbe.2011.8.263 [2] Kai Qu, Qi Dong, Chanjie Li, Feiyu Zhang. Finite element method for two-dimensional linear advection equations based on spline method. Discrete & Continuous Dynamical Systems - S, 2021, 14 (7) : 2471-2485. doi: 10.3934/dcdss.2021056 [3] Editorial Office. Retraction: Xiao-Qian Jiang and Lun-Chuan Zhang, Stock price fluctuation prediction method based on time series analysis. Discrete & Continuous Dynamical Systems - S, 2019, 12 (4&5) : 915-915. doi: 10.3934/dcdss.2019061 [4] Qinqin Chai, Ryan Loxton, Kok Lay Teo, Chunhua Yang. A unified parameter identification method for nonlinear time-delay systems. Journal of Industrial & Management Optimization, 2013, 9 (2) : 471-486. doi: 10.3934/jimo.2013.9.471 [5] Jiu Ding, Noah H. Rhee. A unified maximum entropy method via spline functions for Frobenius-Perron operators. Numerical Algebra, Control & Optimization, 2013, 3 (2) : 235-245. doi: 10.3934/naco.2013.3.235 [6] Xin Guo, Qiang Fu, Yue Wang, Kenneth C. Land. A numerical method to compute Fisher information for a special case of heterogeneous negative binomial regression. Communications on Pure & Applied Analysis, 2020, 19 (8) : 4179-4189. doi: 10.3934/cpaa.2020187 [7] Lianjun Zhang, Lingchen Kong, Yan Li, Shenglong Zhou. A smoothing iterative method for quantile regression with nonconvex $\ell_p$ penalty. Journal of Industrial & Management Optimization, 2017, 13 (1) : 93-112. doi: 10.3934/jimo.2016006 [8] Tobias Breiten, Sergey Dolgov, Martin Stoll. Solving differential Riccati equations: A nonlinear space-time method using tensor trains. Numerical Algebra, Control & Optimization, 2021, 11 (3) : 407-429. doi: 10.3934/naco.2020034 [9] Andrea L. Bertozzi, Ning Ju, Hsiang-Wei Lu. A biharmonic-modified forward time stepping method for fourth order nonlinear diffusion equations. Discrete & Continuous Dynamical Systems, 2011, 29 (4) : 1367-1391. doi: 10.3934/dcds.2011.29.1367 [10] Masoumeh Hosseininia, Mohammad Hossein Heydari, Carlo Cattani. A wavelet method for nonlinear variable-order time fractional 2D Schrödinger equation. Discrete & Continuous Dynamical Systems - S, 2021, 14 (7) : 2273-2295. doi: 10.3934/dcdss.2020295 [11] Hongfei Yang, Xiaofeng Ding, Raymond Chan, Hui Hu, Yaxin Peng, Tieyong Zeng. A new initialization method based on normed statistical spaces in deep networks. Inverse Problems & Imaging, 2021, 15 (1) : 147-158. doi: 10.3934/ipi.2020045 [12] Z.G. Feng, K.L. Teo, Y. Zhao. Branch and bound method for sensor scheduling in discrete time. Journal of Industrial & Management Optimization, 2005, 1 (4) : 499-512. doi: 10.3934/jimo.2005.1.499 [13] Rodrigo I. Brevis, Jaime H. Ortega, David Pardo. A source time reversal method for seismicity induced by mining. Inverse Problems & Imaging, 2017, 11 (1) : 25-45. doi: 10.3934/ipi.2017002 [14] Jinyan Fan, Jianyu Pan. Inexact Levenberg-Marquardt method for nonlinear equations. Discrete & Continuous Dynamical Systems - B, 2004, 4 (4) : 1223-1232. doi: 10.3934/dcdsb.2004.4.1223 [15] Qun Lin, Ryan Loxton, Kok Lay Teo. The control parameterization method for nonlinear optimal control: A survey. Journal of Industrial & Management Optimization, 2014, 10 (1) : 275-309. doi: 10.3934/jimo.2014.10.275 [16] Yongjian Yang, Zhiyou Wu, Fusheng Bai. A filled function method for constrained nonlinear integer programming. Journal of Industrial & Management Optimization, 2008, 4 (2) : 353-362. doi: 10.3934/jimo.2008.4.353 [17] Zhiyou Wu, Fusheng Bai, Guoquan Li, Yongjian Yang. A new auxiliary function method for systems of nonlinear equations. Journal of Industrial & Management Optimization, 2015, 11 (2) : 345-364. doi: 10.3934/jimo.2015.11.345 [18] Carlos E. Kenig. The method of energy channels for nonlinear wave equations. Discrete & Continuous Dynamical Systems, 2019, 39 (12) : 6979-6993. doi: 10.3934/dcds.2019240 [19] Weijun Zhou. A globally convergent BFGS method for symmetric nonlinear equations. Journal of Industrial & Management Optimization, 2021  doi: 10.3934/jimo.2021020 [20] Igor Griva, Roman A. Polyak. Proximal point nonlinear rescaling method for convex optimization. Numerical Algebra, Control & Optimization, 2011, 1 (2) : 283-299. doi: 10.3934/naco.2011.1.283

2020 Impact Factor: 1.801