American Institute of Mathematical Sciences

Advanced
April  2009, 5(2): 239-252. doi: 10.3934/jimo.2009.5.239

Estimation in polytomous logistic model: Comparison of methods

Inácio Andruski-Guimarães 1, and  Anselmo Chaves-Neto 2,

1. 

Departamento Acadêmico de Matemática, UTFPR - Universidade Tecnológica Federal do Paraná, Rua Sete de Setembro, 3165, 80230-901 Curitiba Paraná, Brazil
2. 

Departamento de Estatística, UFPR - Universidade Federal do Paraná, Centro Politécnico Jardim das Américas Caixa Postal 19081, 81531-980 Curitiba Paraná, Brazil

Received  April 2007 Revised  February 2009 Published  April 2009

The logistic regression model is a powerful method for modeling the relationship between a categorical variable and a set of explanatory variables. In practice, however, the existence of maximum likelihood estimates is known to be dependent on the data configuration. In fact, the Maximum Likelihood Estimators (MLE) of unknown parameters exists if, and only if, there is data overlapping. The Hidden Logistic Regression (HLR) is an alternative model under which the observed response is related to the unobservable response. The Maximum Estimated Likelihood (MEL) method is also proposed, once it is immune to the complete or quasi-complete separation of data. The Principal Component Logistic Regression (PCLR) model is useful to reduce the number of dimensions of a logistic regression model with continuous covariates avoiding multicollinearity. In this paper we present an extension of the HLR and PCLR models as means for the solution of problems with polytomous responses. The main purpose is to compare the classificatory performance obtained by the models mentioned above with those of the Classical Logistic Regression (CLR) and Individualized Logistic regression (ILR) models, in the case of polytomous responses. The purpose is to propose an alternative approach for the parameter estimation problem in polytomous logistic models when the data groups are completely separated. Simulations results resulting from databases taken from the literature show that the proposed approach is feasible.
Keywords: Principal Component Analysis., Polytomous Logistic Regression, Robust Estimation.
Mathematics Subject Classification: Primary: 62H30; Secondary: 62J02 , 68T1.
Citation: Inácio Andruski-Guimarães, Anselmo Chaves-Neto. Estimation in polytomous logistic model: Comparison of methods. Journal of Industrial and Management Optimization, 2009, 5 (2) : 239-252. doi: 10.3934/jimo.2009.5.239
[1]

Ningyu Sha, Lei Shi, Ming Yan. Fast algorithms for robust principal component analysis with an upper bound on the rank. Inverse Problems and Imaging, 2021, 15 (1) : 109-128. doi: 10.3934/ipi.2020067
[2]

Hui Zhang, Jian-Feng Cai, Lizhi Cheng, Jubo Zhu. Strongly convex programming for exact matrix completion and robust principal component analysis. Inverse Problems and Imaging, 2012, 6 (2) : 357-372. doi: 10.3934/ipi.2012.6.357
[3]

Qingshan You, Qun Wan, Yipeng Liu. A short note on strongly convex programming for exact matrix completion and robust principal component analysis. Inverse Problems and Imaging, 2013, 7 (1) : 305-306. doi: 10.3934/ipi.2013.7.305
[4]

Yitong Guo, Bingo Wing-Kuen Ling. Principal component analysis with drop rank covariance matrix. Journal of Industrial and Management Optimization, 2021, 17 (5) : 2345-2366. doi: 10.3934/jimo.2020072
[5]

Azam Moradi, Jafar Razmi, Reza Babazadeh, Ali Sabbaghnia. An integrated Principal Component Analysis and multi-objective mathematical programming approach to agile supply chain network design under uncertainty. Journal of Industrial and Management Optimization, 2019, 15 (2) : 855-879. doi: 10.3934/jimo.2018074
[6]

Charles Curry, Stephen Marsland, Robert I McLachlan. Principal symmetric space analysis. Journal of Computational Dynamics, 2019, 6 (2) : 251-276. doi: 10.3934/jcd.2019013
[7]

Sebastian Springer, Heikki Haario, Vladimir Shemyakin, Leonid Kalachev, Denis Shchepakin. Robust parameter estimation of chaotic systems. Inverse Problems and Imaging, 2019, 13 (6) : 1189-1212. doi: 10.3934/ipi.2019053
[8]

Yang Mi, Kang Zheng, Song Wang. Homography estimation along short videos by recurrent convolutional regression network. Mathematical Foundations of Computing, 2020, 3 (2) : 125-140. doi: 10.3934/mfc.2020014
[9]

Wei Li, Yun Teng. Enterprise inefficient investment behavior analysis based on regression analysis. Discrete and Continuous Dynamical Systems - S, 2019, 12 (4&5) : 1015-1025. doi: 10.3934/dcdss.2019069
[10]

Chongyang Liu, Meijia Han, Zhaohua Gong, Kok Lay Teo. Robust parameter estimation for constrained time-delay systems with inexact measurements. Journal of Industrial and Management Optimization, 2021, 17 (1) : 317-337. doi: 10.3934/jimo.2019113
[11]

Dominique Chapelle, Philippe Moireau, Patrick Le Tallec. Robust filtering for joint state-parameter estimation in distributed mechanical systems. Discrete and Continuous Dynamical Systems, 2009, 23 (1&2) : 65-84. doi: 10.3934/dcds.2009.23.65
[12]

Yuyuan Ouyang, Trevor Squires. Some worst-case datasets of deterministic first-order methods for solving binary logistic regression. Inverse Problems and Imaging, 2021, 15 (1) : 63-77. doi: 10.3934/ipi.2020047
[13]

Yazhe Li, Tony Bellotti, Niall Adams. Issues using logistic regression with class imbalance, with a case study from credit risk modelling. Foundations of Data Science, 2019, 1 (4) : 389-417. doi: 10.3934/fods.2019016
[14]

Lican Kang, Yuan Luo, Jerry Zhijian Yang, Chang Zhu. A primal and dual active set algorithm for truncated $L_1$ regularized logistic regression. Journal of Industrial and Management Optimization, 2022  doi: 10.3934/jimo.2022050
[15]

Jiang Xie, Junfu Xu, Celine Nie, Qing Nie. Machine learning of swimming data via wisdom of crowd and regression analysis. Mathematical Biosciences & Engineering, 2017, 14 (2) : 511-527. doi: 10.3934/mbe.2017031
[16]

Bingzheng Li, Zhengzhan Dai. Error analysis on regularized regression based on the Maximum correntropy criterion. Mathematical Foundations of Computing, 2020, 3 (1) : 25-40. doi: 10.3934/mfc.2020003
[17]

Wenming Li, Yongge Tian, Ruixia Yuan. Statistical analysis of a linear regression model with restrictions and superfluous variables. Journal of Industrial and Management Optimization, 2022  doi: 10.3934/jimo.2022079
[18]

Ruotian Gao, Wenxun Xing. Robust sensitivity analysis for linear programming with ellipsoidal perturbation. Journal of Industrial and Management Optimization, 2020, 16 (4) : 2029-2044. doi: 10.3934/jimo.2019041
[19]

Gregory Zitelli, Seddik M. Djouadi, Judy D. Day. Combining robust state estimation with nonlinear model predictive control to regulate the acute inflammatory response to pathogen. Mathematical Biosciences & Engineering, 2015, 12 (5) : 1127-1139. doi: 10.3934/mbe.2015.12.1127
[20]

Dominique Duncan, Thomas Strohmer. Classification of Alzheimer's disease using unsupervised diffusion component analysis. Mathematical Biosciences & Engineering, 2016, 13 (6) : 1119-1130. doi: 10.3934/mbe.2016033

2021 Impact Factor: 1.411

Tools

Metrics

  • PDF downloads (154)
  • HTML views (0)
  • Cited by (1)

Other articles
by authors

[Back to Top]

Copyright © 2022 American Institute of Mathematical Sciences | Privacy Policy