A New Robust LQS-NTP Estimator for Mitigating Correlated Endogenous Variables and Extreme Observations in Linear Regression Models: Theoretical Development and Applications
DOI:
https://doi.org/10.62054/ijdm/0303.16Abstract
This study proposes a Robust Least Quantile of Squares–New Two-Parameter (LQS-NTP) estimator for addressing multicollinearity and extreme observations in linear regression models. The proposed estimator combines the high-breakdown robustness of the Least Quantile of Squares (LQS) method with the shrinkage properties of the New Two-Parameter (NTP) estimator. The Mean Squared Error (MSE) of the proposed estimator was derived, and its biasing parameters were obtained by minimizing the corresponding MSE. The performance of the proposed estimator was assessed using real-life Boston Housing and Portland Cement datasets and compared with some already existing methods. The data sets exhibited substantial multicollinearity, together with several outlying observations. The proposed LQS-NTP estimator achieved the lowest MSE of both data employed. These results demonstrate that the proposed estimator provides an effective alternative for regression estimation in the simultaneous presence of multicollinearity and extreme observations.
References
Adejumo, T. J., Ayinde, K., Akomolafe, A. A., Makinde, O. S. and Ajiboye, A. S. (2023). Robust-M new two-parameter estimator for linear regression models: Simulations and applications. African Scientific Reports. DOI:10.46481/asr.2023.2.3.138
Altukhaes, W. B., Roozbeh, M., & Mohamed, N. A. (2024). Feasible robust Liu estimator to combat outliers and multicollinearity effects in restricted semiparametric regression models. AIMS Mathematics, 9(11), 31581–31606. https://doi.org/10.3934/math.20241519
Awwad, M., & Abonazel, M. R. (2022). Development of robust Özkale–Kaçiranlar and Yang–Chang estimators for regression models in the presence of multicollinearity and outliers. Concurrency and Computation: Practice and Experience, 34(9), e6779. https://doi.org/10.1002/cpe.6779
Belsley, D. A., Kuh, E., & Welsch, R. E. (1980). Regression diagnostics: Identifying influential data and sources of collinearity. John Wiley & Sons.
Dawoud, I., & Abonazel, M. R. (2021). Robust Dawoud–Kibria estimator for handling multicollinearity and outliers in the linear regression model. Journal of Statistical Computation and Simulation, 91(17), 3678–3692. https://doi.org/10.1080/00949655.2021.1945063
Erisoğlu, M., Karakoca, A., & Yurtaslan, A. (2024). Novel robust estimators for the linear regression model with multicollinearity and outlier problems. REVSTAT Statistical Journal. https://doi.org/10.57805/revstat.v22i4.686
Greene, W. H. (2018). Econometric analysis (8th ed.). Pearson.
Hampel, F. R. (1974). The influence curve and its role in robust estimation. Journal of the American Statistical Association, 69(346), 383–393. https://doi.org/10.1080/01621459.1974.10482962
Hoerl, A. E., & Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1), 55–67. https://doi.org/10.1080/00401706.1970.10488634
Huber, P. J. (1964). Robust estimation of a location parameter. Annals of Mathematical Statistics, 35(1), 73–101. https://doi.org/10.1214/aoms/1177703732
Huber, P. J. (1973). Robust regression: Asymptotically normal estimators. The Annals of Statistics, 1(5), 799–821. https://doi.org/10.1214/aos/1176342503
Huber, P. J. (1981). Robust statistics. John Wiley & Sons.
Kibria, B. M. G. (2003). Performance of some new ridge regression estimators. Communications in Statistics—Simulation and Computation, 32(2), 419–435. https://doi.org/10.1081/SAC-120017499
Kutner, M. H., Nachtsheim, C. J., Neter, J., & Li, W. (2005). Applied linear statistical models (5th ed.). McGraw-Hill.
Liu, K. (1993). A new class of biased estimate in linear regression. Communications in Statistics—Theory and Methods, 22(2), 393–402. https://doi.org/10.1080/03610929308831027
Liu, K. (2003). Using Liu-type estimator to combat multicollinearity. Communications in Statistics—Theory and Methods.
Lukman, A. F., Ayinde, K., Binuomote, S., & Clement, O. A. (2019). Modified ridge-type estimator to combat multicollinearity. Journal of Statistical Computation and Simulation, 89(18), 3496–3512. https://doi.org/10.1080/00949655.2019.1666800
Montgomery, D. C., Peck, E. A., & Vining, G. G. (2021). Introduction to linear regression analysis (6th ed.). John Wiley & Sons.
Oyeleke, K. T., Olatayo, T. O., & Efuwape, B. T. (2025). Handling multicollinearity and outliers: A comparative study of one- and two-parameter estimators using real-life data. International Journal of Development Mathematics. https://doi.org/10.62054/ijdm/0104.14
Özkale, M. R., & Kaçiranlar, S. (2007). The restricted and unrestricted two-parameter estimators. Communications in Statistics—Theory and Methods, 36(15), 2707–2725. https://doi.org/10.1080/03610920601126517
Rousseeuw, P. J. (1984). Least median of squares regression. Journal of the American Statistical Association, 79(388), 871–880. https://doi.org/10.1080/01621459.1984.10477105
Rousseeuw, P. J. (1984). Least median of squares regression. Journal of the American Statistical Association, 79(388), 871–880. https://doi.org/10.1080/01621459.1984.10477105
Rousseeuw, P. J., & Leroy, A. M. (1987). Robust regression and outlier detection. John Wiley & Sons. https://doi.org/10.1002/0471725382
Wooldridge, J. M. (2020). Introductory econometrics: A modern approach (7th ed.). Cengage Learning.
Yu, C., Yao, W., & Bai, X. (2014). Robust linear regression: A review and comparison. Communications in Statistics—Simulation and Computation, 43(6), 1285–1321. https://doi.org/10.1080/03610918.2012.727369
Zaman, A., Rousseeuw, P. J., & Orhan, M. (2001). Econometric applications of high-breakdown robust regression techniques. Economics Letters, 71(1), 1–8. https://doi.org/10.1016/S0165-1765(00)00388-9
Downloads
Published
Data Availability Statement
Data will be made available upon request
Issue
Section
License
Copyright (c) 2026 Adewale A. Titilola, Timothy O. Olatayo, Abass I. Taiwo (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors are solely responsible for obtaining permission to reproduce any copyrighted material contained in the manuscript as submitted. Any instance of possible prior publication in any form must be disclosed at the time the manuscript is submitted and a
copy or link to the publication must be provided.
The Journal articles are open access and are distributed under the terms of the Creative
Commons Attribution-NonCommercial-NoDerivs 4.0 IGO License, which permits use,
distribution, and reproduction in any medium, provided the original work is properly cited.
No modifications or commercial use of the articles are permitted.
