A Jackknifed Ridge M-estimator for regression model with multicollinearity and outliers. (English) Zbl 1420.62295
Summary: In the multiple regression analysis, most frequently occurring problems are the presence of mul-ticollinearity and outliers. They produce undesirable effects on the least squares estimates of regression parameters. The Jackknifed Ridge Regression estimator and M-estimator have been proposed to overcome multicollinearity and outliers respectively. The Jackknifed Ridge Regression estimator is obtained by shrinking the Ordinary Least Squares estimator. Since the Ordinary Least Squares estimator is sensitive to outliers, the Jackknife Ridge Regression estimator is also sensitive to outliers. To overcome the combined problem of multicollinearity and outliers, we propose a new estimator namely, Jackknifed Ridge M-estimator. This estimator is obtained by shrinking an M-estimator instead of the Ordinary Least Squares estimator.
References:
| [1] | Draper, N.R., Smith, H., 1998. Applied Regression Analysis, Third edition. John Wiley, New York. · Zbl 0895.62073 |
| [2] | Hampel, F.R., Ronchetti, E.M., Rousseeuvw, P.J., Stahel, W.A., 1986. Robust Statistics: The Approach Based on Influence Function. John Wiley, New York. · Zbl 0593.62027 |
| [3] | Hoerl, A.E., Kennard, R.W., 1970. Ridge regression: biased estimation for nonorthogonal problems. Tech-nometrics, 12(1), 55-67. · Zbl 0202.17205 |
| [4] | Hoerl, A.E., Kennard, R.W., Baldwin, K.F., 1971. Ridge regression: some simulations. Communications in Statistics-Theory and Methods, 4(2), 105-123. · Zbl 0296.62062 |
| [5] | Huber, P.J., 1973. Robust Regression: asymptotics, conjectures, and Monte Carlo. Ann. Stat., 1, 799-821. · Zbl 0289.62033 · doi:10.1214/aos/1176342503 |
| [6] | Huber, P.J., 1981. Robust Statistics. John Wiley, New York. · Zbl 0536.62025 · doi:10.1002/0471725250 |
| [7] | McDonald, G.C., Galarneau, D.I., 1971. A Monte Carlo evaluation of some ridge-type estimators. Journal of the American Statistical Association, 70(350), 407-416. · Zbl 0319.62049 · doi:10.1080/01621459.1975.10479882 |
| [8] | Montgomery, D.C., Peck, E.A., Vining, G.G., 2006. Introduction to Linear Regression Analysis, Third edition. John Wiley and sons, New York. · Zbl 1229.62092 |
| [9] | Rousseeuw, P.J., Leroy, A.M., 1987. Robust Regression and Outlier Detection. John Wiley and sons, New York. · Zbl 0711.62030 · doi:10.1002/0471725382 |
| [10] | Sakalliogˇlu, S., Kaçiranlar, S., 2008. A new biased estimator based on ridge estimation. Stat. Papers, 49, 669-689. · Zbl 1309.62116 · doi:10.1007/s00362-006-0037-0 |
| [11] | Singh, B., Chaubey, Y.P., Dwivedi, T.D., 1986. An almost unbiased ridge estimators. Sankhya, 48(3), 342-346. · Zbl 0687.62054 |
| [12] | Vinod, H.D., Ullah, A., 1981. Recent Advance in Regression Methods. Marcel Dekker, New York. · Zbl 0511.62084 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
