Some cautionary notes on the use of principal components regression

American Statistician

Volumn 52, Issue 1, 1998, Pages 15-19

  Hadi, Ali S ^a   Ling, Robert F ^b  

^a Department of Obstetrics Gynecology   (United States)

^b AMRL   (United States)

Author keywords

Hald s data; Longley data; Multicollinearity

Indexed keywords

EID: 0032330512     PISSN: 00031305     EISSN: 15372731     Source Type: Journal    
DOI: 10.1080/00031305.1998.10480530     Document Type: Article

References (17)

1. Beaton, A. E., Rubin, D. B., and Barone, J. L. (1976), ‘The Acceptability of Regression Solutions: Another Look at Computational Accuracy,” Journal of the American Statistical Association, 71, 158-168.
2. Boneh, S., and Mendieta, G.R. (1994), “Variable Selection in Regression Models Using Principal Components,” Communications in Statistics- Theory and Methods, 23, 197-213.
3. Chatterjee, S., and Price, B. (1991), Regression Analysis by Example, 2nd ed., New York: Wiley.
4. Draper, N., and Smith, H. (1981), Applied Regression Analysis, 2nd ed.O, New York: Wiley.
5. Gunst, R.F., and Mason, R.L. (1973), “Biased Estimation in Regression: An Evaluation Using Mean Squared Error,” Journal of the American Statistical Association, 72, 616-628.
6. Hawkins, D.M. (1973), “On the Investigations of Alternative Regressions by Principal Component Analysis,” Applied Statistics, 22, 275-286.
7. Hotelling, H. (1957), “The Relations of Newer Multivariate Statistical Methods to Factor Analysis,” British Journal of Statistical Psychology, 10, 69-79.
8. Jackson, E. (1991), A User’s Guide to Principal Components, New York: Wiley.
9. Jeffers, J.N. (1967), “Two Case Studies in the Application of Principal Component Analysis,” Applied Statistics, 16, 225-236.
10. Jolliffe, I.T. (1972), “Discarding Variables in a Principal Component Analysis, I: Artificial Data,” Applied Statistics, 21, 160-173.
11. Jolliffe, I.T. (1973), “Discarding Variables in a Principal Component Analysis, II: Real Data,” Applied Statistics, 22, 21-31.
12. Jolliffe, I.T. (1982), “A Note on the Use of Principal Components in Regression,” Applied Statistics, 31, 300-303.
13. Jolliffe, I.T. (1986), Principal Components Analysis, New York: SpringerVerlag.
14. Longley, J.W. (1967), “An Appraisal of Least-Squares Programs for the Electronic Computer from the Point of View of the User,” Journal of the American Statistical Association, 62, 819-831.
15. Lott, W. F. (1973), ‘The Optimal Set of Regression Components Restrictions on a Least Squares Regression,” Communications in Statistics- Theory and Methods, 2, 449-464.
16. Mansfield, E.R., Webster, J.T., and Gunst, R.F. (1977), “An Analytic Variable Selection Technique for Principal Component Regression,” Applied Statistics, 36, 34-40.
17. Olaya, J. (1997), “Some Findings on an Existing Method of Using Principal Components Regression to Select Predictor Variables,” unpublished manuscript, presented at the 1997 Joint Statistical Meetings.