Accuracy of population validity and cross-validity estimation: An empirical comparison of formula-based, traditional empirical, and equal weights procedures

Applied Psychological Measurement

Volumn 23, Issue 2, 1999, Pages 99-115

  Raju, Nambury S ^a   Bilgic, Reyhan ^b   Edwards, Jack E ^b   Fleer, Paul F ^b  

^a ILLINOIS INSTITUTE OF TECHNOLOGY   (United States)

^b NONE

Author keywords

Cross validation; Equal weights; Multiple regression; Ordinary least squares; Population cross validity; Population validity; Unit weights

Indexed keywords

EID: 0033241136     PISSN: 01466216     EISSN: None     Source Type: Journal    
DOI: 10.1177/01466219922031220     Document Type: Article

References (31)

1. Ayabe, C. R. (1985). Multicrossvalidation and the jackknife in the estimation of shrinkage of the multiple coefficient of correlation. Educational and Psychological Measurement, 45, 445-451.
2. Browne, M. W. (1975). Comparison of single sample and cross-validation methods for estimating the mean squared error of prediction in multiple linear regression. British Journal of Mathematical and Statistical Psychology, 28, 112-120.
3. Burket, G. R. (1964). A study of reduced rank models for multiple prediction. Psychometric Monograph (No. 12).
4. Callender, J. C., Osburn, H. G., Greener, J. M., & Ashworth, S. (1982). Multiplicative validity generalization model: Accuracy of estimates as a function of sample size and mean variance, and shape of the distribution of true validities. Journal of Applied Psychology, 67, 859-867.
5. Campbell, J. P. (1974). A monte carlo approach to some problems inherent in multivariate prediction, with special reference to multiple regression. Unpublished manuscript, University of Minnesota, Department of Psychology.
6. Cattin, P. (1980a). Estimation of a regression model. Journal of Applied Psychology, 65, 407-414.
7. Cattin, P. (1980b). Note on the estimation of the squared cross-validated multiple correlation of a regression model. Psychological Bulletin, 87, 63-65.
8. Claudy, J. G. (1972). A comparison of five variable weighting procedures. Educational and Psychological Measurement, 32, 311-322.
9. Claudy, J. G. (1978). Multiple regression and validity estimation in one sample. Applied Psychological Measurement, 2, 595-607.
10. Cotter, K. L., & Raju, N. S. (1982). An evaluation of formula-based population squared cross-validity estimates in prediction. Educational and Psychological Measurement, 40, 101-112.
11. Darlington, R. B. (1978). Reduced-variance regression. Psychological Bulletin, 85, 1238-1255.
12. Darlington, R. B. (1996). Estimating the true accuracy of regression predictions. Midwestern Educational Researcher, 9, 29-31.
13. Dorans, N. J., & Drasgow, F. (1978). Alternative weighting schema for linear prediction. Organizational Behavior and Human Performance, 21, 316-345.
14. Dorans, N. J., & Drasgow, F. (1980). A note on cross-validating prediction equations. Journal of Applied Psychology, 65, 728-730.
15. Drasgow, F., Dorans, N. J., & Tucker, L. R. (1979). Estimators of the squared cross-validity coefficient: A monte carlo investigation. Applied Psychological Measurement, 3, 387-399.
16. Eggebrecht, R. (1980). Estimating validity and population cross-validity: A Monte Carlo investigation. Unpublished doctoral dissertation, Illinois Institute of Technology, Chicago.
17. Fowler, R. L. (1986). Confidence intervals for the cross-validated multiple correlation in predictive regression models. Journal of Applied Psychology, 71, 318-322.
18. Herzberg, P. A. (1969). The parameters of cross-validation. Psychometrika, 34, 1-68.
19. Huberty, C. J., & Mourad, S. A. (1980). Estimation in multiple correlation/prediction. Educational and Psychological Measurement, 40, 101-112.
20. IMSL (1982). International mathematical and statistical libraries. Houston TX: Author.
21. Kennedy, E. (1988). Estimation of the squared cross-validity coefficient in the context of best subset regression. Applied Psychological Measurement, 12, 231-237.
22. Kromrey, J. D., & Hines, C. V. (1995). Use of empirical estimates of shrinkage in multiple regression: A caution. Educational and Psychological Measurement, 53, 901-925.
23. Krus, D. J., & Fuller, E. A. (1982). Computer assisted multicrossvalidation in regression analysis. Educational and Psychological Measurement, 42, 187-193.
24. Laughlin, J. E. (1978). Comment on "Estimating coefficients in linear models: It don't make no nevermind." Psychological Bulletin, 85, 247-253.
25. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading MA: Addison-Wesley.
26. Mitchell, T. W., & Klimoski, R. J. (1986). Estimating the validity of cross-validity estimation. Journal of Applied Psychology, 71, 311-317.
27. Raju, N. S., Bilgic, R., Edwards, J. E., & Fleer, P. F. (1997). Methodology review: Estimation of population validity and cross-validity, and the use of equal weights. Applied Psychological Measurement, 21, 291-305.
28. Schmidt, F. L. (1971). The relative efficiency of regression in simple unit predictor weights in applied differential psychology. Educational and Psychological Measurement, 31, 699-714.
29. Schmitt, N., Coyle, B. W., & Rauschenberger, J. (1977). A Monte Carlo evaluation of three formula estimates of cross-validated multiple correlation. Psychological Bulletin, 84, 751-758.
30. Wainer, H. (1976). Estimating coefficients in linear models: It don't make no nevermind. Psychological Bulletin, 83, 213-217.
31. Wilbourn, J. M., Valentine, L. D., & Ree, M. J. (1984). Relationships of the Armed Services Vocational Aptitude Battery (ASVAB) Forms 8, 9, and 10 to the Air Force technical school final grades (AFHRL-TR-84-8, AD-A144 213). Brooks Air Force Base TX: Manpower and Personnel Division, Air Force Human Resources Laboratory.