College Performance and Retention: A Meta-Analysis of the Predictive Validities of ACT® Scores, High School Grades, and SES

Educational Assessment

Volumn 20, Issue 1, 2015, Pages 23-45

  Westrick, Paul A ^a   Le, Huy ^b   Robbins, Steven B ^c   Radunzel, Justine M R ^a   Schmidt, Frank L ^d  

^a ACT INC   (United States)

^b UNIVERSITY OF TEXAS AT SAN ANTONIO   (United States)

^c EDUCATIONAL TESTING SERVICE   (United States)

^d UNIVERSITY OF IOWA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84924481667     PISSN: 10627197     EISSN: None     Source Type: Journal    
DOI: 10.1080/10627197.2015.997614     Document Type: Article

References (61)

1. ACT. (2007). The ACT technical manual. Iowa City, IA: Author.
2. ACT. (2008). The Student Readiness Inventory: SRI user's guide. Iowa City, IA: Author.
3. ACT. (2010). The national collegiate retention and persistence to degree rates. Iowa City, IA: Author.
4. AgrestiA., BoothJ. G., HobartJ. P., & CaffoB. (2000). Random-effects modeling of categorical response data. Sociological Methodology, 30, 27–80.
5. AllenJ. (2013). Updating the ACT College Readiness Benchmarks(ACT Research Report No. 2013-6).Iowa City, IA: ACT, Inc.
6. AllenJ., & RobbinsS. (2010). Effects of interest–major congruence, motivation, and academic performance on timely degree attainment. Journal of Counseling Psychology, 57, 23–35.
7. AllenJ., RobbinsS., CasillasA., & OhI. (2008). Third-year college retention and transfer: Effects of academic performance, motivation, and social connectedness. Research in Higher Education, 49, 647–664.
8. AllenJ., RobbinsS., & SawyerR. (2010). Can measuring psychosocial factors promote college success?Applied Measurement in Education, 23, 1–22.
9. AllenJ., & SconingJ. (2005). Using ACT Assessment scores to set benchmarks for college readiness(ACT Research Report No. 2005-3).Iowa City, IA: ACT, Inc.
10. BerryC. M., & SackettP. R. (2009). Individual differences in course choice result in underestimation of the validity of college admissions systems. Psychological Science, 20, 822–830.
11. BridgemanB., PollackJ., & BurtonN. (2008). Predicting grades in different types of college courses(College Board Research Report No. 2008-1, ETS RR-08-06).New York, NY: The College Board.
12. ColvinR. L. (1997, October 1). Q & A: Should UC do away with the SAT?Los Angeles Times. Retrieved from http://articles.latimes.com/.
13. CronbachL. (1960). Essentials of psychological testing (2nd ed.). New York, NY: Harper & Row.
14. GoldmanR. D., & WidawskiM. H. (1976). A within-subjects technique for comparing college grading standards: Implications in the validity of the evaluation of college achievement. Educational and Psychological Measurement, 36, 381–390.
15. GulliksenH. (1987). Theory of mental tests. Hillsdale, NJ: Erlbaum.
16. HumphreysL. G. (1968). The fleeting nature of the prediction of college academic success. Journal of Educational Psychology, 59, 375–380.
17. HunterJ. E., & SchmidtF. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.
18. HunterJ. E., SchmidtF. L., & LeH. (2006). Implications of direct and indirect range restriction for meta-analysis methods and findings. Journal of Applied Psychology, 91, 594–612.
19. JohnsonJ. T., & ReeM. J. (1994). RANGEJ: A Pascal program to compute the multivariate correction for range restriction. Journal of Educational and Psychological Measurement, 54, 693–695.
20. JohnsonV. E. (1997). An alternative to traditional GPA for evaluating student performance. Statistical Science, 12, 251–278.
21. KirkR. E. (2008). Statistics: An introduction (5th ed.). Belmont, CA: Thomson Wadsworth.
22. KobrinJ. L., PattersonB. F., ShawE. J., MatternK. D., & BarbutiS. M. (2008). The validity of the SAT for predicting first-year college grade point average(College Board Research Report 2008-5).New York, NY: The College Board.
23. KohnA. (2001). Two cheers for an end to the SAT. Chronicle of Higher Education, 9, p.B-12.
24. LawleyD. N. (1943). A note on Karl Pearson's selection formulae. Proceedings of the Royal Society of Edinburgh, LX/I-Part, 1(1), 28–30.
25. LeH., CasillasA., RobbinsS., & LangleyR. (2005). Motivational and skills, social, and self-management predictors of college outcomes: Constructing the Student Readiness Inventory. Educational and Psychological Measurement, 65, 482–508.
26. LinnR. L. (1982). Ability testing: Individual differences, prediction, and differential prediction. In A.Widgor & W.Garner (Eds.), Ability testing: Uses, consequences, and controversies (pp. 335–388). Washington, DC: National Academy Press.
27. MatternK. D., & PattersonB. F. (2010). The relationship between SAT scores and retention to the third year: 2006 cohort(College Board Statistical Report 2011-2).New York, NY: The College Board.
28. MatternK. D., & PattersonB. F. (2011a). The relationship between SAT scores and retention to the fourth year: 2006 validity sample(College Board Statistical Report 2011-6).New York, NY: The College Board.
29. MatternK. D., & PattersonB. F. (2011b). The relationship between SAT scores and retention to the second year: 2007 validity sample(College Board Statistical Report 2011-4).New York, NY: The College Board.
30. MatternK. D., & PattersonB. F. (2011c). Validity of the SAT for predicting fourth-year grades: 2006 SAT validity sample(College Board Statistical Report 2011-7).New York, NY: The College Board.
31. MatternK. D., & PattersonB. F. (2011d). Validity of the SAT for predicting second-year grades: 2006 SAT validity sample(College Board Statistical Report 2011-1).New York, NY: The College Board.
32. MatternK. D., & PattersonB. F. (2011e). Validity of the SAT for predicting third-year grades: 2006 SAT validity sample(College Board Statistical Report 2011-3).New York, NY: The College Board.
33. NobleJ. P., & SawyerR. L. (2004). Is high school GPA better than admission test scores for predicting academic success in college?College and University, 79(4), 17–22.
34. NobleJ., & SawyerR. (2013). A study of the effectiveness of developmental courses for improving success in college(ACT Research Report No. 2013-1).Iowa City, IA: ACT, Inc.
35. OswaldF. L., SchmittN., KimB. H., RamsayL. J., & GillespieM. A. (2004). Developing a biodata measure and situational judgment inventory as predictors of college success. Journal of Applied Psychology, 89, 187–208.
36. PascarellaE. T., & TerenziniP. T. (2005). How college affects students: A third decade of research. San Francisco, CA: Jossey-Bass.
37. PetersonC. H., CasillasA., & RobbinsS. B. (2006). The Student Readiness Inventory and the Big Five: Examining social desirability and college academic performance. Personality and Individual Differences, 41, 663–673.
38. RaudenbushS. W., & BrykA. S. (2002). Hierarchical linear models applications and data analysis methods. Thousand Oaks, CA: Sage.
39. ReeM. J., EarlesJ. A., & TeachoutM. S. (1994). Predicting job performance: Not much more than g. Journal of Applied Psychology, 79, 518–524.
40. RobbinsS., AllenJ., CasillasA., PetersonC., & LeH. (2006). Unraveling the differential effects of motivational and skills, social, and self-management measures from traditional predictors of college outcomes. Journal of Educational Psychology, 98, 598–616.
41. RobbinsS. B., LauverK., LeH., DavisD., LangleyR., & CarlstromA. (2004). Do psychosocial and study skill factors predict college outcomes? A meta-analysis. Psychological Bulletin, 130, 261–288.
42. RobbinsS., OhI., LeH., & ButtonC. (2009). Intervention effects on college performance and persistence, mediated by motivational, emotional, and social control factors: Integrated meta-analytic path analyses. Journal of Applied Psychology, 94, 1163–1184.
43. SackettP. R., KuncelN. R., ArnesonJ. J., CooperS. R., & WatersS. D. (2009). Does socioeconomic status explain the relationship between admission tests and post-secondary academic performance?Psychological Bulletin, 135, 1–22.
44. SackettP. R., & YangH. (2000). Correction for range restriction: An expanded typology. Journal of Applied Psychology, 85, 112–118.
45. SawyerR. (2007). Indicators of usefulness of test scores. Applied Measurement in Education, 20, 255–271.
46. SawyerR. (2010). Usefulness of high school average and ACT scores in making college admission decisions(ACT Research Report No. 2010-2).Iowa City, IA: ACT, Inc.
47. SchielJ., & NobleJ. (1991). Accuracy of self-reported course work and grade information of high school sophomores(ACT Research Report No. 91-6).Iowa City, IA: ACT, Inc.
48. SchmidtF. L., & HunterJ. E. (1999). Comparison of three meta-analysis methods revisited: An analysis of Johnson, Mullen, and Salas (1995). Journal of Applied Psychology, 84, 144–148.
49. SchmittN., KeeneyJ., OswaldF., PleskacT., BillingtonA., SinhaR., & ZorzieM. (2009). Prediction of 4-year college student performance using cognitive and noncognitive predictors and the impact on demographic status of admitted students. Journal of Applied Psychology, 94, 1479–1497.
50. ShawE. S., & MatternK. D. (2009). Examining the accuracy of self-reported high school grade point average(College Board Research Report No. 2009-5).New York, NY: The College Board.
51. SnyderT. D., & DillowS. A. (2010). Digest of Education Statistics 2009(NCES 2010-013).Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.
52. StrentaA. C., & ElliotR. (1987). Differential grading revisited. Journal of Educational Measurement, 24, 281–291.
53. StrentaA. C., ElliotR., AdairR., MatierM., & ScottJ. (1994). Choosing and leaving science in highly selective institutions. Research in Higher Education, 35, 513–547.
54. U.S. Department of Education, National Center for Education Statistics. (2011). Web tables—Six-year attainment, persistence, transfer, retention, and withdrawal rates of students who began postsecondary education in 2003–04. (NCES 2011-152). Retrieved from http://nces.ed.gov/pubs2011/2011152.pdf.
55. U.S. General Accounting Office. (2003). College completion additional efforts could help education with its completion goals(GAO-03-568).Washington, DC: Author.
56. WillinghamW. W., LewisC., MorganR., & RamistL. (1990). Predicting College Grades: An analysis of institutional trends over two decades. Princeton, NJ: Educational Testing Service.
57. WillinghamW. W., PollackJ. M., & LewisC. (2002). Grades and test scores: Accounting for observed differences. Journal of Educational Measurement, 39, 1–37.
58. WilsonK. M. (1983). A review of research on the prediction of academic performance after the freshman year(College Board Research Report No. 83-2).New York, NY: The College Board.
59. WoodruffD. J., & ZiomekR. L. (2004a). Differential grading standards among high schools(ACT Research Report 2004-2).Iowa City, IA: ACT, Inc.
60. WoodruffD. J., & ZiomekR. L. (2004b). High school grade inflation from 1991 to 2003(ACT Research Report 2004-4).Iowa City, IA: ACT, Inc.
61. ZwickR. (2006). Higher education admission testing. In R.Brennan (Ed.), Educational measurement (4th ed., pp. 647–679). Westport, CT: American Council on Education, Praeger.