Assessing differential prediction of college grades by race/ethnicity with a multilevel model

Journal of Educational Measurement

Volumn 46, Issue 2, 2009, Pages 220-242

  Culpepper, Steven A ^a,c   Davenport, Ernest C ^b  

^a UNIVERSITY OF COLORADO   (United States)

^b UNIVERSITY OF MINNESOTA   (United States)

^c UNIVERSITY OF COLORADO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 66749129650     PISSN: 00220655     EISSN: 17453984     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2009.00079.x     Document Type: Article

References (85)

1. Abelson, R. P. (1952). Sex differences in predictability of college grades. Educational and Psychological Measurement, 12, 638 644.
2. Aguinis, H. (1995). Statistical power problems with moderated multiple regression in management research. Journal of Management, 21, 1141 1158.
3. Aguinis, H., Stone-Romero, E. F. (1997). Methodological artifacts in moderated multiple regression and their effects on statistical power. Journal of Applied Psychology, 82, 192 206. (Pubitemid 127038754)
4. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC : American Educational Research Association.
5. Bartlett, C. J., Bobko, P., Mosier, S. B., Hannan, R. (1978). Testing for fairness with a moderated multiple regression strategy: An alternative to differential analysis. Personnel Psychology, 31, 233 241.
6. Bartlett, C. J., O'Leary, B. S. (1969). A differential prediction model to moderate the effects of heterogeneous groups in personnel selection and classification. Personnel Psychology, 22, 1 17.
7. Barton, P. (2003). Parsing the achievement gap: Baselines for tracking progress (Policy Information Report No. PIC-PARSING). Princeton, NJ : Educational Testing Service.
8. Bowen, W. G., Bok, D. C. (1998). The shape of the river: Long-term consequences of considering race in college and university admissions. Princeton, NJ : Princeton University Press.
9. Bowen, W. G., Kurzweil, M. A., Tobin, E. M. (2005). Equity and excellence in American higher education. Charlottesville : University of Virginia Press.
10. Bowers, J. (1970). The comparison of GPA regression equations for regularly admitted and disadvantaged freshmen at the University of Illinois. Journal of Educational Measurement, 7, 219 225.
11. Breland, H. M. (1979). Population validity and college entrance measures (Research Monograph No. 8). New York : College Entrance Examination Board.
12. Bridgeman, B., McCamley-Jenkins, L., Ervin, N. (2000). Predictions of freshman grade-point average from the revised and recentered SAT I: Reasoning Test (Research Report No. 2000-1). New York : College Entrance Examination Board.
13. Bridgeman, B., Wendler, C. (1991). Gender differences in predictors of college mathematics performance and in college mathematics course grades. Journal of Educational Psychology, 83, 275 284.
14. Brown, F. G., Scott, D. A. (1967). Differential predictability in college admission testing. Journal of Educational Measurement, 4, 163 166.
15. Burton, N. W., Ramist, L. (2001). Predicting success in college: SAT® studies of classes graduating since 1980 (Research Report No. 2001-1). New York : College Entrance Examination Board.
16. Camara, W. J. (1998). High school grading policies (Research Notes No. 4). New York : College Entrance Examination Board.
17. ® I and high school grades: Utility in predicting success in college (Research Notes No. RN-10). New York : College Entrance Examination Board.
18. Camara, W. J., Kimmel, E., Scheuneman, J., Sawtell, E. A. (2003). Whose grades are inflated Research Report No. 2003-4). New York : College Entrance Examination Board.
19. Carcieri, M. D. (2004). The University of Michigan affirmative action cases and public personnel decisions. Review of Public Personnel Administration, 24, 70 76.
20. Centra, J. A. (1970). Black students at predominantly white colleges: A research description. Sociology of Education, 43, 325 339.
21. Cleary, T. A. (1968). Test bias: Prediction of grades of Negro and White students in integrated colleges. Journal of Educational Measurement, 5, 115 124.
22. Cleary, T. A., Humphreys, L. G., Kendrick, S. A., Wesman, A. (1975). Educational uses of tests with disadvantaged students. American Psychologist, 30, 15 41.
23. Colorado Commission on Higher Education (2007). CCHE Admissions Eligibility Index, Fall 2008-Fall 2010. Retrieved March 4, 2008 from http://highered.colorado.gov/Publications/Policies/Current/i-partf-index.pdf
24. Darlington, R. B. (1971). Another look at "cultural fairness Journal of Educational Measurement, 8, 71 82.
25. Davison, M. L., Kwak, N., Seo, Y. S., Choi, J. (2002). Using hierarchical linear models to examine moderator effects: Person-by-organization interactions. Organizational Research Methods, 5, 231 254.
26. Dorans, N. J. (2004). Using subpopulation invariance to assess test score equity. Journal of Educational Measurement, 41, 43 68. (Pubitemid 38919492)
27. Duran, R. P. (1983). Hispanics' education and background: Predictors of college achievement (Research Report). New York : College Entrance Examination Board.
28. Elliot, E. W., Ewoh, A. I. E. (2005). Beyond Gratz and Grutter: Prospects for affirmative action in the aftermath of the Supreme Court's Michigan decisions. Review of Policy Research, 22, 541 553. (Pubitemid 41043461)
29. Geiser, S., Studley, R. (2001). UC and the SAT: Predictive validity and differential impact of the SAT I and SAT II at the University of California. Oakland, CA : Office of the President, University of California.
30. Goldman, R. D., Hewitt, B. N. (1975). An investigation of test bias for Mexican-American college students. Journal of Educational Measurement, 12, 187 196.
31. Goldman, R. D., Hewitt, B. N. (1976). Predicting the success of Black, Chicano, Oriental, and White college students. Journal of Educational Measurement, 13, 107 117.
32. Goldman, R. D., Richards, R. (1974). The SAT prediction of grades for Mexican-American versus Anglo-American students at the University of California, Riverside. Journal of Educational Measurement, 11, 129 135.
33. Gratz v. Bollinger, 539 U.S. 244 (2003).
34. Grutter v. Bollinger, 539 U.S. 306 (2003).
35. Gulliksen, H., Wilks, S. S. (1950). Regression tests for several samples. Psychometrika, 15, 91 114.
36. Hubin, D. R. (1988). The Scholastic Aptitude Test: Its development and introduction, 1900-1948. Unpublished doctoral dissertation, University of Oregon, Eugene.
37. Humphreys, L. (1952). Individual differences. Annual Review of Psychology, 3, 131 150.
38. Hurtado, S., Milem, J. F., Clayton-Pedersen, A. R., Allen, W. R. (1998). Enhancing campus climates for racial/ethnic diversity: Educational policy and practice. Review of Higher Education, 21, 279 302.
39. Initiative 200 (1998). Retrieved July 1, 2008 from http://www.secstate. wa.gov/elections/1998/i200-text.aspx
40. Kallingal, A. (1971). The prediction of grades for black and white students at Michigan State University. Journal of Educational Measurement, 8, 263 265.
41. Kamata, A. (1998, April). One-parameter hierarchical generalized linear logistic model: An application of HGLM to IRT. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
42. ® I and SAT II for admissions decisions in California and the nation (Research Report No. 2002-6). New York : College Entrance Examination Board.
43. Lefkowitz, J. (1972). Differential validity: Ethnic group as a moderator in predicting tenure. Personnel Psychology, 25, 223 240.
44. Linn, R. L. (1973). Fair test use in selection. Review of Educational Research, 43, 139 161.
45. Linn, R. L., Werts, C. E. (1971). Considerations for studies of test bias. Journal of Educational Measurement, 8, 1 4.
46. Long, M. C. (2004). Race and college admissions: An alternative to affirmative action? Review of Economics and Statistics, 84, 1020 1033. (Pubitemid 40031305)
47. Missouri Department of Higher Education (2008). Admissions criteria. Retrieved July 1, 2008 from http://www.dhe.mo.gov/admissionscriteria.shtml
48. Morgan, R. (1989). Analyses of the predictive validity of the SAT and high school grades from 1976 to 1985 (Research Report No. 89-7). New York : College Entrance Examination Board.
49. Nettles, M. T., Thoeny, A. R., Gosman, E. J. (1986). Comparative and predictive analyses of black and white students' college achievement and experiences. Journal of Higher Education, 57, 289 318.
50. Noble, J. (2003). The effects of using ACT composite score and high school average on college admission decisions for racial/ethnic groups (ACT Research Report Series No. 1). Iowa City, IA : American College Testing Program.
51. Noble, J., Sawyer, R. (1997). Alternative methods for validating admissions and course placement criteria. Professional File, 63, 1 12.
52. Norris, D., Oppler, S., Kuang, D., Day, R., Adams, K. (2006). The College Board SAT® Writing validation study: An assessment of predictive and incremental validity (Research Report No. 2006-2). New York : College Entrance Examination Board.
53. Norton, M. I., Sommers, S. R., Vandello, J. A., Darley, J. M. (2006). Mixed motives and racial bias: The impact of legitimate and illegitimate criteria on decision making. Psychology, Public Policy, and Law, 12, 36 55.
54. Oklahoma State Regents for Higher Education (2008). Oklahoma state college and university admission standards for fall 2008. Retrieved July 1, 2008 from http://www.utahsbr.edu/prospective-students/admissions/index-chart.htm
55. Perfetto, G., Escandon, M., Graff, S., Rigol, G., Schmidt, A. (1999). Toward a taxonomy of the admissions decision-making process: A public document based on the first and second College Board Conferences on admissions models. New York : College Entrance Examination Board.
56. Pfeifer, C. M., Sedlacek, W. E. (1971). The validity of academic prediction for black and white students at a predominantly white university. Journal of Educational Measurement, 8, 253 261.
57. Proposal 06-2 (2006). Retrieved July 1, 2008 from http://www.senate. michigan.gov/sfa/Publications/BallotProps/Proposal06-2&06-4fold.pdf
58. Proposition 209 (1996). Retrieved July 1, 2008 from http://vote96.sos.ca. gov/Vote96/html/BP/209.htm
59. Raudenbush, S. W., Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA : Sage Publications.
60. Raudenbush, S. W., Bryk, A. S., Congdon, R. (2005). HLM 6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL : Scientific Software International, Inc.
61. Raudenbush, S. W., Sampson, R. J. (1999). Ecometrics: Toward a science of assessing ecological settings, with application to the systematic social observations of neighborhoods. Sociological Methodology, 29, 1 41.
62. Rigol, G. (1997). Common sense about SAT score differences and test validity (Research Notes No. RN-01). New York : College Entrance Examination Board.
63. Rigol, G. (2003). Admissions decision-making models: How U.S. institutions of higher education select undergraduate students. New York : College Entrance Examination Board.
64. Rijmen, F., Tuerlinckx, F., De Boeck, P., Kuppens, P. (2003). A nonlinear mixed model framework for item response theory. Psychological Methods, 8, 185 205. (Pubitemid 37189472)
65. Sabbagh, D. (2003). Judicial uses of subterfuge: Affirmative action reconsidered. Political Science Quarterly, 118, 411 436. (Pubitemid 37537527)
66. Saunders, D. R. (1956). Moderator variables in prediction. Educational and Psychological Measurement, 16, 209 222.
67. Sireci, S. G., Talento-Miller, E. (2006). Evaluating the predictive validity of Graduate Management Admission Test scores. Educational and Psychological Measurement, 66, 305 317.
68. Stanley, J. C., Porter, A. C. (1967). Correlation of scholastic aptitude test scores with college grades for negroes versus whites. Journal of Educational Measurement, 4, 199 218.
69. Steinberg, J. (2002). The gatekeepers: Inside the admissions process of a premier college. New York : Viking.
70. Stricker, L. J., Rock, D. A., Burton, N. W. (1993). Sex differences in predictions of college grades from scholastic aptitude test scores. Journal of Educational Psychology, 85, 710 718.
71. Tam, M. S., Sukhatme, U. (2004). How to make better college admission decisions: Considering high school quality and other factors. Journal of College Admission, 183, 12 16.
72. Temp, G. (1971). Validity of the SAT for blacks and whites in thirteen integrated institutions. Journal of Educational Measurement, 8, 245 251.
73. Thomas, C. L., Stanley, J. C. (1969). Effectiveness of high school grades for predicting college grades of black students: A review and discussion. Journal of Educational Measurement, 6, 203 215.
74. Thorndike, R. L. (1971). Concepts of culture-fairness. Journal of Educational Measurement, 8, 63 70.
75. Utah System of Higher Education (2007). Admissions index chart. Retrieved March 8, 2007 from http://www.utahsbr.edu/prospective-students/admissions/ index-chart.htm
76. Washington Higher Education Coordinating Board (2007). What is an admissions index Retrieved March 8, 2007 from http://www.hecb.wa.gov/research/ issues/admissionsindexinfo.asp
77. Wiener, R., Pristoop, E. (2006). How states shortchange the districts that need the most help. Washington, DC : The Education Trust.
78. Wilson, K. M. (1983). A review of research on the prediction of academic performance after the freshman year (College Board Research Report No. 83-2 and Educational Testing Service Research Report No. 83-11). New York : College Entrance Examination Board.
79. Young, J. W. (1990). Adjusting the cumulative GPA using item response theory. Journal of Educational Measurement, 27, 175 186.
80. Young, J. W. (1991a). Gender bias in predicting college academic performance. Journal of Educational Measurement, 28, 37 47.
81. Young, J. W. (1991b). Improving the prediction of college performance of ethnic minorities using the IRT-based GPA. Applied Measurement in Education, 4, 229 239.
82. Young, J. W. (1994). Differential prediction of college grades by gender and by ethnicity: A replication study. Educational and Psychological Measurement, 54, 1022 1029.
83. Young, J. W. (2001). Differential validity, differential prediction, and college admission testing: A comprehensive review and analysis (Research Report No. 2001-6). New York : College Entrance Examination Board.
84. Zwick, R. (2002). Fair game? The use of standardized admissions tests in higher education. New York : Routledge Falmer.
85. Zwick, R., Schlemer, L. (2004). SAT validity for linguistic minorities at the University of California, Santa Barbara. Educational Measurement: Issues and Practice, 23 (1 6 16.