Reporting subscores from college admission tests

Practical Assessment, Research and Evaluation

Volumn 14, Issue 4, 2009, Pages

  Lyrén, Per Erik ^a  

^a UMEÅ UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77953485769     PISSN: None     EISSN: 15317714     Source Type: Journal    
DOI: None     Document Type: Article

References (41)

1. (2007) ACT. ACT technical manual. Iowa City, IA: Author.
2. Allalouf, A. (2003). Scoring and equating at the National Institute for Testing and Evaluation (Based on Allalouf, A. (1999) Scoring and equating at the National Institute for Testing and Evaluation. Research Report No. 269). Jerusalem: National Institute for Testing and Evaluation.
3. American College Testing (1989). P-ACT+ Program technical manual. Iowa City, IA: Author. American Educational Research Association, American Psychological Association, & National Council on
4. Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
5. Carlstedt, B., & Gustafsson, J.-E. (2005). Construct validation of the Swedish Scholastic Aptitude Test by means of the Swedish Enlistment Battery. Scandinavian Journal of Psychology, 46(1), 31-42.
6. Chalifour, C., & Powers, D. E. (1988). Content characteristics of GRE Analytical Reasoning items (ETS Research Report No. RR-88-07). Princeton, NJ: Educational Testing Service.
7. College Board (2008). The SAT Program handbook. New York: Author. College Board, & National Merit Scholarship Corporation (2008a). Official educator guide to the PSAT/NMSQT. New York: College Board. Retrieved March 4, 2009, from http://professionals.collegeboard.com/profdownload/official-educator-guide-to-the-psat-nmsqt.pdf
8. College Board, & National Merit Scholarship Corporation (2008b). Understanding 2008 PSAT/NMSQT scores. New York: College Board. Retrieved March 4, 2009, from http://professionals.collegeboard.com/profdownload/understanding-psat-nmsqt-scores.pdf
9. Dwyer, C. A., & Villegas, A. M. (1993). Guiding conceptions and assessment principles for the Praxis Series: Professional assessments for beginning teachers. (ETS Research Report No. RR-93-17). Princeton, NJ: Educational Testing Service.
10. Edwards, M. C., & Vevea, J. L. (2006). An empirical Bayes approach to subscore augmentation: How much strength can we borrow? Journal of Educational and Behavioral Statistics, 31(3), 241-259.
11. Embretson, S. E. (1998). A cognitive design system approach to generating valid tests: Application to abstract reasoning. Psychological Methods, 3(3), 380-396.
12. Goodman, D. P., & Hambleton, R. K. (2004). Student test score reports and interpretive guides: Review of current practices and suggestions for future research. Applied Measurement in Education, 17(2), 145-220.
13. Haberman, S. J. (2005). When can subscores have value? (ETS Research Report No. RR-05-08). Princeton, NJ: Educational Testing Service.
14. Haberman, S. J. (2008). When can subscores have value? Journal of Educational and Behavioral Statistics, 33(2), 204-229.
15. Haberman, S. J., Sinharay, S., & Puhan, G. (2009). Reporting subscores for institutions. British Journal of Mathematical and Statistical Psychology, 62(1), 79-95.
16. Haladyna, T. M., & Kramer, G. A. (2004). The validity of subscores for a credentialing test. Evaluation & The Health Professions, 27(4), 349-368.
17. Hanson, B. A. (1989). Scaling the P-ACT+. In R. L. Brennan (Ed.), Methodology used in scaling the ACT Assessment and P-ACT+. Iowa City, IA: American College Testing.
18. Hanson, B. A., & Brennan, R. L. (1990). An investigation of classification consistency indexes estimated under alternative strong true score models. Journal of Educational Measurement, 27(4), 345-359.
19. Harris, D. J., & Hanson, B. A. (1991, April). Methods of examining the usefulness of subscores. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago.
20. Holland, P. W., & Hoskens, M. (2003). Classical test theory as a first-order item response theory: Application to true-score prediction from a possibly nonparallel test. Psychometrika, 68(1), 123-149.
21. Joint Commission on National Dental Examinations (2004). National board dental examinations technical report. Chicago: American Dental Association.
22. Kelley, T. L. (1947). Fundamentals of statistics. Cambridge, MA: Harvard University Press.
23. Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling and linking (2nd ed.). New York: Springer.
24. Longford, N. T. (1990). Multivariate variance component analysis: An application in test development. Journal of Educational and Behavioral Statistics, 15(2), 91-112.
25. Lord, F. M. (1965). A strong true score theory, with applications. Psychometrika, 30, 239-270.
26. McPeek, M., Altman, R., Wallmark, M., & Wingersky, B. C. (1976). An investigation of the feasibility of obtaining additional subscores on the GRE Advanced Psychology Test (GRE Board Professional Report No. 74-4P). Princeton, NJ: Educational Testing Service. (ERIC Document No. ED163090)
27. Monaghan, W. (2006). The facts about subscores (ETS R&D Connections No. 4). Princeton, NJ: Educational Testing Service. Retrieved January 29, 2009, from http://www.ets.org/Media/Research/pdf/RD_Connections4.pdf
28. National Institute for Testing and Evaluation (2009). How your scores are used? Retrieved February 3, 2009, from http://www.nite.org.il/scripts/english/txt.asp?pc=145617455&selFol=776228773&flag=0
29. Petersen, N. S., Kolen, M. J., & Hoover, H. D. (1989). Scaling, norming, and equating. In R. L. Linn (Ed.), Educational Measurement (3rd ed.). New York: American Council on Educational Measurement/Macmillan.
30. Puhan, G., Sinharay, S., Haberman, S. J., & Larkin, K. (2008). Comparison of subscores based on classical test theory methods (ETS Research Report No. RR-08-54). Princeton, NJ: Educational Testing Service.
31. Rudner, L. M., & Talento-Miller, E. (2007, April). Diagnostic testing using decision theory. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago.
32. Ryan, J. M. (2003). An analysis of item mapping and test reporting strategies. Greensboro, NC: South Carolina Department of Education.
33. Ryan, J. M. (2006). Practices, issues, and trends in student test score reporting. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development. Mahwah, NJ: Lawrence Erlbaum Associates.
34. Sheehan, K. M., & Mislevy, R. J. (1990). Integrating cognitive and psychometric models to measure document literacy. Journal of Educational Measurement, 27(3), 255-272.
35. Sinharay, S., Haberman, S. J., & Puhan, G. (2007). Subscores based on classical test theory: To report or not to report. Educational Measurement: Issues and Practice, 26(4), 21-28.
36. Tate, R. L. (2004). Implications of multidimensionality for total score and subscore performance. Applied Measurement in Education, 17(2), 89-112.
37. Wainer, H., Hambleton, R. K., & Meara, K. (1999). Alternative displays for communicating NAEP results: A redesign and validity study. Journal of Educational Measurement, 36(4), 301-335.
38. Wainer, H., Sheehan, K. M., & Wang, X. (2000). Some paths toward making Praxis scores more useful. Journal of Educational Measurement, 37(2), 113-140.
39. Wang, M. W., & Stanley, J. C. (1970). Differential weighting: A review of methods and empirical studies. Review of Educational Research, 4, 663-704.
40. Yao, L., & Boughton, K. A. (2007). A multidimensional item response modeling approach for improving subscale proficiency estimation and classification. Applied Psychological Measurement, 31(2), 83-105.
41. Yen, W. M. (1987). A Bayesian/IRT index of objective performance. Paper presented at the annual meeting of the Psychometric Society, Montreal, Québec, Canada., June