How often do subscores have added value? Results from operational and simulated data

Journal of Educational Measurement

Volumn 47, Issue 2, 2010, Pages 150-174

  Sinharay, Sandip ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77954712546     PISSN: 00220655     EISSN: 17453984     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2010.00106.x     Document Type: Article

References (22)

1. Ackerman T, Shu Z. Using confirmatory MIRT modeling to provide diagnostic information in large scale assessment. Paper presented at the meeting of the National Council on Measurement in Education 2009, April, San Diego, CA
2. Standards for educational and psychological testing 1999, American Educational Research Association, American Psychological Association, & National Council on Measurement in Education, Washington, DC, American Educational Research Association
3. Beaton A E, Allen N L. Interpreting scales through scale anchoring. Journal of Educational Statistics 1992, 17:191-204.
4. Bock R D, Petersen A C. A multivariate correction for attenuation. Biometrika 1975, 62:673-678.
5. Haberman S J. When can subscores have value. Journal of Educational and Behavioral Statistics 2008, 33:204-229.
6. Haberman S J, Sinharay S. Reporting of subscores using multidimensional item response theory. Psychometrika
7. Haberman S J, Sinharay S, Puhan G. Reporting subscores for institutions. British Journal of Mathematical and Statistical Psychology 2009, 62:79-95.
8. Haberman S J, von Davier M, Lee Y. Comparison of multidimensional item response models: Multivariate normal ability distributions versus multivariate polytomous distributions 2008, (ETS Research Report No. RR-08-45), Princeton, NJ, Educational Testing Service
9. Haladyna S J, Kramer G A. The validity of subscores for a credentialing test. Evaluation and the Health Professions 2004, 24:349-368.
10. Harris D J, Hanson B A. Methods of examining the usefulness of subscores. Paper presented at the meeting of the National Council on Measurement in Education 1991, April, Chicago, IL
11. Henson R, Templin J, Irwin P. Ancillary random effects: A way to obtain diagnostic information from existing large scale tests. Paper presented at the meeting of the National Council on Measurement in Education 2009, April, San Diego, CA
12. Kamata A, Turhan A, Darandari E. Estimating reliability for multidimensional composite score scale scores. Paper presented at the meeting of the American Educational Research Association 2003, April, Chicago, IL
13. Ling G. Why the major field (business) test does not report subscores of individual test-takers-reliability and construct validity evidence. Paper presented at the meeting of the National Council on Measurement in Education 2009, April, San Diego, CA
14. Lyren P. Reporting subscores from college admission tests. Practical Assessment, Research, and Evaluation 2009, 14:1-10.
15. Puhan G, Sinharay S, Haberman S J, Larkin K. Comparison of subscores based on classical test theory methods 2008, (ETS Research Report No. RR-08-54), Princeton, NJ, Educational Testing Service
16. Reckase M D. Multidimensional item response theory. Handbook of statistics 2007, Vol. 26:607-642. Rao C RSinharay S. In, Eds., pp, Amsterdam, The Netherlands, North-Holland
17. Sinharay S. Bayesian item fit analysis for unidimensional item response theory models. British Journal of Mathematical and Statistical Psychology 2006, 59:429-449.
18. Sinharay S, Haberman S J. Reporting subscores: A survey 2008, (ETS Research Memorandum No. RM-08-18), Princeton, NJ, Educational Testing Service
19. Sinharay S, Haberman S J, Puhan G. Subscores based on classical test theory: To report or not to report. Educational Measurement: Issues and Practice 2007, 26(4):21-28.
20. Stone C A, Ye F, Zhu X, Lane S. Providing subscale scores for diagnostic information: A case study when the test is essentially unidimensional. Applied Measurement in Education 2010, 23:63-86.
21. Tate R L. Implications of multidimensionality for total score and subscore performance. Applied Measurement in Education 2004, 17:89-112.
22. Wainer H, Vevea J L, Camacho F, Reeve B B, Rosa K, Nelson L. Augmented scores-" Borrowing strength" to compute scores based on small numbers of items. Test scoring 2001, 343-387. Thissen D, Wainer H, In, Eds., pp, Hillsdale, NJ, Lawrence Erlbaum