Subscores based on classical test theory: To report or not to report

Educational Measurement: Issues and Practice

Volumn 26, Issue 4, 2007, Pages 21-28

  Sinharay, Sandip ^a   Haberman, Shelby ^a   Puhan, Gautam ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Institutional level subscore; Mean squared error; Reliability

Indexed keywords

EID: 36148946825     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2007.00105.x     Document Type: Article

References (20)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington DC : AERA.
2. de la Torre, J., & Patz, R. J. (2005). Making the most of what we have: A practical application of multidimensional IRT in test scoring. Journal of Educational and Behavioral Statistics, 30, 295 311.
3. Dwyer, A., Boughton, K. A., Yao, L., Steffen, M., & Lewis, D. (2006). A comparison of subscale score augmentation methods using empirical data. Paper presented at the Annual Meeting of the National Council on Measurement in Education, San Fransisco, CA.
4. Educational Testing Service (2006). Interpreting the Praxis™ Institutional Summary Report. Princeton, NJ. Retrieved August 15, 2006, from http://www.ets.org/Media/Tests/PRAXIS/pdf/ interpreting_praxis_score_reports_51657.pdf.
5. Grandy, J. (1992). Construct Validity Study of the NTE Core Battery Using Confirmatory Factor Analysis (ETS RR 92-03). Princeton, NJ : Educational Testing Service.
6. Grant, M. (2003). Fundamental subjects: Content knowledge (0511), test analysis, form 3ypx1 (Report No. SR-2003-62). Princeton, NJ : ETS.
7. Haberman, S. J. (2005). When can subscores have value? (ETS RR-05-08). Princeton, NJ : Educational Testing Service.
8. Haberman, S. J., Sinharay, S., & Puhan, G. (2006). Subscores for institutions ETS RR-06-13). Princeton, NJ : Educational Testing Service.
9. Haberman, S. J., & von Davier, M. (2006). Some notes on models for cognitively based skills diagnosis. In C. R. Rao & S. Sinharay (Eds. Handbook of statistics 26 (pp. 1031 1038). Amsterdam : Elsevier North-Holland.
10. Haladyna, T. M., & Kramer, G. A. (2004). The validity of subscores for a credentialing test. Evaluation and the Health Professions, 24 (7 349 368.
11. Harris, D. J., & Hanson, B. A. (1991). Methods of examining the usefulness of subscores. Paper presented at the Annual Meeting of the National Council on Measurement in Education, Chicago, IL.
12. Kane, M. T. (2006). Content-related validity evidence. In S. M. Downing & T. M. Haladyna (Eds. Handbook of test development, pp. 131 154. Mahwah, NJ : Lawrence Erlbaum Associates.
13. Kuder, G., & Richardson, M. (1937). The theory of estimation of test reliability. Psychometrika, 2, 151 160.
14. Longford, N. T. (1990). Multivariate variance component analysis: An application in test development. Journal of Educational Statistics, 15 (2 91 112.
15. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA : Addison-Wesley.
16. Tate, R. L. (2004). Implications of multidimensionality for total score and subscore performance. Applied Measurement in Education, 17 (2 89 112.
17. Wainer, H., Sheehan, K., & Wang, X. (2000). Some paths toward making praxis scores more useful. Journal of Educational Measurement, 37, 113 140.
18. Wainer, H., Vevea, J. L., Camacho, F., Reeve, B. B., Rosa, K., Nelson, L., Swygert, K. A., & Thissen, D. (2001). Augmented scores - "borrowing strength" to compute scores based on small numbers of items. In D. Thissen & H. Wainer (Eds. Test scoring (pp. 343 387). Hillsdale, NJ : Lawrence Erlbaum.
19. Yao, L. H., & Boughton, K. A. (2007). A multidimensional item response modeling approach for improving subscale proficiency estimation and classification. Applied Psychological Measurement, 31 (2 83 105.
20. Yen, W. M. (1987). A Bayesian/IRT index of objective performance. Paper presented at the annual meeting of the Psychometric Society, Montreal, Quebec, Canada, June 1-19.