Classification Accuracy of Assigning Student Performance to Proficiency Levels: Guidelines for Assessment Design

Applied Measurement in Education

Volumn 15, Issue 3, 2002, Pages 269-294

  Ercikan, Kadriye ^a,c   Julian, Marc ^b  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b ETSK 12 Works Inc   (United States)

^c Faculty of Education   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0036037046     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15324818AME1503_3     Document Type: Article

References (27)

1. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
2. Bock., R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Applicaiion of an EM algorithm. Psychometrika, 66, 443-459.
3. Burket, G. (1991). PARDUX [Computer program]. Unpublished.
4. Burket, G. (1993). FLUX [Computer program]. An unpublished IRT estimation and graphic analysis program. Monterey, CA: CTB/McGraw-Hill.
5. Burket, G. (1995). BSSIM. An unpublished IRT simulation software. Monterey, CA: CTB/ McGraw-Hill.
6. Cohen. J. A. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
7. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
8. CTB/McGraw-Hill. (1996). TerraNova-CTBS. Monterey, CA: Author.
9. Fitzpatrick, A. R. (1991). Status report on the results of preliminary analyses of dichotomous and multi-level items using the PARMATE program. Monterey, CA: CTB/McGraw-Hill.
10. Fitzpatrick, A. R., & Julian, M. W. (1996). Two studies comparing the parameter estimates produced by PARDUX and PAKSCALE. Monterey, CA: CTB/McGraw-Hill.
11. Hambleton, R. K., & Slater, S. C. (1997). Reliability of credentialing examinations and the impact of scoring models and standard-setting policies. Applied Measurement in Education, 10, 19-39.
12. Huynh, H. (1976). On the reliability of domain-referenced testing. Journal of Educational Measurement, 13, 253-359.
13. Livingston, S. A., & Lewis, C. (1995). Estimating the consistency and accuracy of classifications based on test scores. Journal of Educational Measurement, 32, 179-198.
14. Livingston, S. A., & Wingersky, M. S. (1979). Assessing the reliability of tests used to make pass/fail decisions. Journal of Educational Measurement, 16, 247-260
15. Lord, F. M. (1980). Applications of item response theory to practical testing problems, Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
16. Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
17. Muraki, E., & Bock, R. D. (1995). PARSCALE. [Computer program]. Lincolnwood, IL: Scientific Software International, Inc.
18. Stocking, M. L., & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.
19. Subkoviak. M. J. (1976). Estimating reliability from a single administration of a criterion-referenced test. Journal of Educational Measurement, 13, 265-276.
20. Swaminathan, H., Hambleton, R. K., & Algina, J. (1974). Reliability of criterion-referenced tests: A decision-theoretic formulation. Journal of Educational Measurement, 11, 263-267.
21. Thissen, D. (1982). Marginal maximum likelihood estimation for the one-parameter logistic model. Psychometrika, 47, 175-186.
22. Thissen, D. (1990). MIH-TILOG: Multiple categorical item analysis and test scoring (version 6) [Computer program]. Mooresville, IN; Scientific Software.
23. Traub, R. E., Haertel, E. H., & Shavelson, R. J. (1996, April). The effects of measurement error on the trustworthiness of examinee classification. Paper presented at the 1996 annual meeting of the American Educational Research Association (Session 54.40), New York.
24. Traub, R. E., & Rowley, G. L. (1980). Reliability of test scores and decisions. Applied Psychological Measurement, 4, 517-545.
25. Wilcox, R. R. (1981). A review of the beta-binomial model and its extensions. Journal of Educational Statistics, 6, 3-32.
26. Yen, W. M. (1991). Information, Unpublished manuscript.
27. Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187-213.