Examining guidelines for developing accurate proficiency level scores

Canadian Journal of Education

Volumn 29, Issue 3, 2006, Pages 823-838

  Ercikan, Kadriye ^a  

^a NONE

Author keywords

Assessment design; Classification accuracy; Proficiency level scores; Reliability

Indexed keywords

EID: 33847326322     PISSN: 03802361     EISSN: None     Source Type: Journal    
DOI: 10.2307/20054197     Document Type: Article

References (19)

1. British Columbia Ministry of Education. (2001). Interpreting and communicating British Columbia Foundation Skills Assessment Results, 2000. Vancouver, BC: The Author
2. Burket, G. (1991). PARDUX [Computer program]. Unpublished. Monterey, CA: CTB/McGraw-Hill.
3. Burket, G. (1993). FLUX [Computer program]. An unpublished IRT estimation and graphic analysis program. Monterey, CA: CTB/McGraw-Hill.
4. Cohen, J. A. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 3746.
5. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
6. Ercikan, K., & Julian, M. (2002). Classification accuracy of assigning student performance to proficiency levels: Guidelines for assessment design. Applied Measurement in Education, 15, 269-294.
7. Hambleton, R. K., & Slater, S. C. (1997). Reliability of credentialing examinations and the impact of scoring models and standard-setting policies. Applied Measurement in Education, 10, 19-39.
8. Huynh, H. (1976). On the reliability of domain-referenced testing. Journal of Educational Measurement, 13, 253-359.
9. Huynh, H. (1979). Computation and inference for two reliability indices in mastery testing based on the Beta-nomial model. Journal of Educational Statistics, 4, 231-246.
10. Huynh, H., & Saunders, J. C. (1980). Accuracy of two procedures for estimating reliability of mastery tests. Journal of Educational Measurement, 4, 351-358.
11. Livingston, S. A., & Lewis, C. (1995). Estimating the consistency and accuracy of classifications based on test scores. Journal of Educational Measurement, 32, 179-198.
12. Livingston, S. A., & Wingersky, M. S. (1979). Assessing the reliability of tests used to make pass/fail decisions. Journal of Educational Measurement, 16, 247-260.
13. Lord, F. M. (1980). Applications of item response Theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
14. Subkoviak, M. J. (1976). Estimating reliability from a single administration of a criterion-referenced test. Journal of Educational Measurement, 13, 265-276.
15. Swaminathan, H., Hambleton, R. H., & Algina, J. (1974). Reliability of criterion-referenced tests: A decision-theoretic formulation. Journal of Educational Measurement, 11, 263-267.
16. Traub, R. E., Haertel, E. H., & Shavelson, R. J. (1996, April). The effects of measurement error on the trustworthiness of examinee classification. Paper presented at the 1996 annual conference of the American Educational Research Association (Session 54.40), New York.
17. Traub, R. E., & Rowley, G. L. (1980). Reliability of test scores and decisions. Applied Psychological Measurement, 4, 517-545.
18. Wilcox, R. R. (1981). A review of the Beta-binomial model and its extensions. Journal of Educational Statistics, 6, 3-32.
19. Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187-213.