Recommendations for preparing and scoring constructed-response items: What the experts say

Applied Measurement in Education

Volumn 20, Issue 4, 2007, Pages 427-441

  Hogan, Thomas P ^a   Murphy, Gavin ^a  

^a UNIVERSITY OF SCRANTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 41449084261     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1080/08957340701580736     Document Type: Review

References (32)

1. Allen, N. L., Holland, P. W., & Thayer, D. T. (1993). The optional essay problem and the hypothesis of equal difficulty. Research Report No. 93-40. Princeton, NJ: Educational Testing Service.
2. Allen, N. L., Holland, P. W., & Thayer, D. T. (2005). Measuring the benefits of examinee-selected questions. Journal of Educational Measurement, 42, 27-51.
3. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
4. American Federation of Teachers, National Council on Measurement in Education, & National Education Association. (1990). Standards for teacher competence in educational assessment of students. Washington, DC: National Council on Measurement in Education.
5. Bejar, I. I., & Weiss, D. J. (1977). A comparison of empirical differential option weighting scoring procedures as a function of inter-item correlation. Educational and Psychological Measurement, 37, 335-340.
6. Bennett, R. E. (1993). On the meanings of constructed response. In R. E. Bennett & W. C. Ward (Eds.), Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment (pp. 1-27). Hillsdale, NJ: Erlbaum.
7. Buckendahl, C. W., Plake, B. S., & Impara, J. C. (2004). A strategy for evaluating district developed assessments for state accountability. Educational Measurement: Issues and Practice, 23(2), 17-25.
8. Daniel, L. G., & King, D. A. (1998). Knowledge and use of testing and measurement literacy of elementary and secondary teachers. Journal of Educational Research, 91, 331-344.
9. Feldt, L. S. (2004). Estimating the reliability of a test battery composite or a test score based on weighted item scoring. Measurement and Evaluation in Counseling and Development, 37, 184-190.
10. Guilford, J. P. (1954). Psychometric methods. New York: McGraw-Hill.
11. Gullickson, H. (1950). Theory of mental tests. New York: Wiley.
12. Haladyna, T. M. (1994). Developing and validating multiple-choice test items. Mahwah, NJ: Erlbaum.
13. Haladyna, T. M. (1999). Developing and validating multiple-choice test items (2nd ed.). Mahwah, NJ: Erlbaum.
14. Haladyna, T. M. (2004). Developing and validating multiple-choice test items (3rd ed.). Mahwah, NJ: Erlbaum.
15. Haladyna, T. M., & Downing, S. M. (1989a). A taxonomy of multiple-choice item-writing rules. Applied Measurement in Education, 1, 37-50.
16. Haladyna, T. M., & Downing, S. M. (1989b). The validity of a taxonomy of multiple-choice item-writing rules. Applied Measurement In Education, 1, 71-78.
17. Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15, 309-334.
18. Hogan, T. P. (1981). Relationship between free-response and choice-type tests of achievement: A review of the literature. Green Bay, WI: University of Wisconsin. (ERIC Document Reproduction Service No. ED 224 81.1.)
19. Lord, F. M., & Novick, M. R. (1968). Statistical theory of mental test scores. Reading, MA: Addison-Wesley.
20. Lukin, L. E., Bandalos, D. L., Eckhout, T. J., & Mickleson, K. (2004). Facilitating the development of assessment literacy. Educational. Measurement: Issues and Practice, 23(2), 26-32.
21. Merwin, J. C. (1959). Rational and mathematical relationships of six scoring procedures applicable to three-choice items. Journal of Educational Psychology, 50, 153-161.
22. Mertler, C. A. (2005). Secondary teachers' assessment literacy: Does classroom experience make a difference? American Secondary Education, 33, 76-92.
23. Plake, B. S., Impara, J. C., & Fager, J. J. (1993). Assessment competencies of teachers: A national survey. Educational Measurement: Issues and Practice, 12(4), 10-12, 39.
24. Rodriguez, M. C. (2002). Choosing an item format. In G. Tindal & T. M. Haladyna (Eds.), Large-scale assessment programs for all students: Validity, technical adequacy, and implications (pp. 213-231). Mahwah, NJ: Erlbaum.
25. Rodriguez, M. C. (2003). Construct equivalence of multiple-choice and constructed-response items: A random effects synthesis of correlations. Journal of Educational Measurement, 40, 163-184.
26. Rodriguez, M. C. (2005). Three options are optimal for multiple-choice items: A. meta-analysis of 80 years of research. Educational Measurement: Issues and Practice, 24(2), 3-13.
27. Ryan, J. M., & DeMark, S. (2002). Variation in achievement scores related to gender, item format, and content area tested. In G. Tindal & T. M. Haladyna (Eds.), Large-scale assessment programs for all students: Validity, technical adequacy, and implementation (pp. 67-88). Mahwah, NJ: Erlbaum.
28. Snow, R. E. (1993). Construct validity and constructed-response tests. In R. E. Bennett and W. C. Ward (Eds.), Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment (pp. 45-60). Hillsdale, NJ: Erlbaum.
29. Stiggins, R. J. (1995). Assessment literacy for the 21st century. Phi Delta Kappan, 77, 238-245.
30. Traub, R. E. (1993). On the equivalence of the traits assessed by multiple-choice and constructed-response tests. In R. E. Bennett & C. W. Ward (Eds.), Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment (pp. 29-44). Hillsdale, NJ: Erlbaum.
31. Welch, C. (2006). Item and prompt development in performance testing. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 303-327). Mahwah, NJ: Erlbaum.
32. Zhang, Z., & Burry-Stock, J. A. (2003). Classroom assessment practices and teachers' self-perceived assessment skills. Applied Measurement in Education, 16, 323-342.