Differences in Reaction to Immediate Feedback and Opportunity to Revise Answers for Multiple-Choice and Open-Ended Questions

Educational and Psychological Measurement

Volumn 76, Issue 5, 2016, Pages 787-802

  Attali, Yigal ^a   Laitusis, Cara ^a   Stone, Elizabeth ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

feedback; multiple choice; open ended; reliability; test design

Indexed keywords

EID: 84987729499     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164415612548     Document Type: Article

References (39)

1. Attali Y., (2015a). Effects of multiple-try feedback and question type during mathematics problem solving on performance in similar problems. Computers and Education, 86, 260-267.
2. Attali Y., (2015b). Practicing for a quantitative reasoning assessment: Effects of question and feedback type. Manuscript submitted for publication.
3. Attali Y., Powers D., (2010). Immediate feedback and opportunity to revise answers to open-ended questions. Educational and Psychological Measurement, 70, 22-35.
4. Bangert-Drowns R. L., Kulik J. A., Kulik C.-L. C., Morgan M. T., (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61, 213-238.
5. Baumert J., Demmrich A., (2001). Testing motivation in the assessment of student skills: The effects of incentives on motivation and performance. European Journal of Psychology of Education, 16, 441-462.
6. Bennett R., (2011). CBAL: Results from piloting innovative K-12 assessments (Research Report 11-23). Princeton, NJ: Educational Testing Service.
7. Bennett R. E., Rock D. A., Wang M., (1991). Equivalence of free-response and multiple choice items. Journal of Educational Measurement, 28, 77-92.
8. Bennett R. E., Ward W. C., (1993). Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment. Hillsdale, NJ: Lawrence Erlbaum.
9. Black P., Wiliam D., (1998). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80, 139-148.
10. Bloom B. S., (1984). The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher, 13, 4-16.
11. Braun H., Kirsch I., Yamamoto K., (2011). An experimental study of the effects of monetary incentives on performance on the 12th-grade NAEP reading assessment. Teachers College Record, 113, 2309-2344.
12. Bridgeman B., (1992). A comparison of quantitative questions in open-ended and multiple-choice formats. Journal of Educational Measurement, 29, 253-271.
13. Eklof H., (2006). Development and validation of scores from an instrument measuring test-taking motivation. Educational and Psychological Measurement, 66, 643-656.
14. Epstein M. L., Epstein B. B., Brosvic G. M., (2001). Immediate feedback during academic testing. Psychological Reports, 88, 889-894.
15. Feldt L. S., (1969). A test of the hypothesis that Cronbach’s alpha or Kuder-Richardson coefficient twenty is the same for two tests. Psychometrika, 34, 363-373.
16. Feldt L. S., (1980). A test of the hypothesis that Cronbach’s alpha reliability coefficient is the same for two tests administered to the same sample. Psychometrika, 45, 99-105.
17. Gilman D., Ferry P., (1972). Increasing test reliability through self-scoring procedures. Journal of Educational Measurement, 9, 205-207.
18. Hattie J., Timperley H., (2007). The power of feedback. Review of Educational Research, 77, 81-112.
19. Kluger A. N., DeNisi A., (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254-284.
20. Laitusis C., Attali Y., Stone E., (2015). Effects of feedback and revision for students with learning disabilities. Manuscript in preparation.
21. Martinez M. E., (1999). Cognition and the question of test item format. Educational Psychologist, 34, 207-218.
22. Meng X. L., Rosenthal R., Rubin D. B., (1992). Comparing correlated correlation coefficients. Psychological Bulletin, 111, 172-175.
23. O’Neil H. F., Jr. Abedi J., Miyoshi J., Mastergeorge A., (2005). Monetary incentives for low-stakes tests. Educational Assessment, 10, 185-208.
24. O’Neil H. F., Jr. Sugrue B., Baker E., (1996). Effects of motivational interventions on the NAEP mathematics performance. Educational Assessment, 3, 135-157.
25. Pressey S. L., (1926). A simple apparatus which gives tests and scores—and teaches. School and Society, 23, 373-376.
26. Pressey S. L., (1950). Development and appraisal of devices providing immediate automatic scoring of objective tests and concomitant self-instruction. Journal of Psychology, 29, 417-447.
27. Rodriguez M. C., (2003). Construct equivalence of multiple-choice and constructed-response items: A random effects synthesis of correlations. Journal of Educational Measurement, 40, 163-184.
28. Rodriguez M. C., (2004). The role of classroom assessment in student performance on TIMSS. Applied Measurement in Education, 17, 1-24.
29. Salomon G., Globerson T., (1987). Skill may not be enough: The role of mindfulness in learning and transfer. International Journal of Educational Research, 11, 623-637.
30. Scriven M., (1967). The methodology of evaluation. In Tyler R. W., Gagne R. M., Scriven M., (Eds.), Perspectives of curriculum evaluation (pp. 39-83). Chicago, IL: Rand McNally.
31. Shute V. J., (2008). Focus on formative feedback. Review of Educational Research, 78, 153-189.
32. Snow R. E., Lohman D. F., (1989). Implications of cognitive psychology for educational measurement. In Linn R. L., (Ed.), Educational measurement (3rd ed., pp. 263-331). New York, NY: Macmillan.
33. Traub R. E., (1993). On the equivalence of the traits assessed by multiple-choice and constructed-response tests. In Bennett R. E., Ward W. C., (Eds.), Construction versus choice in educational measurement: Issues in constructed response, performance testing, and portfolio assessment (pp. 29-43). Hillsdale, NJ: Lawrence Erlbaum.
34. Traub R. E., MacRury K., (1990). Multiple-choice vs. free-response in the testing of scholastic achievement. In Ingenkamp K., Jager R. S., (Eds.), Yearbook on educational measurement (pp. 128-159). Weinheim, Germany: Beltz.
35. Wainer H., (1993). Measurement problems. Journal of Educational Measurement, 30, 1-21.
36. Wainer H., Thissen D., (1993). Combining multiple-choice and constructed-response test scores: Toward a Marxist theory of test construction. Applied Measurement in Education, 6, 103-118.
37. Ward W. C., Dupree D., Carlson S. B., (1987). A comparison of free-response and multiple-choice questions in the assessment of reading comprehension (RR-87-20). Princeton, NJ: Educational Testing Service.
38. Wiliam D., Thompson M., (2008). Integrating assessment with learning: What will it take to make it work? In Dwyer C. A., (Ed.), The future of assessment: Shaping teaching and learning (pp. 53-82). New York, NY: Lawrence Erlbaum.
39. Wise S. L., DeMars C. E., (2005). Low examinee effort in low-stakes assessment: Problems and potential solutions. Educational Assessment, 10, 1-17.