Single instrument, multiple measures: Considering the use of multiple item formats to assess reading comprehension

Children's Reading Comprehension and Assessment

Volumn , Issue , 2005, Pages 347-368

  Campbell, Jay R ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 54749120631     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781410612762     Document Type: Chapter

References (31)

1. Afflerbach, P., & Johnston, P. (1984). Research methodology: On the use of verbal reports in reading research. Journal of Reading Behavior, 16,307-322.
2. Bennett, R.E., & Ward, C.W. (Eds.). (1993). Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment. Hillsdale, NJ: Lawrence Erlbaum Associates.
3. Birenbaum, M., & Tatsuoka, K.K. (1987). Open-ended versus multiple-choice response formats: It does make a difference for diagnostic purposes. Applied Psychological Measurement, II, 385-395.
4. Bracht, G.H., & Hopkins, K.D. (1970). The communality of essay and objective tests of academic achievement. Educational and Psychological Measurement, 30,359-364.
5. Bridgeman, B., & Rock, D.A. (1993). Relationships among multiple-choice and openended analytical questions. Journal of Educational Measurement, 30,313-329.
6. Campbell, J.R. (1999). Cognitive processes elicited by multiple-choice and constructedresponse questions on an assessment of reading comprehension, Unpublished doctoral dissertation, Temple University, Philadelphia, PA.
7. Choppin, B.H., & Purves, A.C. (1969). A comparison of open-ended and multiplechoice items dealing with literary understanding. Research in the Teaching of English, 3, 15-24.
8. Cordón, L.A., & Day, J.D. (1996). Strategy use on standardized reading comprehension tests. Journal of Educational Psychology, 88,288-295.
9. Embretson, W.S. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93,179-197.
10. Ericsson, K.A., & Simon, H.A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press. (Original work published 1984)
11. Farr, R., Pritchard, R., & Smitten, B. (1990). A description of what happens when an examinee takes a multiple-choice reading comprehension test. Journal of Educational Measurement, 27,209-226.
12. Heim, A.W., & Watts, R.B. (1967). An experiment on multiple-choice versus openended answering in a vocabulary test. British Journal of Educational Psychology, 37,339-346.
13. Katz, S., & Lautenschlager, G.J. (2001). The contribution of passage and no-passage factor to item performance on the SAT reading task. Educational Assessment, 7,165-176.
14. Katz, S., Lautenschlager, G.J., Blackburn, A.B., & Harris, F.H. (1990). Answering reading comprehension items without passages on the SAT. Psychological Science, 1,122-127.
15. Kucan, L., & Beck, I.L. (1997). Thinking aloud and reading comprehension research: Inquiry, instruction, and social interaction. Review of Educational Research, 67,271-299.
16. Langer, J.A. (1987). The construction of meaning and the assessment of comprehension: An analysis of reader performance on standardized test items. In R.O. Freedle & R.P. Duran (Eds.), Cognitive and linguistic analyses of text performance (pp. 225-244. Norwood, NJ: Ablex.
17. Lindquist, E.F. (1951). Preliminary considerations in objective test construction. In E.F. Lindquist (Ed.), Educational measurement (pp. 119-184. Washington, DC: American Council on Education.
18. Lukhele, R., Thissen, D., & Wainer, H. (1994). On the relative value of multiplechoice, constructed-response, and examinee-selected items on two achievement tests. Journal of Educational Measurement, 31,234-250.
19. Manhart, J.J. (1996, April). Factor analytic method for determining whether multiple-choice and constructed-response tests measure the same construct. Paper presented at the annual meeting of the National Council on Measurement in Education, New York.
20. Mazzeo, J., Yamamoto, K., & Kulick, E. (1993, April). Extended constructed-response items in the 1992 NAEP: Psychometrically speaking, were they worth the price? Paper presented at the annual meeting of the National Council on Measurement in Education, Atlanta, GA.
21. Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp.13-103). New York: Macmillan Publishers.
22. Murphy, S. (1998). Fragile evidence: A critique of reading assessment. Mahwah, NJ: Lawrence Erlbaum Associates.
23. Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale, NJ: Lawrence Erlbaum Associates.
24. Pritchard, R. (1990). The evolution of introspective methodology and its implications for studying the reading process. Reading Psychology: An International Quarterly, 11,1-13.
25. Resnick, L.B., & Resnick, D.P. (1992). Assessing the thinking curriculum: New tools for educational reform. In B.R.Gifford & M.C.O'Connor (Eds.), Changing assessment: Alternative views of aptitude, achievement, and instruction. Boston: Kluwer Academic.
26. Valencia, S., & Pearson, P.D. (1987). Reading assessment: Time for a change. Reading Teacher, 40(7),726-732.
27. van den Bergh, H. (1990). On the construct validity of multiple-choice items for reading comprehension. Applied Psychological Measurement, 14,1-12.
28. Ward, W.C., Dupree, D., & Carlson, S.B. (1987). Acomparison of free-response and multiple-choice questions in the assessment of reading comprehension (Research Report No. 87-20). Princeton, NJ: Educational Testing Service.
29. Ward, W.C., Frederiksen, N., & Carlson, S.B. (1980). Construct validity of freeresponse and machine-scorable forms of a test. Journal of Educational Measurement, 17,11-29.
30. Weiss, D., & Jackson, R. (1983). The validity of descriptive tests of language skills: Relationship to direct measure of writing skill ability and grades in introductory college English courses (Report LB-83-4; ETS-RR-83-27). New York: College Entrance Examination Board.
31. Winograd, P., Paris, S., & Bridge, C. (1991). Improving the assessment of literacy. Reading Teacher, 45(2),108-116.