Developing and Validating Instructionally Relevant Reading Competency Profiles Measured by the Critical Reading Section of the SAT Reasoning Test™

Reading Comprehension Strategies: Theories, Interventions, and Technologies

Volumn , Issue , 2007, Pages 137-172

  VanderVeen, Arthur ^a   Huff, Kristen ^a   Gierl, Mark ^b   McNamara, Danielle S ^c   Louwerse, Max ^c   Graesser, Art ^c  

^a The College Board   (United States)

^b UNIVERSITY OF ALBERTA   (Canada)

^c UNIVERSITY OF MEMPHIS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85145534629     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9780203810033-9     Document Type: Chapter

References (82)

1. Anderson, R. C. (1982).How to construct achievement tests to assess comprehension. Review of Educational Research 42 145-170.
2. Bolt, D. M. (2005).Limited- and full-information estimation of item response theory models. In A Maydeu-Olivares and J. J. McArdle (Eds.), Contemporary psychometrics 27-71 Mahwah, NJ: Lawrence Erlbaum Associates
3. Buck, G., VanEssen, T., Tatsuoka, K., Kostin, I., Lutz, D., and Phelps, M. (1998).Development, selection and validation of a set of cognitive and linguistic attributes for the SAT I Verbal: Sentence completion section Educational Testing Service Research ReportRR-98-23 NJ.
4. Carnegie Council on Adolescent Development. (1989).Turning points: Preparing American youth for the 21st century, report of the Task Force on Education of Youth Adolescents New York: Carnegie Corporation of New York.
5. Cook, L. J., Dorans, N. J., and Eignor, D. R. (1988).An assessment of the dimensionality of three SAT-Verbal test editions. Journal of Educational Statistics 13 19-43.
6. Daneman, M., and Carpenter, R. A. (1980).Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behavior 19 450-466.
7. DiBello, L. V. (2002April)Skills-based scoring models for the PSAT/NMSQT Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
8. DiBello, L. V., and Crone, C. (2001April)Technical methods underlying the PSAT/NMSQT? enhanced score report Paper presented at the annual meeting of the National Council on Measurement in Education, Seattle, WA.
9. DiBello, L. V., Stout, W. F., and Roussos, L. A. (1995).Unified cognitive/psychometric diagnostic assessment likelihood-based classification techniques. In P. D. Nichols, S. F. Chipman, and R. L. Brennan (Eds.), Cognitively diagnostic assessment 361-390 Mahwah, NJ: Lawrence Erlbaum Associates, Inc
10. Dorans, N., and Lawrence, I. (1999).The role of the unit of analysis in dimensionality assessment EducationalTestingServiceResearchReportRR-99-14 NJ.
11. Embretson, S. E., and Wetzel, C. D. (1987).Component latent trait models for paragraph comprehension. Applied Psychological Measurement 11 175-193.
12. Everson, H. (2004).Innovation and change in the SAT: A design framework for future college admission tests. In R. Zwick (Ed.), Rethinking the SAT: The future of standardized testing in university admissions 75-91 New York: Routledge-Falmer
13. Frederiksen, J. R. (1982).A componential theory of reading skills and their interactions. In R. J. Sternberg (Ed.), Advances in the psychology of human intelligence: Vol. 1 125-180 Hillsdale, NJ: Lawrence Erlbaum Associates, Inc
14. Froelich, A. G. (2001, April). Assessing the unidimensionality of test items and some asymptotics of parametric item response theory. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.
15. Froelich, A. G., and Habing, B. (2001).Refinements of the DIMTEST methodology for testing unidimensionality and local independence Paper presented at the annual meeting of the National Council on Measurement in Education, Seattle, WA.
16. Gierl, M. J. (2004).Identifying cognitive dimensions that affect student performance on the New SAT: A discussion paper Paper presented to the College Board, New York.
17. Gierl, M. J., Bisanz, J., Bisanz, G., and Boughton, K. (2003).Identifying content and cognitive skills that produce gender differences in mathematics: A demonstration of the DIF analysis framework. Journal of Educational Measurement 40 281-306.
18. Gierl, M. J., Leighton, J. P., and Hunka, S. M. (2000).Exploring the logic of Tatsuoka’s rule-space model for test development and analysis. An NCME Instructional Module. Educational Measurement: Issues and Practice 19(3), 34-44.
19. Gierl, M. J., Leighton, J. P., Wang, C., and Tan, X. (2005).Identifying cognitive dimensions that affect student performance on the New SAT-Technical Report No. 2: Evaluating primary skill categories New York: College Examination Board.
20. Gierl, M. J., Tan, X., and Wang, C. (2005).Identifying content and cognitive dimensions on the SAT Research Report No. 2005-11. New York: College Examination Board.
21. Glaser, R. (1986).A cognitive science perspective on selection and classification and on technical training. Advances in Reading/Language Research 4 253-268.
22. Gorin, J. S. (2005).Manipulating processing difficulty of reading comprehension questions:The feasibility of verbal item generations. Journal of Educational Measurement 4 351-373.
23. Greeno, J. G. (1976).Cognitive objectives in instruction: Theory of knowledge for solving problems and answering questions. In D. Klahr (Ed.), Cognition and instruction 123-159 Hillsdale, NJ: Lawrence Erlbaum Associates, Inc
24. Greeno, J. G. (1989).A perspective on thinking. American Psychologist 44 134-141.
25. Griffin, P. (2001April)Performance assessment of higher order thinking Paper presented at the annual conference of the American Education Research Association, Seattle, WA.
26. Hannon, B., and Daneman, M. (2001).A new tool for measuring and understanding individual differences in the component process of reading comprehension. Journal of Educational Psychology 93 103-128.
27. Huff, K. (2004April)A practical application of evidence centered design principles:Coding items for skills. In K. Huff (Organizer), Connecting curriculum and assessment through meaningful score reports Symposium conducted at the meeting of the National Council on Measurement in Education, San Diego, CA.
28. Huff, K. (2006April)Using item difficulty modeling to inform descriptive score reports Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
29. Huff, K., and Goodman, D. (2007).The demand for cognitive diagnostic assessment. In J. Leighton and M. Gierl (Eds.), Cognitively diagnostic assessment London: Cambridge University Press.
30. Hunt, E. (1978).Mechanics of verbal ability. Psychological Review 85 109-130.
31. Hunt, E. (1985).Verbal ability. In R. J. Sternberg (Ed.), Human abilities: An informationprocessing approach 31-58 New York: Freeman
32. Hunt, E., Frost, N., and Lunnenborg, C. (1973). Individual differences in cognition: A new approach to intelligence. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 7, pp. 87-122). New York: Academic.
33. Hunt, E., and Lansman, M. (1975). Cognitive theory applied to individual differences. In W. K. Estes (Ed.), Handbook of learning and cognitive processes: Introduction to concepts and issues (Vol. 1, pp. 81-107). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
34. Hunt, E., Lunnenborg, C., and Lewis, J. (1975).What does it mean to be high verbal? Cognitive Psychology 7 194-227.
35. Just, M. A., and Carpenter, P. A. (1992).A capacity theory of comprehension: Individual differences in working memory. Psychological Review 98 122-149.
36. Kail, R. V., Chi, M. T. H., Ingram, A. L., and Danner, F. W. (1977).Constructive aspects of children’s reading comprehension. Child Development 48 684-688.
37. Kintsch, W. (1998).Comprehension: A paradigm for cognition Cambridge, MA:Cambridge University Press.
38. Kintsch, W., and van Dijk, T. A. (1978).Toward a model of text comprehension and production. Psychological Review 85 363-394.
39. Kirsch, I. S., and Mosenthal, P. B. (1990).Exploring document literacy: Variables underlying the performance of young adults. Reading Research Quarterly 25 5-30.
40. Leighton, J. P., Gierl, M. J., and Hunka, S. (2004).The attribute hierarchy method for cognitive assessment: A variation on Tatsuoka’s rule-space approach. Journal of Educational Measurement 41 205-237.
41. Leighton, J. P., and Gierl, M. J. (2006).Identifying and evaluating cognitive models in educational measurement Manuscript submitted for publication.
42. Leighton, J. P., and Gierl, M. J. (in press).Defining and evaluating models of cognition used in educational measurement to make inferences about examinees’ thinking processes. Educational Measurement: Issues and Practice
43. Lesgold, A. M., and Perfetti, C. A. (1978).Interactive processes in reading comprehension. Discourse Processes 1 323-336.
44. Linn, R. L. (1986).Educational testing and assessment: Research needs and policy issues. American Psychologist 41 1153-1160.
45. Liu, J., Feigenbaum, M., and Walker, M. E. (2004April)New SAT and New PSAT/NMSQT Spring 2003 field trial design Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
46. Louwerse, M., and van Peer, W. (2002).Thematics: Interdisciplinary studies Amsterdam/ Philadelphia: John Benjamins.
47. McClelland, J. L., and Rumelhart, D. E. (1981).An interactive activation model of context effects in letter perception: Part 1. An account of basic findings. Psychological Review 88 357-407.
48. McNamara, D., Kintsch, E., Songer, N., and Kintsch, W. (1996).Are good texts always better? Interactions of text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction 14 1-43.
49. Messick, S. (1989).Validity. In R. L. Linn (Ed.), Educational measurement 3rd ed., 13-103 New York: American Council on Education, Macmillan
50. Mislevy, R. J. (1994)Evidence and inference in educational assessment. Psychometrika 59 439-483.
51. Mislevy, R. J. (1996).Evidence and inference in educational assessment CSE Technical Report 414. Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing, Graduate School of Education and Information Studies, University of California.
52. Mislevy, R. J., and Riconscente, M. M. (2005).Evidence-centered assessment design. In S. M. Downing and T. M. Haladyna (Eds.), Handbook of test development (61-90) Mahwah, NJ: Lawrence Erlbaum Associates, Inc
53. Mosenthal, P. B., and Kirsch, I. S. (1991).Toward an explanatory model of document literacy. Discourse Processes 14 147-180.
54. National Center for Education Statistics. (2003). Nation’s report card: Reading 2002. Washington, DC: U.S. Government Printing Office.
55. National Education Goals Panel. (1991).Measuring progress toward the national educational goals: Potential indicators and measurement strategies Washington, DC: U.S. Government Printing Office.
56. Nichols, P. D. (1994).A framework for developing cognitively diagnostic assessments. Review of Educational Research 64 575-603.
57. Nitko, A. J. (1989).Designing tests that are integrated with instruction. In R. L. Linn (Ed.), Educational measurement 3rd ed., 447-474 New York: American Council on Education, Macmillan
58. O’Neill, K. A., and McPeek, W. M. (1993).Item and test characteristics that are associated with differential item functioning. In P. W. Holland and H. Wainer (Eds.), Differential item functioning 255-279 Hillsdale, NJ: Lawrence Erlbaum Associates, Inc
59. Pellegrino, J. W., Baxter, G. P., and Glaser, R. (1999).Addressing the “two disciplines” problem: Linking theories of cognition and learning with assessment and instructional practice. Review of Research in Education 24 307-353.
60. Pellegrino, J. W., and Glaser, R. (1979).Cognitive correlates and components in the analysis of individual differences. Intelligence 3 187-214.
61. Pellegrino, J. W., Jones, L. R., and Mitchell, K. J. (1999). Grading the nation’s report card: Evaluating NAEP and transforming the assessment of educational progress Washington, DC: National Academy Press.
62. Perfetti, C. A. (1985a).Reading ability New York: Oxford University Press.
63. Perfetti, C. A. (1985b).Reading ability. In R. J. Sternberg (Ed.), Human abilities: An information- processing approach 31-58 New York: Freeman
64. Perfetti, C. A., and Goldman, S. R. (1976).Discourse memory and reading comprehension skill. Journal of Verbal Learning and Verbal Behavior 15 33-42.
65. Perfetti, C. A., and Hoagaboam, T. (1975).Relationship between simple word decoding and reading comprehension skill. Journal of Educational Psychology 67 461-469.
66. Schum, D. A. (1987).Evidence and inference for the intelligence analyst Lanham, MD:University Press of America.
67. Shealy, R., and Stout, W. F. (1993).A model-based standardization approach that separates true bias/DIF from group differences and detects test bias/DIF as well as item bias/DIF. Psychometrika 58 159-194.
68. Sheehan, K. M., and Ginther, A. (2001April)What do passage-based multiple-choice verbal reasoning items really measure? An analysis of the cognitive skills underlying performance on the current TOEFL reading section Paper presented at the 2001 annual meeting of the National Council of Measurement in Education, Seattle, WA.
69. Snow, R. E. (1989).Aptitude interactions as a framework for individual differences in learning. In P. L. Ackerman, R. J. Sternberg, and R. Glaser (Eds.), Learning and individual differences: Advances in theory and research 13-59 New York: Freeman
70. Snow, R. E., and Lohman, D. F. (1989).Implications of cognitive psychology for educational measurement. In R. L. Linn (Ed.), Educational measurement (3rd ed., 263-331) New York: American Council on Education, Macmillan
71. Sternberg, R. J. (1977).Intelligence, information processing, and analogical reasoning:The componential analysis of human abilities Hillsdale, NJ: Lawrence Erlbaum Associates, Inc
72. Stiggins, R. (1994).Student-centered classroom assessment New York: Merrill.
73. Stout, W., Habing, B., Douglas, J., Kim, H. R., Roussos, L., and Zhang, J. (1966).Conditional covariance-based nonparametric multidimensional assessment. Applied Psychological Measurement 20 331-354.
74. Tatsuoka, K. K. (1983).Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement 20 345-354.
75. Tatsuoka, K. K. (1984).Caution indices based on item response theory. Psychometrika 49 95-110.
76. Tatsuoka, K. K. (1985).A probabilistic model for diagnosing misconceptions by the pattern classification approach. Journal of Educational Statistics 10 55-73.
77. Tatsuoka, K. K. (1990).Toward an integration of item-response theory and cognitive error diagnoses. In N. Frederiksen, R. L. Glaser, A. M. Lesgold, and M. G. Shafto (Eds.), Diagnostic monitoring of skill and knowledge acquisition 453-488 Hillsdale, NJ:Lawrence Erlbaum Associates, Inc
78. Tatsuoka, K. K. (1991). Boolean algebra applied to determination of universal set of knowledge states. Research Report No. RR-91-44-ONR, Educational Testing Service, Princeton, NJ.
79. Tatsuoka, K. K., and Tatsuoka, M. M. (1991).On measures of misconception stability Research report, ONR Grant N00014-86-K0290, University of Illinois, Urbana
80. Tatsuoka, M. M., and Tatsuoka, K. K. (1987).Rule space. In S. Kotz and N. Johnson (Eds.), Encyclopedia of statistical sciences 217-221 New York: Wiley
81. VanderVeen, A. (2004April)Toward a construct of critical reading for the new SAT. In K. Huff (Organizer), Connecting curriculum and assessment through meaningful score reports Symposium conducted at the meeting of the National Council on Measurement in Education, San Diego, CA.
82. Woltz, D. J. (1988).An investigation of the role of working memory in procedural skill acquisition. Journal of Experimental Psychology: General 117 319-331.