A case study in principled assessment design: Designing assessments to measure and support the development of argumentative reading and writing skills

Psicologia Educativa

Volumn 20, Issue 2, 2014, Pages 99-108

  Deane, Paul ^a   Song, Yi ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Argumentation; Assessment; CBAL; Learning progression; Reading; Scenario; Writing

Indexed keywords

EID: 84924525201     PISSN: 1135755X     EISSN: 21740526     Source Type: Journal    
DOI: 10.1016/j.pse.2014.10.001     Document Type: Article

References (60)

1. Aristotle (1939). Topics (E. S. Forster, Loeb, Trans.). Classical Library. Cambridge, MA: Harvard University Press.
2. R.E. Bennett Cognitively based assessment of, for, and as learning: A preliminary theory of action for summative and formative assessment Measurement: Interdisciplinary Research and Perspectives 8 2010 70 91
3. J.R. Bracewell, M. Scardamalia, and C. Bereiter The development of audience awareness in writing Resources in education 1978 154 433
4. S. Brem, and L. Rips Evidence and explanation in informal argument Cognitive Science 24 2000 573 604
5. R. Bright Writing instruction in the intermediate grades. What is said, What is done, What is understood 1995 International Reading Association Newark, DE
6. J.A. Butler, and A.M. Britt Investigating instruction for improving revision of argumentative essays Written Communication 28 2011 70 96
7. M.J. Chambliss Text cues and strategies successful readers use to construct the gist of lengthy written arguments Reading Research Quarterly 30 1995 778 807
8. R. Clark, and J. Delia The development of functional persuasive skills in childhood and early adolescence Child Develoment 47 1976 1008 1014
9. P. Coirier, J.E.B. Andriessen, and L. Chanquoy From planning to translating: The specificity of argumentative writing P. Coirier, J. Andriessen, Foundations of argumentative text processing 1999 Amsterdam University Press Amsterdam, The Netherlands 1 28
10. T. Corcoran, F.A. Mosher, and A. Rogat Learning progressions in science: An evidence-based approach to reform 2009 Center on Continuous Instructional Improvement, Teachers College-Columbia University NY
11. Council of Chief State School Officers & National Governors Association (2010). Common Core State Standards for English language arts and literacy in history/social studies, science, and technical subjects. Washington, DC: Author. Retrieved from www.corestandards.org/the-standards/ELA-Literacy.
12. S. De La Paz, and S. Graham Strategy instruction in planning: Effects on the writing performance and behavior of students with learning disabilities Exceptional Children 63 1997 167 181
13. P. Deane Writing assessment and cognition, (ETS Research Report No. 11-14) 2011 ETS Princeton, NJ
14. A. DiPardo, and S.W. Freedman Peer response groups in the writing classroom: Theoretic foundations and new directions Review of Educational Research 58 1988 119 149
15. A. Eisenberg, and C. Garvey Children's use of verbal strategies in resolving conflicts Discourse Processes 4 1981 149 170
16. S. Erduran, S. Simon, and J. Osborne TAPping into argumentation: Developments in the application of Toulmin's argument pattern for studying science discourse Science Education 88 2004 915 933
17. R.P. Ferretti, W.E. Lewis, and S. Andrews-Weckerly Do goals affect the structure of students' argumentative writing strategies? Journal of Educational Psychology 101 2009 577 589
18. R.P. Ferretti, C.A. MacArthur, and N.S. Dowdy The effects of an elaborated goal on the persuasive writing of students with learning disabilities and their normally achieving peers Journal of Educational Psychology 93 2000 694 702
19. L. Flower, J.R. Hayes, L. Carey, K.A. Schriver, and J. Stratman Detection, diagnosis, and the strategies of revision College Composition and Communication 37 1986 16 55
20. J.S. Gorin, T.P. O'Reilly, J.P. Sabatini, Y. Song, and P. Deane Measurement: Facilitating the goal of literacy B. Miller, P. McCardle, R. Long, Teaching Reading and Writing: Improving Instruction and Student Achievement 2014 Paul H. Brookes Publishing Co Baltimore, MD 119 128
21. S. Graham, and K.R. Harris Improving learning disabled students' skills at composing essays: Self-instructional strategy training Exceptional Children 56 1989 201 214
22. S. Graham, and M.A. Hebert Writing to read: Evidence for how writing can improve reading (A Carnegie Corporation Time to Act Report). Washington DC: Alliance for Excellent Education 2010
23. S. Graham, C.A. MacArthur, and S.S. Schwarts The effects of goal setting and procedural facilitation on the revising behavior and writing performance of students with writing and learning problems Journal of Educational Psychology 87 1995 230 240
24. J.R. Hayes, and L.S. Flower Identifying the organization of writing processes L. Gregg, E.R. Steinberg, Cognitive process in writing 1980 Lawrence Erlbaum Associates Hillsdale, NJ 3 30
25. Heritage, M. (2008). Learning progressions: Supporting instruction and formative assessment Retrieved from http://www.k12.wa.us/assessment/ClassroomAssessmentIntegration/pubdocs/FASTLearningProgressions.pdf.
26. G. Hillocks Jr. The testing trap: How state writing assessments control learning 2002 Teachers College Press New York
27. K. Kinsler Structured peer collaboration: Teaching essay revision to college students needing writing remediation Cognition and Instruction 7 1990 303 321
28. P. Klaczynski Motivated scientific reasoning biases, epistemological beliefs, and theory polarization: A two-process approach to adolescent cognition Child Development 71 2000 1347 1366
29. R.E. Knudson The development of written argumentation: An analysis and comparison of argumentative writing at four grade levels Child Study Journal 22 1992 167 184
30. Kuhn, D. (1991). The skills of argument. Cambridge, England: Cambridge University Press. Kuhn, D.; Katz, J.B.; & Dean, D.; Jr. (2004). Developing reason. Thinking & Reasoning, 10, 197-219.
31. D. Kuhn, V. Shaw, and M. Felton Effects of dyadic interaction on argumentive reasoning. Cognition and Instruction 15 1997 287 315
32. D. Kuhn, and D. Udell The development of argument skill Child Development 74 2003 1245 1260
33. D. Kuhn, N. Zillmer, A. Crowell, and J. Zavala Developing Norms of Argumentation: Metacognitive Epistemological, and Social Dimensions of Developing Argumentive Competence. Cognition and Instruction 31 2013 456 496
34. M. Larson, M.A. Britt, and A.A. Larson Disfluencies in comprehending argumentative texts Reading Psychology 25 2004 205 224
35. S. Leitão Evaluating and selecting counterarguments: Studies of children's rhetorical awareness Written Communication 20 2003 269 306
36. A. Matsuhashi, and E. Gordon Revision, addition, and the power of unseen text S. Freedman, The acquisition of written language: Response and revision 1985 Ablex Norwood, NJ 236 249
37. T.M. McCann Student argumentative writing: knowledge and ability at three grade levels Research in the Teaching of English 23 1989 62 76
38. R.J. Mislevy, L.S. Steinberg, and R.G. Almond On the structure of educational assessments Measurement: Interdisciplinary Research and Perspectives 1 2003 3 67
39. Nation's Center for Education Statistics. (2008). The nation's report card: Writing 2007 (U.S. Department of Education Publication No. NCES 2008-468). Washington, DC: U.S. Government Printing Office. Retrieved from http://nces.ed.gov/nationsreportcard/pdf/main2007/2008468.pdf.
40. G.E. Newell, R. Beach, J. Smith, and J. Van Der Heide Teaching and learning argumentative reading and writing: A review of research Reading Research Quarterly 46 2011 273 304
41. M.E. Nussbaum, and C.M. Kardash The effects of goal instructions and text on the generation of counterarguments during writing Journal of Educational Psychology 97 2005 157 169
42. O'Reilly and Sabatini, O'Reilly, T.; & Sabatini, J. (in press). Reading for Understanding: How performance moderators and scenarios impact assessment design (ETS Research Report). Princeton, NJ: Educational Testing Service.
43. O'Reilly, T.; & Sheehan, K.M. (2009). Cognitively Based Assessment of, for and as Learning: A Framework for Assessing Reading Competency (ETS Research Report RR-09-26). Princeton, NJ: Educational Testing Service.
44. J.W. Pellegrino Assessment as a Positive Influence on 21st Century Teaching and Learning: A Systems Approach to Progress Psicología Educativa 20 2014 65 77
45. D.N. Perkins, M. Farady, and B. Bushey Everyday reasoning and the roots of intelligence J.F. Voss, D.N. Perkins, J.W. Segal, Informal reasoning and education 1991 Erlbaum Hillsdale, NJ 83 106
46. Persky, H.R.; Daane, M. C, & Jin, Y. (2003). The nation's report card: Writing 2002 (U.S. Department of Education Publication No. NCES 2003-529). Washington, DC: U.S. Government Printing Office.
47. A. Reznitskaya, R.C. Anderson, B. McNurlen, K. Nguyen-Jahiel, A. Archodiou, and S. Kim Influence of oral discussion on written argument Discourse Processes 32 2001 155 175
48. M. Scardamalia, and C. Bereiter Research on written composition M.C. Wittrock, Handbook of Research on Teaching 1986 Macmillan New York 778 803
49. M. Sexton, K.R. Harris, and S. Graham Self-regulated strategy development and the writing process: Effects on essay writing and attributions Exceptional Children 64 1998 295 311
50. Shanahan, T. (Ed.) (1990). Reading and writing together: New perspectives for the classroom. Norwood, MA: Christopher-Gordon.
51. Shavelson, R. (2009). Reflections on learning progressions. Paper presented at the Learning Progressions in Science (LeaPS) Conference, Iowa City, IA.
52. Sheehan, K.M.; & O'Reilly, T. (2011). The CBAL Reading Assessment: An Approach for Balancing Measurement and Learning Goals (ETS Research Report RR-11-21). Princeton, NJ: Educational Testing Service.
53. D. Simon, and K.J. Holyoak Structural dynamics of cognition: From consistency theories to constraint satisfaction. Personality and Social Psychology 6 2002 283 294
54. N.L. Stein, and C.A. Miller A theory of argumentative understanding: Relationships among position preference, judgments of goodness, memory, and reasoning Argumentation 7 1993 183 204
55. F.H. Van Eemeren, and R. Grootendorst Argumentation, communication, and fallacies: A pragma-dialectical perspective 1992 Erlbaum Mahwah, NJ
56. F.H. Van Eemeren, R. Grootendorst, and F.S. Henkemans Fundamentals of argumentation theory: A handbook of historical backgrounds and contemporary developments 1996 Erlbaum Mahwah, NJ
57. P.W. Van Rijn, E.A. Graf, and P. Deane Empirical Recovery of Argumentation Learning Progressions in Scenario-Based Assessments of English Language Arts Psicología Educativa 20 2014 109 115
58. L.S. Vygotsky Mind in society: The development of higher psychological processes 1978 Harvard University Press Cambridge, MA
59. D. Walton Plausible argument in everyday conversation 1992 State University of New York Press Albany, NY
60. M. Zieky An introduction to the use of evidence-centered design in test development Psicología Educativa 20 2014 79 87