Historical view of the influences of measurement and writing theories on the practice of writing assessment in the United States

Assessing Writing

Volumn 16, Issue 3, 2011, Pages 189-211

  Behizadeh, Nadia ^a   Engelhard, George ^a  

^a EMORY UNIVERSITY   (United States)

Author keywords

History; Measurement theory; Rasch measurement; Sociocultural theory; Writing assessment in the U.S.; Writing theory

Indexed keywords

EID: 79960035649     PISSN: 10752935     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asw.2011.03.001     Document Type: Article

References (141)

1. ACT Inc. (2007a). Writing framework for the 2011 National Assessment of Educational Progress. Iowa City, Iowa: Author.
2. ACT, Inc. (2007b). Writing specifications for the 2011 National Assessment of Educational Progress. Iowa City, Iowa: Author.
3. American Psychological Association. (1954). Technical recommendations for psychological tests and diagnostic techniques. Washington, DC: Author.
4. Au W. High-stakes testing and curricular control: A qualitative metasynthesis. Educational Researcher 2007, 36(5):258-267.
5. Baker F.B. Automation of test scoring, reporting and analysis. Educational measurement: Second edition 1971, 202-234. American Council on Education, Washington, DC. R.L. Thorndike (Ed.).
6. Barkaoui K. Participants, texts, and processes in ESL/EFL essay tests. A narrative review of the literature. The Canadian Modern Language Review 2007, 64(1):99-134.
7. Barton D., Hamilton M. Local literacies: Reading and writing in one community 1998, Routledge, London.
8. Bereiter C. Development in writing. Cognitive processes in writing 1980, 73-93. Erlbaum, Hillsdale, NJ. L.W. Gregg, E.R. Steinberg (Eds.).
9. Birnbaum A. Some latent trait models and their use inferring an examinee's ability. Statistical theories of mental test scores 1968, Addison Wesley, Reading, MA. F.M. Lord, M.R. Novick (Eds.).
10. Taxonomy of educational objectives: The classification of educational goals. Handbook 1. Cognitive domain 1956, McKay, New York, NY. B.S. Bloom (Ed.).
11. Bock R.D. A brief history of item response theory. Educational Measurement: Issues and Practice 1997, 16(10):21-32.
12. Boscolo P. Writing in primary school. Handbook of research on writing: History, society, school, individual, text 2008, 293-309. Erlbaum, New York, NY. C. Bazerman (Ed.).
13. Braddock R. English composition. Encyclopedia of educational research 1969, 443-461. The Macmillan Company, New York, NY. R.L. Ebel (Ed.).
14. Breland H.M. Computer-assisted writing assessment: The politics of science versus the humanities. Assessment of writing: Politics, policies, practices 1996, 249-256. Modern Language Association of America, New York, NY. E.M. White, W.D. Lutz, S. Kamusikiri (Eds.).
15. Breland H., Camp R., Jones R., Morris M., Rock D. Assessing writing skills 1987, College Entrance Examination Board, New York, NY.
16. Brennan R.L. Generalizability theory. Educational Measurement: Issues and Practice 1992, 11(4):27-34.
17. Brennan R.L. A perspective on the history of generalizability. Educational Measurement: Issues and Practice 1997, 16(10):14-20.
18. Bruner J. The process of education 1960, Random House/Vintage Books, New York, NY.
19. Camilli G. Test fairness. Educational measurement 2006, 221-256. Praeger, Westport, CT. 4th ed. R.L. Brennan (Ed.).
20. Camp R. Changing the model for the direct assessment of writing. Validating holistic scoring for writing assessment 1993, 45-78. Hampton, Creskill, NJ. M.M. Williamson, B.A. Huot (Eds.).
21. Charters, W. W., & Miller, E. (1915). A course of study in grammar based upon the grammatical errors of school children of Kansas City, Missouri. University of Missouri Bulletin, 16(2), Education Series No. 9.
22. Chomsky N. Syntactic structures 1957, Mouton, The Hague.
23. Clifford G.J. Edward L. Thorndike: The sane positivist 1984, Wesleyan University Press, Middletown, CT.
24. Cronbach L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16:297-334.
25. Cronbach L.J., Gleser G.C., Nanda H., Rajaratnam N. The dependability of behavioral measurements: Theory of generalizability of scores and profiles 1972, Wiley, New York, NY.
26. Cronbach L.J., Rajaranam N., Gleser G.C. Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology 1963, 16:137-163.
27. Cuban, L. (1990, December). Four stories about national goals for American education. Phi Delta Kappan, 265-271.
28. Factor analysis at 100: Historical developments and future directions 2007, L. Erlbaum, Mahwah, NJ. R. Cudeck, R.C. MacCallum (Eds.).
29. Dewey J. Experience and education 1938, Collier Books, New York, NY.
30. Dewey J. Democracy and education 1944, The Free Press, New York, NY.
31. Diederich P.B. Measuring growth in English 1974, National Council of Teachers of English, Urbana, IL.
32. Dyson A.H. Social worlds of children learning to write in an urban primary school 1993, Teachers College Press, New York, NY.
33. Dyson A.H. On reframing children's words: The perils, promises, and pleasures of writing children. Research in the Teaching of English 2000, 34:352-367.
34. Ebel R.L. Estimation of the reliability of ratings. Psychometrika 1951, 16:407-424.
35. Elbow P., Belanoff E. Reflections on an explosion: Portfolios in the 90's and beyond. Situating portfolios: Four perspectives 1997, 21-34. Utah State University Press, Logan, UT. K. Yancey, I. Weiser (Eds.).
36. Elliot N. On a scale: A social history of writing assessment in America 2005, Peter Lang, New York.
37. Emig J. The composing processes of twelfth graders 1971, National Council of Teachers of English, Urbana, IL.
38. Emig J. Writing, composition, and rhetoric. Encyclopedia of educational research 1982, 2021-2036. The Free Press, New York, NY. H.E. Mitzel (Ed.).
39. Elliot N., Briller V., Joshi K. Portfolio assessment: Quantification and community. Journal of Writing Assessment 2006, 3(1):5-30.
40. Engelhard G. The measurement of writing ability with a many-faceted Rasch model. Applied Measurement in Education 1992, 5(3):171-191.
41. Engelhard G. Historical view of the influences of measurement and reading theories on the assessment of reading. Journal of Applied Measurement 2001, 2(1):1-26.
42. Engelhard G. Monitoring raters in performance assessments. Large-scale assessment programs for ALL students: Development, implementation, and analysis 2002, 261-287. Erlbaum, Mahwah, NJ. G. Tindal, T. Haladyna (Eds.).
43. Engelhard G. Using IRT and model-data fit to conceptualize differential item and person functioning for students with disabilities. Educational and Psychological Measurement 2009, 69(4):585-602.
44. Engelhard G., Myford C.M. Monitoring faculty consultant performance in the Advanced Placement English Literature and Composition Program with a many-faceted Rasch model 2003, College Entrance Examination Board, New York, NY.
45. Engestrom Y. Expansive learning at work: Toward an activity theoretical reconceptualization. Journal of Education and Work 2001, 14(1):133-156.
46. Fisher M.T. Writing in rhythm: Spoken word poetry in urban classrooms 2007, Teachers College Press, New York, NY.
47. Flower L. Reading-to-write: Exploring a cognitive and social process 1990, Oxford University Press, New York, NY.
48. Flower L. The construction of negotiated meaning: A social cognitive theory of writing 1994, University of Southern Illinois Press, Carbondale, IL.
49. Foley J.J. Evaluation of learning in writing. Handbook on formative and summative evaluation of student learning 1971, 769-813. McGraw-Hill, New York, NY. B.S. Bloom, J.T. Hastings, G.F. Madaus (Eds.).
50. Gee J.P. A sociocultural perspective on opportunity to learn. Assessment, equity, and opportunity to learn 2008, 76-108. Cambridge University Press, Cambridge. P. Moss, D.C. Pullin, J.P. Gee (Eds.).
51. Godshalk F.I., Swineford F., Coffman W.E. The measurement of writing ability 1966, College Entrance Examination Board, New York, NY.
52. Graham S., Perin D. Writing next: Effective strategies to improve writing of adolescents in middle and high schools 2007, Carnegie Corporation, New York, NY.
53. Greene H.A. English: Language, grammar, and composition. Encyclopedia of educational research 1941, 446-461. The Macmillan Company, New York, NY. W.S. Monroe (Ed.).
54. Greene H.A. English: Language, grammar, and composition. Encyclopedia of educational research 1950, The Macmillan Company, New York, NY. W.S. Monroe (Ed.).
55. Gutierrez K.D., Baquedano-Lopez P., Tejada C. Rethinking diversity: Hybridity and hybrid language practices in the third space. Mind, Culture, and Activity 1999, 6(4):286-303.
56. Assessing second language writing in academic contexts 1991, Ablex Publishing Corporation, Norwood, NJ. L. Hamp-Lyons (Ed.).
57. Hamp-Lyons L. Fourth generation writing assessment. On second language writing assessment 2001, 117-127. Erlbaum, Mahwah, NJ. T. Silva, P.K. Matsuda (Eds.).
58. Hamp-Lyons L. The scope of writing assessment. Assessing Writing 2002, 8:5-16.
59. Hamp-Lyons L., Condon W. Assessing the portfolio: Principles for practice, theory, and research 2000, Hampton Press, Cresskill, NJ.
60. Hamp-Lyons, L., & Kroll, B. (1997). TOEFL 2000 - writing: Composition, community, and assessment (TOEFL Monograph Series Report No. 5). Princeton, NJ: Educational Testing Service.
61. Haswell R.H. Book review [Review of the book A social history of writing assessment in America]. Assessing Writing 2006, 20:140-144.
62. Hatfield, W. W. (1935). An experience curriculum in English (A report of the curriculum commission of the National Council of Teachers of English). New York, NY: Appleton-Century.
63. Hayes J.R. A new framework for understanding cognition and affect in writing. The science of writing 1996, 1-17. Erlbaum, Mahwah, NJ. C.M. Levy, S. Randell (Eds.).
64. Hayes J.R., Flower L.S. Identifying the organization of writing processes. Cognitive processes in writing 1980, 3-30. Erlbaum, Hillsdale, NJ. L.W. Gregg, E.R. Steinberg (Eds.).
65. Heath S.B. Ways with words: Language, life, and work in communities and classrooms 1983, Cambridge University Press, Cambridge.
66. Hesse D.D. 2005 CCCC Chair's address: Who owns writing?. College Composition and Communication 2005, 57(2):335-357.
67. Hildyard A. Written composition. Encyclopedia of educational research 1992, 1528-1540. Macmillan Publishing Company, New York, NY. M.C. Alkin (Ed.).
68. Hillegas M.B. Scale for the measurement of quality in English composition by young people. Teachers College Record 1912, 13(4):1-54.
69. Hillocks G. The focus on form vs. content in teaching writing. Research in the Teaching of English 2005, 40(2):238-248.
70. Hinsdale B.A. Teaching the language arts: Speech, reading, and composition 1896, D. Appleton and Company, New York, NY.
71. Huot B. The literature of direct writing assessment: Major concern and prevailing trends. Review of Educational Research 1990, 60:237-264.
72. Huot B. (Re) Articulating writing assessment for teaching and learning 2002, Utah State University Press, Logan, Utah.
73. IRA/NCTE Joint Task Force on Assessment. (1994). Standards for the assessment of reading and writing (IRA Stock No. 674; NCTE Stock No. 01231). International Reading Association and National Council of Teacher of English.
74. Ivanic R. Discourses of writing and learning to write. Language and Education 2004, 18(3):220-245.
75. Jeffery J.V. Constructs of writing proficiency in US state and national writing assessments: Exploring variability. Assessing Writing 2009, 14:3-24.
76. Johnson C.S., Elliot N. Undergraduate technical writing assessment: A model. Programmatic Perspectives 2010, 2(2):110-151.
77. Jones L. A history of the National Assessment of Educational Progress and some questions about its future. Educational Researcher 1996, 25(7):15-22.
78. Joreskog K.G. Analyzing psychological data by structural analysis of covariance matrices. Contemporary developments in mathematical psychology 1974, Vol. 2:1-56. W.H. Freeman, San Francisco.
79. Joreskog K.G. Factor analysis and its extensions. Factor analysis at 100: Historical developments and future directions 2007, Erlbaum, Mahwah, NJ. R. Cudeck, R.C. MacCallum (Eds.).
80. Kaestle C.F. Literacy in the United States: Readers and reading since 1880 1991, Yale University Press, New Haven, CT.
81. Kane M.T. Validation. Educational measurement, Fourth Edition 2006, 17-64. American Council on Education and National Council on Measurement in Education, Washington, DC. R. Brennan (Ed.).
82. Kinloch V.F. Revisiting the promise of "Students' Right to Their Own Language": Pedagogical strategies. College Composition and Communication 2005, 57(1):83-113.
83. Kuder G.F., Richardson M.W. The theory of estimation of test reliability. Psychometrika 1937, 2:151-160.
84. Kuhn T.S. The structure of scientific revolutions 1970, Princeton University Press, Princeton, NJ. 2nd ed.
85. Lakatos I. The methodology of scientific research programs 1978, Cambridge University Press, Cambridge.
86. Laudan L. Progress and its problems: Toward a theory of scientific change 1977, University of California Press, Berkeley, CA.
87. Lee C. Is October Brown Chinese? A cultural modeling activity system for underachieving students. American Educational Research Journal 2001, 38(1):97-141.
88. Lee C. Synthesis of research on the role of culture in learning among African American youth: The contributions of Asa G. Hilliard, III. Review of Educational Research 2008, 78(4):797-827.
89. Lewis C. What's discourse got to do with it? A meditation on critical discourse analysis in literacy research. Research in the Teaching of English 2006, 40(3).
90. Linacre J.M. Many-facet Rasch measurement 1989, MESA Press, Chicago.
91. Lord F.M. Applications of item response theory to practical testing problems 1980, Erlbaum, Hillsdale, NJ.
92. Lunsford A. The past-and future-of writing assessment. Writing assessment: Issues and strategies 1986, 1-12. Longman, White Plains, NY. K.L. Greenberg, H.S. Wiener, R.A. Donovan (Eds.).
93. Lyman, R. L. (1922). English grammar in American schools before 1950. Doctoral dissertation, University of Chicago. Retrieved September 4, 2009, from http://books.google.com/books%3Fid=bjpCAAAAIAAJ%26ots=A2aIwqhcP-%26dq=lyman%25201922%26lr=%26pg=PA5%23v=onepage%26q=%26f=false.
94. Lyman R.L. The enrichment of the English curriculum 1932, University of Chicago Press.
95. MacArthur C.A., Graham S., Fitzgerald J. The handbook of writing research 2006, The Guilford Press, New York, NY.
96. McCutchen D., Teske P., Bankston C. Writing and cognition: Implications of the cognitive architecture for learning to write and writing to learn. Handbook of research on writing: History, society, school, individual, text 2008, 451-470. Erlbaum, New York, NY. C. Bazerman (Ed.).
97. Messick S. Validity and washback in language testing. Language Testing 1996, 13(3):241-256.
98. Messick S. Validity. Educational measurement 1989, 13-103. Macmillan/American Council on Education, New York, NY. R.L. Linn (Ed.).
99. Moore C., O'Neill P., Huot B. Creating a culture of assessment in writing programs and beyond. College Composition and Communication 2009, 61(1):107-132.
100. Morrell E. Critical literacy and urban youth: Pedagogies of access, dissent, and liberation 2008, Routledge, New York, NY.
101. Moss P.A. Can there be validity with reliability?. Educational Researcher 1994, 23(2):229-258.
102. Murphy S., Camp R. Moving towards systematic coherence. A discussion of conflicting perspectives in portfolio assessment. Writing portfolios in the classroom: Policy and practice, promise and peril 1996, Erlbaum, Mahwah, NJ. R. Calfee, P. Perfumo (Eds.).
103. Murphy S., Underwood T. Portfolio practices: Lessons from schools, districts, and states 2000, Christopher Gordon Publishers, Norwood, MA.
104. Myford, C. M., & Mislevy, R. J. (1995). Monitoring and improving a portfolio assessment system (ETS Center for Performance Assessment Report No. MS 94-05). Princeton, NJ: Educational Testing Service.
105. National Commission on Writing. (2003). The neglected "R": The need for a writing revolution. New York, NY The College Board.
106. Nystrand M. English language instruction. Encyclopedia of educational research 1992, Vol. 2:443-453. Macmillan Publishing Company, New York, NY.
107. Prior P. A sociocultural theory of writing. Handbook of writing research 2006, 54-66. Guilford Press, New York, NY. C.A. MacArthur, S. Graham, J. Fitzgerald (Eds.).
108. Prior, P., & Shipka, J. (2003). Chronotopic lamination: Tracing the contours of literate activity. In C. Bazerman & D. R. Russel (Eds.), Writing selves/writing societies: Research from activity perspectives (pp. 180-238). Fort Collins, CO: WAC Clearing House and Mind, Culture, and Activity. Retrieved from http://wac.colostate.edu/books/selves_societies/.
109. Purves A.C. The IEA study of writing composition II: Education and performance in fourteen countries 1992, Pergamon Press, Oxford.
110. Quaynor, L., &, Engelhard, G. (2010). Historical View of Measurement and Language Theories Within the Context of the Assessment the Language Proficiency of English Language Learner. Paper presented at the meeting of the International Objective Measurement Workshop at the University of Colorado, Boulder.
111. Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests. Chicago: The University of Chicago Press (Original work published 1960).
112. Richardson M.W., Russell J.T., Stalnaker J.M., Thurstone L.L. Manual of examination methods 1933, University of Chicago, Chicago.
113. Russell D.R. Activity theory and its implications for writing instruction. Reconceiving writing, rethinking writing instruction 1995, 51-77. Erlbaum, Mahwah, NJ. J. Petraglia (Ed.).
114. Russell D.R. Rethinking genre in school and society: An activity theory analysis. Written Communication 1997, 14(4):504-554.
115. Scribner S., Cole M. Unpackaging literacy. Writing: The nature, development, and teaching of written communication 1981, 71-87. Erlbaum, Mahwah, NJ. M.F. Whiteman (Ed.).
116. Searles J.R., Carlsen G.R. English. Encyclopedia of educational research 1960, 454-470. Macmillan Publishing Company, New York, NY. C.W. Harris (Ed.).
117. Seely H.F. On teaching English 1933, American Book Company, Chicago.
118. Shepard L.A. Role of assessment in a learning culture. Educational Researcher 2000, 29(7):4-14.
119. Smith, D. V. (1933). Instruction in English. U.S. Office of Education Bulletin, No. 17. GPO.
120. Spearman C. "General intelligence," objectively determined and measured. American Journal of Psychology 1904, 15:201-293.
121. Sperling M., Freedman S.W. Research on writing. Handbook of research on teaching 2001, 370-389. American Educational Research Association, Washington, DC. 4th ed. V. Richardson (Ed.).
122. Stone M.H., Wright B.D., Stenner A.J. Mapping variables. Journal of Outcome Measurement 1999, 3(4):308-322.
123. Street B.V. Literacy in theory and practice 1984, Cambridge University Press, Cambridge.
124. Street B.V. Social literacies: Critical approaches to literacy in development ethnography and education 1995, Longman, London.
125. Street B.V., Lefstein A. Literacy: An advanced resource book 2007, Routledge, London.
126. Szwed J.F. The ethnography of literacy. Writing: The nature, development, and teaching of written communication 1981, 13-23. Erlbaum, Mahwah, NJ. M.F. Whiteman (Ed.).
127. Thorndike E.L. An introduction to the theory of mental and social measurements 1904, Teachers College, Columbia University, New York, NY.
128. Thorndike E.L. English composition: 150 specimens arranged for use in psychological and educational experiments 1916, Teachers College, Columbia University, New York, NY.
129. Thurstone L.L. The reliability and validity of tests 1931, Edwards, Ann Arbor, MI.
130. Trabue M.R. Supplementing the Hillegas Scale. Teachers College Record 1917, 18(1):51-84.
131. Traub R. Classical test theory in historical perspective. Educational Measurement: Issues and Practice 1997, 16(10):8-13.
132. Handbook of modern item response theory 1997, Springer-Verlag, New York, NY. W.J. van der Linden, R.K. Hambleton (Eds.).
133. Vygotsky L.S. Mind in society: The development of higher psychological processes 1978, Harvard University Press, Cambridge, MA.
134. Weigle S.C. Assessing writing 2002, Cambridge University Press, Cambridge.
135. White E.M. Teaching and assessing writing 1985, Jossey-Bass, San Francisco, CA.
136. White E.M. The scoring of writing portfolios: Phase 2. College Composition and Communication 2005, 56(4):581-600.
137. Wiggins G. Assessment: Authenticity, context, and validity. Phi Delta Kappan 1993, 75(3):200-214.
138. Winn M.T., Behizadeh N. The right to be literate: Literacy, education, and the school-to-prison pipeline. Review of Research in Education 2011, 35:147-173.
139. Wright B.D. Solving measurement problems with the Rasch model. Journal of Educational Measurement 1977, 72:97-116.
140. Yancey K.B. Looking back as we look forward: Historicizing writing assessment. College Composition and Communication 1999, 50(3):483-503.
141. Zumbo B.D. Three generations of dif analyses: Considering where it has been, where it is now, and where it is going. Language Assessment Quarterly 2007, 4(2):223-233.