Placement of students into first-year writing courses

Research in the Teaching of English

Volumn 46, Issue 3, 2012, Pages 285-313

  Elliot, Norbert ^a   Deess, Perry ^a   Rudniy, Alex ^a   Joshi, Kamal ^a  

^a NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84857846929     PISSN: 0034527X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (102)

1. American Educational Research Association, American Psychological Associat ion, & Nat ional Council on Measurement in Educat ion. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (2nd ed.) (pp. 508-600). Washington, DC: American Council on Education.
3. Applebee, A. N., & Langer, J. A. (2006). The state of writing instruction in America's Schools: What existing data tell us? Albany, NY: Center on English Learning & Achievement. Retrieved from http://www.albany.edu/ aire/.
4. Armstrong, W. B. (2000). The association among student success in courses, placement test scores, student background data, and instructor grading practices. Community College Journal of Research and Practice, 24, 681-695.
5. Bandura, A. (2006). Toward a psychology of human agency. Perspectives on Psychological Science, 1, 164-180.
6. Behizadeh, N., & Englahard, G. (2011). Historical view of the influences of measurement and writing theories on the practice of writing assessment in the United States. Assessing Writing, 16, 189-211.
7. Belanoff, P., & Dickson, M. (1991). (Eds.). Portfolios: Process and product. Portsmouth, NH: Boynton.
8. Bennett , R. E. (2011). Automated scoring of constructed-response literacy and mathematics items. Washington, DC: Arabella Philanthropic Investment Advisors. Retrieved from http://www.ets.org/research/.
9. Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. Cambridge, England: Cambridge University Press.
10. Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061-1071. (Pubitemid 39375087)
11. Bowen, W. G., Chingos, M. M., & McPherson, M. S. (2009). Crossing the finish line: Completing college at America's public universities. Princeton, NJ: Princeton University Press.
12. Breland, H., Kubota , M., Nickerson, K., Trapa ni, C., & Walker, M. (2004). New SAT® writing prompt study (College Board Report 2004-1). New York, NY: College Board. Retrieved from http://professionals .collegeboard.com/.
13. Breland, H., Maxey, J., Gernand, R., Cumming, T., & Tripa ni, C. (2002). Trends in college admission 2000: A report of a survey of undergraduate admissions policies, practices, and procedures. (Sponsored by ACT, Inc., Association for Institutional Research, The College Board, Educational Testing Service, and National Association for College Admission Counseling). Retrieved from http://www .airweb.org/.
14. Brennan, R. L. (2006). Perspectives on the evolution and future of educational measurement. In R. L. Brennan (Ed.), Educational measurement (4th ed.) (pp. 1-16). Westport, CT: American Council on Education/Praeger.
15. Bridgeman, B., Trapa ni, C., & Atta li, Y. (in press). Comparison of human and machine scoring of essays: Differences by gender, ethnicity, and country. Applied Measurement in Education.
16. Camilli, G. (2006). Test fairness. In R. L. Brennan (Ed.), Educational measurement (4th ed.) (pp. 221-256). Westport, CT: American Council on Education/Praeger.
17. Camp, R. (1996). New views of measurement and new models for writing assessment. In E. M. White, W. D. Lutz, & S. Kamusikiri (Eds.), Assessment of writing: Politics, policies, practices (pp. 135-147). New York, NY: Modern Language Association.
18. Cizek, G. J. (2008). Assessing Educational measurement: Ovations, omissions, opportunities. [Review of the book Educational measurement, 4th ed. by R. L. Brennan (Ed.)]. Educational Researcher, 37, 96-100.
19. Cizek, G. J., & Bunch, M. B. (2007). Standard setting: A guide to establishing and evaluating performance standards on tests. Thousand Oaks, CA: Sage Press.
20. Cleary, T. A. (1968). Test bias: Prediction of grades of Negro and White students in integrated colleges. Journal of Educational Measurement, 5, 115-124.
21. Code of Federal Regulat ions. (2011). 34§ 668.6. Retrieved from http://ecfr.gpoaccess.gov/.
22. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
23. College Board. (2007). ACCUPLACER Coordinator's guide. New York, NY: College Board.
24. College Board (2011). State profile report: New Jersey. New York: College Board. Retrieved from http://professionals.college board.com.
25. Coppola, N., & Elliot, N. (2010). Assessment of graduate programs in technical communication. In M. Hundleby & J. Allen (Eds.), Assessment in technical and professional communication (pp. 127-160). Amityville, NY: Baywood.
26. Council of Writing Program Administrat ors, Nat ional Council of Teachers of English, & Nat ional Writing Project. (2011). Framework for success in postsecondary writing. Retrieved from http://wpacouncil.org/files/frameworkfor- success-postsecondary-writing.pdf.
27. Cronbach, L. J. (1975, February). Beyond the two disciplines of scientific psychology. American Psychologist, 116-127.
28. Cronbach, L. J. (1988). Five perspectives on validity argument. In H. Wainer & H. Braun (Eds.), Test Validity (pp. 3-17). Hillsdale, NJ: Lawrence Earlbaum.
29. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302.
30. Cronbach, L. J., & Snow, R. E. (1997). Aptitudes and instructional methods: A handbook for research on interactions. New York: Irvington Publishers.
31. Elliot, N. (2005). On a scale: A social history of writing assessment in America. New York, NY: Peter Lang.
32. Elliot, N., Briller, V., & Joshi, K. (2007). Portfolio assessment: Quantification and community. Journal of Writing Assessment, 3, 5-30.
33. Elliott , S. (2003). IntelliMetric: From here to validity. In M. D. Shermis & J. C. Burstein (Eds.), Automated essay scoring: A cross-disciplinary perspective (pp. 71-86). Mahwah, NJ: Lawrence Erlbaum.
34. Embretson, S. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197.
35. Ericsson, P. F., & Haswell, R. H. (2006). Introduction. In P. F. Ericsson & R. H. Haswell (Eds.), Machine scoring of student essays: Truth and consequences (pp. 1-7). Logan, UT: Utah State University Press.
36. Federal Register (2011, June). Program integrity: Gainful employment - debt measures, 76, 34386-34539. Retrieved from http://www.gpo.gov/.
37. Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted Kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613-619.
38. Flower, L. (1986). The construction of negotiated meaning: A social cognitive theory of writing. Carbondale and Edwardsville, IL: Southern Illinois University Press.
39. Gere, A. R., Aull, L., Green, T., & Porter, A. (2010). Assessing the validity of directed self-placement at a large university. Assessing Writing, 15, 154-176.
40. Gilyard, K. 1991). Voices of the self: A study of language competence. Detroit, MI: Wayne State University Press.
41. Godshalk, F., Swineford, F., & Coffman, W. E. (1966). The measurement of writing ability. Princeton, NJ: Educational Testing Service.
42. Greene, J. P. (2000). The cost of remedial education. Midland, MI: Mackinac Center for Public Policy.
43. Hambleton, R. K., & Plake, B. S. (1995). Using an extended Angoff procedure set standards on complex performance assessments. Applied Measurement in Education, 8, 41-55.
44. Harrington, S., Rhodes, K., Fischer, R. O., & Malenczyk, R. (Eds). (2006). The outcomes book: Debate and consensus after the WPA outcomes statement. Logan, UT: Utah State University Press.
45. Haswell, R. H. (1998). Multiple inquiry in the validation of writing tests. Assessing Writing, 5, 89-101.
46. Haswell, R. H. (2005). Post-secondary entrance writing placement. Retrieved from http://comppile.tamucc.edu/placement.htm.
47. Hech, L. W. (1980). Validation of the New Jersey college basic skills placement test (ED 204 945). Retrieved from http://www.eric.ed.gov/.
48. Hester, V., O'Neill, V., Neal, M., Eddington, A, & Huot, B. (2007). Adding portfolios to the placement process: A longitudinal perspective. In P. O'Neill (Ed.), Blurring boundaries: Developing writers, researchers, and teachers (pp. 61-90). Creskill, NJ: Hampton Press.
49. H. R. 4137. Extension of Higher Education Act of 1965. 110th Cong. (2008). Retrieved from http://www.govtrack.us/congress/.
50. Huot, B. (1996). Towards a new theory of writing assessment. College Composition and Communication, 47, 549-566.
51. Huot, B. (2002). (Re)Articulating writing assessment in teaching and learning. Logan, UT: Utah State University Press.
52. Johnson, C., & Elliot, N. (2010). Undergraduate technical writing assessment. Programmatic Perspectives, 2, 110-151. Retrieved from http://www.cptsc.org/.
53. Kane, M. T. (2006) Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed.) (pp. 17-64). Westport, CT: American Council on Education/Praeger.
54. Kelley, T. L. (1927). Interpretation of educational measurements. New York: Macmillan.
55. Kobrin, J. L., Patt erson, B. F., Shaw , E. J, Mattern, K. D., & Barbuti, S. M. (2008). Validity of the SAT® for predicting first-year college grade point average (College Board Report 2008-5). New York: College Board. Retrieved from http://professionals.collegeboard.com/.
56. Lee, J. M., & Rawls, A. (2010). The college completion agenda: 2010 progress report. New York: College Board. Retrieved from http:// professionals.collegeboard.com/gateway.
57. Livingston, S. (2004). Equating test scores (without IRT). Princeton, NJ: Educational Testing Service. Retrieved from http://www .ets.org/research/.
58. Lynne, P. (2004). Coming to terms: A theory of writing assessment. Logan, UT: Utah State University Press.
59. Matt ern, K. D., & Packman, S. (2009). Predictive validity of ACCUPLACER® scores for course placement: A meta-analysis (Research Report 2009-2). New York: College Board. Retrieved from http://professionals. collegeboard.com/gateway.
60. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational Measurement (3rd ed.) (pp.134-103). New York, NY: American Council on Education and Macmillan.
61. Messick, S. (1998). Test validity: A matter of consequences. Social Indicators Research, 45, 35-44.
62. Mislevy, R. J. (2006). Cognitive psychology and educational assessment. In R. L. Brennan (Ed.), Educational measurement (4th ed.) (pp. 257-305). Westport, CT: American Council on Education/Praeger.
63. Mislevy, R. J. (2007). Validity by design. Educational Researcher, 36, 463-469.
64. Mitzel, H. C., Lewis, D. M., Pat z, R. J., & Green, D. R. (2001). The bookmark prog-cedure: Psychological perspectives. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 249-281). Mahwah, NJ: Lawrence Erlbaum.
65. Morgan, D. L. (2006). Setting local cut scores on the SAT Reasoning Test; Writing Section for use in college placement and admission decisions. New York: College Board. Retrieved from http://professionals.collegeboard.com/.
66. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
67. New Jersey Stat e Depa rtment of Higher Educat ion (1980). Establishing cut scores on the New Jersey college basic skills placement test. Trenton, NJ: New Jersey State Department of Higher Education. Retrieved from http:// www.eric.ed.gov/.
68. N.J.S. 18A:3b-1 et seq., 1994. Higher Education Restructuring Act of 1994. Retrieved from http://www.state.nj.us/highereducation/about/Restructuring- Statute.htm.
69. Norris, D., Oppler, S., Kuang, D., Day , R., & Adams, K. (2006). The College Board SAT® Writing validation study: An assessment of predictive and incremental validity (Research Report 2006-2). New York: College Board. Retrieved from http://professionals .collegeboard.com/.
70. Obama, Barack. (2009). Remarks prepared for delivery address to joint session of Congress, Tuesday, February 24, 2009. Retrieved from http://www.whitehouse.gov/.
71. O'Neill, P., Moore, C., & Huot, B. (2009). A guide to college writing assessment. Logan, UT: Utah State University Press.
72. O'Neill, T. R., Tannenbaum, R. J., & Tiffen, J. (2005). Recommending a minimum English proficiency standard for entry-level nursing. Journal of Nursing Measurement, 13, 129-146. (Pubitemid 43096841)
73. O'Reilly, T., & Sheehan, K. M. (2009). Cognitively based assessment of, for, and as Learning: A framework for assessing reading competency (ETS RR-09-26). Princeton, NJ: Educational Testing Service.
74. Ott e, G., & Mlynarczyk, W. (2010). Basic writing. West Lafayette, IN: Parlor Press and WAC Clearninghouse.
75. Palmer, O. (1961). Sense or nonsense? The objective testing of English composition. English Journal, 50, 314-320.
76. Parsad, B., & Lewis, L. (2003). Remedial education in degree-granting postsecondary institutions in fall 2000. (NCES 2004-010). Washington, DC: U.S. Department of Education, National Center for Educational Statistics.
77. Peckham, I. (2009). Online placement in first year writing. College Composition and Communication, 60, 517-540.
78. Peckham, I. (2010). Online challenge versus offline ACT. College Composition and Communication, 61, 718-745.
79. Reinheimer, D. A. (2007). Validating placement: Local means, multiple measures. Assessing Writing, 12, 170-179.
80. Reynolds, C. R. (1982). Methods of detecting construct and predictive bias. In R. A. Berk (Ed.), Handbook of methods for detecting bias (pp. 199-227). Baltimore, MD: Johns Hopkins University Press.
81. Reynolds, W. R., & Miller. G. E. (Eds.). (2003). Handbook of psychology: Vol. 7. Educational psychology. Hoboken, NJ: John Wiley.
82. Royer, D.J., & Gilles, R. (1998). Directed selfplacement: An attitude of orientation. College Composition and Communication, 50, 54-70.
83. Salahu-Din, D., Persky, H., & Miller, J. (2008). The nation's report card: Writing 2007. (NCES 2008-468). U.S. Department of Education, Washington, DC: National Center for Education Statistics. Retrieved from http:// nces.ed.gov/.
84. Smitherman, G. (2000). African American student writers in the NAEP, 1969-1988/89. In G. Smitherman (Ed.), Talkin that talk: Language, culture and education in African America (pp. 163-176). New York: Routledge.
85. Snyder, T. D., & Dillow, S. A. (2011). Digest of educational statistics, 2010 (NCES 2011-015). Washington, DC: National Center for Education Statistics. Retrieved from http:// nces.ed.gov/.
86. State of New Jersey. New Jersey college basic skills placement test: Scoring the essays. Trenton, NJ: Department of Higher Education. Archives of the Carl Campbell Brigham Library, ETS, Princeton, NJ.
87. Sternberg, R., & Subotnik, R. F. (2006). Optimizing student success in school with the other three Rs: Reasoning, resilience, and responsibility. Charlotte, NC: Information Age Publishing.
88. Sullivan. P., & Tinberg, H. (Eds.). (2006). What is "college level" writing? Urbana, IL: National Council of Teachers of English.
89. Thorndike, E. L. (1911). A scale for merit in English writing by young people. Journal of Educational Psychology, 2, 361-368.
90. Title VI of the Civil Rights Act, 42 U. S. C. § 2000d (1964). Retrieved from http://www.justice.gov/.
91. Title VII of the Civil Rights Act, 42 U. S. C. § 2000e et. seq. (1964). Retrieved from http:// www.justice.gov/.
92. Toulmin, S. E. (1958). The uses of argument. Cambridge, England: Cambridge University Press.
93. U.S. Depa rtment of Educat ion. (2006). A test of leadership: Charting the future of U.S. higher education. Washington, DC: U.S. Department of Education. Retrieved from http://www2.ed.gov/.
94. Venezia, A., Bracco, K. R., & Nodine, T. (2010). One-shot deal? Students' perceptions of assessment and course placement in California's community colleges. San Francisco: WestEd.
95. White, E. M. (1973). (Ed.). Comparison and contrast: The 1973 California State University and College Freshman English Equivalency Examination. (ERIC ED 114825). Retrieved from http://www.eric.ed.gov/.
96. White, E. M. (2001). The opening of the modern era of writing assessment: A narrative. College English, 63, 306-320.
97. Williamson, M. (1994). The worship of efficiency: Untangling theoretical and practical considerations in writing assessment. Assessing Writing, 1, 147-174.
98. Willingham, W. W. (1974). College placement and exemption. New York: College Board. Retrieved from http://www.eric.ed.gov/.
99. Willingham, W. W., Pollack, J. M., & Lewis, C. (2002). Grades and test scores: Accounting for observed differences. Journal of Educational Measurement, 39, 1-97.
100. Yancey, K. B. (1999). Looking back as we look forward: Historicizing writing assessment as a rhetorical act. College Composition and Communication, 50, 483-503.
101. Yen, W. M., & Fitzpat rick, A. R. (2006). Item response theory. In R. L. Brennan (Ed.), Educational measurement (4th ed.) (pp. 111-153). Westport, CT: American Council on Education/ Praeger.
102. Zieky, M., & Perie, M. (2006). A primer on setting cut scores on tests of educational achievement. Princeton, NJ: Educational Testing Service. Retrieved from http://www.ets.org/ research/.