The legal and the local: Using disparate impact analysis to understand the consequences of writing assessment

College Composition and Communication

Volumn 65, Issue 4, 2014, Pages 588-611

  Poe, Mya ^a   Elliot, Norbert ^b   Cogan Jr , John Aloysius ^c   Nurudeen Jr , Tito G ^b  

^a NORTHEASTERN UNIVERSITY   (United States)

^b NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

^c UNIVERSITY OF CONNECTICUT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84901716140     PISSN: 0010096X     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (99)

1. Abernathy, Charles F. "Legal Realism and the Failure of the 'Effects' Test for Discrimination. " Georgetown Law Journal 94.2 (2006): 267-319. Print.
2. Alexander v. Choate. 469 US 287. Supreme Court of the US. 1985. Print.
3. Alexander v. Sandoval. 532 US 275. Supreme Court of the US. 2001. Print.
4. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. Standards for Educational and Psychological Testing. Washington: American Educational Research Association, 1999. Print.
5. Association of Mexican-American Educators v. California. 231 F.3d 572. US Court of Appeals for the Ninth Circuit. 2000. Print.
6. Baldwin, Doug. "Fundamental Challenges in Developing and Scoring Constructed-Response Assessments. " Elliot and Perelman 327-43. Barone v. Dept. of Human Services. 107 NJ 355. Supreme Court of NJ. 1987. Print.
7. Bernal, Delorez Delgado. "Critical Race Theory, Latino Critical Theory, and Critical Raced-Gendered Epistemologies: Recognizing Students of Color as Holders and Creators of Knowledge. " Qualitative Inquiry 8.1 (2002): 105-26. Print.
8. Black, Derek. "Picking Up the Pieces after Alexander v. Sandoval: Resurrecting a Private Cause of Action for Disparate Impact. " North Carolina Central Law Review 81.1 (2002): 356-91. Print.
9. Braceras, Jennifer C. "Killing the Messenger: The Misuse of Disparate Impact Theory to Challenge High-Stakes Educational Tests. " Vanderbilt Law Review 55.4 (2002): 1111-203. Print.
10. Breland, Hunter M., and Gail H. Ironson. "DeFunis Reconsidered: A Comparative Analysis of Alternative Admissions Stratagies. " Journal of Educational Measurement 13.1 (1976): 89-99. Print.
11. Brennan, Robert L., ed. Educational Measurement. 4th ed. Westport: American Council on Education / Praeger, 2006. Print.
12. Bridgeman, Brent. Message to the authors. 29 Mar. 2013. Email.
13. Bridgeman, Brent, Judith Pollack, and Nancy Burton. "Predicting Grades in College Courses: A Comparison of Multiple Regression and Percent Succeeding Approaches. " Journal of College Admissions 199 (Spring 2008): 19-35. Print.
14. Broad, Bob, et al. Organic Writing Assessment: Dynamic Criteria Mapping in Action. Logan: Utah State UP, 2009. Print.
15. California State University, Long Beach. "All Undergraduate Students. " California State U, Long Beach. Fall Semester Ethnicity Breakdown, 2010. Web. 23 Dec. 2013.
16. Camilli, Gregory. "Test Fairness. " Brennan 221-56. Cannon v. University of Chicago. 441 US 677. Supreme Court of the US. 1979. Print.
17. City University of New York. "Current Student Data Book by Subject. " City U of New York. N.d. Web. 23 Dec. 2013.
18. Cleary, Ann T. "Prediction of Grades of Negro and White Students in Integrated Colleges. " Journal of Educational Measurement 5.2 (1968): 115-24. Print.
19. College Board. Essay Scoring Guide. New York: College Board, 2013. Web. 23 Dec. 2013.
20. College Board. State Profile Report: New Jersey. New York: College Board, 2013. Web. 23 Dec. 2013.
21. College Board. Total Group Profile Report. New York: College Board, 2013. Web. 23 Dec. 2013.
22. Complete College America. Remediation: Higher Education's Bridge to Nowhere. Washington: Complete College America. Web. 23 Dec. 2013.
23. Condon, William. "Large-Scale Assessment, Locally-Developed Measures, and Automated Scoring of Essays: Fishing for Red Herrings?" Assessing Writing 18.1 (2013): 100-108. Print.
24. Davis, Eden. "Unhappy Parents of Limited English Proficiency Students: What Can They Really Do?" Journal of Law and Education 35.2 (2006): 277-88. Print.
25. Elliot, Norbert, Perry Deess, Alex Rudniy, and Kamal Joshi. "Placement of Students into First-year Writing Courses. " Research in the Teaching of English 46.3 (2012): 285-313. Print.
26. Elliot, Norbert, and Les Perelman, eds. Writing Assessment in the 21st Century: Essays in Honor of Edward M. White. New York: Hampton, 2012. 327-343. Print.
27. Elul, Hagit. "Making the Grade, Public Education Reform: The Use of Standardized Testing to Retain Students and Deny Diplomas. " Columbia Human Rights Law Review 30 (1998): 495-536. Print.
28. Family Educational Rights and Privacy Act. 20 U.S.C. Sec. 1232g; 34 CFR Part 99. Print.
29. Feinstein, Alvan R. Principles of Medical Statistics. Boca Raton: CRC P, 2001. Print.
30. Frank v. Ivy Club. 120 NJ 73. Supreme Court of NJ. 1990. Print.
31. Gere, Anne Ruggles, Laura Aull, Moisés Damián Perales Escudero, Zak Lancaster, and Elizabeth Vander Lei. "Local Assessment: Using Genre Analysis to Validate Direct Self-Placement. " College Composition and Communication 64.4 (2013): 605-33. Print.
32. Glau, Greg. "Stretch Courses. " WPA-Comp-Pile Research Bibliographies, No. 2. Council of Writing Program Administrators. Feb. 2010. Web. 23 Dec. 2013.
33. Green, Preston C., III. "Can Title VI Prevent Law Schools from Adopting Admissions Practices That Discriminate against African-Americans?" Southern University Law Review 24.2 (1996): 237-61. Print.
34. Greenberg v. Kimmelman. 99 NJ 552. Supreme Court of NJ. 1985. Print.
35. Guardians Association v. Civil Service Commission of New York City. 463 US 582. Supreme Court of the US. 1983. Print.
36. Hamp-Lyons, Liz. Assessing Second Language Writing in Academic Contexts. Norwood: Ablex, 1991. Print.
37. Haswell, Richard, and Janis Tedesco Haswell. "Gender Bias and Critique of Student Writing. " Assessing Writing 3.1 (1996): 31-83. Print.
38. Higher Education Act. Pub. L. No. 89-329. 1965. Print.
39. Horner, Bruce. "Relocating Basic Writing. " Journal of Basic Writing 30.2 (2011): 5-23. Print.
40. Huot, Brian. (Re)Articulating Writing Assessment for Teaching and Learning. Logan: Utah State UP, 2002. Print.
41. Inoue, Asao. "The Effectiveness of Grading Contracts on Different Racial Formations in Writing Classrooms. " Inoue and Poe 73-88.
42. Inoue, Asao, and Mya Poe. Race and Writing Assessment. New York: Peter Lang, 2012. Print.
43. Kane, Michael T. "Validating the Interpretation and Use of Test Scores. " Journal of Educational Measurement 50.1 (2013): 1-73. Print.
44. Kane, Michael T. "Validation. " Brennan 17-64.
45. Kaplin, William A., and Barbara A. Lee. The Law of Higher Education. 4th ed. Vol. 1. San Francisco: Jossey-Bass, 2006. Print.
46. Kelly-Riley, Diane. "Validity Inquiry of Race and Shared Evaluation Practices in a Large-Scale, University-wide Writing Portfolio Assessment. " Journal of Writing Assessment 4.1 (2011): n.p. Web. 23 Dec. 2013.
47. Kidder, William C., and Jay Rosner. "How the SAT Creates Built-in-Headwinds: An Educational and Legal Analysis of Disparate Impact. " Santa Clara Law Review 43.1 (2002): 131-211. Print.
48. Knoch, Ute, and Woranon Sitajalabhorn. "A Closer Look at Integrated Writing Tasks: Towards a More Focused Definition for Assessment Purposes. " Assessing Writing 18.4 (2013): 300-308. Print.
49. Lau v. Nichols. 414 US 563. Supreme Court of the US. 1974. Print.
50. Lynne, Patricia. Coming to Terms: Theorizing Writing Assessment in Composition Studies. Logan: Utah State UP, 2004. Print.
51. Mank, Bradford C. "Using 1983 to Enforce Title VI's Section 602 Regulations. " University of Kansas Law Review 49.2 (2000): 321-82. Print.
52. Mattern, Krista, Wayne Camara, and Jennifer L. Kobrin. "SAT Writing: An Overview of Research and Psychometrics to Date. " New York: College Board, 2007. Web. 23 Dec. 2013.
53. McNenny, Gerri, and Sallyanne H. Fitzgerald, eds. Mainstreaming Basic Writers: Politics and Pedagogies of Access. Mahwah: Erlbaum, 2001. Print.
54. National Center for Education Statistics. Projection of Education Statistics to 2018. 37th ed. National Center for Education Statistics, Institute of Education Sciences. Web. 23 Dec. 2013. New Jersey Statutes. Sec. 10:5.1-10:5.30. 2013. NJ Legislature. Web. 23 Dec. 2013.
55. New York City Transit Authority v. Beazer. 440 U.S. 568, 587 n.31. US Supreme Court, 1979. Print.
56. Norton, Helen. "The Supreme Court's Post-Racial Turn towards a Zero-Sum Understanding of Equality. " William and Mary Law Review 52.1 (2010): 197. Print.
57. Norton, Michael I., and Samuel R. Sommers. "Whites See Racism as a Zero-Sum Game That They are Now Losing. " Perspectives on Psychological Science 6.3 (2011): 215-18. Print.
58. O'Neill, Peggy, Linda Adler-Kassner, Cathy Fleischer, and Anne-Marie Hall. "Creating the Framework for Success in Postsecondary Writing. " In "Symposium: On the Framework for Success in Postsecondary Writing. " College English 74.6 (2012): 520-33. Print.
59. Otte, George, and Trudy Smoke, eds. Spec. issue of Journal of Basic Writing 19.1 (2000): 1-123. Print.
60. Peresie, Jennifer L. "Toward a Coherent Test for Disparate Impact Discrimination. " Indiana Law Journal 84.3 (2009): 773-802. Print.
61. Phillips, S. E., and Wayne J. Camara. "Legal and Ethical Issues. " Brennan 733-55. Plaut, Victoria C. "Law and the Zero-Sum Game of Discrimination: Commentary on Norton and Sommers (2011). " Perspectives on Psychological Science 6.3 (2011): 219-21. Print.
62. Pollock, Mica. "Keeping On Keeping On: OCR and Complaints of Racial Discrimination 50 Years after Brown. " Teachers College Record 107.9 (2005): 2106-40. Print.
63. Powe v. Miles. 407 F2d 73. US Court of Appeals for the Second Circuit. 1968. Print.
64. Rawls, John. A Theory of Justice. Cambridge: Harvard UP, 1971. Print.
65. Reynolds, Cecil R. "Methods for Detecting Construct and Predictive Bias. " Handbook of Methods for Detecting Bias. Ed. R. A. Berk. Baltimore: Johns Hopkins UP, 1985. 199-227. Print.
66. Ricci v. DeStephano. 129 SCt 2658. Supreme Court of the US. 2009. Print.
67. Rutgers University. "About Rutgers: We Are Diverse. " Rutgers U. 2013. Web. 23 Dec. 2013.
68. Ryan, James E. "Race Discrimination in Education: A Legal Perspective. " Teachers College Record 105.6 (2003): 1087-118. Print.
69. Scott, Tony, and Lil Brannon. "Democracy, Struggle, and the Praxis of Assessment. " College Composition and Communication 65.2 (2013): 273-98. Print.
70. Scott-Clayton, Judith. "Do High-Stakes Placement Exams Predict College Success?" Community College Research Center. Working Paper 41. Web. 23 Dec. 2013.
71. Selmi, Michael. "Was the Disparate Impact Theory a Mistake?" UCLA Law Review 53.3 (2006): 701-82. Print.
72. Shapiro, Shawna. "Stuck in the Remedial Rut: Confronting Resistance to ESL Curriculum Reform. " Journal of Basic Writing 30.2 (2011): 24-52. Print.
73. Shelley v. Kraemer. 334 US 1. Supreme Court of the US. 1948. Print.
74. Sheskin, David J. Handbook of Parametric and Nonparametric Statistical Procedures. Boca Raton: CRC P, 2003. 502-03. Print.
75. Sireci, Stephen, and Polly Parker. "Validity on Trial: Psychometric and Legal Conceptualization of Validity. " Educational Measurement: Issues and Practice 25.3 (2006): 27-34. Print.
76. Soliday, Mary. The Politics of Remediation: Institutional and Student Needs in Higher Education. Pittsburgh: U of Pittsburgh P, 2002. Print.
77. Stanford University. "Common Data Set, 2012-2013. " Stanford U, University Communications. 2013. Web. 23 Dec. 2013.
78. State v. O'Hagen. 189 NJ 140. Supreme Court of NJ. 2007. Print.
79. Sternglass, Marilyn. Time to Know Them: A Longitudinal Study of Writing and Learning at the College Level. Mahwah, NJ: Erlbaum, 1997. Print.
80. Student Right-to-Know and Campus Security Act. P.L. 101-542. 9 Nov. 1990. Print.
81. United States. Census Bureau. "Census Bureau Estimates Nearly Half of Children under Age 5 Are Minorities. " US Census Bureau. U.S. Dept. of Commerce. May 2009. Web. 23 Dec. 2013.
82. United States. Census Bureau. Dept. of Education. "Compliance Review Letter Metropolitan School District of Pike Township. " Office for Civil Rights. US Dept. of Education. Dec. 2012. Web. 23 Dec. 2013.
83. United States. Census Bureau. Dept. of Education. "Request for Information to Gather Technical Expertise Pertaining to Data Elements, Metrics, Data Collection, Weighting, Scoring, and Presentation of a Postsecondary Institution Rating System. " Federal Register 17 Dec. 2013: 76289-91. Print.
84. United States. Census Bureau. Dept. of Housing and Urban Development. "Implementation of the Fair Housing Act's Discriminatory Effects Standard. " US Dept. of Housing and Urban Development. Feb. 2013. Web. 23 Dec. 2013.
85. United States. Census Bureau. Dept. of Justice. "Guidance to Federal Financial Assistance Recipients Regarding Title VI Prohibition against National Origin Discrimination Affecting Limited English Proficient Persons. " US Dept. of Justice. June 2002. Web. 23 Dec. 2013.
86. United States. Census Bureau. Dept. of Justice. "Title VI Legal Manual. " US Dept. of Justice. Jan. 2001. Web. 23 Dec. 2013.
87. United States. Census Bureau. Equal Employment Opportunity Commission, et al. "Adoption of Questions and Answers To Clarify and Provide a Common Interpretation of the Uniform Guidelines on Employee Selection Procedures. " Federal Register 2 Mar. 1979: 11996-2009. Print.
88. 34 Code of Federal Regulations. Sec. 100.3(b)(2). 2012. US Govt. Printing Office. Web. 23 Dec. 2013.
89. 42 US Code. Sec. 1983. 2011. US Govt. Printing Office. Web. 23 Dec. 2013.
90. 42 US Code. Sec. 2000d. 2011. US Govt. Printing Office. Web. 23 Dec. 2013.
91. 42 US Code. Sec. 2000d-1. 2011. US Govt. Printing Office. Web. 23 Dec. 2013.
92. US Constitution. Amend. XIV, Sec. 1. Wards Cove Packing Co. v. Atonio, 490 US 642. Supreme Court of the US, 1989. Print.
93. Washington v. Davis. 426 US 229. Supreme Court of the US. 1976. Print.
94. Watson, Sidney D. "Reinvigorating Title VI: Defending Health Care Discrimination-It Shouldn't Be So Easy. " Fordham Law Review 58.5 (1990): 939-78. Print.
95. Wax, Amy. "Disparate Impact Realism. " William and Mary Law Review 53.2 (2011): 621-712. Print.
96. West-Faulcon, Kimberly. "The River Runs Dry: When Title VI Trumps State Anti-Affirmative Action Laws. " University of Pennsylvania Law Review 157.4 (2009): 1075-106. Print.
97. White, Edward, and Leon Thomas. "Racial Minorities and Writing Skills Assessment in the California State University and Colleges. " College English 43.3 (1981): 276-83. Print.
98. Williams, Robert F. The New Jersey State Constitution: A Reference Guide. New Brunswick: Rutgers University P, 1997. Print.
99. Wiseman, Cynthia S. "Rater Effects: Ego Engagement in Rater Decision-Making. " Assessing Writing 17.3 (2012): 150-73. Print.