Divide and correct: Using clusters to grade short answers at scale

L@S 2014 - Proceedings of the 1st ACM Conference on Learning at Scale

Volumn , Issue , 2014, Pages 89-98

  Brooks, Michael ^a,b   Basu, Sumit ^b   Jacobs, Charles ^b   Vanderwende, Lucy ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Assessment; Clustering; Clustering interfaces; Grading; Grading interfaces; MOOCs; User interfaces

Indexed keywords

GRADING; USER INTERFACES;

ASSESSMENT; CLUSTER-BASED; CLUSTERING; FEEDBACK TO STUDENTS; LARGE GROUPS; MOOCS; MULTIPLE CHOICE;

STUDENTS;

EID: 84899668403     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2556325.2566243     Document Type: Conference Paper

References (21)

1. Anderson, R. and Biddle, W. On asking people questions about what they are reading. Psychology of learning and motivation 9, (1975).
2. Basu, S., Jacobs, C., and Vanderwende, L. Powergrading: a Clustering Approach to Amplify Human Effort for Short Answer Grading. TACL 1, (2013), 391-402.
3. Bloom, B. The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Edu. Researcher 13, 6 (1984), 4-16.
4. Brookhart, S. Teachers' grading: Practice and theory. Applied Measurement in Edu., (1994).
5. Cross, L. and Frary, R. Hodgepodge grading: Endorsed by students and teachers alike. Applied Measurement in Edu., October 2013 (1999), 37-41.
6. Hearst, M. The debate on automated essay grading. Intelligent Systems and their Applications, (2000).
7. Heywood, J. Assessment in higher education: Student learning, teaching, programmes and institutions. 2000.
8. Jordan, S. and Mitchell, T. e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback. British Journal of Edu. Tech. 40, 2 (2009), 371-385.
9. Karpicke, J.D. and Roediger, H.L. The critical importance of retrieval for learning. Science 319, 5865 (2008), 966-8.
10. Markoff, J. Essay-Grading Software Offers Professors a Break. The New York Times, 2013.
11. McMillan, J. Secondary teachers' classroom assessment and grading practices. Edu. Measurement: Issues and Practice, (2001).
12. Mohler, M.A.G., Bunescu, R., and Mihalcea, R. Learning to Grade Short Answer Questions using Semantic Similarity Measures and Dependency Graph Alignments. Proc. ACL, (2011).
13. Mory, E. Feedback research revisited. In D.J. Mahwah, ed., Handbook of Research on Educational Communications and Technology. 2004, 745-784.
14. Perelman, L. Critique (Ver. 3.4) of Mark D. Shermis & Ben Hammer, "Contrasting State-of-the-Art Automated Scoring of Essays: Analysis.," 2013.
15. Piech, C., Huang, J., Chen, Z., Do, C., Ng, A., and Koller, D. Tuned Models of Peer Assessment in MOOCs. Proc. EDM, (2013).
16. Poulos, A. and Mahony, M.J. Effectiveness of feedback: the students' perspective. Assessment & Evaluation in Higher Edu. 33, 2 (2008), 143-154.
17. Reily, K., Finnerty, P.L., and Terveen, L. Two peers are better than one: aggregating peer reviews for computing assignments is surprisingly accurate. Proc. GROUP, ACM Press (2009), 115.
18. Sadler, P. and Good, E. The Impact of Self- and Peer-Grading on Student Learning. Edu. Assessment 11, 1 (2006), 1-31.
19. Scriven, M. The methodology of evaluation. In R.E. Stake, ed., AERSA Monograph Series on Curriculum Evaluation. Rand McNally, Chicago, 1967.
20. Thorpe, M. Assessment and 'third generation' distance education. Distance Edu. 19, 2 (1998), 265-286.
21. Weld, D., Adar, E., and Chilton, L. Personalized Online Education-A Crowdsourcing Challenge. Proc. AAAI, workshop on Human Computation, (2012), 159-163.