Mechanical TA: Partially automated high-stakes peer grading

SIGCSE 2015 - Proceedings of the 46th ACM Technical Symposium on Computer Science Education

Volumn , Issue , 2015, Pages 96-101

  Wright, James R ^a   Thornton, Chris ^a   Leyton Brown, Kevin ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Calibration; Computer science education; Peer grading; Peer review; Scalability

Indexed keywords

CALIBRATION; CURRICULA; EDUCATION COMPUTING; GRADING; SCALABILITY; USER EXPERIENCE;

COMPUTER SCIENCE EDUCATION; COURSE DESIGN; PEER REVIEW; PEER REVIEW SYSTEM; PEER-REVIEW PROCESS; REVIEW QUALITY; STUDENT LEARNING; TEACHING ASSISTANTS;

STUDENTS;

EID: 84942436980     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2676723.2677278     Document Type: Conference Paper

References (13)

1. O. L. Chapman. Calibrated Peer Review™, 2001.
2. K. Cho and C. D. Schunn. Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system. Computers & Education, 48(3):409-426, 2007.
3. L. de Alfaro and M. Shavlovsky. CrowdGrader: A tool for crowdsourcing the evaluation of homework assignments. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education, SIGCSE '14, pages 415-420, New York, NY, USA, 2014. ACM.
4. E. F. Gehringer. Electronic peer review and peer grading in computer-science courses. ACM SIGCSE Bulletin, 33(1):139-143, 2001.
5. J. Hamer, K. T. K. Ma, and H. H. F. Kwong. A method of automatic grade calibration in peer assessment. In Proceedings of the 7th Australasian Conference on Computing Education-Volume 42, ACE '05, pages 67-72, Darlinghurst, Australia, Australia, 2005. Australian Computer Society, Inc.
6. C. E. Kulkarni, R. Socher, M. S. Bernstein, and S. R. Klemmer. Scaling short-answer grading by combining peer assessment with algorithmic scoring. In Proceedings of the First ACM Conference on Learning @ Scale Conference, L@S '14, pages 99-108, New York, NY, USA, 2014. ACM.
7. R. A. Mulder and J. M. Pearce. PRAZE: Innovating teaching through online peer review. In ICT: Providing choices for learners and learning. Proceedings ascilite Singapore, 2007.
8. D. E. Paré and S. Joordens. Peering into large lectures: examining peer and expert mark agreement using peerScholar, an online peer assessment tool. Journal of Computer Assisted Learning, 24(6):526-540, 2008.
9. J. G. Politz, D. Patterson, S. Krishnamurthi, and K. Fisler. CaptainTeach: Multi-stage, in-ow peer review for programming assignments. In ACM SIGCSE Conference on Innovation and Technology in Computer Science Education, 2014.
10. C. P. Robert and G. Casella. Monte Carlo statistical methods. Springer Verlag, 2004.
11. R. Robinson. Calibrated Peer Review™ an application to increase student reading & writing skills. The American Biology Teacher, 63(7):pp. 474-476+478-480, 2001.
12. R. Seabrook, G. D. Brown, and J. Solity. Distributed and massed practice: from laboratory to classroom. Applied Cognitive Psychology, 19(1):107-122, 2005.
13. M. E. Walvoord, M. H. Hoefnagels, D. D. Gaffin, M. M. Chumchal, and D. A. Long. An analysis of Calibrated Peer Review (CPR) in a science lecture classroom. Journal of College Science Teaching, 37(4):66, 2008.