PeerStudio: Rapid peer feedback emphasizes revision and improves performance

L@S 2015 - 2nd ACM Conference on Learning at Scale

Volumn , Issue , 2015, Pages 75-84

  Kulkarni, Chinmay ^a   Bernstein, Michael S ^a   Klemmer, Scott ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Deliberate practice; Mastery learning; MOOC; Peer assessment; Peer learning

Indexed keywords

STUDENTS; TEACHING;

DELIBERATE PRACTICES; MASTERY LEARNING; MOOC; PEER ASSESSMENT; PEER LEARNING;

FEEDBACK;

EID: 84928009406     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2724660.2724670     Document Type: Conference Paper

References (29)

1. Anderson, S. and Rodin, J. Is Bad News Always Bad?: Cue and Feedback Effects on Intrinsic Motivation. Journal of Applied Social Psychology 19, 6 (1989), 449-467.
2. Andrade, H.G. The Effects of Instructional Rubrics on Learning to Write. Current Issues in Education 4, 4 (2001).
3. Andrade, H.G. Teaching with rubrics: The good, the bad, and the ugly. College Teaching 53, 1 (2005), 27-31.
4. André, P., Bernstein, M., and Luther, K. Who gives a tweet? Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work-CSCW '12, ACM Press (2012), 471.
5. Balcazar, F.E., Hopkins, B.L., and Suarez, Y. A critical, objective review of performance feedback. Journal of Organizational Behavior Management 7, 2 (1986).
6. Brooks, M., Basu, S., Jacobs, C., and Vanderwende, L. Divide and Correct: Using Clusters to Grade Short Answers at Scale. Learning at Scale, (2014).
7. Buxton, B. Sketching user experiences: getting the design right and the right design. Morgan Kaufmann, 2007.
8. Carlson, P.A. and Berry, F.C. Calibrated Peer Review and assessing learning outcomes. Frontiers in Education Conference, (2003).
9. Dawes, R.M. The robust beauty of improper linear models in decision making. American psychologist 34, 7 (1979), 571.
10. Dow, S., Fortuna, J., Schwartz, D., Altringer, B., and Klemmer, S. Prototyping dynamics: sharing multiple designs improves exploration, group rapport, and results. Proceedings of the 2011 annual Conference on Human factors in computing systems, (2011), 2807-2816.
11. Dow, S.P., Heddleston, K., and Klemmer, S.R. The efficacy of prototyping under time constraints. Proceeding of the ACM Conference on Creativity and cognition, ACM Press (2009), 165.
12. Ericsson, K.A., Krampe, R.T., and Tesch-Römer, C. The role of deliberate practice in the acquisition of expert performance. Psychological review 100, 3 (1993).
13. Falchikov, N. and Goldfinch, J. Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of educational research 70, 3 (2000), 287-322.
14. Fast, E., Lee, C., Aiken, A., Bernstein, M.S., Koller, D., and Smith, E. Crowd-scale interactive formal reasoning and analytics. Proceedings of the 26th annual ACM symposium on User interface software and technology, (2013).
15. Gray, W.D. and Boehm-Davis, D.A. Milliseconds matter: an introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of experimental psychology. Applied 6, 4 (2000), 322-35.
16. Guskey, T.R. Closing Achievement Gaps: Revisiting Benjamin S. Bloom's "Learning for Mastery." Journal of Advanced Academics 19, 1 (2007), 8-31.
17. Hattie, J. and Timperley, H. The Power of Feedback. Review of Educational Research 77, 1 (2007), 81-112.
18. Heffernan, N., Heffernan, C., Dietz, K., Soffer, D., Pellegrino, J. W. Goldman, S.R., and Dailey, M. Improving Mathematical Learning Outcomes Through Automatic Reassessment and Relearning. AERA, (2012).
19. Kim, S.-M., Pantel, P., Chklovski, T., and Pennacchiotti, M. Automatically assessing review helpfulness. Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics (2006), 423-430.
20. Kittur, A., Chi, E.H., and Suh, B. Crowdsourcing user studies with Mechanical Turk. Proc. of CHI, ACM Press (2008), 453.
21. Kluger, A.N. and DeNisi, A. The effects of feedback interventions on performance: A historical review, a metaanalysis, and a preliminary feedback intervention theory. Psychological Bulletin 119, 2 (1996), 254-284.
22. Krosnick, J.A. Survey research. Annual review of psychology 50, 1 (1999), 537-567.
23. Kulik, J.A. and Kulik, C.-L.C. Timing of Feedback and Verbal Learning. Review of Educational Research 58, 1 (1987), 79-97.
24. Kulkarni, C., Socher, R., Bernstein, M.S., and Klemmer, S.R. Scaling Short-answer Grading by Combining Peer Assessment with Algorithmic Scoring. ACM Conf on Learning@Scale, (2014).
25. Kulkarni, C., Wei, K.P., Le, H., Chia, D., Papadopoulos, K., Cheng, J., Koller, D., and Klemmer, S.R. Peer and self assessment in massive online classes. ACM Transactions on Computer-Human Interaction (TOCHI) 20, 6 (2013), 33.
26. Latham, G.P. and Locke, E.A. Self-regulation through goal setting. Organizational Behavior and Human Decision Processes 50, 2 (1991), 212-247.
27. Marsh, R.L., Landau, J.D., and Hicks, J.L. How examples may (and may not) constrain creativity. Memory & cognition 24, 5 (1996), 669-80.
28. Sommers, N. Responding to Student Writing. College Composition and Communication 33, 2 (1982), 148-156.
29. Tinapple, D., Olson, L., and Sadauskas, J. CritViz: Web-Based Software Supporting Peer Critique in Large Creative Classrooms. Bulletin of the IEEE Technical Committee on Learning Technology 15, 1 (2013), 29.