Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment

Assessment and Evaluation in Higher Education

Volumn 39, Issue 3, 2014, Pages 275-292

  Liu, Xiongyi ^a   Li, Lan ^b  

^a CLEVELAND STATE UNIVERSITY   (United States)

^b BOWLING GREEN STATE UNIVERSITY   (United States)

Author keywords

assessment training; peer assessment; training effects

Indexed keywords

EID: 84894230459     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2013.823540     Document Type: Article

References (52)

1. Bellofatto, L., N. Bohl, M. Casey, M. Krill, and B. Dodge. 2001. "A Rubric for Evaluating WebQuest." Accessed June 19. http://webquest.sdsu.edu/webquestrubric.html
2. Bostock, S. (2000). "Student Peer Assessment, Learning Technology." http://www.keele.ac.uk/depts/aa/landt/lt/docs/bostock_peer_assessment.htm.
3. Chang, C., K. Tseng, P. Chou, and Y. Chen. 2011. "Reliability and Validity of Web-Based Portfolio Peer Assessment: A Case Study for a Senior High school's Students Taking Computer Course." Computers & Education 57(1): 1306-1316.
4. Cheng, W., and M. Warren. 1997. "Having Second Thoughts: Student Perceptions Before and After a Peer Assessment Exercise." Studies in Higher Education 22(2): 233-238.
5. Cheng, W., and M. Warren. 1999. "Peer and Teacher Assessment of the Oral and Written Tasks of a Group Project." Assessment & Evaluation in Higher Education 24(3): 301-314.
6. Cho, K., and C. MacArthur. 2010. "Student Revision With Peer and Expert Reviewing." Learning and Instruction 20: 328-338.
7. Cho, K., C. D. Schunn, and R. Wilson. 2006. "Validity and Reliability of Scaffolded Peer Assessment of Writing from Instructor and Student Perspectives." Journal of Educational Psychology 98(4): 891-901.
8. Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates.
9. Dancer, W. T., and J. Dancer. 1992. "Peer Rating in Higher Education." Journal of Education for Business 67: 306-309.
10. Davies, P. 2009. "Review and Reward Within the Computerised Peer-Assessment of Essays." Assessment & Evaluation in Higher Education 34(3): 321-333.
11. Dochy, F., M. Segers, and D. M. A. Sluijsmans. 1999. "The Use of Self-, Peer-, and Co-Assessment in Higher Education: A Review." Studies in Higher Education 24(3): 331-350.
12. Dodge, B. 1995. "WebQuests: A Technique for Internet-Based Learning." Distance Educator 1(2): 10-13.
13. Earl, S. E. 1986. "Staff and Peer Assessment - Measuring an Individual's Contribution to Group Performance." Assessment & Evaluation in Higher Education 11(1): 60-69.
14. Falchikov, N. 1986. "Product Comparisons and Process Benefits of Collaborative Peer Group and Self Assessments." Assessment & Evaluation in Higher Education 11: 146-166.
15. Falchikov, N. 1995. "Peer Feedback Marking: Developing Peer Assessment." Innovations in Education and Training International 32(2): 175-187.
16. *Power 3: A Flexible Statistical Power Analysis for the Social, Behavioral, and Biomedical Sciences." Behavior Research Methods 39(2): 175-191.
17. Freeman, M. 1995. "Peer Assessment by Groups of Group Work." Assessment & Evaluation in Higher Education 20(3): 289-300.
18. Goldfinch, J., and R. Raeside. 1990. "Development of a Peer Assessment Technique for Obtaining Individual Marks on a Group Project." Assessment & Evaluation in Higher Education 15(3): 210-231.
19. Gratz, R. K. 1990. "Improving Lab Report Quality by Model Analysis, Peer Review, and Revision." Journal of College Science Teaching 19(5): 292-295.
20. Hiltz, S. R., and B. Wellman. 1997. "Asynchronous Learning Networks as a Virtual Classroom." Communications of the ACM 40(2): 44-49.
21. Hughes, I., and B. Large. 1993. "Staff and Peer-Group Assessment of Oral Communication Skills." Studies in Higher Education 18(3): 379-385.
22. Kwan, K. P., and R. Leung. 1996. "Tutor versus Peer Group Assessment of Student Performance in a Simulation Training Exercise." Assessment & Evaluation in Higher Education 21(3): 205-214.
23. Li, L., and A. L. Steckelberg. 2005. "Impact of Technology-Mediated Peer Assessment on Student Project Quality." Paper presented at the Annual Meeting of the Association for Educational Communications and Technology, Orlando, FL, October.
24. Li, L., X. Liu, and A. L. Steckelberg. 2010. "Assessor or Assessee: How Student Learning Improves by Giving and Receiving Peer Feedback." British Journal of Educational Technology 41(3): 523-536. doi:10.1111/j.1467-8535.2009.00968.x.
25. Li, L., X. Liu, and Y. Zhou. 2012. "Give and Take: A Re-Analysis of Assessor and Assessee's Roles in Technology-Facilitated Peer Assessment." British Journal of Educational Technology 43(3): 376-384. doi:10.1111/j.1467-8535.2011.01180.x.
26. Li, L., A. Steckelberg, X. Liu, J. Cain, T. Starker, and S. Kotcherlakota. 2005. "Comparing Peer Assessment With Instructor Assessment in a Technology-Mediated Peer Reviewing System." In Proceedings of Society for Information Technology & Teacher Education International Conference 2005, edited by C. Crawford, R. Carlsen, I. Gibson, K. McFerrin, J. Price, R. Weber and D. A. Willis, 946-951. Chesapeake, VA: AACE.
27. Li, L., A. L. Steckelberg, and S. Srinivasan. 2008. "Utilizing Peer Interactions to Promote Learning Through a Computer-Assisted Peer Assessment System." Canadian Journal of Learning and Technology 34(2): 133-148.
28. Liu, E. Z. F., S. S. J. Lin, and S. M. Yuan. 2002. "Alternatives to Instructor Assessment: A Case Study of Comparing Self and Peer Assessment with Instructor Assessment under a Networked Innovative Assessment Procedures." International Journal of Instructional Media 29(4): 395-404.
29. March, T. 2011. "Criteria for Assessing Best WebQuests." Accessed June 13. http://bestwebquests.com/bwq/matrix.asp
30. Martin, B. 1999. "WebQuest Evaluation Rubric." Accessed August 28. http://drwilliampmartin.tripod.com/s_WebQuest_Rubric1.html
31. Marty, M. C. 2010. "Outcomes of a Peer Assessment/Feedback Training Program in an Undergraduate Sports Medicine Course." PhD diss., The University of North Carolina at Greensboro (UNCG) Library. http://libres.uncg.edu/ir/uncg/listing.aspx?id=3645
32. Mehrens, W. A., W. J. Popham, and J. M. Ryan. 1998. "How to Prepare Students for Performance Assessments." Educational Measurement: Issues and Practice 17(1): 18-22.
33. Orsmond, P., and S. Merry. 1996. "The Importance of Marking Criteria in the Use of Peer Assessment." Assessment & Evaluation in Higher Education 21(3): 239-250.
34. Orsmond, P., S. Merry, and K. Reiling. 2002. "The Use of Exemplars and Formative Feedback When Using Student Derived Marking Criteria in Peer and Self-Assessment." Assessment & Evaluation in Higher Education 27(4): 309-323.
35. Patri, M. 2002. "The Influence of Peer Feedback on Self- and Peer-Assessment of Oral Skills." Language Testing 19(2): 109-131.
36. Plutsky, S., and B. A. Wilson. 2004. "Comparison of the Three Methods for Teaching and Evaluating Writing: A Quasi-Experimental Study." The Delta Pi Epsilon Journal 46(1): 50-61.
37. Pope, N. 2001. "An Examination of the Use of Peer Rating for Formative Assessment in the Context of the Theory of Consumption Values." Assessment & Evaluation in Higher Education 26(3): 235-246.
38. Saito, H. 2008. "EFL Classroom Peer Assessment: Training Effects on Rating and Commenting." Language Testing 25(4): 553-581.
39. Saito, H., and T. Fujita. 2004. "Characteristics and User Acceptance of Peer Rating in EFL Writing Classrooms." Language Teaching Research 8(1): 31-54.
40. Sluijsmans, D. M. A., S. Brand-Gruwel, and J. J. G. van Merriënboer. 2002. "Peer Assessment Training in Teacher Education: Effects on Performance and Perceptions." Assessment & Evaluation in Higher Education 27(5): 443-454.
41. Somervell, H. 1993. "Issues in Assessment, Enterprise and Higher Education: The Case for Self-, Peer and Collaborative Assessment." Assessment & Evaluation in Higher Education 18: 221-233.
42. Stefani, L. A. J. 1994. "Peer, Self and Tutor Assessment: Relative Reliabilities." Studies in Higher Education 19(1): 69-75.
43. Sung, Y., K. Chang, S. Chiou, and H. Hou. 2005. "The Design and Application of a Web-Based Self- and Peer-Assessment System." Computers & Education 45(2): 187-202.
44. Sung, Y., C.-S. Lin, C.-L. Lee, and K.-E. Chang. 2003. "Evaluating Proposals for Experiments: An Application of Web-Based Self-Assessment and Peer Assessment." Teaching of Psychology 30(4): 331-333.
45. Svinicki, M. D. 2001. "Encouraging Your Students to Give Feedback." New Directions in Teaching and Learning 87: 12-24.
46. Topping, K. 1998. "Peer Assessment between Students in Colleges and Universities." Review of Educational Research 68(3): 249-276.
47. Topping, K. 2003. "Self and Peer Assessment in School and University: Reliability, Validity and Utility." In Optimizing New Modes of Assessment: In Search of Qualities and Standards, edited by M. Segers, F. Dochy and E. Cascallar, 55-87. Dordrecht: Kluwer Academic.
48. Topping, K. J., E. F. Smith, I. Swanson, and A. Elliot. 2000. "Formative Peer Assessment of Academic Writing Between Postgraduate Students." Assessment & Evaluation in Higher Education 25(2): 149-169.
49. Torrance, H. 2007. "Assessment as Learning? How the Use of Explicit Learning Objectives, Assessment Criteria and Feedback in Post-Secondary Education and Training Can Come to Dominate Learning." Assessment in Education 14(3): 281-294.
50. Venables, A., and R. Summit. 2003. "Enhancing Scientific Essay Writing Using Peer Assessment." Innovations in Education & Teaching International 40(3): 281-290.
51. Vickerman, P. 2009. "Student Perspectives on Formative Peer Assessment: An Attempt to Deepen Learning?" Assessment & Evaluation in Higher Education 34(2): 221-230.
52. Wen, M. L., and C. Tsai. 2008. "Online Peer Assessment in an Inservice Science and Mathematics Teacher Education Course." Teaching in Higher Education 13(1): 55-67.