Factors associated with students’ attitude change in online peer assessment–a mixed methods study in a graduate-level course

Assessment and Evaluation in Higher Education

Volumn 45, Issue 5, 2020, Pages 714-727

  Wang, Jiandong ^a   Gao, Ruiqin ^a   Guo, Xiuyan ^b   Liu, Jin ^a  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b EMORY AND HENRY COLLEGE   (United States)

Author keywords

graduate students; mixed methods; Online peer assessment; students attitude change

Indexed keywords

EID: 85075461572     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2019.1693493     Document Type: Article

References (60)

1. Andrade, H., and Y., Du. 2007. “Student Responses to Criteria‐Referenced Self‐Assessment.” Assessment & Evaluation in Higher Education 32(2): 159–181. doi:10.1080/02602930600801928.
2. Azarnoosh, M., 2013. “Peer Assessment in an EFL Context: Attitudes and Friendship Bias.” Language Testing in Asia 3(1): 11. https://doi.org/10.1186/2229-0443-3-11 doi:10.1186/2229-0443-3-11.
3. Bangert-Drowns, R. L., C. L. C., Kulik, J. A., Kulik, and M., Morgan. 1991. “The Instructional Effect of Feedback in Test-like Events.” Review of Educational Research 61(2): 213–238. doi:10.3102/00346543061002213.
4. Barrett, E., and V., Lally. 1999. “Gender Differences in an on‐Line Learning Environment.” Journal of Computer Assisted Learning 15(1): 48–60. doi:10.1046/j.1365-2729.1999.151075.x.
5. Bolliger, D. U., and C., Halupa. 2012. “Student Perceptions of Satisfaction and Anxiety in an Online Doctoral Program.” Distance Education 33(1): 81–98. doi:10.1080/01587919.2012.667961.
6. Bolzer, M., J. W., Strijbos, and F., Fischer. 2015. “Inferring Mindful Cognitive‐Processing of Peer‐Feedback via Eye‐Tracking: Role of Feedback‐Characteristics, Fixation‐Durations and Transitions.” Journal of Computer Assisted Learning 31(5): 422–434. doi:10.1111/jcal.12091.
7. Bouchoucha, S., and H., Wozniak. 2010. “Is Peer Assessment of Asynchronous Group Discussions Fostering Skills Relevant to Our Future Graduates?” Curriculum, Technology & Transformation for an Unknown Future Proceedings Ascilite Sydney 113–118.
8. Brindley, C., and S., Scoffield. 1998. “Peer Assessment in Undergraduate Programmes.” Teaching in Higher Education 3(1): 79–90. doi:10.1080/1356215980030106.
9. Chen, C. H., 2010. “The Implementation and Evaluation of a Mobile Self-and Peer-Assessment System.” Computers & Education 55(1): 229–236. doi:10.1016/j.compedu.2010.01.008.
10. Cheng, K. H., and H. T., Hou. 2015. “Exploring Students’ Behavioural Patterns during Online Peer Assessment from the Affective, Cognitive, and Metacognitive Perspectives: A Progressive Sequential Analysis.” Technology, Pedagogy and Education 24(2): 171–188. doi:10.1080/1475939X.2013.822416.
11. Cheng, W., and M., Warren. 1997. “Having Second Thoughts: Student Perceptions before and after a Peer Assessment Exercise.” Studies in Higher Education 22(2): 233–239. doi:10.1080/03075079712331381064.
12. Chinn, D., 2005., “Peer Assessment in the Algorithms Course.” Acm Sigcse Bulletin 37(3): 69–73. ACM. doi:10.1145/1151954.1067468.
13. Cho, K., C. D., Schunn, and R. W., Wilson. 2006. “Validity and Reliability of Scaffolded Peer Assessment of Writing from Instructor and Student Perspectives.” Journal of Educational Psychology 98(4): 891. doi:10.1037/0022-0663.98.4.891.
14. Clifford, V. A., 1999. “The Development of Autonomous Learners in a University Setting.” Higher Education Research & Development 18(1): 115–128. doi:10.1080/0729436990180109.
15. Collimore, L. M., D. E., Paré, and S., Joordens. 2015. “SWDYT: So What Do You Think? Canadian Students’ Attitudes about peerScholar, an Online Peer-Assessment Tool.” Learning Environments Research 18(1): 33–45. doi:10.1007/s10984-014-9170-1.
16. Creswell, J. W., and J. D., Creswell. 2017. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Thousand Oaks, CA: Sage.
17. Davies, P., 2000. “Computerized Peer Assessment.” Innovations in Education and Training International 37(4): 346–355. doi:10.1080/135580000750052955.
18. Demir, M., 2018. “Using Online Peer Assessment in an Instructional Technology and Material Design Course through Social Media.” Higher Education 75(3): 399–414. doi:10.1007/s10734-017-0146-9.
19. DiGiovanni, E., and G., Nagaswami. 2001. “Online Peer Review: An Alternative to Face-to Face?.” ELT Journal 55(3): 263–272. doi:10.1093/elt/55.3.263.
20. Doherty, K.M., 2002. May 9). Students Speak Out. Education Week. Retrieved December 12, 2002, from http://www.edweek.org/sreports/tc02
21. Dominguez, C., G., Cruz, A., Maia, D., Pedrosa, and G., Grams. 2012. Online peer assessment: An exploratory case study in a higher education civil engineering course. In 2012 15th International Conference on Interactive Collaborative Learning (ICL) 1–8. IEEE.
22. Falchikov, N., and J., Goldfinch. 2000. “Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks.” Review of Educational Research 70(3): 287–232. doi:10.3102/00346543070003287.
23. Gagne, R., L., Briggs, and W., Wagner. 1992. Principles of Instructional Design. Belmont, CA: Wadsworth/Thomson Learning.
24. Greer, F. W., B. S., Wilson, C., DiStefano, and J., Liu. 2012. “Considering Social Validity in the Context of Emotional and Behavioral Screening.” School Psychology Forum 6(4): 148–159. doi:10.1037/e601712013-001.
25. Guo, X., 2017. “Effect of Quality Characteristics of Peer Rater on the Reliability and Validity of Peer Assessment” Doctoral diss. The Pennsylvania State University.
26. Hawkins, J. E., 2018. “The Practical Utility Suitability of Email Interviews in Qualitative Research.” The Qualitative Report 23(2): 493–501.
27. Kamradt, T. F., and E. J., Kamradt. 1999. “Structured Design for Attitudinal Instruction.” Instructional-Design Theories and Models: A New Paradigm of Instructional Theory 2: 563–590.
28. Kaufman, J. H., and C. D., Schunn. 2011. “Students’ Perceptions about Peer Assessment for Writing: Their Origin and Impact on Revision Work.” Instructional Science 39(3): 387–406. doi:10.1007/s11251-010-9133-6.
29. Kwok, R. C. W., and J., Ma. 1999. “Use of a Group Support System for Collaborative Assessment.” Computers & Education 32(2): 109–125. doi:10.1016/S0360-1315(98)00059-1.
30. Lee, H., 2008. “Students’ perceptions of peer and self assessment in a higher education online collaborative learning environment.” Unpublished Ph.D. diss., Graduate School of the University of Texas at Austin, Austin.
31. Levine, R. E., P. A., Kelly, T., Karakoc, and P., Haidet. 2007. “Peer Evaluation in a Clinical Clerkship: Students’ Attitudes, Experiences, and Correlations with Traditional Assessments.” Academic Psychiatry 31(1): 19–24. doi:10.1176/appi.ap.31.1.19.
32. Li, H., Y., Xiong, C. V., Hunter, X., Guo, and R., Tywoniw. 2019. “Does Peer Assessment Promote Student Learning? a Meta-Analysis.” Assessment & Evaluation in Higher Education 1–19. doi:10.1080/02602938.2019.1620679.
33. Lin, S. S., E. Z. F., Liu, and S. M., Yuan. 2001. “Web‐Based Peer Assessment: Feedback for Students with Various Thinking‐Styles.” Journal of Computer Assisted Learning 17(4): 420–432. doi:10.1046/j.0266-4909.2001.00198.x.
34. Liu, E. Z. F., and C. Y., Lee. 2013. “Using Peer Feedback to Improve Learning via Online Peer Assessment.” Turkish Online Journal of Educational Technology-TOJET 12(1): 187–199.
35. Liu, E. Z. F., S. S. J., Lin, C. H., Chiu, and S. M., Yuan. 2001. “Web-Based Peer Review: The Learner as Both Adapter and Reviewer.” IEEE Transactions on Education 44(3): 246–251. doi:10.1109/13.940995.
36. Liu, X., L., Li, and Z., Zhang. 2018. “Small Group Discussion as a Key Component in Online Assessment Training for Enhanced Student Learning in Web-Based Peer Assessment.” Assessment & Evaluation in Higher Education 43(2): 207–222. doi:10.1080/02602938.2017.1324018.
37. Liu, C. C., and C. M., Tsai. 2005. “Peer Assessment through Web‐Based Knowledge Acquisition: Tools to Support Conceptual Awareness.” Innovations in Education and Teaching International 42(1): 43–59. doi:10.1080/14703290500048838.
38. McGarr, O., and A. M., Clifford. 2013. “Just Enough to Make You Take It Seriously’: Exploring Students’ Attitudes towards Peer Assessment.” Higher Education 65(6): 677–693. doi:10.1007/s10734-012-9570-z.
39. Nicol, D., and C., Milligan. 2006. “Rethinking Technology-Supported Assessment Practices in Relation to the Seven Principles of Good Feedback Practice.” Innovative Assessment in Higher Education 64–77.
40. Panadero, E., A., Jonsson, and M., Alqassab. 2018. “Providing Formative Peer Feedback: What Do we Know?.” In The Cambridge Handbook of Instructional Feedback, edited by A. A., Lipnevich, & J. K., Smith. Cambridge: Cambridge University Press.
41. Patchan, M. M., C. D., Schunn, and R. J., Clark. 2018. “Accountability in Peer Assessment: examining the Effects of Reviewing Grades on Peer Ratings and Peer Feedback.” Studies in Higher Education 43(12): 2263–2278. doi:10.1080/03075079.2017.1320374.
42. Paré, D. E., and S., Joordens. 2008. “Peering into Large Lectures: Examining Peer and Expert Mark Agreement Using peerScholar, an Online Peer-Assessment Tool.” Journal of Computer Assisted Learning 24: 526–540. doi:10.1111/j.1365-2729.2008.00290.x.
43. Petty, R. E., S. C., Wheeler, and Z. L., Tormala. 2003. “Persuasion and Attitude Change.” In Handbook of Psychology: Personality and Social Psychology. edited by T., Millon & M., Lerner, 353–382. Hoboken, NJ: Wiley.
44. Regression with Stata Chapter 2–Regression Diagnostics. (n.d.). Retrieved from https://stats.idre.ucla.edu/stata/webbooks/reg/chapter2/stata-webbooksregressionwith-statachapter-2-regression-diagnostics/.
45. Rosa, S. S., C. P., Coutinho, and M. A., Flores. 2016. “Online Peer Assessment: Method and Digital Technologies.” Procedia-Social and Behavioral Sciences 228: 418–423. doi:10.1016/j.sbspro.2016.07.064.
46. Sluijsmans, D. M., S., Brand-Gruwel, and J. J., van Merriënboer. 2002. “Peer Assessment Training in Teacher Education: Effects on Performance and Perceptions.” Assessment & Evaluation in Higher Education 27(5): 443–454. doi:10.1080/0260293022000009311.
47. Smith, H., A., Cooper, and L., Lancaster. 2002. “Improving the Quality of Undergraduate Peer Assessment: A Case for Student and Staff Development.” Innovations in Education and Teaching International 39(1): 71–81. doi:10.1080/13558000110102904.
48. Sung, Y. T., K. E., Chang, S. K., Chiou, and H. T., Hou. 2005. “The Design and Application of a Web-Based Self-and Peer-Assessment System.” Computers & Education 45(2): 187–202. doi:10.1016/j.compedu.2004.07.002.
49. Tabs, E. D., T., Waits, and L., Lewis. 2003. Distance Education at Degree-Granting Postsecondary Institutions: 2000-2001. Washington, DC: US Department of Education.
50. Topping, K., 1998. “Peer Assessment between Students in Colleges and Universities.” Review of Educational Research 68(3): 249–276. doi:10.3102/00346543068003249.
51. Topping, K. J., 2009. “Peer Assessment.” Theory into Practice 48(1): 20–27. doi:10.1080/00405840802577569.
52. Topping, K. J., 2010. “Methodological Quandaries in Studying Process and Outcomes in Peer Assessment.” Learning and Instruction 20(4): 339–343. doi:10.1016/j.learninstruc.2009.08.003.
53. U.S. Department of Education, National Center for Education Statistics. 2018. Digest of Education Statistics 2016 (NCES 2017-094), Table 311.15.
54. Van Lehn, K. A., M. T. H., Chi, W., Baggett, and R. C., Murray. 1995. Progress Report: Towards a Theory of Learning during Tutoring. Pittsburgh, PA: Learning Research and Development Center, University of Pittsburgh.
55. Van Zundert, M., D., Sluijsmans, and J., Van Merriënboer. 2010. “Effective Peer Assessment Processes: Research Findings and Future Directions.” Learning and Instruction 20(4): 270–279. doi:10.1016/j.learninstruc.2009.08.004.
56. Wen, M. L., and C. C., Tsai. 2006. “University Students’ Perceptions of and Attitudes toward (Online) Peer Assessment.” Higher Education 51(1): 27–44. doi:10.1007/s10734-004-6375-8.
57. Wen, M. L., and C. C., Tsai. 2008. “Online Peer Assessment in an Inservice Science and Mathematics Teacher Education Course.” Teaching in Higher Education 13(1): 55–67. doi:10.1080/13562510701794050.
58. Yang, C., and Y. S., Chang. 2012. “Assessing the Effects of Interactive Blogging on Student Attitudes towards Peer Interaction, Learning Motivation, and Academic Achievements.” Journal of Computer Assisted Learning 28(2): 126–135. doi:10.1111/j.1365-2729.2011.00423.x.
59. Zhang, B., and M. W., Ohland. 2009. “How to Assign Individualized Scores on a Group Project: An Empirical Evaluation.” Applied Measurement in Education 22(3): 290–308. doi:10.1080/08957340902984075.
60. Zou, Y., C. D., Schunn, Y., Wang, and F., Zhang. 2018. “Student Attitudes That Predict Participation in Peer Assessment.” Assessment & Evaluation in Higher Education 43(5): 800–811. doi:10.1080/02602938.2017.1409872.