Developing student competence through peer assessment: the role of feedback, self-regulation and evaluative judgement

Higher Education

Volumn 80, Issue 1, 2020, Pages 137-156

  Ibarra Sáiz, María Soledad ^a   Rodríguez Gómez, Gregorio ^a   Boud, David ^b  

^a UNIVERSITY OF CÁDIZ   (Spain)

^b DEAKIN UNIVERSITY   (Australia)

Author keywords

Evaluative judgement; Feedback; Importance performance map analysis; Peer assessment; Self regulation; Structural equation modelling

Indexed keywords

EID: 85078585401     PISSN: 00181560     EISSN: 1573174X     Source Type: Journal    
DOI: 10.1007/s10734-019-00469-2     Document Type: Article

References (78)

1. Adachi, C., Tai, J., & Dawson, P. (2018). A framework for designing, implementing, communicating and researching peer assessment. Higher Education Research and Development, 37(3), 453–467. 10.1080/07294360.2017.1405913. DOI: 10.1080/07294360.2017.1405913
2. Ajjawi, R., & Boud, D. (2017). Researching feedback dialogue: an interactional analysis approach. Assessment & Evaluation in Higher Education, 42(2), 252–265. 10.1080/02602938.2015.1102863. DOI: 10.1080/02602938.2015.1102863
3. Ajjawi, R., & Boud, D. (2018). Examining the nature and effects of feedback dialogue. Assessment & Evaluation in Higher Education, 43(7), 1106–1119. 10.1080/02602938.2018.1434128. DOI: 10.1080/02602938.2018.1434128
4. Bearman, M., Dawson, P., Bennett, S., Hall, M., Molloy, E., Boud, D., & Joughin, G. (2017). How university teachers design assessments: a cross-disciplinary study. Higher Education, 74(1), 49–64. 10.1007/s10734-016-0027-7. DOI: 10.1007/s10734-016-0027-7
5. Boud, D. (2014). Shifting views of assessment: from secret teachers’ business to sustaining learning. In C. Kreber, C. Anderson, N. Entwistle, & J. McArthut (Eds.), Advances and inovations in university assessment and feedback (pp. 13–31). Edinburgh: Edinburgh University Press Ltd. 10.3366/edinburgh/9780748694549.003.0002. DOI: 10.3366/edinburgh/9780748694549.003.0002
6. Boud, D. (2016). Current influences on changing assessment: implications for research to make a difference. In EARLI SIG1 Conference. Munchen.
7. Boud, D., & Falchikov, N. (2007). Developing assessment for informing judgement. In D. Boud & N. Falchikov (Eds.), Rethinking assessment in higher education (pp. 181–197). London: Routledge. DOI: 10.4324/9780203964309
8. Boud, D., & Molloy, E. (Eds.). (2013). Feedback in higher and professional education. London: Routledge.
9. Boud, D., & Soler, R. (2016). Sustainable assessment revisited. Assessment & Evaluation in Higher Education, 41(3), 400–413. 10.1080/02602938.2015.1018133. DOI: 10.1080/02602938.2015.1018133
10. Boud, D., Ajjawi, R., Dawson, P., & Tai, J. (Eds.). (2018a). Developing evaluative judgement in higher education. Assessment for knowing and producing quality work. London: Routledge.
11. Boud, D., Dawson, P., Tai, J., & Ajjawi, R. (2018b). Creating an agenda for developing students’ evaluative judgement. In D. Boud, R. Ajjawi, P. Dawson, & J. Tai (Eds.), Developing evaluative judgement in higher education: assessment for knowing and producing quality work (pp. 186–195). London: Routledge. DOI: 10.4324/9781315109251-20
12. Brabrand, C., & Dahl, B. (2009). Using the SOLO taxonomy to analyze competence progression of university science curricula. Higher Education, 58(4), 531–549. 10.1007/s10734-009-9210-4. DOI: 10.1007/s10734-009-9210-4
13. Carless, D. (2009). Trust, distrust and their impact on assessment reform. Assessment & Evaluation in Higher Education, 34(1), 79–89. 10.1080/02602930801895786. DOI: 10.1080/02602930801895786
14. Carless, D. (2013). Trust and its role in facilitating dialogic feedback. In D. Boud & E. Molloy (Eds.), Feedback in higher and professional education (pp. 90–103). London: Routledge.
15. Carless, D. (2015). Exploring learning-oriented assessment processes. Higher Education, 69(6), 963–976. 10.1007/s10734-014-9816-z. DOI: 10.1007/s10734-014-9816-z
16. Carless, D., Joughin, G., & Liu, N.-F. (2006). How assessment supports learning: learning-oriented assessment in action. Hong Kong: Hong Kong University Press. DOI: 10.5790/hongkong/9789622098237.001.0001
17. Carless, D., Bridges, S. M., Chan, C. K. Y., & Glofcheski, R. (Eds.). (2017). Scaling up assessment for learning in higher education. Singapore: Springer.
18. Cartney, P. (2012). Exploring the use of peer assessment as a vehicle for closing the gap between feedback and feedback used. In S. Hatzipanagos & R. Rocho (Eds.), Approaches to assessment that enhance learning in higher education (pp. 61–72). London: Routledge.
19. Coombs, A., DeLuca, C., LaPointe-McEwan, D., & Chalas, A. (2018). Changing approaches to classroom assessment: an empirical study across teacher career stages. Teaching and Teacher Education, 71, 134–144. 10.1016/j.tate.2017.12.010. DOI: 10.1016/j.tate.2017.12.010
20. Cowan, J. (2010). Developing the ability for making evaluative judgements. Teaching in Higher Education, 15(3), 323–334.
21. Creswell, J. W., & Clark, V. P. (2010). Designing and conducting mixed methods research (2nd ed.). Thousands Oaks: SAGE Publications.
22. Dann, R. (2014). Assessment as learning: blurring the boundaries of assessment and learning for theory, policy and practice. Assessment in Education: Principles, Policy & Practice, 21(2), 149–166. 10.1080/0969594X.2014.898128. DOI: 10.1080/0969594X.2014.898128
23. Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2018). What makes for effective feedback: staff and student perspectives. Assessment & Evaluation in Higher Education, 2938, 1–12. 10.1080/02602938.2018.1467877. DOI: 10.1080/02602938.2018.1467877
24. DeLuca, C., Valiquette, A., Coombs, A., LaPointe-McEwan, D., & Luhanga, U. (2016). Teachers’ approaches to classroom assessment: a large-scale survey. Assessment in Education: Principles, Policy & Practice, 25(4), 355–375. 10.1080/0969594X.2016.1244514. DOI: 10.1080/0969594X.2016.1244514
25. Dochy, F., Segers, M., & Sluijsmans, D. (1999). The use of self-, peer and co-assessment in higher education: a review. Studies in Higher Education, 24, 331–350. DOI: 10.1080/03075079912331379935
26. Earl, L. (2013). Assessment as learning. Using classroom assessment to maximize student learning. London: Sage.
27. Espasa, A., & Meneses, J. (2010). Analysing feedback processes in an online teaching and learning environment: an exploratory study. Higher Education, 59(3), 277–292. 10.1007/s10734-009-9247-4. DOI: 10.1007/s10734-009-9247-4
28. Evans, C. (2013). Making sense of assessment feedback in higher education. Review of Educational Research, 83(1), 70–120. 10.3102/0034654312474350. DOI: 10.3102/0034654312474350
29. Falchikov, N. (2005). Improving assessment through student involvement. Practical solutions for aiding learning in higher education and further education. London: RoutledgeFalmer.
30. Garson, G. D. (2016). Partial least squares: regression & structural equation models. Asheboro: Statistical Publishing Associates.
31. Gielen, S., Dochy, F., & Onghena, P. (2011). An inventory of peer assessment diversity. Assessment & Evaluation in Higher Education, 36(2), 137–155. DOI: 10.1080/02602930903221444
32. Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS_SEM). London: Sage.
33. Hair, J. F., Sarstedt, M., Ringle, C. M., & Gudergan, S. P. (2018). Advanced issues in partial least squares structural equation modeling. London: Sage.
34. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.
35. Hawe, E., & Dixon, H. (2017). Assessment for learning: a catalyst for student self-regulation. Assessment & Evaluation in Higher Education, 42(8), 1181–1192. 10.1080/02602938.2016.1236360. DOI: 10.1080/02602938.2016.1236360
36. Hernández, R. (2012). Does continuous assessment in higher education support student learning? Higher Education, 64(4), 489–502. 10.1007/s10734-012-9506-7. DOI: 10.1007/s10734-012-9506-7
37. Hounsell, D. (2007). Towards more sustainable feedback to students. In D. Boud & N. Falchikov (Eds.), Rethinking assessment in higher education: Learning for the longer term (pp. 101–113). London: Routledge.
38. Ibarra-Sáiz, M. S., & Rodríguez-Gómez, G. (2017). EvalCOMIX®: a web-based programme to support collaboration in assessment. In T. Issa, P. Kommers, T. Issa, P. Isaías, & T. B. Issa (Eds.), Smart technology applications in business environments (pp. 249–275). Hershey: IGI Global. 10.4018/978-1-5225-2492-2.ch012. DOI: 10.4018/978-1-5225-2492-2.ch012
39. Järvelä, S., Järvenoja, H., Malmberg, J., Isohätälä, J., & Sobocinski, M. (2016). How do types of interaction and phases of self-regulated learning set a stage for collaborative engagement? Learning and Instruction, 43, 39–51. 10.1016/j.learninstruc.2016.01.005. DOI: 10.1016/j.learninstruc.2016.01.005
40. Johnson, R. L., & Morgan, G. B. (2016). Survey scales. A guide to development, analysis, and reporting. London: The Guilford Press.
41. Klinger, D., McDivitt, P., Howard, B., Rogers, T., Muñoz, M., & Wylie, C. (2015). Classroom assessment standards: practices for PK-12 teachers. Seattle: Kindle Direct Press.
42. Lai, P. (2006). Review of assessing for learning: building a sustainable commitment across the institution. Assessment & Evaluation in Higher Education, 31(4), 479–481. 10.1080/02602930600679258. DOI: 10.1080/02602930600679258
43. Litwin, M. S. (2003). How to assess and interpret survey psychometrics. Thousands Oaks: SAGE Publications. DOI: 10.4135/9781412984409
44. López-Pastor, V., & Sicilia-Camacho, A. (2017). Formative and shared assessment in higher education. Lessons learned and challenges for the future. Assessment & Evaluation in Higher Education, 42(1), 77–97. 10.1080/02602938.2015.1083535. DOI: 10.1080/02602938.2015.1083535
45. Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty: replication in the education sciences. Educational Researcher, 43(6), 304–316. 10.3102/0013189X14545513. DOI: 10.3102/0013189X14545513
46. Moore, C., & Teather, S. (2013). Engaging students in peer review: feedback as learning. Issues in Educational Research, 23(2), 196–212.
47. Murillo, F. J., & Hidalgo, N. (2017). Students’ conceptions about a fair assessment of their learning. Studies in Educational Evaluation, 53, 10–16. 10.1016/j.stueduc.2017.01.001. DOI: 10.1016/j.stueduc.2017.01.001
48. Nguyen, T. T. H., & Walker, M. (2016). Sustainable assessment for lifelong learning. Assessment & Evaluation in Higher Education, 41(1), 97–111. 10.1080/02602938.2014.985632. DOI: 10.1080/02602938.2014.985632
49. Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: a peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102–122. 10.1080/02602938.2013.795518. DOI: 10.1080/02602938.2013.795518
50. Panadero, E. (2016). Is it safe? Social, interpersonal, and human effects of peer assessment: a review and future directions. In G. T. L. Brown & L. R. Harris (Eds.), Handbook of social and human conditions in assessment (pp. 247–266). New York: Routledge.
51. Panadero, E. (2017). A review of self-regulated learning: six models and four directions for research. Frontiers in Psychology, 8(APR), 1–28. 10.3389/fpsyg.2017.00422. DOI: 10.3389/fpsyg.2017.00422
52. Panadero, E., Klug, J., & Järvelä, S. (2016). Third wave of measurement in the self-regulated learning field: when measurement and intervention come hand in hand. Scandinavian Journal of Educational Research, 60(6), 723–735. 10.1080/00313831.2015.1066436. DOI: 10.1080/00313831.2015.1066436
53. Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self- efficacy: four meta-analyses. Educational Research Review, 22, 74–98. 10.1016/j.edurev.2017.08.004. DOI: 10.1016/j.edurev.2017.08.004
54. Panadero, E., Andrade, H., & Brookhart, S. (2018). Fusing self-regulated learning and formative assessment: a roadmap of where we are, how we got here, and where we are going. The Australian Educational Researcher, 45(1), 13–31. 10.1007/s13384-018-0258-y. DOI: 10.1007/s13384-018-0258-y
55. Pardo, A. (2018). A feedback model for data-rich learning experiences. Assessment & Evaluation in Higher Education, 43(3), 428–438. 10.1080/02602938.2017.1356905. DOI: 10.1080/02602938.2017.1356905
56. Penuel, W. R., & Shepard, L. A. (2016). Social models of learning and assessment. In A. A. Rupp & J. P. Leighton (Eds.), Handbook of cognition and assessment: frameworks, methodologies, ans applications. Hoboke: Wiley.
57. Pereira, D., Niklasson, L., & Flores, M. A. (2017). Students’ perceptions of assessment: a comparative analysis between Portugal and Sweden. Higher Education, 73(1), 153–173. 10.1007/s10734-016-0005-0. DOI: 10.1007/s10734-016-0005-0
58. Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In M. Boekhaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 451–502). San Diego: Academic Press. DOI: 10.1016/B978-012109890-2/50043-3
59. Reinholz, D. (2016). The assessment cycle: a model for learning through peer assessment. Assessment & Evaluation in Higher Education, 41(2), 301–315. 10.1080/02602938.2015.1008982. DOI: 10.1080/02602938.2015.1008982
60. Ringle, C. M., Wende, S., & Becker, J.-M. (2015). SmartPLS 3. Bönningstedt: SmartPLS. http://www.smartpls.com.
61. Rodríguez-Gómez, G., & Ibarra-Sáiz, M. S. (2015). Assessment as learning and empowerment: towards sustainable learning in higher education. In M. Peris-Ortiz & J. M. Merigó Lindahl (Eds.), Sustainable learning in higher education. Developing competencies for the global marketplace (pp. 1–20). Springer International Publishing. 10.1007/978-3-319-10804-9_1.
62. Rowe, A. D. (2017). Feelings about feedback: the role of emotions in assessment for learning. In D. Carless, S. M. Bridges, C. K. Y. Chan, & R. Glofcheski (Eds.), Scaling up assessment for learning in Higher Education (pp. 159–172). Singapore: Springer. 10.1007/978-981-10-3045-1_11
63. Rust, C., O’Donovan, B., & Price, M. (2005). A social constructivist assessment process model: how the research literature shows us this could be best practice. Assessment & Evaluation in Higher Education, 30(3), 231–240. 10.1080/02602930500063819. DOI: 10.1080/02602930500063819
64. Sadler, D. R. (2012). Beyond feedback: developing student capability in complex appraisal. In S. Hatzipanagos & R. Rochon (Eds.), Approaches to assessment that enhance learning in higher education (pp. 45–60). London: Routledge.
65. Sadler, D. R. (2016). Three in-course assessment reforms to improve higher education learning outcomes. Assessment & Evaluation in Higher Education, 41(7), 1081–1099. 10.1080/02602938.2015.1064858. DOI: 10.1080/02602938.2015.1064858
66. Sambell, K., McDowell, L., & Montgomery, C. (2013). Assessment for learning in higher education. London: Routledge.
67. Skjong, R., & Wentworth, B. (2000). Expert judgement and risk perception. Hovik: Det Norsrke Veritas. http://research.dnv.com/skj/Papers/SkjWen.pdf. Accessed on 02/09/2018.
68. Smith, E., & Coombe, K. (2006). Quality and qualms in the marking of university assignments by sessional staff: an exploratory study. Higher Education, 51(1), 45–69. 10.1007/s10734-004-6376-7. DOI: 10.1007/s10734-004-6376-7
69. Stone-Romero, E. F., & Rosopa, P. J. (2008). The relative validity of inferences about mediation as a function of research design characteristics. Organizational Research Methods, 11(2), 326–352. 10.1177/1094428107300342. DOI: 10.1177/1094428107300342
70. Strijbos, J., Engels, N., & Struyven, K. (2015). Criteria and standards of generic competences at bachelor degree level: a review study. Educational Research Review, 14, 18–32. 10.1016/j.edurev.2015.01.001. DOI: 10.1016/j.edurev.2015.01.001
71. Struyven, K., Dochy, F., & Janssens, S. (2005). Students’ perceptions about evaluation and assessment in higher education: a review1. Assessment & Evaluation in Higher Education, 30(4), 325–341. 10.1080/02602930500099102. DOI: 10.1080/02602930500099102
72. Tai, J. H. M., Canny, B. J., Haines, T. P., & Molloy, E. K. (2016). The role of peer-assisted learning in building evaluative judgement: opportunities in clinical medical education. Advances in Health Sciences Education, 21(3), 659–676. 10.1007/s10459-015-9659-0. DOI: 10.1007/s10459-015-9659-0
73. Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: enabling students to make decisions about the quality of work. Higher Education, 76(3), 467–481. 10.1007/s10734-017-0220-3. DOI: 10.1007/s10734-017-0220-3
74. Thomas, G., Martin, D., & Pleasants, K. (2011). Using self-and peer-assessment to enhance students’ future-learning in higher education. Journal of University Teaching & Learning Practice, 8(81).
75. Topping, K. J. (2010). Methodological quandaries in studying process and outcomes in peer assessment. Learning and Instruction, 20, 339–343. DOI: 10.1016/j.learninstruc.2009.08.003
76. Wilson, M., & Scalise, K. (2006). Assessment to improve learning in higher education: the BEAR Assessment System. Higher Education, 52(4), 635–663. DOI: 10.1007/s10734-004-7263-y
77. Yucel, R., Bird, F. L., Young, J., & Blanksby, T. (2014). The road to self-assessment: exemplar marking before peer review develops first-year students’ capacity to judge the quality of a scientific report. Assessment & Evaluation in Higher Education, 39(8), 971–986. 10.1080/02602938.2014.880400. DOI: 10.1080/02602938.2014.880400
78. Zlatkin-Troitschanskaia, O., Shavelson, R. J., & Kuhn, C. (2015). The international state of research on measurement of competency in higher education. Studies in Higher Education, 40(3), 393–411. 10.1080/03075079.2015.1004241. DOI: 10.1080/03075079.2015.1004241