Observations of student accuracy in criteria-based self-assessment

Assessment and Evaluation in Higher Education

Volumn 45, Issue 8, 2020, Pages 1088-1105

  Carroll, Danny ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

criteria based self assessment; developing evaluative judgement; Self assessment; self assessment accuracy; self assessment training

Indexed keywords

EID: 85089249468     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2020.1727411     Document Type: Article

References (55)

1. Andrade, H., and A., Valtcheva. 2009. “Promoting Learning and Achievement through Self-Assessment.” Theory into Practice 48 (1): 12–19. doi:10.1080/00405840802577544.
2. Beyer, S., 1999. “Gender Differences in the Accuracy of Grade Expectancies and Evaluations.” Sex Roles 41 (3/4): 279–296.
3. Boud, D., 2013. Enhancing Learning through Self-Assessment. Abingdon: Routledge.
4. Boud, D., and N., Falchikov. 1989. “Quantitative Studies of Student Self-Assessment in Higher Education: A Critical Analysis of Findings.” Higher Education 18 (5): 529–549. doi:10.1007/BF00138746.
5. Boud, D., and N., Falchikov. 2007. Rethinking Assessment in Higher Education: Learning for the Longer Term. Oxford, England: Routledge Falmer.
6. Boud, D., R., Lawson, and D. G., Thompson. 2015. “The Calibration of Student Judgement through Self-Assessment: Disruptive Effects of Assessment Patterns.” Higher Education Research and Development 34 (1): 45–59. doi:10.1080/07294360.2014.934328.
7. Boud, D., and R., Soler. 2016. “Sustainable Assessment Revisited.” Assessment and Evaluation in Higher Education 41 (3): 400–413. doi:10.1080/02602938.2015.1018133.
8. Breidert, J. T., and J. E., Fite. 2009. Self-Assessment: Review and Implications for Training (No. ARI-RR-1900). Fort Knox, KY: Army Research Institute for the Behavioral and Social Sciences.
9. Brown, G., H., Andrade, and F., Chen. 2015. “Accuracy in Student Self-Assessment: Directions and Cautions for Research.” Assessment in Education 22 (4): 444. doi:10.1080/0969594X.2014.996523.
10. Brown, G. T. L., and L. R., Harris, 2013. “Student self-assessment.” In The SAGE Handbook of Research on Classroom Assessment, edited by J. H., McMillan, 367–393. Thousand Oaks, CA: Sage.
11. Brown, G. T. L., and L. R., Harris. 2014. “The Future of Self-Assessment in Classroom Practice: Reframing Self-Assessment as a Core Competency.” Frontline Learning Research 2 (1): 22–30. doi:10.14786/flr.v2i1.24.
12. Carless, D., G., Joughin, and M., Mok. 2006. “Learning-Oriented Assessment: Principles and Practice.” Assessment and Evaluation in Higher Education 31 (4): 395–398.
13. Carroll, D., 2018. “Student Accuracy in Criteria-Based Self-Assessment.” Thesis, Education, Faculty of Arts and Social Sciences, UNSW. http://handle.unsw.edu.au/1959.4/60597.
14. Casillas, A., S., Robbins, J., Allen, Y., Kuo, M. A., Hanson, and C., Schmeiser. 2012. “Predicting Early Academic Failure in High School from Prior Academic Achievement, Psychosocial Characteristics, and Behavior.” Journal of Educational Psychology 104 (2): 407–420. doi:10.1037/a0027180.
15. Colliver, J. A., S. J., Verhulst, and H. S., Barrows. 2005. “Self-Assessment in Medical Practice: A Further Concern about the Conventional Research Paradigm.” Teaching and Learning in Medicine 17 (3): 200–201. doi:10.1207/s15328015tlm1703_1.
16. Covic, T., and M. K., Jones. 2008. “Is the Essay Resubmission Option a Formative or a Summative Assessment and Does It Matter as Long as the Grades Improve?” Assessment and Evaluation in Higher Education 33 (1): 75–85. doi:10.1080/02602930601122928.
17. Design-Based Research Collective. 2003. “Design-Based Research: An Emerging Paradigm for Educational Inquiry.” Educational Researcher 32 (1): 5–8.
18. Dochy, F. J. R. C., M., Segers, and D., Sluijsmans. 1999. “The Use of Self-, Peer and Co-Assessment in Higher Education: A Review.” Studies in Higher Education 24 (3): 331–350. doi:10.1080/03075079912331379935.
19. Dunning, D., K., Johnson, J., Ehrlinger, and J., Kruger. 2003. “Why People Fail to Recognize Their Own Incompetence.” Current Directions in Psychological Science 12 (3): 83–87. doi:10.1111/1467-8721.01235.
20. Dunning, D., C., Heath, and J. M., Suls. 2018. “Reflections on Self-Reflection: Contemplating Flawed Self-Judgments in the Clinic, Classroom, and Office Cubicle.” Perspectives on Psychological Science 13 (2): 185–189. doi:10.1177/1745691616688975.
21. Ehrlinger, J., K., Johnson, M., Banner, D., Dunning, and J., Kruger. 2008. “Why the Unskilled Are Unaware: Further Explorations of (Absent) Self-Insight among the Incompetent.” Organizational Behavior and Human Decision Processes 105 (1): 98–121. doi:10.1016/j.obhdp.2007.05.002.
22. Eva, K. W., and G., Regehr. 2005. “Self-Assessment in the Health Professions: A Reformulation and Research Agenda.” Academic Medicine 80 (Suppl): S46–S54. doi:10.1097/00001888-200510001-00015.
23. Fastré, G. M., M. R., van der Klink, D., Sluijsmans, and J. J., van Merriënboer. 2012. “Drawing Students’ Attention to Relevant Assessment Criteria: Effects on Self-Assessment Skills and Performance.” Journal of Vocational Education and Training 64 (2): 185–198. doi:10.1080/13636820.2011.630537.
24. Fisher, R., J., Cavanagh, and A., Bowles. 2011. “Assisting Transition to University: Using Assessment as a Formative Learning Tool.” Assessment and Evaluation in Higher Education 36 (2): 225–237. doi:10.1080/02602930903308241.
25. Fitzgerald, J. T., C. B., White, and L. D., Gruppen. 2003. “A Longitudinal Study of Self‐Assessment Accuracy.” Medical Education 37 (7): 645–649. doi:10.1046/j.1365-2923.2003.01567.x.
26. Garavalia, L. S., and M. E., Gredler. 2002. “An Exploratory Study of Academic Goal Setting. Achievement Calibration and Self-Regulated Learning.” Journal of Instructional Psychology 29 (4): 221–230.
27. Hacker, D. J., L., Bol, D. D., Horgan, and E. A., Rakow. 2000. “Test Prediction and Performance in a Classroom Context.” Journal of Educational Psychology 92 (1): 160–170. doi:10.1037/0022-0663.92.1.160.
28. Hacker, D. J., L., Bol, and M. C., Keener. 2008. “Metacognition in Education: A Focus on Calibration.” In Handbook of Metamemory and Memory, edited by J., Dunlosky & R. A., Bjork, Oxford, England: Taylor and Francis.
29. Hattie, J., and H., Timperley. 2007. “The Power of Feedback.” Review of Educational Research 77 (1): 81–112. doi:10.3102/00346543077001081.
30. Hemmings, B., P., Grootenboer, and R., Kay. 2011. “Predicting Mathematics Achievement: The Influence of Prior Achievement and Attitudes.” International Journal of Science and Mathematics Education 9 (3): 691–705. doi:10.1007/s10763-010-9224-5.
31. Keren, G., 1991. “Calibration and Probability Judgements: Conceptual and Methodological Issues.” Acta Psychologica 77 (3): 217–273. doi:10.1016/0001-6918(91)90036-Y.
32. Kluger, A. N., and A., DeNisi. 1996. “The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory.” Psychological Bulletin 119 (2): 254–284. doi:10.1037/0033-2909.119.2.254.
33. Lew, M. D., W., Alwis, and H. G., Schmidt. 2010. “Accuracy of Students’ Self‐Assessment and Their Beliefs about Its Utility.” Assessment and Evaluation in Higher Education 35 (2): 135–156. doi:10.1080/02602930802687737.
34. McDonald, B., and D., Boud. 2003. “The Impact of Self-Assessment on Achievement: The Effects of Self-Assessment Training on Performance in External Examinations.” Assessment in Education: Principles, Policy and Practice 10 (2): 209–220. doi:10.1080/0969594032000121289.
35. McMillan, J. H., and J., Hearn. 2008. “Student Self-Assessment: The Key to Stronger Student Motivation and Higher Achievement.” Educational Horizons 87 (1): 40–49.
36. Ng, J. R., and J. K., Earl. 2008. “Accuracy in Self-Assessment: The Role of Ability, Feedback, Self-Efficacy and Goal Orientation.” Australian Journal of Career Development 17 (3): 39–50. doi:10.1177/103841620801700307.
37. Nicol, D. J., and D., Macfarlane-Dick. 2006. “Formative Assessment and Self‐Regulated Learning: A Model and Seven Principles of Good Feedback Practice.” Studies in Higher Education 31 (2): 199–218. doi:10.1080/03075070600572090.
38. Nietfeld, J. L., L., Cao, and J. W., Osborne. 2005. “Metacognitive Monitoring Accuracy and Student Performance in the Postsecondary Classroom.” The Journal of Experimental Educational 74: 7–28.
39. Pallier, G., 2003. “Gender Differences in the Self-Assessment of Accuracy on Cognitive Tasks.” Sex Roles 48 (5/6): 265–276.
40. Panadero, E., and J., Alonso-Tapia. 2013. “Self-Assessment: Theoretical and Practical Connotations. When It Happens, How is It Acquired and What to Do to Develop It in Our Students.” Electronic Journal of Research in Educational Psychology 11 (2): 551–576.
41. Panadero, E., G. T., Brown, and J., Strijbos. 2015. “The Future of Student Self-Assessment: A Review of Known Unknowns and Potential Directions.” Educational Psychology Review 28 (4): 803–830. doi:10.1007/s10648-015-9350-2.
42. Robins, R. W., and J. S., Beer. 2001. “Positive Illusions about the Self: Short-Term Benefits and Long-Term Costs.” Journal of Personality and Social Psychology 80 (2): 340–352. doi:10.1037/0022-3514.80.2.340.
43. Ross, J. A., 2006. “The Reliability, Validity, and Utility of Self-Assessment.” Practical Assessment, Research, and Evaluation 11 (10): 1–13.
44. Sadler, D. R., 2009. “Indeterminacy in the Use of Pre-Set Criteria for Assessment and Grading.” Assessment and Evaluation in Higher Education 34 (2): 159–179. doi:10.1080/02602930801956059.
45. Sadler, D. R., 2010. “Beyond Feedback: Developing Student Capability in Complex Appraisal.” Assessment and Evaluation in Higher Education 35 (5): 535–550. doi:10.1080/02602930903541015.
46. Sadler, D. R., 2013. “Assuring Academic Achievement Standards: From Moderation to Calibration.” Assessment in Education: Principles, Policy and Practice 20 (1): 5–19. doi:10.1080/0969594X.2012.714742.
47. Schön, D. A., 1983. The Reflective Practitioner: How Professionals Think in Action. New York, NY: Basic Books.
48. Schunk, D. H., and Zimmerman, B. J., (Eds.). 1998. Self-Regulated Learning: From Teaching to Self-Reflective Practice. New York: Guilford Press.
49. Taras, M., 2010. “Assessment for Learning: Assessing the Theory and Evidence.” Procedia - Social and Behavioral Sciences 2 (2): 3015–3022. doi:10.1016/j.sbspro.2010.03.457.
50. Thompson, D., L., Treleaven, P., Kamvounias, B., Beem, and E., Hill. 2008. “Integrating Graduate Attributes with Assessment Criteria in Business Education: Using an Online Assessment System.” Journal of University Teaching and Learning Practice 5 (1): 4.
51. Winne, P. H., 2004. “Students’ Calibration of Knowledge and Learning Processes: Implications for Designing Powerful Software Learning Environments.” International Journal of Educational Research 41 (6): 466–488. doi:10.1016/j.ijer.2005.08.012.
52. Winne, P. H., and D., Jamieson-Noel. 2002. “Exploring Students’ Calibration of Self-Reports about Study Tactics and Achievement.” Contemporary Educational Psychology 27 (4): 551–572. doi:10.1016/S0361-476X(02)00006-1.
53. Yammarino, F. J., and L. E., Atwater. 1993. “Understanding Self‐Perception Accuracy: Implications for Human Resource Management.” Human Resource Management 32 (2–3): 231–247. doi:10.1002/hrm.3930320204.
54. Yan, Z., and G. T., Brown. 2016. “A Cyclical Self-Assessment Process: Towards a Model of How Students Engage in Self-Assessment.” Assessment and Evaluation in Higher Education 42 (8): 1–16. doi:10.1080/02602938.2016.1260091.
55. Yates, J. F., 1990. Judgment and Decision Making. Upper Saddle River, NJ: Prentice-Hall, Inc.