Variability In The Accuracy Of Self-Assessments Among Low, Moderate, And High Performing Students In University Education

Practical Assessment, Research and Evaluation

Volumn 26, Issue , 2021, Pages 1-14

  León, Samuel Parra ^a   Vallejo, Antonio Pantoja ^a   Nelson, James Byron ^b  

^a UNIVERSITY OF JAÉN   (Spain)

^b UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85118245599     PISSN: None     EISSN: 15317714     Source Type: Journal    
DOI: 10.7275/6q91-az58     Document Type: Article

References (74)

1. Admiraal, W., Huisman, B., & Pilli, O. (2015). Assessment in massive open online courses. Electronic Journal of E-learning, 13(4), 207-216. Retrieved from https://academic-publishing.org/index.php/ejel/article/view/172 8/1691
2. Ainscow, M. (1988). Beyond the eyes of the monster: an analysis of recent trends in assessment and recording. Support for learning, 3(3), 149-153. https://doi.org/10.1111/j.1467-9604.1988.tb00088.x
3. Alameddine, M. B., Englesbe, M. J., & Waits, S. A. (2018). A video-based coaching intervention to improve surgical skill in fourth-year medical students. Journal of surgical education, 75(6), 1475-1479. https://doi.org/10.1016/j.jsurg.2018.04.003
4. Andrade H. L. (2019) A Critical Review of Research on Student Self-Assessment. Front. Educ. 4:87. https://doi.org/10.3389/feduc.2019.00087
5. Andrade, H. L. (2010). Students as the definitive source of formative assessment: academic self-assessment and the self-regulation of learning. In H. L. Andrade & G. J. Cizek (Eds.), Handbook of formative assessment (pp. 90–105). New York: Routledge.
6. Andrade, H., Du, Y., & Mycek, K. (2010). Rubric-referenced self-assessment and middle school students’ writing. Assessment in Education: Principles, Policy & Practice, 17(2), 199–214. https://doi.org/10.1080/09695941003696172
7. Andrade, H., Wang, X. L., Du, Y., & Akawi, R. L. (2009). Rubric-referenced self-assessment and self-efficacy for writing. Journal of Educational Research, 102(4), 287–301. https://doi.org/10.3200/JOER.102.4.287-302
8. Aranda, A. F., Pastor, V. M. L., Oliva, F. J. C., & Romero, R. (2013). La evaluación formativa en docencia universitaria y el rendimiento académico del alumnado. Aula abierta, 41(2), 23-34. Retrieved from https://dialnet.unirioja.es/descarga/articulo/4239063.pdf
9. Aryadoust, V. (2015). Self-and peer assessments of oral presentations by first-year university students. Educational Assessment, 20(3), 199-225. https://doi.org/10.1080/10627197.2015.106198 9
10. Berry, R. (2011). Assessment Reforms Around the World. Assessment Reform in Education, 89–102. https://doi.org/10.1007/978-94-007-0729-0_7
11. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: principles, policy & practice, 5(1), 7-74. https://doi.org/10.1080/0969595980050102
12. Boekaerts, M. (2011). Emotions, emotion regulation, and self-regulation of learning. In B. J. Zimmerman & D. H. Schunk (Eds.), Handbook of self-regulation of learning and performance (pp. 408– 425). New York: Routledge.
13. Bolívar-Cruz, A., & Verano-Tacoronte, D. (2018). Self-assessment of the oral presentation competence: Effects of gender and student’s performance. Studies in Educational Evaluation, 59, 94-101. https://doi.org/10.1016/j.stueduc.2018.04.001
14. Boud, D. J., & Tyree, A. L. (1979). Self and peer assessment in professional education: a preliminary study in law, Journal of the Society of Public Teachers of Law, 15, 1, 65-74. Retrieved from https://heinonline.org/HOL/LandingPage?han dle=hein.journals/sptlns15&div=1&src=home
15. Boud, D., & Falchikov, N. (1989). Quantitative studies of student self-assessment in higher education: A critical analysis of findings. Higher education, 18(5), 529-549. https://doi.org/10.1007/bf00138746
16. Brown, G. T. L., & Harris, L. R. (2013). Student self-assessment. In J. H. McMillan (Ed.), The SAGE handbook of research on classroom assessment (pp. 367– 393). Thousand Oaks: Sage.
17. Brown, G. T. L., & Harris, L. R. (2014). The future of self-assessment in classroom practice: reframing self-assessment as a core competency. Frontline Learning Research, 3, 22–30. https://doi.org/10.14786/flr.v2i1.24
18. Butler, R. (1990). The effects of mastery and competitive conditions on self-assessment at different ages. Child Development, 61, 201-210. https://doi.org/10.2307/1131059
19. Cain, K. M., Wilkowski, B. M., Barlett, C. P., Boyle, C. D., & Meier, B. P. (2018). Do we see eye to eye? Moderators of correspondence between student and faculty evaluations of day-to-day teaching. Teaching of Psychology, 45(2), 107-114. https://doi.org/10.1177/0098628318762862
20. Cochran, S.B. & Spears, M.C. (1980). Student self-assessment and instructors' ratings: a comparison, Journal of the American Diatetic Association, 76, 253-257. Retrieved from http://agris.fao.org/agris-search/search.do?recordID=US8045887
21. Ćukušić, M., Garača, Ž., & Jadrić, M. (2014). Online self-assessment and students' success in higher education institutions. Computers & Education, 72, 100-109. https://doi.org/10.1016/j.compedu.2013.10.018
22. Daines, J.M. (1978). Self evaluation of academic performance in a continuously assessed course of study, Research Intelligence, 4, 1, 24-26. https://doi.org/10.1080/0141192780040106
23. Davis, J.K. & Rand, D.C. (1980). Self-grading versus instructor grading, Journal of Educational Research, 73(4), 207-211. https://doi.org/10.1080/00220671.1980.10885237
24. Dochy, F. J. R. C., Segers, M., & Sluijsmans, D. (1999). The use of self-, peer and co-assessment in higher education: A review. Studies in Higher education, 24(3), 331-350. https://doi.org/10.1080/0307507991233137993 5
25. Doleys, E. J., & Renzaglia, G. A. (1963). Accuracy of student prediction of college grades. Personnel & Guidance Journal, 41(6), 528–530. https://doi.org/10.1002/j.2164-4918.1963.tb02337.x
26. Dunning, D., Heath, C., & Suls, J. M. (2004). Flawed self-assessment: implications for health, education, and the workplace. Psychological Science in the Public Interest, 5(3), 69–106. https://doi.org/10.1111/j.1529-1006.2004.00018.x
27. Efron, B. (1992). Bootstrap methods: another look at the jackknife. In Breakthroughs in statistics (pp. 569-593). Springer, New York, NY.
28. Falchikov, N., & Boud, D. (1989). Student self-assessment in higher education: A meta-analysis. Review of Educational Research, 59(4), 395-430. https://doi.org/10.2307/1170205
29. Filene, P.O. (1969). Self-grading: an experiment in learning, Journal of Higher Education, 40, 451-458. https://doi.org/10.2307/1979820
30. Finn, B., & Metcalfe, J. (2014). Overconfidence in children’s multi-trial judgments of learning. Learning & Instruction, 32, 1–9. https://doi.org/10.1016/j.learninstruc.2014.01.001
31. Gaier, E. L. (1961). Student self estimates of final course grades. The Journal of genetic psychology, 98(1), 63-67. https://doi.org/10.1080/00221325.1961.10534353
32. Gordon, M. J. (1991). A review of the validity and accuracy of self-assessments in health professions training. Academic medicine: journal of the Association of American Medical Colleges, 66(12), 762-769. https://doi.org/10.1097/00001888-199112000-00012
33. Hedges, L. V. (1981). Distribution Theory for Glass’s Estimator of Effect size and Related Estimators. Journal of Educational Statistics, 6(2), 107-128. https://doi.org/10.3102/10769986006002107
34. Ho, J., Tumkaya, T., Aryal, S., Choi, H., & Claridge-Chang, A. (2018). Moving beyond P values: Everyday data analysis with estimation plots. Nat Methods 16, 565–566. https://doi.org/10.1038/s41592-019-0470-3
35. Instituto Nacional de Estadística (2015). Mujeres en el Profesorado Por Enseñanza que Imparten] [Females in the Teaching Body According to the Grade Level They Teach. Available at: http://www.ine.es/ss/Satellite?L=es_ES&c=INESeccion_C&cid=1259925481851&p=1254735110672&pagename=ProductosYServicios%2FPYSLayout¶m3=1259924822888
36. Kallio, H., Virta, K. & Kallio, M. (2018). Modelling the Components of Metacognitive Awareness. International Journal of Educational Psychology, 7(2), 94-122. https://doi.org/10.17583/ijep.2018.2789
37. Kane, M. (2006). Content-related validity evidence in test development. In S.M. Downing & T.M. Haladyna (Eds.), Handbook of test development (pp. 131–153). Mahwah, NJ: Lawrence Erlbaum Associates
38. Keefer, K. E. (1971). Characteristics of students who make accurate and inaccurate self-predictions of college achievement. The Journal of Educational Research, 64(9), 401-404. https://doi.org/10.1080/00220671.1971.10884203
39. Kostons, D., van Gog, T., & Paas, F. (2012). Training self-assessment and task-selection skills: a cognitive approach to improving self-regulated learning. Learning and Instruction, 22(2), 121–132. https://doi.org/10.1016/j.learninstruc.2011.08.0 04
40. Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134. https://doi.org/10.1037/0022-3514.77.6.1121
41. Longhurst, N., & Norton, L. S. (1997). Self-assessment in coursework essays. Studies in Educational Evaluation, 23(4), 319-330. https://doi.org/10.1016/s0191-491x(97)86213-x
42. McMillan, J. H., & Hearn, J. (2008). Student self-assessment: the key to stronger student motivation and higher achievement. Educational Horizons, 87, 40–49. Retrieved from https://pdfs.semanticscholar.org/bb37/9a8107153678f41b65ac68d78726ba065f26.pdf?_ga=2.39662499.1836272783.1575369325-792685113.1573028967
43. Moreland, R., Miller, J. & Laucka, F. (1981) Academic achievement and self-evaluation of academic performance. Journal of Educational Psychology, 73(3), 335-344. https://doi.org/10.1037/0022-0663.73.3.335
44. Morton, J.B. & Macbeth, W.A.A.G. (1977). Correlations between staff, peer, and self-assessments of fourth-years students in surgery, Medical Education, 11(3), 167-170. https://doi.org/10.1111/j.1365-2923.1977.tb00586.x
45. Mueller, R. H. (1970). Is self-grading the answer? The Journal of Higher Education, 41(3), 221-224. https://doi.org/10.2307/1977312
46. Murstein, B. I. (1965). The relationship of grade expectations and grades believed to be deserved to actual grades received. The Journal of Experimental Education, 33(4), 357-362. https://doi.org/10.1080/00220973.1965.11010894
47. Nicol, D., & McFarlane-Dick, D. (2006). Formative assessment and self-regulated learning, a model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218. https://doi.org/10.1080/03075070600572090
48. Noonan, B., & Duncan, C. R. (2005). Peer and self-assessment in high schools. Practical assessment, research and evaluation, 10(17), 1-8. Retrieved from https://pareonline.net/pdf/v10n17.pdf
49. Olina, Z., & Sullivan, H. J. (2004). Student self-evaluation, teacher evaluation, and learner performance. Educational Technology Research and Development, 52(3), 5–22. https://doi.org/10.1007/BF02504672
50. Orsmond, P., Merry, S., & Reiling, K. (2000). The use of student derived marking criteria in peer and self-assessment. Assessment & Evaluation in Higher Education, 25(1), 23–38. https://doi.org/10.1080/02602930050025006
51. Pakaslahti, L., & Keltikangas-Järvinen, L. (2000). Comparison of peer, teacher and self-assessments on adolescent direct and indirect aggression. Educational Psychology, 20(2), 177-190. https://doi.org/10.1080/713663710
52. Panadero, E., & Alonso-Tapia, J. (2013). Self-Assessment: Theoretical and Practical Connotations. When It Happens, How Is It Acquired and What to Do to Develop It in Our Students. Electronic Journal of Research in Educational Psychology, 11(2), 551-576. https://doi.org/10.1016/j.stueduc.2013.04.001
53. Panadero, E., & Alonso-Tapia, J. (2014). How do students self-regulate? Review of Zimmerman’s cyclical model of self-regulated learning. Anales De Psicologia, 30(2), 450–462. https://doi.org/10.6018/analesps.30.2.167221
54. Panadero, E., & Romero, M. (2014). To rubric or not to rubric? The effects of self-assessment on self regulation, performance and self-efficacy. Assessment in Education: Principles, Policy & Practice, 21(2), 133–148. https://doi.org/10.1080/0969594X.2013.877872
55. Panadero, E., Alonso-Tapia, J., & Huertas, J. A. (2012). Rubrics and self-assessment scripts effects on self-regulation, learning and self-efficacy in secondary education. Learning and Individual Differences, 22(6), 806–813. https://doi.org/10.1016/j.lindif.2012.04.007
56. Panadero, E., Brown, G. T., & Strijbos, J. W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803-830. https://doi.org/10.1007/s10648-015-9350-2
57. Panadero, E., Brown, G., & Courtney, M. (2014). Teachers’ reasons for using self-assessment: A survey self-report of Spanish teachers. Assessment in Education: Principles, Policy & Practice, 21(4), 365-383. https://doi.org/10.1080/0969594x.2014.919247
58. Panadero, E., Jonsson, A., & Botella, J. (2017). Effects of self-assessment on self-regulated learning and self-efficacy: Four meta-analyses. Educational Research Review, 22, 74-98. https://doi.org/10.1016/j.edurev.2017.08.004
59. Ramdass, D., & Zimmerman, B. J. (2008). Effects of self-correction strategy training on middle school students’ self-efficacy, self-evaluation, and mathematics division learning. Journal of Advanced Academics, 20(1), 18– 41. https://doi.org/10.4219/jaa-2008-869
60. Real Decreto 1125/2003, de 5 de septiembre, por el que se establece el sistema europeo de créditos y el sistema de calificaciones en las titulaciones universitarias de carácter oficial y validez en todo el territorio nacional. Boletín Oficial del Estado, 224, de 18 de septiembre de 2003, 34,355-34,356. Retrieved from https://www.boe.es/eli/es/rd/2003/09/05/1125
61. Ross, J. A. (2006). The Reliability, Validity, and Utility of Self-Assessment. Practical Assessment Research & Evaluation, 11(10) 10. https://doi.org/10.7275/9wph-vv65
62. Ross, J. A., Rolheiser, C., & Hogaboam-Gray, A. (1998). Skills training versus action research in service: Impact on student attitudes to self-evaluation. Teaching and Teacher Education, 14(5), 463-477. https://doi.org/10.1016/s0742-051x(97)00054-1
63. Ross, S. (1998). Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing, 15(1), 1-20. https://doi.org/10.1177/026553229801500101
64. Sitzmann, T., Ely, K., Brown, K. G., & Bauer, K. N. (2010). Self-assessment of knowledge: A cognitive learning or affective measure? Academy of Management Learning & Education, 9(2), 169-191. https://doi.org/10.5465/amle.9.2.zqr169
65. Stanton, H.E. (1978) Self-grading as an assessment method. Improving College and University Teaching, 26(4), 236-238. https://doi.org/10.1080/00193089.1978.9927589
66. Sumner, F.C. (1932). Marks as estimated by students, Education, 32, 429.
67. Sung, Y. T., Chang, K. E., Chiou, S. K., & Hou, H. T. (2005). The design and application of a web-based self-and peer-assessment system. Computers & Education, 45(2), 187-202. https://doi.org/10.1016/j.compedu.2004.07.002
68. Tan, K. H. K. (2012). Student self-assessment. Assessment, learning and empowerment. Singapore: Research Publishing.
69. Taras, M. (2010). Student self-assessment: processes and consequences. Teaching in Higher Education, 15(2), 199–209. https://doi.org/10.1080/13562511003620027
70. Tejeiro, R. A., Gómez-Vallecillo, J. L., Romero, A. F., Pelegrina, M., Wallace, A., & Emberley, E. (2012). Summative self-assessment in higher education: Implications of its counting towards the final mark. Electronic Journal of Research in Educational Psychology, 10 (2), 789-812. Retrieved from http://investigacion-psicopedagogica.org/revista/articulos/27/english/Art_27_707.pdf
71. Topping, K. J. (2003). Self and peer assessment in school and university: reliability, validity and utility. In M. Segers, F. Dochy, & E. Cascallar (Eds.), Optimising new modes of assessment: in search of qualities and standards Vol. 1 (pp. 55–87). Netherlands: Springer.
72. Torres, K., & Tackett, S. (2016). Pre-service teachers’ beliefs about teaching ESOL students in mainstream classrooms. International Online Journal of Education and Teaching, 3(3), 186-200. Retrieved from http://iojet.org/index.php/IOJET/article/view/130/135
73. Ward, M., Gruppen, L., & Regehr, G. (2002). Measuring self-assessment: current state of the art. Advances in Health Sciences Education, 7(1), 63-80. https://doi.org/10.1023/a:1014585522084
74. Ysseldyke, J.E. & Matson, D. (1988). Issues in the psychological evaluation of children. En V. Van Hasselt, P.S. Satrain, & M. Hersen (Eds.) Handbook of developmental and physucal disabilities. Nueva York: Pergamon