Accuracy in student self-assessment: directions and cautions for research

Assessment in Education: Principles, Policy and Practice

Volumn 22, Issue 4, 2015, Pages 444-457

  Brown, Gavin T L ^a   Andrade, Heidi L ^b   Chen, Fei ^b  

^a UNIVERSITY OF AUCKLAND   (New Zealand)

^b STATE UNIVERSITY OF NEW YORK   (United States)

Author keywords

accuracy; literature review; research implications; self assessment

Indexed keywords

EID: 84941804949     PISSN: 0969594X     EISSN: 1465329X     Source Type: Journal    
DOI: 10.1080/0969594X.2014.996523     Document Type: Article

References (80)

1. F.D.Alsaker, (1989). School achievement, perceived academic competence and global self-esteem. School Psychology International, 10, 147–158. doi:10.1177/0143034389102009
2. H.Andrade, (2010). Students as the definitive source of formative assessment: Academic self-assessment and the self-regulation of learning. In H.Andrade & G.Cizek (Eds.), Handbook of formative assessment (pp. 90–105). New York, NY: Routledge.
3. H.L.Andrade,, Y.Du,, & K.Mycek, (2010). Rubric-referenced self-assessment and middle school students’ writing. Assessment in Education: Principles, Policy & Practice, 17, 199–214. doi:10.1080/09695941003696172
4. H.L.Andrade,, Y.Du,, & X.Wang, (2008). Putting rubrics to the test: The effect of a model, criteria generation, and rubric-referenced self-assessment on elementary school students’ writing. Educational Measurement: Issues and Practice, 27, 3–13. doi:10.1111/j.1745-3992.2008.00118.x
5. H.Andrade,, & A.Valtcheva, (2009). Promoting learning and achievement through self-assessment. Theory into Practice, 48, 12–19.10.1080/00405840802577544
6. J.Barling, (1980). A multistage multidependent variable assessment of children’s self-regulation of academic performance. Child Behavior Therapy, 2, 43–54.10.1300/J473V02N02_03
7. J.E.Barnett,, & J.E.Hixon, (1997). Effects of grade level and subject on student test score predictions. The Journal of Educational Research, 90, 170–174.10.1080/00220671.1997.10543773
8. R.Birnbaum, (1972). Factors associated with the accuracy of self-reported high-school grades. Psychology in the Schools, 9, 364–370. doi:10.1002/1520-6807%28197210%299:4%3C364:AID-PITS2310090404%3E3.0.CO;2-G
9. P.Blatchford, (1997a). Pupils’ self assessments of academic attainment at 7, 11 and 16 years: Effects of sex and ethnic group. British Journal of Educational Psychology, 67, 169–184.10.1111/bjep.1997.67.issue-2
10. P.Blatchford, (1997b). Students’ self assessment of academic attainment: Accuracy and stability from 7 to 16 years and influence of domain and social comparison group. Educational Psychology, 17, 345–359. doi:10.1080/0144341970170308
11. L.Bol,, & D.J.Hacker, (2012). Calibration research: Where do we go from here? Frontiers in Psychology, 3, doi:10.3389/fpsyg.2012.00229
12. B.K.Bradshaw, (2001). Do students effectively monitor their comprehension? Reading Horizons, 41, 143–154.
13. R.L.Brennan, (2001). Generalizability theory. New York, NY: Springer.10.1007/978-1-4757-3456-0
14. S.M.Brookhart, (2013). How to create and use rubrics for formative assessment and grading. Alexandria, VA: Association for Supervision & Curriculum Development.
15. S.M.Brookhart,, M.Andolina,, M.Zuza,, & R.Furman, (2004). Minute math: An action research study of student self-assessment. Educational Studies in Mathematics, 57, 213–227.10.1023/B:EDUC.0000049293.55249.d4
16. V.Brooks, (2002). Assessment in secondary schools: The new teacher’s guide to monitoring, assessment, recording, reporting and accountability. Buckingham: Open University Press.
17. G.T.L.Brown,, & L.R.Harris, (2013). Student self-assessment. In J.H.McMillan (Ed.), The Sage handbook of research on classroom assessment (pp. 367–393). Thousand Oaks, CA: Sage.10.4135/9781452218649
18. G.T.L.Brown,, & L.R.Harris, (2014). The future of self-assessment in classroom practice: Reframing self-assessment as a core competency. Frontline Learning Research, 2, 22–30. doi:10.14786/flr.v2i1.24
19. G.T.L.Brown,, & Z.Wang, (2013). Illustrating assessment: How Hong Kong university students conceive of the purposes of assessment. Studies in Higher Education, 38, 1037–1057. doi:10.1080/03075079.2011.616955
20. R.Butler, (1990). The effects of mastery and competitive conditions on self-assessment at different ages. Child Development, 61, 201–21010.2307/1131059.
21. R.Butler, (2011). Are positive illusions about academic competence always adaptive, under all circumstances: New results and future directions. International Journal of Educational Research, 50, 251–256. doi:10.1016/j.ijer.2011.08.006
22. M.Claes,, & R.Salame, (1975). Motivation toward accomplishment and the self-evaluation of performances in relation to school achievement. Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement, 7, 397–410. doi:10.1037/h0081924
23. J.P.Connell,, & B.C.Ilardi, (1987). Self-system concomitants of discrepancies between children’s and teachers' evaluations of academic competence. Child Development, 58, 1297–1307. doi:10.2307/1130622
24. B.Cowie, (2009). My teacher and my friends helped me learn: Student perceptions and experiences of classroom assessment. In D.M.McInerney, G.T.L.Brown, & G.A.D.Liem (Eds.), Student perspectives on assessment: What students can tell us about assessment for learning (pp. 85–105). Charlotte, NC: Information Age.
25. D.Dalton,, & M.Ortegren, (2011). Gender differences in ethics research: The importance of controlling for the social desirability response bias. Journal of Business Ethics, 103, 73–93. doi:10.1007/s10551-011-0843-8
26. D.Dunning,, C.Heath,, & J.M.Suls, (2004). Flawed self-assessment: Implications for health, education, and the workplace. Psychological Science in the Public Interest, 5, 69–106.10.1111/j.1529-1006.2004.00018.x
27. J.Eccles,, A.Wigfield,, R.D.Harold,, & P.Blumenfeld, (1993). Age and gender differences in children’s self- and task perceptions during elementary school. Child Development, 64, 830–847.10.2307/1131221
28. S.E.Embretson,, & S.P.Reise, (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
29. N.Epley,, & T.Gilovich, (2005). When effortful thinking influences judgmental anchoring: Differential effects of forewarning and incentives on self-generated and externally provided anchors. Journal of Behavioral Decision Making, 18, 199–212.10.1002/(ISSN)1099-0771
30. N.Falchikov, (2005). Improving assessment through student involvement: Practical solutions for aiding learning in higher and further education. London: Routledge Falmer.
31. N.Falchikov,, & D.Boud, (1989). Student self-assessment in higher education: A meta-analysis. Review of Educational Research, 59, 395–430.10.3102/00346543059004395
32. K.S.Frey,, & D.N.Ruble, (1987). What children say about classroom performance: Sex and grade differences in perceived competence. Child Development, 58, 1066–1078.10.2307/1130547
33. D.J.Hacker,, L.Bol,, & K.Bahbahani, (2008). Explaining calibration accuracy in classroom contexts: The effects of incentives, reflection, and explanatory style. Metacognition and Learning, 3, 101–121.10.1007/s11409-008-9021-5
34. D.Hacker,, L.Bol,, D.Horgan,, & E.Rakow, (2000). Test prediction and performance in a classroom context. Journal of Educational Psychology, 92, 160–170.10.1037/0022-0663.92.1.160
35. E.H.Haertel, (2006). Reliability. In R.L.Brennan (Ed.), Educational measurement (4th ed., pp. 65–110). Westport, CT: Praeger.
36. L.R.Harris,, & G.T.L.Brown, (2013). Opportunities and obstacles to consider when using peer- and self-assessment to improve student learning: Case studies into teachers’ implementation. Teaching and Teacher Education, 36, 101–111. doi:10.1016/j.tate.2013.07.008
37. L.R.Harris,, J.Harnett,, & G.T.L.Brown, (2009). “Drawing” out student conceptions of assessment: Using pupils’ pictures to examine their conceptions of assessment. In D.M.McInerney, G.T.L.Brown, & G.A.D.Liem (Eds.), Student perspectives on assessment: What students can tell us about assessment for learning (pp. 53–83). Charlotte, NC: Information Age.
38. J.Hattie,, & R.Peddie, (2003). School reports: ‘Praising with faint damns’. Set: Research Information for Teachers, (3), 4–9.
39. S.A.Heldsinger,, & S.M.Humphry, (2013). Using calibrated exemplars in the teacher-assessment of writing: An empirical study. Educational Research, 55, 219–235.10.1080/00131881.2013.825159
40. M.P.Hewitt, (2001). The effects of modeling, self-evaluation, and self-listening on junior high instrumentalists’ music performance and practice attitude. Journal of Research in Music Education, 49, 307–322. doi:10.2307/3345614
41. M.P.Hewitt, (2005). Self-evaluation accuracy among high school and middle school instrumentalists. Journal of Research in Music Education, 53, 148–161.10.1177/002242940505300205
42. K.M.Higgins,, N.A.Harris,, & L.L.Kuehn, (1994). Placing assessment into the hands of young children: A study of student-generated criteria and self-assessment. Educational Assessment, 2, 309–324. doi:10.1207/s15326977ea0204_3
43. C.B.Ikeguchi, (1996). Self assessment and ESL competence of Japanese returnees. Retrieved from http://eric.ed.gov/PDFS/ED399798.pdf
44. J.N.Kaderavek,, R.B.Gillam,, T.A.Ukrainetz,, L.M.Justice,, & S.N.Eisenberg, (2004). School-age children’s self-assessment of oral narrative production. Communication Disorders Quarterly, 26, 37–48. doi:10.1177/15257401040260010401
45. M.T.Kane, (2006). Validation. In R.L.Brennan (Ed.), Educational measurement (4th ed., pp. 17–64). Westport, CT: Praeger.
46. K.Kasanen,, & H.Räty, (2002). ‘You be sure now to be honest in your assessment’: Teaching and learning self-assessment. Social Psychology of Education, 5, 313–328. doi:10.1023/A:1020993427849
47. K.Kasanen,, H.Räty,, & A.-L.Eklund, (2009). Elementary school pupils’ evaluations of the malleability of their academic abilities. Educational Research, 51, 27–38.10.1080/00131880802704699
48. N.Kirby,, & C.Downs, (2007). Self‐assessment and the disadvantaged student: Potential for encouraging self‐regulated learning? Assessment and Evaluation in Higher Education, 32, 475–494.10.1080/02602930600896464
49. N.R.Kuncel,, M.Credé,, & L.L.Thomas, (2005). The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research, 75, 63–82.10.3102/00346543075001063
50. D.C.Kwok,, & D.W.Lai, (1993, May). The self-perception of competence by Canadian and Chinese children. Paper presented at the annual convention of the Canadian Psychological Association, Montreal, QC.
51. D.Laveault,, & C.Miles, (2002, April). The study of individual differences in the utility and validity of rubrics in the learning of writing ability. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
52. J.C.LaVoie,, & A.F.Hodapp, (1987). Children’s subjective ratings of their performance on a standardized achievement test. Journal of School Psychology, 25, 73–80. doi:10.1016/0022-4405%2887%2990062-8
53. S.Leahy,, C.Lyon,, M.Thompson,, & D.Wiliam, (2005). Classroom assessment minute by minute, day by day. Educational Leadership, 63(3), 18–24.
54. M.Lew,, W.Alwis,, & G.Schmidt, (2010). Accuracy of students’ self-assessment and their beliefs about its utility. Assessment & Evaluation in Higher Education, 35, 135–156.
55. A.Lipnevich,, & J.Smith, (2008). Response to assessment feedback: The effects of grades, praise, and source of information (Research Report RR-08-30). Princeton, NJ: Educational Testing Service.
56. R.Lopez,, & S.Kossack, (2007). Effects of recurring use of self-assessment in university courses. International Journal of Learning, 14, 203–216.
57. H.Luyten,, & D.Dolkar, (2010). School-based assessments in high-stakes examinations in Bhutan: A question of trust? Exploring inconsistencies between external exam scores, school-based assessments, detailed teacher ratings, and student self-ratings. Educational Research and Evaluation, 16, 421–435.10.1080/13803611.2010.530437
58. R.H.Maki,, M.Shields,, A.E.Wheeler,, & T.L.Zacchilli, (2005). Individual differences in absolute and relative metacomprehension accuracy. Journal of Educational Psychology, 97, 723–731.10.1037/0022-0663.97.4.723
59. S.Messick, (1989). Validity. In R.L.Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York, NY: Macmillan.
60. T.L.Miller,, S.E.Duffy,, & T.Zane, (1993). Improving the accuracy of self-corrected mathematics homework. The Journal of Educational Research, 86, 184–189.10.1080/00220671.1993.9941157
61. T.M.Miller,, & L.Geraci, (2011). Training metacognition in the classroom: The influence of incentives and feedback on exam predictions. Metacognition and Learning, 6, 303–314. doi:10.1007/s11409-011-9083-7
62. J.R.Ng,, & J.K.Earl, (2008). Accuracy in self-assessment: The role of ability, feedback, self-efficacy and goal orientation. Australian Journal of Career Development, 17, 39–50.10.1177/103841620801700307
63. J.L.Nietfeld,, L.Cao,, & J.W.Osborne, (2005). Metacognitive monitoring accuracy and student performance in the postsecondary classroom. The Journal of Experimental Education, 74, 7–28.
64. D.L.Paulhus, (1991). Measurement and control of response bias. In J.Robinson, P.Shaver, & L.Wrightsman (Eds.), Measures of personality and social psychological attitudes (Vol. 1, pp. 17–59). New York, NY: Academic Press.10.1016/B978-0-12-590241-0.50006-X
65. M.B.Raider-Roth, (2005). Trusting what you know: Negotiating the relational context of classroom life. Teachers College Record, 107, 587–628.
66. D.Ramdass,, & B.J.Zimmerman, (2008). Effects of self-correction strategy training on middle school students’ self-efficacy, self-evaluation, and mathematics division learning. Journal of Advanced Academics, 20, 18–41.
67. J.Ross, A. (2006). The reliability, validity, and utility of self-assessment. Practical Assessment Research & Evaluation, 11(10), 1–13. Retrieved from http://pareonline.net/getvn.asp?v=11&n=10
68. J.A.Ross,, A.Hogaboam-Gray,, & C.Rolheiser, (2002). Student self-evaluation in grade 5–6 mathematics effects on problem-solving achievement. Educational Assessment, 8, 43–58.10.1207/S15326977EA0801_03
69. J.A.Ross,, C.Rolheiser,, & A.Hogaboam-Gray, (1998a, April). Impact of self-evaluation training on mathematics achievement in a cooperative learning environment. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
70. J.A.Ross,, C.Rolheiser,, & A.Hogaboam-Gray, (1998b). Skills training versus action research in-service: Impact on student attitudes to self-evaluation. Teaching and Teacher Education, 14, 463–477.10.1016/S0742-051X(97)00054-1
71. J.A.Ross,, C.Rolheiser,, & A.Hogaboam-Gray, (2002). Influences on student cognitions about evaluation. Assessment in Education: Principles, Policy & Practice, 9, 81–95.
72. R.Saavedra,, & S.K.Kwun, (1993). Peer evaluation in self-managing work groups. Journal of Applied Psychology, 78, 450–462. doi:10.1037/0021-9010.78.3.450
73. P.M.Sadler,, & E.Good, (2006). The impact of self- and peer-grading on student learning. Educational Assessment, 11, 1–31.10.1207/s15326977ea1101_1
74. D.H.Schunk,, & F.Pajares, (2004). Self-efficacy in education revisited: Empirical and applied evidence. In D.M.McInerney & S.van Etten (Eds.), Big theories revisited (pp. 115–138). Greenwich, CT: Information Age.
75. D.J.Stipek, (1981). Children’s perceptions of their own and their classmates’ ability. Journal of Educational Psychology, 73, 404–410. doi:10.1037/0022-0663.73.3.404
76. D.J.Stipek,, & L.M.Tannatt, (1984). Children’s judgments of their own and their peers’ academic competence. Journal of Educational Psychology, 76, 75–84. doi:10.1037/0022-0663.76.1.75
77. Y.-T.Sung,, K.-E.Chang,, T.-H.Chang,, & W.-C.Yu, (2010). How many heads are better than one? The reliability and validity of teenagers’ self- and peer assessments. Journal of Adolescence, 33, 135–145. doi:10.1016/j.adolescence.2009.04.004
78. R.Tierney, (2010). Fairness in classroom assessment. In H.Andrade & G.Cizek (Eds.), Handbook of formative assessment (pp. 125–144). New York, NY: Routledge.
79. S.M.Wall, (1982). Effects of systematic self-monitoring and self-reinforcement in children’s management of test performances. The Journal of Psychology, 111, 129–136.10.1080/00223980.1982.9923524
80. J.Wilson,, & C.R.Wright, (1993). The predictive validity of student self-evaluations, teachers’ assessments, and grades for performance on the verbal reasoning and numerical ability scales of the differential aptitude test for a sample of secondary school students attending rural Appalachia schools. Educational and Psychological Measurement, 53, 259–270. doi:10.1177/0013164493053001029