Understanding, assessing and enhancing student evaluative judgement in digital environments

Developing Evaluative Judgement in Higher Education: Assessment for Knowing and Producing Quality Work

Volumn , Issue , 2018, Pages 70-78

  Lodge, Jason M ^a,b   Kennedy, Gregor ^a,c   Hattie, John ^a,d  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b Learning Research Centre   (Australia)

^c UNIVERSITY OF MELBOURNE   (Australia)

^d UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85048798109     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781315109251     Document Type: Chapter

References (36)

1. Ackerman, R., and M. Goldsmith. 2011. “Metacognitive regulation of text learning: on screen versus on paper.” Journal of Experimental Psychology: Applied 17 (1): 18-32.
2. Adams Becker, S., M. Cummins, A. Davis and B. Yuhnke. 2016. 2016 NMC Technology Outlook for Australian Tertiary Education: A Horizon Project Regional Report. Austin, TX:The New Media Consortium.
3. Azevedo, R., J. Harley, G. Trevors, M. Duffy, R. Feyzi-Behnagh, F. Bouchet, and R. Landis. 2013. “Using trace data to examine the complex roles of cognitive, metacognitive, and emotional self-regulatory processes during learning with multi-agent systems.” In International Handbook on Metacognition and Learning Technologies, edited by R. Azevedo and V. Aleven, 427-449. New York: Springer.
4. Bjork, R. A., J. Dunlosky, and N. Kornell. 2013. “Self-regulated learning: beliefs, techniques, and illusions.” Annual Review of Psychology 64 (1): 417-444. doi:10.1146/annurev-psych-113011-143823.
5. Boud, D. 2000. “Sustainable assessment: rethinking assessment for the learning society.” Studies in Continuing Education 22 (2): 151-167. doi:10.1080/713695728.
6. Boud, D., and R. Soler. 2016. “Sustainable assessment revisited.” Assessment & Evaluation in Higher Education 41 (3): 400-413. doi:10.1080/02602938.2015.1018133.
7. Carpenter, S. K., M. M. Wilford, N. Kornell, and K. M. Mullaney. 2013. “Appearances can be deceiving: instructor fluency increases perceptions of learning without increasing actual learning.” Psychonomic Bulletin & Review 20: 1350-1356. doi:10.3758/s13423-013-0442-z.
8. Cassidy, S. 2007. “Assessing “inexperienced” students’ ability to self-assess: exploring links with learning style and academic personal control.” Assessment & Evaluation in Higher Education 32 (3): 313-330. doi:10.1080/02602930600896704.
9. Cowan, J. 2010. “Developing the ability for making evaluative judgements.” Teaching in Higher Education 15 (3): 323-334. doi:10.1080/13562510903560036.
10. Dalgarno, B., G. Kennedy, and S. Bennett. 2014. “The impact of students’ exploration strategies on discovery learning using computer-based simulations.” Educational Media International 51 (4): 310-329. doi:10.1080/09523987.2014.977009.
11. Finn, B., and S. K. Tauber. 2015. “When confidence is not a signal of knowing: how students’ experiences and beliefs about processing fluency can lead to miscalibrated confidence.” Educational Psychology Review 27 (4): 567-586.
12. Hattie, J. 2013. “Calibration and confidence: where to next?" Learning and Instruction 24 (C): 62-66. doi:10.1016/j.learninstruc.2012.05.009.
13. Hattie, J., and G. M. Donoghue. 2016. “Learning strategies: a synthesis and conceptual model.” npj Science of Learning. doi:10.1038/npjscilearn.2016.13.
14. Hmelo-Silver, C. E., and M. G. Pfeffer. 2004. “Comparing expert and novice understanding of a complex system from the perspective of structures, behaviors, and functions.” Cognitive Science 28 (1): 127-138.
15. Kennedy, G., and J. M. Lodge. 2016. “All roads lead to Rome: tracking students’ affect as they overcome misconceptions.” In Show Me the Learning. Proceedings ASCILITE 2016 Adelaide, edited by S. Barker, S. Dawson, A. Pardo, and C. Colvin, 318-328. Adelaide:University of South Australia.
16. Koriat, A., and R. A. Bjork. 2005. “Illusions of competence in monitoring one’s knowledge during study.” Journal of Experimental Psychology: Learning, Memory, and Cognition31 (2): 187-194. doi:10.1037/0278-7393.31.2.187.
17. Kruger, J., and D. Dunning. 1999. “Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments.” Journal of Personality and Social Psychology 77 (6): 1121-1134.
18. Kuncel, N. R., M. Crede, and L. L. Thomas. 2005. “The validity of self-reported grade point averages, class ranks, and test scores: a meta-analysis and review of the literature.” Review of Educational Research 75 (1): 63-82. doi:10.3102/00346543075001063.
19. Lodge, J. M., and G. E. Kennedy. 2015. “Prior knowledge, confidence and understanding in interactive tutorials and simulations.” In Globally Connected, Digitally Enabled. Proceedings ASCILITE 2015 Perth, edited by T. Reiners, B. R. von Konsky, D. Gibson, V. Chang, L. Irving, and K. Clarke, 178-188. Perth, Australia: Curtin University.
20. McCabe, J. 2011. “Metacognitive awareness of learning strategies in undergraduates.” Memory & Cognition 39 (3): 462-476.
21. Maki, R. H., M. Shields, A. E. Wheeler, and T. L. Zacchilli. 2005. “Individual differences in absolute and relative metacomprehension accuracy.” Journal of Educational Psychology97 (4): 723.
22. Mayer, R. E. 2004. “Should there be a three-strikes rule against pure discovery learning? The case for guided methods of instruction.” The American Psychologist 59 (1): 14-19. doi:10.1037/0003-066X.59.1.14.
23. Nelson, T. O., and L. Narens. 1990. “Metamemory: a theoretical framework and new findings.” The Psychology of Learning and Motivation, Advances in Research and Theory26: 125-173.
24. Nicol, D. J., and D. Macfarlane-Dick. 2006. “Formative assessment and self-regulated learning: a model and seven principles of good feedback practice.” Studies in Higher Education 31 (2): 199-218.
25. Rhodes, M. G. 2016. “Judgments of learning.” In The Oxford Handbook of Metamemory, edited by John Dunlosky and Sarah Tauber, Chapter 4. New York: Oxford University Press.
26. Sadler, D. R. 2009. “Transforming holistic assessment and grading into a vehicle for complex learning.” In Assessment, Learning and Judgement in Higher Education, edited by G. Joughin, 45-64. Dordrecht, The Netherlands: Springer.
27. Sadler, D. R. 2010. “Beyond feedback: developing student capability in complex appraisal.” Assessment & Evaluation in Higher Education 35 (5): 535-550. doi:10.1080/0260293090 3541015.
28. Sadler, R. 1989. “Formative assessment and the design of instructional systems.” Instructional Science 18: 119-144. doi:10.1007/BF00117714.
29. Shute, V. J. 2011. “Stealth assessment in computer-based games to support learning.” Computer Games and Instruction 55 (2): 503-524.
30. Soderstrom, N. C., and R. A. Bjork. 2015. “Learning versus performance: an integrative review.” Perspectives on Psychological Science 10 (2): 176-199. doi:10.1177/1745691 615569000.
31. Soderstrom, N. C., C. L. Yue, and E. L Bjork. 2016. “Metamemory and education.” In The Oxford Handbook of Metamemory, edited by J. Dunlosky and S. Tauber, Chapter 11. New York, NY: Oxford University Press.
32. Thompson, D. G. 2016. “Marks should not be the focus of assessment: but how can change be achieved?" Journal of Learning Analytics 3 (2): 193-212. doi:10.18608/jla.2016.32.9.
33. Timms, M., and J. M. Lodge. 2015. “Assessment in interactive learning environments.” In Australian Council for Education Research Conference 2015, edited by R. Leech, 45-53. Melbourne, Australia: ACER.
34. Uttl, B., C. A. White, and D. Wong Gonzalez. 2017. “Meta-analysis of faculty’s teaching effectiveness: student evaluation of teaching ratings and student learning are not related.” Studies in Educational Evaluation 54: 22-42. doi:10.1016/j.stueduc.2016.08.007.
35. VanLehn, K. 2015. “Regulative loops, step loops and task loops.” International Journal of Artificial Intelligence in Education 26 (1): 107-112. doi:10.1007/s40593-015-0056-x.
36. Van Loon, M. H., J. Dunlosky, T. van Gog, J. J. van Merriënboer, and A. B. de Bruin. 2015. “Refutations in science texts lead to hypercorrection of misconceptions held with high confidence.” Contemporary Educational Psychology 42: 39-48.