Reactivity to confidence ratings in older individuals performing the latin square task

Metacognition and Learning

Volumn 13, Issue 3, 2018, Pages 309-326

  Double, Kit S ^a,b   Birney, Damian P ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Confidence ratings; Decision making; Metacognition; Problem solving; Reactivity

Indexed keywords

EID: 85058778867     PISSN: 15561623     EISSN: 15561631     Source Type: Journal    
DOI: 10.1007/s11409-018-9186-5     Document Type: Article

References (62)

1. Ackerman, R. A. (2014). The diminishing criterion model for metacognitive regulation of time investment. Journal of Experimental Psychology: General, 143(3), 1349–1368
2. Ackerman, R. A., & Thompson, V. (2015). Meta-Reasoning: What can we learn from meta-memory. In A. Feeney & V. Thompson (Eds.), Reasoning as Memory (pp. 164–178). Hove, UK: Psychology Press
3. Aurah, C. M. (2014). The influence of self-efficacy beliefs and metacognitive prompting on genetics problem solving ability among high school students in Kenya. Dissertation Abstracts International Section A: Humanities and Social Sciences, 74(9-a(E)), No pagination specified
4. Bannert, M., & Mengelkamp, C. (2008). Assessment of metacognitive skills by means of instruction to think aloud and reflect when prompted. Does the verbalisation method affect learning? Metacognition and Learning, 3(1), 39–58
5. Bannert, M., & Reimann, P. (2012). Supporting self-regulated hypermedia learning through prompts. Instructional Science, 40(1), 193–211
6. Bauer, D. J., & Curran, P. J. (2005). Probing interactions in fixed and multilevel regression: Inferential and graphical techniques. Multivariate Behavioral Research, 40(3), 373–400
7. Birney, D. P., Beckmann, J., Beckmann, N., & Double, K. S. (2017). Beyond the intellect: Complexity and learning trajectories in Raven’s progressive matrices depend on self-regulatory processes and conative dispositions. Intelligence, 61, 63–77
8. Birney, D. P., Bowman, D. B., Beckmann, J. F., & Seah, Y. Z. (2012). Assessment of processing capacity: Reasoning in latin square tasks in a population of managers. European Journal of Psychological Assessment, 28(3), 216–226
9. Birney, D. P., Halford, G. S., & Andrews, G. (2006). Measuring the influence of complexity on relational reasoning the development of the Latin Square task. Educational and Psychological Measurement, 66(1), 146–171
10. Button, S. B., Mathieu, J. E., & Zajac, D. M. (1996). Goal orientation in organizational research: A conceptual and empirical foundation. Organizational Behavior and Human Decision Processes, 67(1), 26–48
11. Carver, C. S., & Scheier, M. F. (2000). On the structure of behavioral self-regulation. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 41–84). San Diego, CA: Academic Press
12. Carver, C. S., & Scheier, M. F. (2001). On the self-regulation of behavior. Cambridge, UK: Cambridge University Press
13. Castel, A., Middlebrooks, C., & McGillivray, S. (2015). Monitoring memory in old age: Impaired, spared, and aware. In J. Dunlosky & S. K. Tauber (Eds.), The Oxford handbook of Metamemory (pp. 463–483). NY: Oxford University Press
14. Chen, C.-H. K. (2007). Prompting students' knowledge integration and ill-structured problem solving in a web-based learning environment. Dissertation Abstracts International Section A: Humanities and Social Sciences, 67(10-A), 3709
15. Dickinson, E. R., Adelson, J. L., & Owen, J. (2012). Gender balance, representativeness, and statistical power in sexuality research using undergraduate student samples. Archives of Sexual Behavior, 41(2), 325–327. 10.1007/s10508-011-9887-1
16. Double, K. S., & Birney, D. P. (2017a). Are you sure about that? Eliciting confidence ratings may influence performance on Raven's progressive matrices. Thinking & Reasoning, 23(2), 190–206
17. Double, K. S., & Birney, D. P. (2017b). The interplay between self-evaluation, goal orientation, and self-efficacy on performance and Learning Paper presented at the Proceedings of the 39th Annual Conference of the Cognitive Science Society, London, England
18. Double, K.S., & Birney, D.P. (in press). Do confidence ratings prime confidence? Psychonomic Bulletin & Review
19. Double, K. S., Birney, D. P., & Walker, S. A. (2018). A meta-analysis and systematic review of reactivity to judgements of learning. Memory, 26(6), 741–750
20. Dunning, D. (2011). The Dunning-Kruger effect: On being ignorant of one's own ignorance. Advances in Experimental Social Psychology, 44, 247
21. Dunning, D., Johnson, K., Ehrlinger, J., & Kruger, J. (2003). Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83–87
22. Efklides, A. (2011). Interactions of metacognition with motivation and affect in self-regulated learning: The MASRL model. Educational Psychologist, 46(1), 6–25
23. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, mass. MIT Press
24. Fleming, S. M., & Lau, H. C. (2014). How to measure metacognition. Frontiers in Human Neuroscience, 8(July)
25. Fox, M. C., & Charness, N. (2010). How to gain eleven IQ points in ten minutes: Thinking aloud improves Raven's matrices performance in older adults. Aging, Neuropsychology, and Cognition, 17(2), 191–204
26. Fox, M. C., Ericsson, K. A., & Best, R. (2011). Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychological Bulletin, 137(2), 316–344
27. Garrison, S. J. (1997). Influence of metacognitive prompting on learning within computer mediated problem sets. Dissertation Abstracts International Section A: Humanities and Social Sciences, 57(8-A), 3390
28. Harris, F. C., & Lahey, B. B. (1982). Subject reactivity in direct observational assessment: A review and critical analysis. Clinical Psychology Review, 2(4), 523–538
29. Hertzog, C. (2016). Aging and metacognitive control. In J. Dunlosky & S. K. Tauber (Eds.), The Oxford handbook of Metamemory. NY: Oxford University Press
30. Inquisit. (2016). Inquisit 5 (Version 5.04). Retrieved from http://www.millisecond.com
31. Jackson, S. A. (2016). Greater response cardinality indirectly reduces confidence. Journal of Cognitive Psychology, 28(4), 496–504
32. Janes, J. L., Rivers, M. L., & Dunlosky, J. (2018). The influence of making judgments of learning on memory performance: Positive, negative, or both? Psychonomic Bulletin & Review., 25, 2356–2364. 10.3758/s13423-018-1463-4
33. Justice, E. M., & Dornan, T. M. (2001). Metacognitive differences between traditional-age and nontraditional-age college students. Adult Education Quarterly, 51(3), 236–249. 10.1177/074171360105100305
34. Kelemen, W. L., & Weaver, C. A., III. (1997). Enhanced memory at delays: Why do judgments of learning improve over time? Journal of Experimental Psychology: Learning, Memory, and Cognition, 23(6), 1394–1409
35. Koriat, A., Bjork, R. A., Sheffer, L., & Bar, S. K. (2004). Predicting one's own forgetting: The role of experience-based and theory-based processes. Journal of Experimental Psychology: General, 133(4), 643–656
36. Koriat, A., Nussinson, R., Bless, H., & Shaked, N. (2008). Information-based and experience-based metacognitive judgments: Evidence from subjective confidence. A handbook of memory and metamemory, 117–136
37. Leow, R. P., & Morgan-Short, K. (2004). To think aloud or not to think aloud: The issue of reactivity in SLA research methodology. Studies in Second Language Acquisition, 26(01), 35–57
38. Lundeberg, M. A., Fox, P. W., & Punćcohaŕ, J. (1994). Highly confident but wrong: Gender differences and similarities in confidence judgments. Journal of Educational Psychology, 86(1), 114–121
39. McDaniel, M. A., Einstein, G. O., & Jacoby, L. L. (2008). New considerations in aging and memory: The glass may be half full. In F. I. M. Craik & T. Salthouse (Eds.), The handbook of aging and cognition (3 ed., pp. 255–310). Hove, England: Psychology Press
40. Mitchum, A. L., Kelley, C. M., & Fox, M. C. (2016). When asking the question changes the ultimate answer: Metamemory judgments change memory. Journal of Experimental Psychology: General, 145(2), 200–219
41. Nelson, T. O. (1996). Consciousness and metacognition. American Psychologist, 51(2), 102–116
42. Nelson, T. O., & Narens, L. (1994). Why investigate metacognition? In Metacognition: Knowing about knowing (pp. 1–25). Cambridge, MA, US: The MIT Press
43. Palmer, E. C., David, A. S., & Fleming, S. M. (2014). Effects of age on metacognitive efficiency. Consciousness and Cognition, 28, 151–160. 10.1016/j.concog.2014.06.007
44. Pulford, B. D., & Colman, A. M. (1997). Overconfidence: Feedback and item difficulty effects. Personality and Individual Differences, 23(1), 125–133
45. R Core Team. (2017). R: A language and environment for statistical computing (version 3.2.1) [computer software]. Vienna, Austria R Foundation for Statistical Computing. Retrieved from www.R-project.org/
46. Schraw, G. (2009). A conceptual analysis of five measures of metacognitive monitoring. Metacognition and Learning, 4(1), 33–45
47. Silvia, P. J., & Duval, T. S. (2001). Objective self-awareness theory: Recent progress and enduring problems. Personality and Social Psychology Review, 5(3), 230–241
48. Soderstrom, N. C., Clark, C. T., Halamish, V., & Bjork, E. L. (2015). Judgments of learning as memory modifiers. Journal of Experimental Psychology: Learning, Memory, and Cognition, 41(2), 553
49. Soderstrom, N. C., McCabe, D. P., & Rhodes, M. G. (2012). Older adults predict more recollective experiences than younger adults. Psychology and Aging, 27(4), 1082–1088
50. Stankov, L. (2000). Complexity, metacognition, and fluid intelligence. Intelligence, 28(2), 121–143
51. Stankov, L. (2013). Noncognitive predictors of intelligence and academic achievement: An important role of confidence. Personality and Individual Differences, 55(7), 727–732
52. Stankov, L., & Crawford, J. D. (1997). Self-confidence and performance on tests of cognitive abilities. Intelligence, 25(2), 93–109
53. Stankov, L., & Lee, J. (2008). Confidence and cognitive test performance. Journal of Educational Psychology, 100(4), 961–976
54. Stankov, L., Lee, J., Luo, W., & Hogan, D. J. (2012). Confidence: A better predictor of academic achievement than self-efficacy, self-concept and anxiety? Learning and Individual Differences, 22(6), 747–758
55. Stankov, L., Morony, S., & Lee, Y. P. (2014). Confidence: The best non-cognitive predictor of academic achievement? Educational Psychology, 34(1), 9–28
56. Tauber, S. K., & Rhodes, M. G. (2012). Measuring memory monitoring with judgements of retention (JORs). The Quarterly Journal of Experimental Psychology, 65(7), 1376–1396
57. Veenman, M. V., Van Hout-Wolters, B. H., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3–14
58. Wickham, H. (2009). ggplot2: Elegant graphics for data analysis. New York, NY: Springer-Verlag
59. Witherby, A. E., & Tauber, S. K. (2017). The influence of judgments of learning on long-term learning and short-term performance. Journal of Applied Research in Memory and Cognition, The Influence of Judgments of Learning on Long-Term Learning and Short-Term Performance
60. Yeung, N., & Summerfield, C. (2012). Metacognition in human decision-making: Confidence and error monitoring. Phil. Trans. R. Soc. B, 367(1594), 1310–1321
61. Yeung, N., & Summerfield, C. (2014). Shared mechanisms for confidence judgements and error detection in human decision making. In The cognitive neuroscience of metacognition (pp. 147–167). New York, NY: Springer-Verlag Publishing; US
62. Zimmerman, B. J. (1998). Academic studing and the development of personal skill: A self-regulatory perspective. Educational Psychologist, 33(2–3), 73–86