Test framing generates a stability bias for predictions of learning by causing people to discount their learning beliefs

Journal of Memory and Language

Volumn 75, Issue , 2014, Pages 181-198

  Ariel, Robert ^a   Hines, Jarrod C ^a   Hertzog, Christopher ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Framing; Metacognition; Metamemory; Monitoring; Stability bias

Indexed keywords

EID: 84903383406     PISSN: 0749596X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jml.2014.06.003     Document Type: Article

References (63)

1. Abelson R.P. Statistics as principled argument 1995, Lawrence Erlbaum Associates, Hillsdale, NJ.
2. Ariel R., Dunlosky J. The sensitivity of judgment-of-learning resolution to past test performance, new learning, and forgetting. Memory & Cognition 2011, 39:171-184.
3. Bellamy N., Campbell J., Syrotuik J. Comparative study of self-rating pain scales in osteoarthritis patients. Current Medical Research & Opinion 1999, 15:113-119.
4. Borkowski J., Carr M., Pressley M. "Spontaneous" strategy use: Perspectives from metacognitive theory. Intelligence 1987, 11:61-75.
5. Brennan S.E., Williams M. The feeling of another's knowing: Prosody and filled pauses as cues to listeners about the metacognitive states of speakers. Journal of Memory and Language 1995, 34:383-398.
6. Brunier G., Graydon J. A comparison of two methods of measuring fatigue in patients on chronic haemodialysis: Visual analogue vs. Likert scale. International Journal of Nursing Studies 1996, 33:338-348.
7. Carroll M., Nelson T.O. Effect of overlearning on the feeling of knowing is more detectable in within-subject than in between-subject designs. The American Journal of Psychology 1993, 227-235.
8. Castel A.D. Metacognition and learning about primacy and recency effects in free recall: The utilization of intrinsic and extrinsic cues when making judgments of learning. Memory & Cognition 2008, 36:429-437.
9. Cavanaugh J.C., Feldman J., Hertzog C. Memory beliefs as social cognition: A reconceptualization of what memory questionnaires assess. Review of General Psychology 1998, 2:48-65.
10. Connor L.T., Dunlosky J., Hertzog C. Age-related differences in absolute but not relative metamemory accuracy. Psychology and Aging 1997, 12:50-71.
11. Dunlosky, J., & Ariel, R. (2011). Self-regulated learning and the allocation of study time. In B. Ross (Eds.), Psychology of learning and motivation (Vol. 54, pp. 103-140).
12. Dunlosky J., Hertzog C. Updating knowledge about encoding strategies: A componential analysis of learning about strategy effectiveness from task experience. Psychology and Aging 2000, 15:462-474.
13. Dweck C.S., Leggett E.L. A social-cognitive approach to motivation and personality. Psychological Review 1988, 95:256-273.
14. England B.D., Serra M.J. The contributions of anchoring and past-test performance to the underconfidence-with-practice effect. Psychonomic Bulletin & Review 2012, 19:715-722.
15. Epley N., Gilovich T. The anchoring-and-adjustment heuristic: Why the adjustments are insufficient. Psychological Science 2006, 17:311-318.
16. Erev I., Wallstern T.S., Budescu D. Simultaneous overconfidence and underconfidence: The role of error in judgment processes. Psychological Review 1994, 101:519-527.
17. Finn B. Framing effects on metacognitive monitoring and control. Memory & Cognition 2008, 36:813-821.
18. Gu H.B., Wallsten T.S. On setting response criteria for calibrated subjective probability estimates. Journal of Mathematical Psychology 2001, 45:551-563.
19. Guilford J.P. Psychometric theory 1954, McGraw-Hill, New York, NY.
20. Halamish V., McGillivray S., Castel A.D. Monitoring one's own forgetting in younger and older adults. Psychology and Aging 2011, 26:631-635.
21. Hanczakowski M., Zawadzka K., Pasek T., Higham P.A. Calibration of metacognitive judgments: Insights from the underconfidence-with-practice effect. Journal of Memory and Language 2013, 69:429-444.
22. Hartwig M.K., Dunlosky J. Study strategies of college students: Are self-testing and scheduling related to achievement?. Psychonomic Bulletin & Review 2012, 19:126-134.
23. Hertzog C. Repeated measures analysis in developmental research: What our ANOVA text didn't tell us. Life-span developmental psychology: Methodological contributions 1994, 187-222. Erlbaum, New York. S.H. Cohen, H.W. Reese (Eds.).
24. Hertzog C., Dixon R.A., Hultsch D.F. Relationships between metamemory, memory predictions, and memory task performance in adults. Psychology and Aging 1990, 5:215-227.
25. Hertzog C., Hines J.C., Touron D.R. Judgments of learning are influenced by multiple cues in addition to memory for past test accuracy. Archives of Scientific Psychology 2013, 1:23-32.
26. Hertzog C., Price J., Burpee A., Frentzel B.J., Feldstein S., Dunlosky J. Why do people show minimal knowledge updating with task experience: Inferential deficit or experimental artifact?. Quarterly Journal of Experimental Psychology 2009, 62:155-173.
27. Hertzog C., Price J., Dunlosky J. How is knowledge generated about memory encoding strategy effectiveness?. Learning and Individual Differences 2008, 18:430-445.
28. Hessen E. Rehearsal significantly improves immediate and delayed recall on the rey auditory verbal learning test. Applied Neuropsychology 2011, 18:263-268.
29. Higgins E.T. Beyond pleasure and pain. American Psychologist 1997, 52:1280-1300.
30. Jameson A., Nelson T.O., Leonesio R.J., Narens L. The feeling of another person's knowing. Journal of Memory and Language 1993, 32:320-335.
31. Karpicke J.D., Butler A.C., Roediger H.L. Metacognitive strategies in student learning: Do students practice retrieval when they study on their own?. Memory 2009, 17:471-479.
32. Karpicke J.D., Roediger H.L. The critical importance of retrieval for learning. Science 2008, 319:966-968.
33. Keren G. Calibration and probability judgments: Conceptual and methodological issues. Acta Psychologica 1991, 77:217-273.
34. Koriat A. Monitoring one's own knowledge during study. A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General 1997, 126:349-370.
35. Koriat A., Bjork R.A., Sheffer L., Bar S.K. Predicting one's own forgetting: The role of experience-based and theory-based processes. Journal of Experimental Psychology: General 2004, 133:643-656.
36. Kornell N., Bjork R.A. A stability bias in human memory: Overestimating remembering and underestimating learning. Journal of Experimental Psychology: General 2009, 138:449-468.
37. Kornell N., Bjork R.A. The promise and perils of self-regulated study. Psychonomic Bulletin & Review 2007, 6:219-224.
38. Kornell N., Rhodes M.G., Castel A.D., Tauber S.K. The ease-of-processing heuristic and the stability bias: Dissociating memory, memory beliefs, and memory judgments. Psychological Science 2011, 22:787-794.
39. Kornell N., Son L.K. Learners' choices and beliefs about self-testing. Memory 2009, 17:493-501.
40. Lineweaver T.T., Hertzog C. Adults' efficacy and control beliefs regarding memory and aging: Separating general from personal beliefs. Aging, Neuropsychology, and Cognition 1998, 5:264-296.
41. Matvey G., Dunlosky J., Guttentag R. Fluency of retrieval at study affects judgments of learning (JOLs): An analytic or nonanalytic basis for JOLs?. Memory & Cognition 2001, 29:222-232.
42. Mueller M.L., Dunlosky J., Tauber S.K., Rhodes M.G. The font-size effect on judgments of learning: Does it exemplify fluency effects or reflect people's beliefs about memory?. Journal of Memory and Language 2014, 70:1-12.
43. Mueller M.L., Tauber S.K., Dunlosky J. Contributions of beliefs and processing fluency to the effect of relatedness on judgments of learning. Psychonomic Bulletin & Review 2013, 20:37-384.
44. Pintrich P.R. The role of goal orientation in self-regulated learning. Handbook of self-regulation 2000, 451-502. Academic Press, NY. M. Boekaerts, P.R. Pintrich, M. Zeidner (Eds.).
45. Price P.C., Yates J.F. Judgmental overshadowing: Further evidence of cue interaction in contingency judgment. Memory & Cognition 1993, 21:561-572.
46. Pyc M.A., Rawson K.A. Costs and benefits of dropout schedules of test-restudy practice: Implications for student learning. Applied Cognitive Psychology 2011, 25:87-95.
47. Reips U.D., Funke F. Interval-level measurement with visual analogue scales in Internet-based research: VAS Generator. Behavior Research Methods 2008, 40:699-704.
48. Rhodes M.G., Castel A.D. Memory predictions are influenced by perceptual information: Evidence for metacognitive illusions. Journal of Experimental Psychology: General 2008, 137:615-625.
49. Roediger H.L., Karpicke J.D. Test enhanced learning: Taking memory tests improves long-term retention. Psychological Science 2006, 17:249-255.
50. Ross M. Relation of implicit theories to the construction of personal histories. Psychological Review 1989, 96:341-357.
51. Scheck P., Meeter M., Nelson T.O. Anchoring effects in absolute accuracy of immediate versus delayed judgments of learning. Journal of Memory and Language 2004, 51:71-79.
52. Scheck P., Nelson T.O. Lack of pervasiveness of the underconfidence-with-practice effect: Boundary conditions and an explanation via anchoring. Journal of Experimental Psychology: General 2005, 134:124-128.
53. Schwartz N., Knauper B. Cognition, aging, and self-reports. Cognitive aging: A primer 1999, 233-252. Psychology Press. D. Park, N. Schwarz (Eds.).
54. Serra M.J., England B.D. Magnitude and accuracy differences between judgments of remembering and forgetting. The Quarterly Journal of Experimental Psychology 2012, 65:2231-2257.
55. Shaughnessy J.J. Memory monitoring accuracy and modification of rehearsal strategies. Journal of Verbal Learning and Verbal Behavior 1981, 20:216-230.
56. Tauber S.K., Rhodes M.G. Measuring memory monitoring with Judgments of Retention Interval (JOR). Quarterly Journal of Experimental Psychology 2012, 65:1376-1396.
57. Tauber S.K., Rhodes M.G. Multiple bases for young and older adults' judgments of learning in multitrial learning. Psychology and Aging 2012, 27:474-484.
58. Tullis J.G., Finley J.R., Benjamin A.S. Metacognition of the testing effect: Guiding learners to predict the benefits of retrieval. Memory & Cognition 2013, 41:429-442.
59. Tversky A., Kahneman D. Judgments under uncertainty: Heuristics and Biases. Science 1974, 185:1124-1131.
60. Vesonder G.T., Voss J.F. On the ability to predict one's own responses while learning. Journal of Memory and Language 1985, 24:363-376.
61. Winkielman P., Schwarz N., Belli R.F. The role of ease of retrieval and attribution in memory judgments: Judging your memory as worse despite recalling more events. Psychological Science 1998, 9:124-126.
62. Winne P.H., Hadwin A.F. Studying as self-regulated learning. Metacognition in educational theory and practice 1998, 277-304. LEA, Hillsdale, NJ. D.J. Hacker, J. Dunlosky, A.C. Graesser (Eds.).
63. Wissman K.T., Rawson K.A., Pyc M.A. How and when do students use flashcards?. Memory 2012, 20:568-579.