The Pretesting Effect: Do Unsuccessful Retrieval Attempts Enhance Learning?

Journal of Experimental Psychology: Applied

Volumn 15, Issue 3, 2009, Pages 243-257

  Richland, Lindsey E ^a   Kornell, Nate ^b   Kao, Liche Sean ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b WILLIAMS COLLEGE   (United States)

Author keywords

learning; memory; retrieval; testing

Indexed keywords

ADULT; ARTICLE; ATTENTION; COMPREHENSION; EDUCATION; FEMALE; HUMAN; LEARNING; MALE; MEMORY; METHODOLOGY; PHYSIOLOGY; PSYCHOLOGICAL ASPECT; READING; STATISTICS; STUDENT; TASK PERFORMANCE; TIME;

ADULT; ATTENTION; COMPREHENSION; EDUCATIONAL MEASUREMENT; FEMALE; HUMANS; LEARNING; MALE; MEMORY; READING; STUDENTS; TASK PERFORMANCE AND ANALYSIS; TIME FACTORS; YOUNG ADULT;

EID: 71049121081     PISSN: 1076898X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0016496     Document Type: Article

References (84)

1. Amrein A.L., and Berliner D.C. High-stakes testing, uncertainty, and student learning. Education Policy Analysis Archives 10 18 (2002). http://epaa.asu.edu/epaa/v10n18/ Retrieved from http://epaa.asu.edu/epaa/v10n18/
2. Anderson R.C., and Biddle W.B. On asking people questions about what they are reading. In: Bower G.H. (Ed). The psychology of learning and motivation 9 (1975), Academic Press, New York 89-132
3. Bjork R.A. Retrieval as a memory modifier. In: Solso R. (Ed). Information processing and cognition: The Loyola Symposium (1975), Erlbaum, Hillsdale, NJ 123-144
4. Bjork R.A. Retrieval practice and the maintenance of knowledge. In: Gruneberg M.M., Morris P.E., and Sykes R.N. (Eds). Practical aspects of memory II (1988), Wiley, London 396-401
5. Bjork R.A. Memory and metamemory considerations in the training of human beings. In: Metcalfe J., and Shimamura A. (Eds). Metacognition: Knowing about knowing (1994), MIT Press, Cambridge, MA 185-205
6. Black P., and Wiliam D. Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan 80 (1998) 139-144
7. Boekaerts M., Pintrich P.R., and Zeidner M. Handbook of self-regulation (2000), Academic Press, San Diego, CA
8. Bransford J.S., and Johnson M.K. Contextual prerequisites for understanding: Some investigations of comprehension and recall. Journal of Verbal Learning and Verbal Behavior 11 (1972) 717-726
9. Bransford J.S., and Schwartz D.L. Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education 24 (1999) 61-100
10. Butler A.C., Karpicke J.D., and Roediger III H.L. The effect of type and timing of feedback on learning from multiple-choice tests. Journal of Experimental Psychology: Applied 13 (2007) 273-281
11. Butler A.C., and Roediger III H.L. Testing improves long-term retention in a simulated classroom setting. European Journal of Cognitive Psychology 19 (2007) 514-527
12. Carpenter S.K., and DeLosh E.L. Application of the testing and spacing effects to name learning. Applied Cognitive Psychology 19 (2005) 619-636
13. Carrier M., and Pashler H. The influence of retrieval on retention. Memory & Cognition 20 (1992) 633-642
14. Craig S., Gholson B., Ventura M., Graesser A.C., and the Tutoring Research Group. Overhearing dialogues and monologues in a virtual tutoring session: Effects on questioning and vicarious learning. International Journal of Artificial Intelligence in Education 11 (2000) 242-253
15. Craig S.D., Sullins J., Witherspoon A., and Gholson B. The deep-level-reasoning-question effect: The role of dialogue and deep-level-reasoning questions during vicarious learning. Cognition and Instruction 24 (2006) 565-591
16. Craik F., and Lockhart R.S. Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior 11 (1972) 67-84
17. Davis D., and Loftus E.F. Internal and external sources of misinformation in adult witness memory. In: Toglia M.P., Read J.D., Ross D.F., and Lindsay R.C.L. (Eds). Handbook of eyewitness psychology (Vol. 1). Memory for events (2007), Erlbaum, Mahwah, NJ 195-237
18. Dempster F.N. Informing classroom practice: What we know about several task characteristics and their effects on learning. Contemporary Educational Psychology 13 (1988) 254-264
19. Ericsson K.A., Krampe R.T.H., and Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. Psychological Review 100 (1993) 363-406
20. Frase L.T. Effect of question location, pacing, and mode upon retention of prose material. Journal of Educational Psychology 59 (1968) 244-249
21. Frase L.T. Boundary conditions for mathemagenic behaviors. Review of Educational Research 40 (1970) 337-347
22. Garrison C., Jeung B., and Inclán-Rodríquez R. Meeting English language learners' needs under No Child Left Behind. Trends: Issues in Urban Education 21 (2006, March) 1-7
23. Gates A.I. Recitation as a factor in memorizing. Archives of Psychology 40 (1917) 104
24. Ghatala E.S. The effect of internal generation of information on memory performance. American Journal of Psychology 94 (1981) 443-450
25. Ghatala E.S. When does internal generation facilitate memory for sentences?. American Journal of Psychology 96 (1983) 75-83
26. Gholson B., and Craig S.D. Promoting constructive activities that support vicarious learning during computer-based instruction. Educational Psychology Review 18 (2006) 119-139
27. Glover J.A. The "testing" phenomenon: Not gone but nearly forgotten. Journal of Educational Psychology 81 (1989) 392-399
28. Glynn S.M., Britton B.K., and Tillman M.H. Typographic cues in text: Management of the reader's attention. In: Jonassen D. (Ed). The technology of text 2 (1985), Educational Technology Publications, Englewood Cliffs, NJ 192-209
29. Glynn S.M., and DiVesta F.J. Control of prose processing via instructional and typographical cues. Journal of Educational Psychology 71 (1979) 595-603
30. Guthrie E.R. The psychology of learning. rev. ed. (1952), Harper Bros, Oxford, England
31. Herman J.L., and Golan S. The effects of standardized testing on teaching and schools. Educational Measurement: Issues and Practice 12 (1993) 21-25 41-42
32. Hogan R.M., and Kintsch W. Differential effects of study and test trials on long-term recognition and recall. Journal of Verbal Learning and Verbal Behavior 10 (1971) 562-567
33. Huntley J., and Davies I.K. Preinstructional strategies: The role of pretests, behavioral objectives, overviews and advance organizers. Review of Educational Research 46 (1976) 239-265
34. Hursh D. Exacerbating inequality: The failed promise of the No Child Left Behind Act. Race Ethnicity and Education 10 (2007) 295-308
35. Izawa C. Optimal potentiating effects and forgetting-prevention effects of tests in paired-associate learning. Journal of Experimental Psychology 83 (1970) 340-344
36. Kane J.H., and Anderson R.C. Depth of processing and interference effects in the learning and remembering of sentences. Journal of Educational Psychology 70 (1978) 626-635
37. Kang S.H.K., McDermott K.B., and Roediger III H.L. Test format and corrective feedback modify the effect of testing on long-term retention. European Journal of Cognitive Psychology 19 (2007) 528-558
38. Karpicke J.D., and Roediger III H.L. Repeated retrieval during learning is the key to long-term retention. Journal of Memory and Language 57 (2007) 151-162
39. King A. Comparison of self-questioning, summarizing, and notetaking-review as strategies for learning from lectures. American Educational Research Journal 29 (1992) 303-323
40. King A. Guiding knowledge construction in the classroom: Effects of teaching children how to question and how to explain. American Educational Research Journal 31 (1994) 338-368
41. Kornell N., and Bjork R.A. The promise and perils of self-regulated study. Psychonomic Bulletin & Review 14 (2007) 219-224
42. Kornell, N., Hays, M. J., & Bjork, R. A. (in press). Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology: Learning, Memory, and Cognition
43. Leeming F.C. The exam-a-day procedure improves performance in psychology classes. Teaching of Psychology 29 (2002) 210-212
44. Marsh, E. J., Agarwal, P. K., & Roediger, H. L. (in press). Memorial consequences of answering SAT II questions. Journal of Educational Psychology: Applied
45. Marsh E.J., Roediger III H.L., Bjork R.A., and Bjork E.L. Memorial consequences of multiple-choice testing. Psychonomic Bulletin & Review 14 (2007) 194-199
46. Mathison S., and Freeman M. Constraining elementary teachers' work: Dilemmas and paradoxes created by state mandated testing. Education Policy Analysis Archives 11 34 (2003). http://epaa.asu.edu/epaa/images/logo.gif Retrieved from http://epaa.asu.edu/epaa/images/logo.gif
47. Mayer R. Twenty years of research on advance organizers: Assimilation theory is still the best predictor of results. Instructional Science 8 (1979) 133-167
48. Mayer R.E. Learning and instruction. 2nd ed. (2008), Merrill Prentice Hall, Upper Saddle River, NJ
49. McCaslin M. Student motivational dynamics in the era of school reform. The Elementary School Journal 5 (2006) 479-490
50. McDaniel M.A., and Masson M.E.J. Altering memory representations through retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition 11 (1985) 371-385
51. McDaniel M.A., Roediger III H.L., and McDermott K.B. Generalizing test-enhanced learning from the laboratory to the classroom. Psychonomic Bulletin & Review 14 (2007) 200-206
52. Metcalfe J., and Kornell N. Principles of cognitive science in education: The effects of generation, errors and feedback. Psychonomic Bulletin & Review 14 (2007) 225-229
53. No Child Left Behind Act of 2001, 20 U.S.C. §6319 (2008).
54. Paris S.G., Byrnes J.P., and Paris A.H. Constructing theories, identities, and actions of self-regulated learners. In: Zimmerman B., and Schunk D. (Eds). Self-regulated learning and academic achievement: Theoretical perspectives. 2nd ed. (2001), Erlbaum, Mahwah, NJ 253-287
55. Paris S.G., and Winograd P. How metacognition can promote learning and instruction. In: Jones B.F., and Idol L. (Eds). Dimensions of thinking and cognitive instruction (1990), Erlbaum, Hillsdale, NJ 15-51
56. Pashler H., Bain P.M., Bottge B.A., Graesser A., Koedinger K., McDaniel M., and Metcalfe J. Organizing instruction and study to improve student learning (Report No. NCER 2007-2004) (2007), National Center for Education Research, Institute of Education Sciences, U.S. Department of Education, Washington, DC
57. Pashler H., Cepeda N.J., Wixted J.T., and Rohrer D. When does feedback facilitate learning of words?. Journal of Experimental Psychology: Learning, Memory, and Cognition 31 (2005) 3-8
58. Pressley M., Tanenbaum R., McDaniel M.A., and Wood E. What happens when university students try to answer prequestions that accompany textbook material?. Contemporary Educational Psychology 15 (1990) 27-35
59. Reynolds R.E., and Anderson R.C. Influence of questions on the allocation of attention during reading. Journal of Educational Psychology 74 (1982) 623-632
60. Reynolds R.E., Standiford S.N., and Anderson R.C. Distribution of reading time when questions are asked about a restricted category of text information. Journal of Educational Psychology 71 (1979) 183-190
61. Richland L.E., Bjork R.A., and Linn M.C. Cognition and instruction: Bridging laboratory and classroom settings. In: Durso F., Nickerson R., Dumais S., Lewandowsky S., and Perfect T. (Eds). Handbook of applied cognition. 2nd ed. (2007), Wiley, Chichester, England 555-584
62. Richland L.E., Kao L.S., and Kornell N. Can unsuccessful tests enhance learning?. In: Sloutsky V., Love B., and McRae K. (Eds). Proceedings of the Twenty-Eighth Annual Conference of the Cognitive Science Society (2008), Erlbaum, Mahwah, NJ 2338-2343
63. Rickards J.P. Interaction of position and conceptual level of adjunct questions on immediate and delayed retention of text. Journal of Educational Psychology 68 (1976) 210-217
64. Rickards J.P., and Hatcher C.W. Interspersed meaningful question learning questions as semantic cues for poor comprehenders. Reading Research Quarterly 13 (1977-1978) 538-553
65. Roediger III H.L., and Karpicke J.D. The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science 1 (2006) 181-210
66. Roediger III H.L., and Karpicke J.D. Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science 17 (2006) 249-255
67. Roediger III H.L., and Marsh E.J. The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory, and Cognition 31 (2005) 1155-1159
68. Rothkopf E.Z. Some theoretical and experimental approaches to problems in written instruction. In: Krumboltz J.D. (Ed). Learning and the education process (1965), Rand McNally, Chicago 193-221
69. Rothkopf E.Z. Learning from written instructive materials: An exploration of the control of inspection behavior by test-like events. American Educational Research Journal 3 (1966) 241-249
70. Rothkopf E.Z. Adjunct aids and the control of mathemagenic activities during purposeful reading. In: Otto W., and White S. (Eds). Reading expository material (1982), Academic Press, New York
71. Rothkopf E.Z., and Bisbicos E.E. Selective facilitative effects of interspersed questions on learning from written materials. Journal of Educational Psychology 58 (1967) 56-61
72. Sacks O. An anthropologist on Mars: Seven paradoxical tales by Oliver Sacks (1995), Knopf, New York
73. Sagerman N., and Mayer R.E. Forward transfer of different reading strategies evoked by adjunct questions in science text. Journal of Educational Psychology 79 (1987) 189-191
74. Schmidt R.A., and Bjork R.A. New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training. Psychological Science 3 (1992) 207-217
75. Skinner B.F. Teaching machines. Science 128 (1958, October 24) 969-977
76. Snapp J.C., and Glover J.A. Advanced organizers and study questions. Journal of Educational Research 83 (1990) 266-271
77. Stecher B.M., Epstein S., Hamilton L.S., Marsh J.A., Robyn A., McCombs J.S., et al. Pain and gain: Implementing No Child Left Behind in three states, 2004-2006 (2008), Rand Corporation, Santa Monica, CA
78. Terrace H.S. Discrimination learning with and without "errors.". Journal of the Experimental Analysis of Behavior 6 (1963) 1-27
79. Tulving E. The effects of presentation and recall of material in free-recall learning. Journal of Verbal Learning and Verbal Behavior 6 (1967) 175-184
80. VanLehn K., Graesser A.C., Jackson G.T., Jordan P., Olney A., and Rose C.P. When are tutorial dialogues more effective than reading?. Cognitive Science 31 (2007) 1-60
81. Waller R. Typography and discourse. In: Barr R., Pearson D.R., Kamil M.L., and Mosenthal P.B. (Eds). Handbook of reading research 2 (1991), Erlbaum, Mahwah, NJ 341-380
82. Watts G.H., and Anderson R.C. Effects of three types of inserted questions on learning from prose. Journal of Educational Psychology 62 (1971) 387-394
83. Whitten W.B., and Bjork R.A. Learning from tests: Effects of spacing. Journal of Verbal Learning and Verbal Behavior 16 (1977) 465-478
84. Yost M., Avila L., and Vexler E.B. Effects of learning of post-instructional responses to questions of differing degrees of complexity. Journal of Educational Psychology 69 (1977) 398-401