Testing After Worked Example Study Does Not Enhance Delayed Problem-Solving Performance Compared to Restudy

Educational Psychology Review

Volumn 27, Issue 2, 2015, Pages 265-289

  van Gog, Tamara ^a   Kester, Liesbeth ^b,c   Dirkx, Kim ^b,d   Hoogerheide, Vincent ^a   Boerboom, Joris ^a   Verkoeijen, Peter P J L ^a  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^b OPEN UNIVERSITY OF THE NETHERLANDS   (Netherlands)

^c UTRECHT UNIVERSITY   (Netherlands)

^d FONTYS UNIVERSITY OF APPLIED SCIENCES   (Netherlands)

Author keywords

Problem solving; Testing effect; Worked examples

Indexed keywords

EID: 84929841659     PISSN: 1040726X     EISSN: 1573336X     Source Type: Journal    
DOI: 10.1007/s10648-015-9297-3     Document Type: Article

References (51)

1. Agarwal, P. K., Bain, P. M., & Chamberlain, R. W. (2012). The value of applied research: retrieval practice improves learning and recommendations from a teacher, a principal, and a scientist. Educational Psychology Review, 24, 437–448. doi:10.1007/s10648-012-9210-2.
2. Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000). Learning from examples: instructional principles from the worked examples research. Review of Educational Research, 70, 181–214. doi:10.3102/00346543070002181.
3. Baars, M., Van Gog, T., De Bruin, A. B. H., & Paas, F. (2014a). Effects of problem solving after worked example study on primary school children’s monitoring accuracy. Applied Cognitive Psychology, 28, 382–391. doi:10.1002/acp.3008.
4. Baars, M., Vink, S., Van Gog, T., De Bruin, A. B. H., & Paas, F. (2014b). Effects of training self-assessment and using assessment standards on retrospective and prospective monitoring of problem solving. Learning and Instruction, 33, 92–107. doi:10.1016/j.learninstruc.2014.04.004.
5. Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe & A. Shimamura (Eds.), Metacognition: knowing about knowing (pp. 185–205). Cambridge: MIT Press.
6. Butler, A. C., & Roediger, H. L. (2007). Testing improves long-term retention in a simulated classroom setting. European Journal of Cognitive Psychology, 19, 514–527. doi:10.1080/09541440701326097.
7. Butler, A. C., & Roediger, H. L. (2008). Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Memory & Cognition, 36, 604–616. doi:10.3758/MC.36.3.604.
8. Carbonaro, W. (2005). Tracking, students’ effort, and academic achievement. Sociology of Education, 78, 27–49. doi:10.1177/003804070507800102.
9. Carpenter, S., & Pashler, H. (2007). Testing beyond words: using tests to enhance visuospatial map learning. Psychonomic Bulletin & Review, 14, 474–478. doi:10.3758/BF03194092.
10. Carpenter, S. K., Pashler, H., Wixted, J. T., & Vul, E. (2008). The effects of tests on learning and forgetting. Memory and Cognition, 36, 438–448. doi:10.3758/MC.36.2.438.
11. Carroll, W. M. (1994). Using worked out examples as an instructional support in the algebra classroom. Journal of Educational Psychology, 86, 360–367. doi:10.1037/0022-0663.86.3.360.
12. Cooper, G., & Sweller, J. (1987). The effects of schema acquisition and rule automation on mathematical problem-solving transfer. Journal of Educational Psychology, 79, 347–362. doi:10.1037/0022-0663.79.4.347.
13. Coppens, L. C., Verkoeijen, P. P. J. L., & Rikers, R. M. J. P. (2011). Learning Adinkra symbols: the effect of testing. Journal of Cognitive Psychology, 23, 351–357. doi:10.1080/20445911.2011.507188.
14. Cumming, G. (2012). Understanding the new statistics: effect sizes, confidence intervals, and meta-analysis. New York: Routledge.
15. Hoffman, B., & Schraw, G. (2010). Conceptions of efficiency: applications in learning and problem-solving. Educational Psychologist, 45, 1–14. doi:10.1080/00461520903213618.
16. Holyoak, K. J. (2005). Analogy. In K. J. Holyoak & R. G. Morrison (Eds.), The Cambridge handbook of thinking and reasoning (pp. 117–142). Cambridge: Cambridge University Press.
17. Johnson, C. I., & Mayer, R. E. (2009). A testing effect with multimedia learning. Journal of Educational Psychology, 101, 621–629. doi:10.1037/a0015183.
18. Kalyuga, S. (2007). Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review, 19, 509–539. doi:10.1007/s10648-007-9054-3.
19. Kalyuga, S., Chandler, P., Tuovinen, J., & Sweller, J. (2001). When problem solving is superior to studying worked examples. Journal of Educational Psychology, 93, 579–588. doi:10.1037/0022-0663.93.3.579.
20. Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003). The expertise reversal effect. Educational Psychologist, 38, 23–31. doi:10.1207/S15326985EP3801_4.
21. Kang, S. H. K., McDermott, K. B., & Roediger, H. L. (2007). Test format and corrective feedback modulate the effect of testing on memory retention. European Journal of Cognitive Psychology, 19, 528–558. doi:10.1080/09541440601056620.
22. Kang, S. H. K., McDaniel, M. A., & Pashler, H. (2011). Effects of testing on learning of functions. Psychonomic Bulletin and Review, 18, 998–1005. doi:10.3758/s13423-011-0113-x.
23. Karpicke, J. D., & Grimaldi, P. J. (2012). Retrieval-based learning: a perspective for enhancing meaningful learning. Educational Psychology Review, 24, 401–418. doi:10.1007/s10648-012-9202-2.
24. Koedinger, K. R., & Aleven, V. (2007). Exploring the assistance dilemma in experiments with cognitive tutors. Educational Psychology Review, 19, 239–264. doi:10.1007/s10648-007-9049-0.
25. Leahy, W., Hanham, J., & Sweller, J. (2015). High element interactivity information during problem solving may lead to failure to obtain the testing effect. Educational Psychology Review. doi:10.1007/s10648-015-9296-4.
26. Leppink, J., Paas, F., Van Gog, T., Van der Vleuten, C. P. M., & Van Merriënboer, J. J. G. (2014). Effects of pairs of problems and examples on task performance and different types of cognitive load. Learning and Instruction, 30, 32–42. doi:10.1016/j.learninstruc.2013.12.001.
27. McDaniel, M. A., Roediger, H. L., & McDermott, K. B. (2007). Generalizing test-enhanced learning from the laboratory to the classroom. Psychonomic Bulletin & Review, 14, 200–206. doi:10.3758/BF03194052.
28. McLaren, B. M., Lim, S., & Koedinger, K. R. (2008). When and how often should worked examples be given to students? New results and a summary of the current state of research. In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society (pp. 2176–2181). Austin: Cognitive Science Society.
29. McLaren, B., Van Gog, T., Ganoe, C., Yaron, D., & Karabinos, M. (2014). Exploring the assistance dilemma: comparing instructional support in examples and problems. In S. Trausan-Matu, K. E. Boyer, M. Crosby, & K. Panourgia (Eds.), Lecture notes in Computer Science, 8474: intelligent tutoring systems (pp. 354–361). Berlin: Springer. doi:10.1007/978-3-319-07221-0_44.
30. Nievelstein, F., Van Gog, T., Van Dijck, G., & Boshuizen, H. P. A. (2013). The worked example and expertise reversal effect in less structured tasks: learning to reason about legal cases. Contemporary Educational Psychology, 38, 118–125. doi:10.1016/j.cedpsych.2012.12.004.
31. Paas, F. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive load approach. Journal of Educational Psychology, 84, 429–434. doi:10.1037/0022-0663.84.4.429.
32. Paas, F., & Van Merriënboer, J. J. G. (1994). Variability of worked examples and transfer of geometrical problem solving skills: a cognitive-load approach. Journal of Educational Psychology, 86, 122–133. doi:10.1037/0022-0663.86.1.122.
33. Rawson, K. A., & Dunlosky, J. (2012). When is practice testing most effective for improving the durability and efficiency of student learning? Educational Psychology Review, 24, 419–435. doi:10.1007/s10648-012-9203-1.
34. Renkl, A. (2011). Instruction based on examples. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 272–295). New York: Routledge.
35. Renkl, A. (2014). Towards an instructionally-oriented theory of example-based learning. Cognitive Science, 38, 1–37. doi:10.1111/cogs.12086.
36. Renkl, A., & Atkinson, R. K. (2003). Structuring the transition from example study to problem solving in cognitive skills acquisition: a cognitive load perspective. Educational Psychologist, 38, 15–22. doi:10.1207/S15326985EP3801_3.
37. Renkl, A., Stark, R., Gruber, H., & Mandl, H. (1998). Learning from worked-out examples: the effects of example variability and elicited self-explanations. Contemporary Educational Psychology, 23, 90–108. doi:10.1006/ceps.1997.0959.
38. Roediger, H. L., & Karpicke, J. D. (2006a). The power of testing memory: basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181–210. doi:10.1111/j.1745-6916.2006.00012.x.
39. Roediger, H. L., & Karpicke, J. D. (2006b). Test-enhanced learning: taking memory tests improves long-term retention. Psychological Science, 17, 249–255. doi:10.1111/j.1467-9280.2006.01693.x.
40. Roediger, H. L., & Marsh, E. J. (2005). The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 1155–1159. doi:10.1037/0278-7393.31.5.1155.
41. Salden, R., Koedinger, K. R., Renkl, A., Aleven, V., & McLaren, B. M. (2010). Accounting for beneficial effects of worked examples in tutored problem solving. Educational Psychology Review, 22, 379–392. doi:10.1007/s10648-010-9143-6.
42. Schwonke, R., Renkl, A., Krieg, C., Wittwer, J., Aleven, V., & Salden, R. J. C. M. (2009). The worked-example effect: not an artefact of lousy control conditions. Computers in Human Behavior, 25, 258–266. doi:10.1016/j.chb.2008.12.011.
43. Sweller, J., & Cooper, G. A. (1985). The use of worked examples as a substitute for problem solving in learning algebra. Cognition and Instruction, 2, 59–89. doi:10.1207/s1532690xci0201_3.
44. Sweller, J., Van Merriënboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251–295. doi:10.1023/A:1022193728205.
45. Van Gerven, P. W. M., Paas, F., Van Merriënboer, J. J. G., & Schmidt, H. G. (2002). Cognitive load theory and aging: effects of worked examples on training efficiency. Learning and Instruction, 12, 87–105. doi:10.1016/S0959-4752(01)00017-2.
46. Van Gog, T., & Kester, L. (2012). A test of the testing effect: acquiring problem-solving skills from worked examples. Cognitive Science, 36, 1532–1541. doi:10.1111/cogs.12002.
47. Van Gog, T., & Paas, F. (2008). Instructional efficiency: revisiting the original construct in educational research. Educational Psychologist, 43, 16–26. doi:10.1080/00461520701756248.
48. Van Gog, T., & Rummel, N. (2010). Example-based learning: integrating cognitive and social-cognitive research perspectives. Educational Psychology Review, 22, 155–174. doi:10.1007/s10648-010-9134-7.
49. Van Gog, T., Paas, F., & Van Merriënboer, J. J. G. (2006). Effects of process-oriented worked examples on troubleshooting transfer performance. Learning and Instruction, 16, 154–164. doi:10.1016/j.learninstruc.2006.02.003.
50. Van Gog, T., Kester, L., & Paas, F. (2011). Effects of worked examples, example-problem, and problem-example pairs on novices’ learning. Contemporary Educational Psychology, 36, 212–218. doi:10.1016/j.cedpsych.2010.10.004.
51. Wheeler, M. A., Ewers, M., & Buonanno, J. F. (2003). Different rates of forgetting following study versus test trials. Memory, 11, 571–580. doi:10.1080/09658210244000414.