Simple Practice Doesn’t Always Make Perfect: Evidence From the Worked Example Effect

Policy Insights from the Behavioral and Brain Sciences

Volumn 2, Issue 1, 2015, Pages 24-32

  Booth, Julie L ^a   McGinn, Kelly M ^a   Young, Laura K ^a   Barbieri, Christina ^a  

^a TEMPLE UNIVERSITY   (United States)

Author keywords

cognitive science; learning from errors; self explanation; STEM instruction; worked examples

Indexed keywords

EID: 85052898856     PISSN: 23727322     EISSN: 23727330     Source Type: Journal    
DOI: 10.1177/2372732215601691     Document Type: Article

References (70)

1. Adams D. M., McLaren B. M., Durkin K., Mayer R. E., Rittle-Johnson B., Isotani S., van Velsen M., (2014). Using erroneous examples to improve mathematics learning with a web-based tutoring system. Computers in Human Behavior, 36, 401-411
2. Aleven V. A., Koedinger K. R., (2002). An effective metacognitive strategy: Learning by doing and explaining with a computer-based Cognitive Tutor. Cognitive Science, 26, 147-179
3. Atkinson R. K., Renkl A., Merrill M. M., (2003). Transitioning from studying examples to solving problems: Effects of self-explanation prompts and fading worked-out steps. Journal of Educational Psychology, 95, 774-783
4. Au W., (2007). High-stakes testing and curricular control: A qualitative metasynthesis. Educational Researcher, 36, 258-267
5. Barbieri C., Booth J. L., (under review). Support for struggling students in algebra: Contributions of incorrect worked examples. Learning and Individual Differences
6. Booth J. L., Cooper L. A., Donovan M. S., Huyghe A., Koedinger K. R., Paré-Blagoev E. J., (2015). Design-based research within the constraints of practice: AlgebraByExample. Journal of Education for Students Placed at Risk, 20, 79-100
7. Booth J. L., Lange K. E., Koedinger K. R., Newton K. J., (2013). Using example problems to improve student learning in algebra: Differentiating between correct and incorrect examples. Learning and Instruction, 25, 24-34
8. Booth J. L., Oyer M. H., Paré-Blagoev E. J., Elliot A., Barbieri C., Augustine A. A., Koedinger K. R., (in press). Learning algebra by example in real-world classrooms. Journal of Research on Educational Effectiveness. doi:10.1080/19345747.2015.1055636
9. Carroll W. M., (1994). Using worked examples as an instructional support in the algebra classroom. Journal of Educational Psychology, 86, 360-367
10. Catrambone R., (1996). Generalizing solution procedures learned from examples. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 1020-1031
11. Catrambone R., (1998). The subgoal learning model: Creating better examples so that students can solve novel problems. Journal of Experimental Psychology, 127, 355-376
12. Catrambone R., Holyoak K. J., (1989). Overcoming contextual limitations on problem-solving transfer. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 1147-1156
13. Catrambone R., Yuasa M., (2006). Acquisition of procedures: The effects of example elaborations and active learning exercises. Learning and Instruction, 16, 139-153
14. Chi M. T., (2000). Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. Advances in Instructional Psychology, 5, 161-238
15. Chi M. T., Bassok M., Lewis M. W., Reimann P., Glaser R., (1989). Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science, 13,145-182
16. Clark R. C., Mayer R. E., (2003). E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. San Francisco, CA: Jossey-Bass
17. Common Core State Standards Initiative. (2010). Common Core State Standards for Mathematics. Retrieved from http://www.corestandards.org/assets/CCSSI_Math%20Standards.pdf
18. Cooper G., Sweller J., (1987). Effects of schema acquisition and rule automation on mathematical problem-solving transfer. Journal of Educational Psychology, 79, 347-362
19. Cummins D., (1992). Role of analogical reasoning in the induction of problem categories. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 1103-1124
20. Davenport J. L., Klahr D., Koedinger K. R., (2007, August). The influence of diagrams on chemistry learning. Paper presented at the Biennial Conference of the European Association for Research on Learning and Instruction, Budapest, Hungary
21. Durkin K., Rittle-Johnson B., (2012). The effectiveness of using incorrect examples to support learning about decimal magnitude. Learning and Instruction, 22, 206-214
22. Dynarski M., Agodini R., Heaviside S., Novak T., Carey N., Campuzano L... Sussex W., (2007). Effectiveness of reading and mathematics software products: Findings from the first student cohort (Report provided to Congress by the National Center for Education Evaluation). Retrieved from http://ies.ed.gov/ncee/pdf/20074005.pdf
23. Fleischman H. L., Hopstock P. J., Pelczar M. P., Shelley B. E., (2010). Highlights from PISA 2009: Performance of US 15-year-old students in reading, mathematics, and science literacy in an international context (NCES 2011-004). Washington, DC: National Center for Education Statistics
24. Flores R., Inan F., (2014). Examining the impact of adaptively faded worked examples on student learning outcomes. Journal of Interactive Learning Research, 25, 467-485
25. Gentner D., (2005). The development of relational category knowledge. In Rakison D. H., Gershkoff-Stowe L., (Eds.), Building object categories in developmental time (pp. 245-275). Mahwah, NJ: Lawrence Erlbaum
26. Große C. S., Renkl A., (2006). Effects of multiple solution methods in mathematics learning. Learning and Instruction, 16, 122-138
27. Hausmann R. G., Vanlehn K., (2007). Explaining self-explaining: A contrast between content and generation. Frontiers in Artificial Intelligence and Applications, 158, 417
28. Heemsoth T., Heinze A., (2014). The impact of incorrect examples on learning fractions: A field experiment with 6th grade students. Instructional Science, 42, 639-657
29. Hilbert T., Renkl A., Schworm S., Kessler S., Reiss K., (2008). Learning to teach with worked-out examples: A computer-based learning environment for teachers. Journal of Computer Assisted Learning, 24, 316-332
30. Kalyuga S., Ayres P., Chandler P., Sweller J., (2003). The expertise reversal effect. Educational Psychologist, 38, 23-31
31. Kalyuga S., Chandler P., Tuovinen J., Sweller J., (2001). When problem solving is superior to studying worked examples. Journal of Educational Psychology, 93, 579-588
32. Kilpatrick J., Swafford J., Findell B., (2001). Adding it up: Helping children learn mathematics. Washington, DC: National Academies Press
33. Kim R. S., Weitz R., Heffernan N. T., Krach N., (2009). Tutored problem solving vs. “pure” worked examples. In Taatgen N. A., van Rijn H., (Eds.), Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 3121-3126). Austin, TX: Cognitive Science Society
34. Koedinger K. R., Booth J. L., Klahr D., (2013). Instructional complexity and the science to constrain it. Science, 342, 935-937
35. Kuenzi J. J., Matthews C. M., Mangan B. F., (2006). Science, technology, engineering, and mathematics (STEM) education issues and legislative options. Washington DC: Congressional Research Service, Library of Congress
36. Lappan G., Fey J. T., Fitzgerald W. M., Friel S., Phillips E. D., (2006). Connected mathematics 2: Implementing and teaching guide. Boston, MA: Pearson
37. Lehman S., Schraw G., McCrudden M. T., Hartley K., (2007). Processing recall of seductive details in scientific text. Contemporary Educational Psychology, 32, 569-587. doi:10.1016/j.cedpsych.2006.07.002
38. Levin J. R., Anglin G. J., Carney R. N., (1987). On empirically validating functions of pictures in prose. In Willows D. M., Houghton H., (Eds.), The psychology of illustration: Volume 1. Basic research (pp. 51-86). New York, NY: Springer
39. Lomax R. G., West M. M., Harmon M. C., Viator K. A., Madaus G. F., (1995). The impact of mandated standardized testing on minority students. Journal of Negro Education, 64, 171-185
40. McLaren B. M., Lim S. J., Gagnon F., Yaron D., Koedinger K. R., (2006). Studying the effects of personalized language and worked examples in the context of a web-based intelligent tutor. In Ikeda M., Ashlay K., Chan T., (Eds.), Intelligent tutoring systems (pp. 318-328). Berlin, Germany: Springer
41. Moreno R., Reisslein M., Ozogul G., (2009). Optimizing worked-example instruction in electrical engineering: The role of fading and feedback during problem-solving practice. Journal of Engineering Education, 98, 83-92
42. Next Generation Science Standards Lead States. (2013). Next Generation Science Standards: For states, by states. Washington, DC: National Academies Press
43. Ohlsson S., (1996). Learning from performance errors. Psychological Review, 103, 241-262
44. Paas F. G., (1992). Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology, 84, 429-434
45. Paas F., Van Merriënboer J., (1994). Variability of worked examples and transfer of geometrical problem-solving skills: A cognitive-load approach. Journal of Educational Psychology, 86, 122-133
46. Pashler H., Bain P., Bottge B., Graesser A., Koedinger K., McDaniel M., Metcalfe J., (2007). Organizing instruction and study to improve student learning: IES practice guide (NCER 2007-2004). Washington, DC: National Center for Education Research
47. Renkl A., Atkinson R., Große C., (2004). How fading worked solution steps works—A cognitive load perspective. Instructional Science, 32, 59-82
48. Renkl A., Atkinson R., Maier U., Staley R., (2002). From example study to problem solving: Smooth transitions help learning. Journal of Experimental Education, 70, 293-315
49. Renkl A., Stark R., Gruber H., Mandl H., (1998). Learning from worked-out examples: The effects of example variability and elicited self-explanations. Contemporary Educational Psychology, 23, 90-108
50. Rittle-Johnson B., Star J. R., (2007). Does comparing solution methods facilitate conceptual and procedural knowledge? An experimental study on learning to solve equations. Journal of Educational Psychology, 99, 561-574
51. Rittle-Johnson B., Star J. R., (2009). Compared with what? The effects of different comparisons on conceptual knowledge and procedural flexibility for equation solving. Journal of Educational Psychology, 101, 529-544
52. Rittle-Johnson B., Star J. R., (2011). The power of comparison in learning and instruction: Learning outcomes supported by different types of comparisons. In Mestre J. P., Ross B. H., Mestre J. P., Ross B. H., (Eds.), The Psychology of Learning and Motivation: Vol. 55. Cognition in education (pp. 199-225). San Diego, CA: Elsevier
53. Rittle-Johnson B., Star J. R., Durkin K., (2009). The importance of prior knowledge when comparing examples: Influences on conceptual and procedural knowledge of equation solving. Journal of Educational Psychology, 101, 836-852
54. Roy M., Chi M. T. H., (2005). The self-explanation effect in multimedia learning. In Mayer R. E., (Ed.), The Cambridge handbook of multimedia learning (pp. 271-286). New York, NY: Cambridge University Press
55. Salden R. M., Aleven V., Schwonke R., Renkl A., (2010). The expertise reversal effect and worked examples in tutored problem solving. Instructional Science, 38, 289-307
56. Santagata R., (2004). “Are you joking or are you sleeping?” Cultural beliefs and practices in Italian and U.S. teachers’ mistake-handling strategies. Linguistics and Education, 15, 141-164
57. Schwonke R., Renkl A., Krieg C., Wittwer J., Aleven V., Salden R., (2009). The worked-example effect: Not an artefact of lousy control conditions. Computers in Human Behavior, 25, 258-266
58. Schwonke R., Wittwer J., Aleven V., Salden R. J. C. M., Krieg C., Renkl A., (2007). Can tutored problem solving benefit from faded worked-out examples? In Vosniadou S., Kayser D., Protopapas A., (Eds.), Proceedings of EuroCogSci 07: The European Cognitive Science Conference 2007 (pp. 59–64). New York: Erlbaum
59. Siegler R. S., (2002). Microgenetic studies of self-explanations. In Granott N., Parziale J., (Eds.), Microdevelopment: Transition processes in development and learning (pp. 31-58). New York, NY: Cambridge University Press
60. Skinner B. F., (1961). Why we need teaching machines. Harvard Educational Review, 31, 377-398
61. Star J. R., Rittle-Johnson B., (2009). It pays to compare: An experimental study on computational estimation. Journal of Experimental Child Psychology, 102, 408-426
62. Steuer G., Rosentritt-Brunn G., Dresel M., (2013). Dealing with errors in mathematics classrooms: Structure and relevance of perceived error climate. Contemporary Educational Psychology, 38, 196-210
63. Stigler J. W., Hiebert J., (1999). The teaching gap: Best ideas from the world’s teachers for improving education in the classroom. New York, NY: Free Press
64. Stigler J. W., Perry M., (1988). Mathematics learning in Japanese, Chinese, and American classrooms. In Saxe G. B., Gearhart M., (Eds.), Children’s mathematics: New directions for child development (No. 41, pp. 27-54.) San Francisco, CA: Jossey-Bass
65. Sweller J., (1999). Instructional design in technical areas. Camberwell, Australia: ACER Press
66. Tarmizi R. A., Sweller J., (1988). Guidance during mathematical problem solving. Journal of Educational Psychology, 80, 424-436
67. Trafton J. G., Reiser B. J., (1993). The contributions of studying examples and solving problems to skill acquisition. In Polson M., (Ed.), Proceedings of the 15th Annual Conference of the Cognitive Science Society (pp. 1017-1022). Hillsdale, NJ: Lawrence Erlbaum
68. van Merrienboer J. J. G., Kirschner P. A., Kester L. (2003). Taking the load off a learner’s mind: Instructional design for complex learning. Educational Psychologist, 38, 5-13
69. Ward M., Sweller J., (1990). Structuring effective worked examples. Cognition and Instruction, 7, 1-39
70. Zhu X., Simon H., (1987). Learning mathematics from examples and by doing. Cognition and Instruction, 4, 137-166