Completion problems can reduce the illusions of understanding in a computer-based learning environment on genetics

Contemporary Educational Psychology

Volumn 41, Issue , 2015, Pages 157-171

  Mihalca, Loredana ^a   Mengelkamp, Christoph ^b   Schnotz, Wolfgang ^c   Paas, Fred ^d,e  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b UNIVERSITY OF WÜRZBURG   (Germany)

^c University of Koblenz Landau   (Germany)

^d ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^e UNIVERSITY OF WOLLONGONG   (Australia)

Author keywords

Completion problems; Incomplete worked out examples; Judgment bias; Metacognitive judgments; Overconfidence

Indexed keywords

EID: 84922348480     PISSN: 0361476X     EISSN: 10902384     Source Type: Journal    
DOI: 10.1016/j.cedpsych.2015.01.001     Document Type: Article

References (89)

1. Alexander P.A. Calibration: What is it and why it matters? An introduction to the special issue on calibrating calibration. Learning and Instruction 2013, 24:1-3. 10.1016/j.learninstruc.2012.10.003.
2. Atkinson R.K. Optimizing learning from examples using animated pedagogical agents. Journal of Educational Psychology 2002, 94(2):416-427. 10.1037/0022-0663.94.2.416.
3. Atkinson R.K., Derry S.J., Renkl A., Wortham D.W. Learning from examples: Instructional principles from the worked examples research. Review of Educational Research 2000, 70(2):181-214. 10.3102/00346543070002181.
4. Atkinson R.K., Renkl A., Merrill M.M. Transitioning from studying examples to solving problems: Effects of self-explanation prompts and fading worked-out steps. Journal of Educational Psychology 2003, 95(4):774-783. 10.1037/0022-0663.95.4.774.
5. Ayres P. Using subjective measures to detect variations of intrinsic cognitive load within problems. Learning and Instruction 2006, 16:389-400. 10.1016/j.learninstruc.2006.09.001.
6. Baars M., Visser S., Van Gog T., de Bruin A., Paas F. Completion of partially worked-out examples as a generation strategy for improving monitoring accuracy. Contemporary Educational Psychology 2013, 38(4):395-406. 10.1016/j.cedpsych.2013.09.001.
7. Bandura A. Regulation of cognitive processes through perceived self-efficacy. Developmental Psychology 1989, 25:725-739.
8. Bol L., Hacker D. The effect of practice tests on students' calibration and performance. Journal of Experimental Education 2001, 69:133-151. 10.1080/00220970109600653.
9. Brünken R., Plass J.L., Leutner D. Direct measurement of cognitive load in multimedia learning. Educational Psychologist 2003, 38(1):53-61. 10.1207/S15326985EP3801_7.
10. Burson K.A., Larrick R.P., Klayman J. Skilled or unskilled, but still unaware of it: How perceptions of difficulty drive miscalibration in relative comparisons. Journal of Personality and Social Psychology 2006, 90(1):60-77. 10.1037/0022-3514.90.1.60.
11. Catrambone R. Improving examples to improve transfer to novel problems. Memory and Cognition 1994, 22(5):606-615. 10.3758/BF03198399.
12. Catrambone R. Aiding subgoal learning: Effects on transfer. Journal of Educational Psychology 1995, 87(1):5-17. 10.037/0022-0663.87.1.5.
13. Catrambone R. Generalizing solution procedures learned from examples. Journal of Experimental Psychology. Learning, Memory, and Cognition 1996, 22(4):1020-1031. 10.1037/0278-7393.22.4.1020.
14. Chi M.T.H. Two approaches to the study of experts' characteristics. Cambridge handbook of expertise and expert performance 2006, 21-30. Cambridge University Press. K.A. Ericsson, N. Charness, P. Feltovich, R. Hoffman (Eds.).
15. Chi M.T.H., Bassok M., Lewis M.W., Reimann P., Glaser R. Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science 1989, 13(2):145-182. 10.1207/s15516709cog1302_1.
16. Cohen J. A power primer. Psychological Bulletin 1992, 112(1):155-159. 10.1037/0033-2909.112.1.155.
17. Cohen J., Cohen P., West S.G., Aiken L.S. Applied multiple regression/ correlation analysis for the behavioral sciences 2003, Lawrence Erlbaum, Mahwah, N.J. 3rd ed.
18. Dinsmore D.L., Parkinson M.M. What are confidence judgments made of? Students' explanations for their confidence ratings and what that means for calibration. Learning and Instruction 2013, 24:4-14. 10.1016/j.learninstruc.2012.06.001.
19. Dunlosky J., Hertzog C., Kennedy M.R.T., Thiede K.W. The self-monitoring approach for effective learning. Cognitive Technology 2005, 10(1):4-11.
20. Dunlosky J., Metcalfe J. Metacognition 2009, Sage, Thousand Oaks, CA.
21. Dunlosky J., Rawson K.A. Overconfidence produces underachievement: Inaccurate self evaluations undermine students' learning and retention. Learning and Instruction 2012, 22(4):271-280. 10.1016/j.learninstruc.2011.08.003.
22. Dunning D., Johnson K., Ehrlinger J., Kruger J. Why people fail to recognize their own incompetence. Current Directions in Psychological Science 2003, 12(3):83-87. 10.1111/1467-8721.01235.
23. Efklides A. Metacognitive experiences in problem solving: Metacognition, motivation, and self-regulation. Trends and prospects in motivation research 2001, 297-323. Kluwer, Dordrecht, The Netherlands. A. Efklides, J. Kuhl, R.M. Sorrentino (Eds.).
24. Efklides A. Metacognition and affect: What can metacognitive experiences tell us about the learning process?. Educational Research Review 2006, 1:3-14. doi:10.1016/j.edurev.2005.11.001.
25. Ehrlinger J., Johnson K., Banner M., Dunning D., Kruger J. Why the unskilled are unaware: Further explorations of (absent) self-insight among the incompetent. Organizational Behavior and Human Decision Processes 2008, 105(1):98-121. 10.1016/j.obhdp.2007.05.002.
26. Faul F., Erdfelder E., Land A.-G., Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 2007, 39(2):175-191.
27. Finn B., Metcalfe J. Judgments of learning are influenced by memory for past test. Journal of Memory and Language 2008, 58(1):19-34. 10.1016/j.jml.2007.03.006.
28. Flavell J.H. Metacognitive aspects of problem solving. The nature of intelligence 1976, 231-235. Earlbaum, Hillsdale, NJ. L.B. Resnick (Ed.).
29. Glenberg A.M., Epstein W. Calibration of comprehension. Journal of Experimental Psychology. Learning, Memory, and Cognition 1985, 11(4):702-718.
30. Hacker D.J., Bol L., Bahbahani K. Explaining calibration accuracy in classroom contexts: The effects of incentives, reflection, and explanatory style. Metacognition and Learning 2008, 3:101-121. 10.1007/s11409-008-9021-5.
31. Hadwin A.F., Webster E.A. Calibration in goal setting: Examining the nature of judgments of confidence. Learning and Instruction 2013, 24:37-47. 10.1016/j.learninstruc.2012.10.001.
32. Hayes A.F. Introduction to mediation, moderation, and conditional process analysis a regression-based approach 2013, Guilford Press, New York.
33. Kalyuga S. Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review 2007, 19(4):509-539. 10.1007/s10648-007-9054-3.
34. Kalyuga S., Ayres P., Chandler P., Sweller J. The expertise reversal effect. Educational Psychologist 2003, 38(1):23-31. 10.1207/S15326985EP3801_4.
35. Kalyuga S., Chandler P., Sweller J. Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology 1999, 13(4):351-371. 10.1002/(SICI)1099-0720(199908)13:4 < 351::AID-ACP589>3.0.CO;2-6.
36. Kalyuga S., Chandler P., Sweller J. Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology 2000, 92(1):126-136. 10.1037/0022-0663.92.1.126.
37. Kalyuga S., Chandler P., Tuovinen J., Sweller J. When problem solving is superior to studying worked examples. Journal of Educational Psychology 2001, 93(3):579-588. 10.1037/0022-0663.93.3.579.
38. Keren G. Calibration and probability judgments: Conceptual and methodological issues. Acta Psychologica 1991, 77(3):217-273. 10.1016/0001-6918(91)90036-Y.
39. Koriat A. Monitoring one's own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology. General 1997, 126(4):349-370. 10.1037/0096-3445.126.4.349.
40. Koriat A. The relationships between monitoring, regulation and performance. Learning and Instruction 2012, 22(4):296-298. 10.1016/j.learninstruc.2012.01.002.
41. Koriat A., Levy-Sadot R. Processes underlying metacognitive judgments: Information-based and experience-based monitoring of one's own knowledge. Dual process theories in social psychology 1999, 483-502. Guilford Press, New York. S. Chaiken, Y. Trope (Eds.).
42. Koriat A., Sheffer L., Ma'ayan H. Comparing objective and subjective learning curves: Judgments of learning exhibit increased underconfidence with practice 2002, University of Haifa, Institute of Information Processing and Decision Making, Haifa, Israel, IIPDM Report No 171.
43. Kornell N., Bjork R.A. A stability bias in human memory: Overestimating remembering and underestimating learning. Journal of Experimental Psychology. General 2009, 138(4):449-468. 10.1037/a0017350.
44. Kornell N., Metcalfe J. Study efficacy and the region of proximal learning framework. Journal of Experimental Psychology. Learning, Memory, and Cognition 2006, 32(3):609-622. 10.1037/0278-7393.32.3.609.
45. Kruger J., Dunning D. Unskilled and unaware - But why? A reply to Krueger and Mueller (2002). Journal of Personality and Social Psychology 2002, 82(2):189-192. 10.1037/0022-3514.82.2.189.
46. Lin L.-M., Zabruscky K.M. Calibration of comprehension: Research and implications for education and instruction. Contemporary Educational Psychology 1998, 23:345-391. 10.1006/ceps.1998.0972.
47. MacCallum R.C., Zhang S., Preacher K.J., Rucker D.D. On the practice of dichotomization of quantitative variables. Psychological Methods 2002, 7(1):19-40. 10.1037/1082-989x.7.1.19.
48. Metcalfe J., Kornell N. A region of proximal learning model of study time allocation. Journal of Memory and Language 2005, 52(4):463-477. 10.1016/j.jml.2004.12.001.
49. Mihalca L., Salden R., Corbalan G., Paas F., Miclea M. Effectiveness of cognitive-load based adaptive instruction in genetics education. Computers in Human Behavior 2011, 27(1):82-88. 10.1016/j.chb.2010.05.027.
50. Nelson T.O. A comparison of current measures of the accuracy of feeling-of-knowing predictions. Psychological Bulletin 1984, 95(1):109-133. 10.1037/0033-2909.95.1.109.
51. Nelson T.O. Gamma is a measure of the accuracy of predicting performance on one item relative to another item, not of the absolute performance on an individual item: Comments on Schraw. Applied Cognitive Psychology 1996, 10(3):257-260. 10.1002/(SICI)1099-0720(199606)10:3 < 257::AID-ACP400>3.0.CO;2-9.
52. Nelson T.O., Dunlosky J. When people's judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The "delayed-JOL effect. Psychological Science 1991, 2(4):267-270. 10.1111/j.1467-9280.1991.tb00147.x.
53. Nietfeld J.L., Cao L., Osborne J.W. The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy. Metacognition and Learning 2006, 1(2):159-179. 10.1007/s10409-006-9595-6.
54. Paas F. Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology 1992, 84(4):429-434. 10.1037/0022-0663.84.4.429.
55. Paas F., Tuovinen J.E., Tabbers H., Van Gerven P.W.M. Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist 2003, 38(1):63-71. 10.1207/S15326985EP3801_8.
56. Paas F., Tuovinen J.E., Van Merriënboer J.J.G., Darabi A.A. A motivational perspective on the relation between mental effort and performance: Optimizing learner involvement in instruction. Educational Technology Research and Development 2005, 53(3):25-34. 10.1007/BF02504795.
57. Paas F., Van Gog T. Optimising worked example instruction: Different ways to increase germane cognitive load. Learning and Instruction 2006, 16(2):87-91. 10.1016/j.learninstruc.2006.02.004.
58. Paas F., Van Merriënboer J.J.G. Variability of worked examples and transfer of geometrical problem solving skills: A cognitive load approach. Journal of Educational Psychology 1994, 86(1):122-133. 10.1037/0022-0663.86.1.122.
59. Paik E.S. Learning with animation and the illusion of understanding. UNLV Theses/Dissertations/Professional Papers/Capstones 2010, Paper 678. http://digitalscholarship.unlv.edu/thesesdissertations/678.
60. Paik E.S., Schraw G. Learning with animation and illusions of understanding. Journal of Educational Psychology 2013, 105:278-289. 10.1037/a0030281.
61. Pintrich P.R., Schrauben B. Students' motivational beliefs and their cognitive engagement in classroom academic tasks. Student perceptions in the classroom 1992, 149-183. Erlbaum, Hillsdale, NJ. D.H. Schunk, J.L. Meece (Eds.).
62. Preacher K.J., Curran P.J., Bauer D.J. Computational tools for probing interactions in multiple linear regression, multilevel modeling, and latent curve analysis. Journal of Educational and Behavioral Statistics 2006, 31:437-448. 10.3102/10769986031004437.
63. Reisslein J., Atkinson R.K., Seeling P., Reisslein M. Investigating the presentation and format of instructional prompts in an electrical circuit analysis computer-based learning environment. IEEE Transactions on Education 2006, 48(3):531-539. 10.1109/TE.2005.852602.
64. Renkl A. Learning from worked-out examples: A study on individual differences. Cognitive Science 1997, 21(1):1-29. 10.1207/s15516709cog2101_1.
65. Renkl A. Learning mathematics from worked-out examples: Analyzing and fostering self-explanations. European Journal of Psychology of Education 1999, XIV(4):477-488. 10.1007/BF03172974.
66. Renkl A. Worked-out examples: Instructional explanations support learning by self-explanations. Learning and Instruction 2002, 12(5):529-556. 10.1016/S0959-4752(01)00030-5.
67. Renkl A., Atkinson R.K. Structuring the transition from example study to problem solving in cognitive skill acquisition: A cognitive load perspective. Educational Psychologist 2003, 38(1):15-22. 10.1207/S15326985EP3801_3.
68. Renkl A., Atkinson R.K., Große C.S. How fading worked solution steps works - A cognitive load perspective. Instructional Science 2004, 32:59-82. 10.1023/B:TRUC.0000021815.74806.f6.
69. Renkl A., Hilbert T., Schworm S. Example-based learning in heuristic domains: A cognitive load theory account. Educational Psychology Review 2009, 21:67-78. 10.1007/s10648-008-9093-4.
70. Schnotz W. Reanalyzing the expertise reversal effect. Instructional Science 2010, 38(3):315-323. 10.1007/s11251-009-9104-y.
71. Schraw G. A conceptual analysis of five measures of metacognitive monitoring. Metacognition and Learning 2009, 4(1):33-45. 10.1007/s11409-008-9031-3.
72. Schraw G., Roedel T.D. Test difficulty and judgment bias. Memory & Cognition 1994, 22(2):63-69. 10.3758/BF03202762.
73. Stark R. Lernen mit lösungsbeispielen. Der einfluß unvollständiger lösungsschritte auf beispielelaboration, motivation und lernerfolg [Learning by worked-out examples. The impact of incomplete solution steps on example elaboration, motivation, and learning outcomes] 1999, Huber, Bern, Germany.
74. Stone N.J. Exploring the relationship between calibration and self-regulated learning. Educational Psychology Review 2000, 12(4):437-475. 10.1023/A:1009084430926.
75. Sweller J. Instructional design in technical areas 1999, ACER Press, Melbourne, Australia.
76. Sweller J., Ayres P., Kalyuga S. Cognitive load theory 2011, Springer, New York.
77. Sweller J., Van Merriënboer J.J.G., Paas F. Cognitive architecture and instructional design. Educational Psychology Review 1998, 10(3):251-296. 10.1023/A:1022193728205.
78. Thiede K.W., Anderson M.C.M., Therriault D. Accuracy of metacognitive monitoring affects learning of texts. Journal of Educational Psychology 2003, 95(1):66-73. 10.1037/0022-0663.95.1.66.
79. Tuovinen J.E., Paas F. Exploring multidimensional approaches to the efficiency of instructional conditions. Instructional Science 2004, 32(1/2):133-152. 10.1023/B:TRUC.0000021813.24669.62.
80. Van Gog T., Kester L., Paas F. Effects of worked examples, example-problem, and problem-example pairs on novices' learning. Contemporary Educational Psychology 2011, 36(3):212-218. 10.1016/j.cedpsych.2010.10.004.
81. Van Gog T., Paas F. Instructional efficiency: Revisiting the original construct in educational research. Educational Psychologist 2008, 43:16-26. 10.1080/00461520701756248.
82. Van Gog T., Paas F., Van Merriënboer J.J.G. Effects of studying sequences of process-oriented and product-oriented worked examples on troubleshooting transfer efficiency. Learning and Instruction 2008, 18(3):211-222. 10.1016/j.learninstruc.2007.03.003.
83. Van Gog T., Rummel N. Example-based learning: Integrating cognitive and social-cognitive research perspectives. Educational Psychology Review 2010, 22(2):155-174. 10.1007/s10648-010-9134-7.
84. Van Merriënboer J.J.G., de Croock M.B.M. Strategies for computer-based programming instruction: Program completion vs. program generation. Journal of Educational Computing Research 1992, 8:365-394. 10.2190/MJDX-9PP4-KFMT-09PM.
85. Van Merriënboer J.J.G., Schuurman J.G., de Croock M.B.M., Paas F. Redirecting learners' attention during training: Effects on cognitive load, transfer test performance and training. Learning and Instruction 2002, 12:11-37. 10.1016/S0959-4752(01)00020-2.
86. Van Merriënboer J.J.G., Sweller J. Cognitive load theory and complex learning: Recent developments and future directions. Educational Psychology Review 2005, 17(2):147-177. 10.1007/s10648-005-3951-0.
87. VanLehn K. Problem solving and cognitive skill acquisition. Foundations of cognitive science 1989, 527-579. The MIT Press, Cambridge, MA. M.I. Posner (Ed.).
88. Wittwer J., Renkl A. How effective are instructional explanations in example-based learning? A meta-analytic review. Educational Psychology Review 2010, 22:393-409. 10.1007/s10648-010-9136-5.
89. Yates J.F. Judgment and decision making 1990, Prentice Hall, Inc, Englewood Cliffs, NJ.