The Effects of Practice Schedule and Critical Thinking Prompts on Learning and Transfer of a Complex Judgment Task

Journal of Educational Psychology

Volumn 103, Issue 2, 2011, Pages 383-398

  Helsdingen, Anne ^a   van Gog, Tamara ^b   van Merriënboer, Jeroen ^c  

^a OPEN UNIVERSITY OF THE NETHERLANDS   (Netherlands)

^b ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^c MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Complex judgment; Contextual interference; Critical thinking; Learning; Transfer

Indexed keywords

EID: 79957790152     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0022370     Document Type: Article

References (108)

1. Abrami P.C., Bernard R.M., Borokhovski E., Wade A., Surkes M., Tamim R., Zhang D.A. Instructional interventions affecting critical thinking skills and dispositions: A stage one meta-analysis. Review of Educational Research 2008, 78:1102-1134. doi: 10.3102/0034654308326084.
2. Aleven V., Koedinger K.R. An effective metacognitive strategy: Learning by doing and explaining with a computer-based cognitive tutor. Cognitive Science 2002, 26:147-179. doi: 10.1207/s15516709cog2602_1.
3. Alexander P.A., Schallert D.L., Reynolds R.E. What is learning anyway? A topographical perspective considered. Educational Psychologist 2009, 44:176-192. doi: 10.1080/00461520903029006.
4. Angeli C., Valanides N. Instructional effects on critical thinking: Performance on ill-defined issues. Learning and Instruction 2009, 19:322-334. doi: 10.1016/j.learninstruc.2008.06.010.
5. Belland B.R., Glazewski K.D., Richardson J.C. A scaffolding framework to support the construction of evidence-based arguments among middle school students. Educational Technology Research and Development 2008, 56:401-422. doi: 10.1007/s11423-007-9074-1.
6. Bjork R.A. Memory and metamemory considerations in the training of human beings. Metacognition: Knowing about knowing 1994, 185-205. MIT Press, Cambridge, MA. J. Metcalfe, A. Shimamura (Eds.).
7. Bjork R.A., Bjork E.L. Optimizing treatment and instruction: Implications of a new theory of disuse. Memory and society: Psychological Perspectives 2006, 116-140. Psychology Press, New York, NY. L.-G. Nilsson, N. Ohta (Eds.).
8. Björkman M. Studies in predictive behavior: Explorations into predictive judgments based on functional learning and defined by estimation, categorization, and choice. Scandinavian Journal of Psychology 1965, 6:129-156. doi: 10.1111/j.1467-9450.1965.tb01030.x.
9. Brady F. A theoretical and empirical review of the contextual interference effect and the learning of motor skills. Quest 1998, 50:266-293.
10. Bransford J.D., Schwartz D.L. Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education 1999, 24:61-100. doi: 10.3102/0091732X024001061.
11. Brehmer A., Brehmer B., Brehmer B., Joyce C.R.B. What have we learned about human judgment from thirty years of policy capturing? Human judgment: The SJT view 1988, 75-114. North-Holland Elsevier, Amsterdam, the Netherlands, doi: 10.1016/S0166-4115(08)62171-8.
12. Brehmer B. Cue utilization and cue consistency in multiple-cue probability learning. Organizational Behavior and Human Decision Processes 1972, 8:286-296.
13. Brehmer B., Joyce C.R.B. Human judgment: The SJT view 1988, North-Holland Elsevier, Amsterdam, the Netherlands.
14. Brown A.L. Transforming schools into communities of thinking and learning about serious matters. American Psychologist 1997, 52:399-413. doi: 10.1037/0003-066X.52.4.399.
15. Brunswik E., Herma H. Probability learning of perceptual cues in the establishment of a weight illusion. Journal of Experimental Psychology 1951, 41:281-290. doi: 10.1037/h0057751.
16. Carlson R.A. Processing nonlinguistic negation. American Journal of Psychology 1989, 102:211-224. doi: 10.2307/1422953.
17. Carlson R.A., Schneider W. Acquisition context and the use of causal rules. Memory & Cognition 1989, 17:240-248.
18. Carlson R.A., Sullivan M.A., Schneider W. Practice and working memory effects in building procedural skill. Journal of Experimental Psychology: Learning, Memory, and Cognition 1989, 15:517-526. doi: 10.1037/0278-7393.15.3.517.
19. Carlson R.A., Yaure R.G. Practice schedules and the use of component skills in problem solving. Journal of Experimental Psychology: Learning, Memory, and Cognition 1990, 16:484-496. doi: 10.1037/0278-7393.16.3.484.
20. Chi M.T.H. Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. Advances in instructional psychology 2000, 161-238. Erlbaum, Mahwah, NJ. R. Glaser (Ed.).
21. Chi M.T.H., Bassok M., Lewis M.W., Reimann P., Glaser R. Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science 1989, 13:145-182. doi: 10.1207/s15516709cog1302_1.
22. Chi M.T.H., De Leeuw N., Chiu M.H., Lavancher C. Eliciting self-explanations improves understanding. Cognitive Science 1994, 18:439-477.
23. Clark A., Anderson R.C., Kuo L.J., Kim J., Archodido A., Nguyen-Jahiel K. Collaborative reasoning: Expanding ways for children to talk and think in school. Educational Psychology Review 2003, 15:181-198. doi: 10.1023/A:1023429215151.
24. Cohen M.S., Freeman J.T. Understanding and enhancing critical thinking in recognition-based decision making. Decision making under stress: Emerging themes and applications 1997, 161-169. Avebury Aviation. R. Flin, L. Martin (Eds.).
25. Cohen M.S., Freeman J.T., Thompson B.B. Critical thinking skills in tactical decision making: A model and a training strategy. Making decisions under stress: Implications for individual and team training 1998, 155-189. American Psychological Association, Washington, DC, doi: 10.1037/10278-006. J.A. Cannon-Bowers, E. Salas (Eds.).
26. Cohen M.S., Freeman J.T., Wolf S. Meta-recognition in time stressed decision making: Recognizing, critiquing, and correcting. Human Factors 1996, 38:206-219. doi: 10.1518/001872096779048020.
27. Craig S.D., Sullins J., Witherspoon A., Gholson B. The deep-level reasoning questions effect: The role of dialogue and deep-level reasoning questions during vicarious learning. Cognition and Instruction 2006, 24:565-591. doi: 10.1207/s1532690xci2404_4.
28. Cross E.S., Schmitt P.J., Grafton S.T. Neural substrates of contextual interference during motor learning support a model of active preparation. Journal of Cognitive Neuroscience 2007, 19:1854-1871. doi: 10.1162/jocn.2007.19.11.1854.
29. Davis E.A. Untangling dimensions of students' beliefs about scientific knowledge and science learning. International Journal of Science Education 2003, 25:439-468. doi: 10.1080/09500690210145765.
30. Davis E.A., Linn M.C. Scaffolding students' knowledge integration: Prompts for reflection in KIE. International Journal of Science Education 2000, 22:819-837. doi: 10.1080/095006900412293.
31. de Bruin A.B.H., Rikers R.M.J.P., Schmidt H.G. Monitoring accuracy and self-regulation when learning to play a chess endgame. Applied Cognitive Psychology 2005, 19:167-181. doi: 10.1002/acp.1109.
32. de Croock M.B.M., Van Merriënboer J.J.G., Paas F. High vs. low contextual interference in simulation based training of troubleshooting skills: Effects on transfer performance and invested mental effort. Computers in Human Behavior 1998, 14:249-267. doi: 10.1016/S0747-5632(98)00005-3.
33. Detterman D.K., Sternberg R.J. Transfer on trial: Intelligence, cognition, and instruction 1993, Ablex, Norwood, NJ.
34. Dhami M.K., Hertwig R., Hoffrage U. The role of representative design in an ecological approach to cognition. Psychological Bulletin 2004, 130:959-988. doi: 10.1037/0033-2909.130.6.959.
35. Dochy F.J.R.C. Assessment of prior knowledge as a determinant for future learning 1992, Lemma BV, Utrecht, the Netherlands.
36. Douglas M., Hosokawa M., Lawler F. A practical guide to clinical teaching in medicine 1988, Springer, New York, NY.
37. Drillings M., Serfaty D. Naturalistic decision making in command and control. Naturalistic decision making 1997, 71-80. Erlbaum, Mahwah, NJ. C.E. Zsambok, G. Klein (Eds.).
38. Ennis R. Critical thinking and subject-specificity: Clarification and needed research. Educational Researcher 1989, 18:4-10.
39. Ericsson K.A., Simon H.A. Protocol analysis: Verbal reports as data 1993, MIT Press, Cambridge, MA. rev. ed.
40. Facione P.A. Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction 1990, The California Academic Press, Millbrae, CA.
41. Ferguson-Hessler M.G.M., de Jong T. Studying physics text: Differences in study processes between good and poor performers. Cognition and Instruction 1990, 7:41-54. doi: 10.1207/s1532690xci0701_2.
42. Freeman J.T., Cohen M.S. Training for complex decision-making: A test of instruction based on the recognition/metacognition model. Proceedings of the 3rd International Command and Control Research and Technology Symposium 1996 1996, Retrieved from www.cog-tech.com/Publications/TrainingPubs.htm.
43. Frijters S., Ten Dam G., Rijlaarsdam G. Effects of dialogic learning on value-loaded critical thinking. Learning and Instruction 2008, 18:66-82. doi: 10.1016/j.learninstruc.2006.11.001.
44. Gagné R.M. Learning outcomes and their effects: Useful categories of human performance. American Psychologist 1984, 39:377-385. doi: 10.1037/0003-066X.39.4.377.
45. Guadagnoli M.A., Lee T.D. Challenge point: A framework for conceptualizing the effects of various practice conditions in motor learning. Journal of Motor Behavior 2004, 36:212-224. doi: 10.3200/JMBR.36.2.212-224.
46. Halpern D.F. Students need "reality checks." Education Digest 1997, 63:24-26.
47. Halpern D.F. Thought and knowledge: An introduction to critical thinking 2003, Erlbaum, Hillsdale, NJ. 4th ed.
48. Hammond K.R., Hursch C.J., Todd F.J. Analyzing the components of clinical inference. Psychological Review 1964, 71:438-456. doi: 10.1037/h0040736.
49. Hammond K.R., McClelland G.H., Mumpower J. Human judgment and decision making: Theories, decisions, and procedures 1980, Praeger, New York, NY.
50. Hatala R.M., Brooks L.M., Norman G.R. Practice makes perfect: The critical role of mixed practice in the acquisition of ECG interpretation skills. Advances in Health Sciences Education 2003, 8:17-26.
51. Helsdingen A.S., Van den Bosch K., Van Gog T., Van Merriënboer J.J.G. The effects of critical thinking instruction on learning complex judgment and decision making. Human Factors: The Journal of the Human Factors and Ergonomics Society 2010, Advance online publication. doi: 10.1177/0018720810377069.
52. Helsdingen A.S., Van Gog T., Van Merriënboer J.J.G. The effects of practice schedule on learning a complex judgment task. Learning and Instruction 2010, Advance online publication, doi: 10.1016/j.learninstruc.2009.12.001.
53. Hoffman P.J., Earle T.C., Slovic P. Multidimensional functional learning (MFL) and some new conceptions of feedback. Organizational Behavior and Human Performance 1981, 27:75-102. doi: 10.1016/0030-5073(81)90040-4.
54. Hogarth R.M. Judgment and choice 1980, Wiley, New York, NY.
55. Hursch C.J., Hammond K.R., Hursch J.L. Some methodological considerations in multiple-cue probability studies. Psychological Review 1964, 71:42-60. doi: 10.1037/h0041729.
56. Jacoby L.L. On interpreting the effects of repetition: Solving a problem versus remembering a solution. Journal of Verbal Learning and Verbal Behavior 1978, 17:649-667. doi: 10.1016/S0022-5371(78)90393-6.
57. Jamieson B.A., Rogers W.A. Age-related effects of blocked and random practice schedules on learning a new technology. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences 2000, 55(B):343-353.
58. Jelsma O., Van Merrienboer J.J., Bijlstra J.P. The ADAPT design model: Towards instructional control of transfer. Instructional Science 1988, 19:89-120.
59. Kanfer R., Ackerman P.L. Motivation and cognitive abilities: An integrative/aptitude treatment approach to skill acquisition. Journal of Applied Psychology 1989, 74:657-690.
60. Klaczynski P. Framing effects on adolescent task representations, analytic and heuristic processing, and decision making: Implications for the normative/descriptive gap. Applied Developmental Psychology 2001, 22:289-309.
61. Knutzon J.S., Walter B.E., Sannier A.V., Oliver J.H. An immersive approach to command and control. Journal of Battlefield Technology 2004, 7:37-42.
62. Kuhn D. A developmental model of critical thinking. Educational Researcher 1999, 28:16-25.
63. Lee A.Y., Hutchison L. Improving learning from examples through reflection. Journal of Experimental Psychology: Applied 1998, 4:187-210. doi: 10.1037/1076-898X.4.3.187.
64. Lee T.D., Magill R.A. The locus of contextual interference in motor-skill acquisition. Journal of Experimental Psychology: Learning, Memory, and Cognition 1983, 9:730-746. doi: 10.1037/0278-7393.9.4.730.
65. Lee T.D., Magill R.A. Can forgetting facilitate skill acquisition?. Differing perspectives in motor learning, memory, and control 1985, 3-22. Elsevier, Amsterdam, the Netherlands. D. Goodman, R.B. Wilberg, I.M. Franks (Eds.).
66. Lee T.D., Simon D.A. Contextual interference. Skill acquisition in sport: Research, theory and practice 2004, 29-44. Routledge, London, United Kingdom. A.M. Williams, N.J. Hodges (Eds.).
67. Lin C.H., Fisher B.E., Winstein C.J., Wu A.D., Gordon J. Contextual interference effect: Elaborative processing or forgetting-reconstruction? A post hoc analysis of transcranial magnetic stimulation-induced effects on motor learning. Journal of Motor Behavior 2008, 40:578-586. doi: 10.3200/JMBR.40.6.578-586.
68. Lipshitz R., Ben Shaul O. Schemata and mental models in recognition-primed decision making. Naturalistic decision making 1997, 293-303. Erlbaum, Mahwah, NJ. C.E. Zsambok, G.A. Klein (Eds.).
69. Magill R.A., Hall K.G. A review of contextual interference effect in motor skill acquisition. Human Movement Science 1990, 9:241-289. doi: 10.1016/0167-9457(90)90005-X.
70. Mayer R.E., Wittrock M.C. Problem-solving transfer. Handbook of educational psychology 1996, 47-62. Simon & Schuster Macmillan, New York, NY. D.C. Berliner, R.C. Calfee (Eds.).
71. Morgan N., Saxton J. Teaching, questioning and learning 1991, Routledge, London, United Kingdom.
72. Naidu S., Bernard R.M. Enhancing academic performance in distance education with concept mapping and inserted questions. Distance Education 1992, 13:218-233. doi: 10.1080/0158791920130205.
73. Nickerson R.S. Why teach thinking?. Teaching thinking skills: Theory and practice 1987, 27-37. Freeman, New York, NY. J.B. Baron, R.J. Sternberg (Eds.).
74. Norris S.P., Ennis R.H. Evaluating critical thinking 1989, Midwest, Pacific Grove, CA.
75. Oprins E. Design of a competence based assessment system for air traffic control training 2008, Doctoral thesis, University Press Maastricht.
76. Orlich D.C., Harder R.J., Callahan R.C., Kauchak D.P., Gibson H.W. Teaching strategies: A guide to better instruction 1994, Heath and Company, Toronto, Canada. 4th ed.
77. Paas F. Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology 1992, 84:429-434. doi: 10.1037/0022-0663.84.4.429.
78. Paas F., Van Merriënboer J.J.G. Variability of worked examples and transfer of geometrical problem-solving skills: A cognitive-load approach. Journal of Educational Psychology 1994, 86:122-133. doi: 10.1037/0022-0663.86.1.122.
79. Perkins D.N., Salomon G. Are cognitive skills context-bound?. Educational Researcher 1989, 18:6-95.
80. Renkl A. Learning from worked-out examples: A study on individual differences. Cognitive Science 1997, 21:1-29. doi: 10.1207/s15516709cog2101_1.
81. Richland L.E., Bjork R.A., Finley J.R., Linn M.C. Linking cognitive science to education: Generation and interleaving effects. Proceedings of the Twenty-Seventh Annual Conference of the Cognitive Science Society 2005, 1624. Erlbaum, Mahwah, NJ. B.G. Bara, L. Barsalou, M. Bucciarelli (Eds.).
82. Rowntree D. Exploring open and distance learning 1992, Kogan Page, London, United Kingdom.
83. Schmidt R.A., Bjork R.A. New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training. Psychological Science 1992, 3:207-217. doi: 10.1111/j.1467-9280.1992.tb00029.x.
84. Schneider V.I., Healy A.F., Bourne L.E. Contextual interference effects in foreign language vocabulary acquisition and retention. Foreign language learning: Psycholinguistic studies on training and retention 1998, 78-90. Erlbaum, Mahwah, NJ. A.F. Healy, L.E. Bourne (Eds.).
85. Schneider V.I., Healy A.F., Bourne L.E. What is learned under difficult conditions is hard to forget: Contextual interference effects in foreign vocabulary acquisition, retention and transfer. Journal of Memory and Language 2002, 46:419-440. doi: 10.1006/jmla.2001.2813.
86. Schneider V.I., Healy A.F., Ericsson K.A., Bourne L.E. The effects of contextual interference on the acquisition and retention of logical rules. Learning and memory of knowledge and skills: Durability and specificity 1995, 95-131. Sage, Thousand Oaks, CA. A.F. Healy, L.E. Bourne (Eds.).
87. Schnotz W., Kürschner C. A reconsideration of cognitive load theory. Educational Psychology Review 2007, 19:469-508. doi: 10.1007/s10648-007-9053-4.
88. Schworm S., Renkl A. Learning argumentation skills through the use of prompts for self-explaining examples. Journal of Educational Psychology 2007, 99:285-296. doi: 10.1037/0022-0663.99.2.285.
89. Shea J.B., Morgan R.L. Contextual interference effects on acquisition, retention and transfer of a motor skill. Journal of Experimental Psychology: Human Learning and Memory 1979, 5:179-187. doi: 10.1037/0278-7393.5.2.179.
90. Shea J.B., Titzer R.C. The influence of reminder trials on contextual interference effects. Journal of Motor Behavior 1993, 25:264-274.
91. Shea J.B., Zimny S.T. Contextual effects in memory and learning movement information. Memory and control of action 1983, 345-366. Elsevier, Amsterdam, the Netherlands. R.A. Magill (Ed.).
92. Shea J.B., Zimny S.T. Knowledge incorporation in motor representation. Complex movement behavior: "The" motor-action controversy 1988, 289-314. Elsevier, Amsterdam, the Netherlands. O.G. Meijer, K. Roth (Eds.).
93. Siegel H. The generalizability of critical thinking. Educational Philosophy and Theory 1991, 23:18-30. doi: 10.1111/j.1469-5812.1991.tb00173.x.
94. Simon D.A. Contextual interference effects with two tasks. Perceptual and Motor Skills 2007, 105:177-183.
95. Singley M.K., Anderson J.R. Transfer of cognitive skill 1989, Harvard University Press, Cambridge, MA.
96. Skinner B.F. Are theories of learning necessary?. Psychological Review 1950, 57:193-216. doi: 10.1037/h0054367.
97. Smedslund J. Multiple-probability learning: An inquiry into the origins of perception 1955, Oslo University Press, Oslo, Norway.
98. Stanovich K.E., West R.F. Advancing the rationality debate. Behavioral and Brain Sciences 2000, 23:701-717. doi: 10.1017/S0140525X00623439.
99. Sweller J., van Merriënboer J.J.G., Paas F. Cognitive architecture and instructional design. Educational Psychology Review 1998, 10:251-296. doi: 10.1023/A:1022193728205.
100. Thorndike E.L. The contribution of psychology to education. Journal of Educational Psychology 1910, 1:5-12. Retrieved from http://psychclassics.yorku.ca/Thorndike/education.htm.
101. Tsui L. Courses and instruction affecting critical thinking. Research in Higher Education 1999, 40:185-200. doi: 10.1023/A:1018734630124.
102. van den Boom G., Paas F., Van Merriënboer J.J.G. Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes. Learning and Instruction 2007, 17:532-548. doi: 10.1016/j.learninstruc.2007.09.003.
103. van den Boom G., Paas F., Van Merriënboer J.J.G., Van Gog T. Reflection prompts and tutor feedback in a web-based learning environment: Effects on students' self-regulated learning competence. Computers in Human Behavior 2004, 20:551-567. doi: 10.1016/j.chb.2003.10.001.
104. van Gog T., Paas F., van Merriënboer J.J.G. Effects of process-oriented worked examples on troubleshooting transfer performance. Learning and Instruction 2006, 16:154-164. doi: 10.1016/j.learninstruc.2006.02.003.
105. van Gog T., Paas F., van Merriënboer J.J.G., Witte P. Uncovering the problem-solving process: Cued retrospective reporting versus concurrent and retrospective reporting. Journal of Experimental Psychology: Applied 2005, 11:237-244. doi: 10.1037/1076-898X.11.4.237.
106. Winne P.H. Inherent details in self-regulated learning. Educational Psychologist 1995, 30:173-187. doi: 10.1207/s15326985ep3004_2.
107. Wulf G., Shea C.H. Principles derived from the study of simple skills do not generalize to complex skill learning. Psychological Bulletin & Review 2002, 9:185-211.
108. Zechmeister E., Johnson J. Critical thinking: A functional approach 1992, Brooks/Cole, Pacific Grove, CA.