Controlling Uncertainty: A Review of Human Behavior in Complex Dynamic Environments

Psychological Bulletin

Volumn 136, Issue 1, 2010, Pages 65-86

  Osman, Magda ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

agency; causality; complex tasks; control; dynamic; monitoring; uncertainty

Indexed keywords

ARTICLE; HUMAN; PERCEPTION; PSYCHOLOGICAL THEORY; SOCIAL BEHAVIOR; SOCIAL ENVIRONMENT;

HUMANS; PSYCHOLOGICAL THEORY; SOCIAL BEHAVIOR; SOCIAL ENVIRONMENT; SOCIAL PERCEPTION;

EID: 74049093069     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0017815     Document Type: Article

References (229)

1. Anderson J.R. Acquisition of cognitive skill. Psychological Review 89 (1982) 369-406
2. Anderson J.R., and Lebiere C. The atomic components of thought (1998), Erlbaum, Mahwah, NJ
3. Anzai Y. Cognitive control of real-time event driven systems. Cognitive Science 8 (1984) 221-254
4. Atkins P., Wood R., and Rutgers P. The effects of feedback format on dynamic decision making. Organizational Behavior and Human Decision processes 88 (2002) 587-604
5. Bandura A. Self-efficacy: Towards a unifying theory of behavioral change. Psychological Review 84 (1977) 191-215
6. Bandura A. Human agency in social cognitive theory. American Psychologist 44 (1989) 1175-1184
7. Bandura A. Social cognitive theory of self-regulation. Organizational Behavior and Human Decision Processes 50 (1991) 248-287
8. Bandura A. Social cognitive theory: An agentic perspective. Annual Review of Psychology 52 (2001) 1-26
9. Bandura A., and Locke E.A. Negative self-efficacy and goal effects revisited. Journal of Applied Psychology 88 (2003) 87-99
10. Bandura A., and Wood R.E. Effect of perceived controllability and performance standards on self-regulation of complex decision making. Journal of Personality and Social Psychology 56 (1989) 805-814
11. Berardi-Coletta B., Dominowski R., Buyer S., and Rellinger E. Metacognition and problem solving: A process orientated approach. Journal of Experimental Psychology: Learning, Memory, and Cognition 21 (1995) 205-223
12. Berry D. The role of action in implicit learning. Quarterly Journal of Experimental Psychology 43 (1991) 881-906
13. Berry D., and Broadbent D.E. On the relationship between task performance and associated verbalizable knowledge. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 36 A (1984) 209-231
14. Berry D., and Broadbent D.E. The combination of implicit and explicit knowledge in task control. Psychological Research 49 (1987) 7-15
15. Berry D.C., and Broadbent D.E. Interactive tasks and the implicit-explicit distinction. British Journal of Psychology 79 (1988) 251-272
16. Bisantz A.M., Kirlik A., Gay P., Phipps D., Walker N., and Fisk A.D. Modeling and analysis of a dynamic judgment task using a lens model approach. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 30 (2000) 605-616
17. Blakemore S.J., Frith C.D., and Wolpert D.M. The cerebellum is involved in predicting the sensory consequences of action. NeuroReport 12 (2001) 1879-1884
18. Blakemore S.J., Wolpert D.M., and Frith C.D. Central cancellation of self-produced tickle sensation. Nature Neuroscience 1 (1998) 635-640
19. Bouffard-Bouchard T. Influence of self-efficacy on performance in a cognitive task. Journal of Social Psychology 130 (1990) 353-363
20. Brandouy O. Laboratory incentive structure and control-test design in an experimental asset market. Journal of Economic Psychology 1 (2001) 1-26
21. Bredereke J., and Lankenau A. Safety-relevant mode confusions modelling and reducing them. Reliability Engineering and System Safety 88 (2005) 229-245
22. Brehmer B. Dynamic decision making: Human control of complex systems. Acta Psychologica 81 (1992) 211-241
23. Brehmer B., and Allard R. Dynamic decision making: The effects of task complexity and feedback delay. In: Rasmussen J., Brehmer B., and Leplat J. (Eds). Distributed decision making: Cognitive models for cooperative work (1991), Wiley, Brisbane, Queensland, Australia 319-334
24. Brehmer B., and Dörner D. Experiments with computer-simulated microworlds: Escaping both the narrow straits of the laboratory and the deep blue sea of the field study. Computers in Human Behavior 9 (1993) 171-184
25. Brézillon P., Pomerol J.-Ch., and Saker I. Contextual and contextualized knowledge: An application in subway control. International Journal on Human Computer Studies 48 (1998) 357-373
26. Broadbent D.E. Levels, hierarchies and the locus of control. Quarterly Journal of Experimental Psychology 32 (1977) 109-118
27. Broadbent D.E., and Ashton B. Human control of a simulated economic system. Ergonomics 78 (1978) 1035-1043
28. Broadbent D.E., Fitzgerald P., and Broadbent M.H.P. Implicit and explicit knowledge in the control of complex systems. British Journal of Psychology 77 (1986) 33-50
29. Brown S., and Steyvers M. The dynamics of experimentally induced criterion shifts. Journal of Experimental Psychology: Learning, Memory, and Cognition 31 (2005) 587-599
30. Buchner A., and Funke J. Finite-state automata: Dynamic task environments in problem-solving research. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 46 A (1993) 83-118
31. Buchner A., Funke J., and Berry D. Negative correlations between control performance and verbalizable knowledge; indicators for implicit learning in process CDCTs. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 48 A (1995) 166-187
32. Burns B.D., and Vollmeyer R. Goal specificity effects on hypothesis testing in problem solving. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 55 A (2002) 241-261
33. Busemeyer J.R. Dynamic decision making. In: Smelser N.J., and Bates P.B. (Eds). International encyclopedia of the social and behavioral sciences: Methodology, mathematics and computer science (2002), Elsevier, Oxford, England 3903-3908
34. Busemeyer J.R., Jessup R.K., Johnson J.G., and Townsend J.T. Building bridges between neural models and complex decision making behaviour. Neural Networks 19 (2006) 1047-1058
35. Busemeyer J.R., and Townsend J.T. Decision field theory: A dynamic cognitive approach to decision making in an uncertain environment. Psychological Review 100 (1993) 432-459
36. Camp G., Paas F., Rikers R., and Van Merriënboer J. Dynamic problem selection in air traffic control training: A comparison between performance, mental effort and mental efficiency. Computers in Human Behavior 17 (2001) 575-595
37. Campbell D. Task complexity: A review and analysis. The Academy of Management Review 13 (1988) 40-52
38. Carrasco F., Llauró X., and Poch M. A methodological approach to knowledge-based control and its application to a municipal solid waste incineration plant. Combustion Science and Technology 178 (2008) 685-705
39. Cervone D., Jiwani N., and Wood R. Goal setting on the differential influence of self-regulatory processes on complex decision-making performance. Journal of Personality and Social Psychology 61 (1991) 257-266
40. Chater N., Tenenbaum J., and Yuille. Probabilistic models of cognition: Conceptual foundations. Trends in Cognitive Sciences 10 (2006) 287-291
41. Chéry, S., Vicente, K. J., & Farrell, P. (1999). Perceptual control theory and ecological interface design: Lessons learned from the CDU. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 389-393). Santa Monica, CA: Human Factors and Ergonomics Society.
42. Chesney A., and Locke E. An examination of the relationship among goal difficulty, business strategies, and performance on a complex management simulation task. Academy of Management Journal 34 (1991) 400-424
43. Chmiel N., and Wall T. Fault prevention, job design, and the adaptive control of advance manufacturing technology. Applied Psychology: An International Review 43 (1994) 455-473
44. Christoffersen K., Hunter C., and Vicente K. A longitudinal study of the effects of ecological interface design on deep knowledge. International Journal of Human-Computer Studies 48 (1998) 729-762
45. Cohen M.S., Freeman J.T., and Wolf S. Meta-cognition in time stressed decision making: Recognizing, critiquing and correcting. Human Factors 38 (1996) 206-219
46. Coury B.G., Boulette M.D., and Smith R.A. Effect of uncertainty and diagnosticity on classification of multidimensional data with integral and separable displays of system status. Human Factors 31 (1989) 551-570
47. Crandall B., and Calderwood R. Clinical assessment skills of experienced neonatal intensive care nurses [Final report] (1989), Klein Associates, Yellow Springs, OH
48. Dandurand F., Bowen M., and Shultz T.R. Learning by imitation, reinforcement and verbal rules in problem-solving tasks. In: Triesch J., and Jebara T. (Eds). Proceedings of the Third International Conference on Development and Learning: Developing social brains (2004), University of California, San Diego, Institute for Neural Computation, La Jolla, CA 88-95
49. David N., Newen A., and Vogeley K. The "sense of agency" and its underlying cognitive and neural mechanisms. Consciousness and Cognition 17 (2008) 523-534
50. Daw N.D., Niv L., and Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 8 (2005) 1704-1711
51. Degani A. Taming HAL: Designing interfaces beyond 2001 (2004), Palgrave Macmillan, New York, NY
52. Degani A., and Heymann M. Formal verification of human-automation interaction. Human Factors 44 (2002) 28-43
53. Degani J.A.S., Shafto M., and Kirlik A. What makes vicarious functioning work? Exploring the geometry of human-technology interaction. In: Kirlik A. (Ed). In adaptive perspectives on human-technology interaction (2006), Oxford University Press, New York, NY 179-196
54. DeShon R.P., and Alexander R.A. Goal setting effects on implicit and explicit learning of complex tasks. Organizational Behavior and Human Decision Processes 65 (1996) 18-36
55. Diehl E., and Sterman J.D. Effects of feedback complexity on dynamic decision making. Organizational Behavior and Human Decision Processes 62 (1995) 198-215
56. Dienes Z., and Berry D. Implicit learning: Below the subjective threshold. Psychonomic Bulletin & Review 4 (1997) 3-23
57. Dienes Z., and Fahey R. Role of specific instances in controlling a dynamic system. Journal of Experimental Psychology: Learning, Memory, and Cognition 21 (1995) 848-862
58. Dienes Z., and Fahey R. The role of implicit memory in controlling a dynamic system. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 51 A (1998) 593-614
59. DiFonzo N., and Bordia P. Rumor and prediction: Making sense (but losing dollars) in the stock market. Organizational Behavior and Human Decision Processes 71 (1997) 329-353
60. DiFonzo N., Hantula D.A., and Bordia P. Microworlds for experimental research: Having your (control and collection) cake, and realism too. Behavior Research Methods, Instruments, & Computers 30 (1998) 278-286
61. Dörner D. Wie menschen eine welt verbessern wollten und sie dabei zerstörten [How people wanted to improve the world]. Bild der Wissenschaft 12 (1975) 48-53
62. Dörner D. The logic of failure (1989), Holt, New York, NY
63. Dörner D., Kreuzig H.W., Reither F., and Staudel T. Lohhausen: Vom Umgang mit Unbestimmtheit und Komplexitat [Lohhausen: On dealing with uncertainty and complexity] (1983), Hans Huber, Bern, Switzerland
64. Earley P.C., Connolly T., and Ekegren G. Goals, strategy development and task performance: Some limits on the efficacy of goal setting. Journal of Applied Psychology 74 (1989) 24-33
65. Earley P.C., Northcraft G.B., Lee C., and Lituchy T.R. Impact of process and outcome feedback on the relation of goal setting to task performance. Academy of Management Journal 33 (1990) 87-105
66. Ehret B.D., Gray W.D., and Kirschenbaum S.S. Contending with complexity: Developing and using a scaled world in applied cognitive research. Human Factors 42 (2000) 8-23
67. Einhorn H. Expert judgment: Some necessary conditions and an example. Journal of Applied Psychology 59 (1974) 562-571
68. Einhorn H., and Hogarth R. Behavioral decision theory: Processes of judgment and choice. Annual Review of Psychology 32 (1981) 53-88
69. Eitam B., Hassan R., and Schul Y. Nonconscious goal pursuit in novel environments. The case of implicit learning. Psychological Science 19 (2008) 261-267
70. Elsner B., and Hommel B. Effect anticipation and action control. Journal of Experimental Psychology: Human Perception and Performance 27 (2001) 229-240
71. Elsner B., and Hommel B. Contiguity and contingency in action-effect learning. Psychological Research 68 (2004) 138-154
72. Ericsson K.A., and Lehman A. Expert and exceptional performance: Evidence of maximal adaptation to constraints. Annual Review of Psychology 47 (1996) 273-305
73. Farrington-Darby T., and Wilson J. The nature of expertise: A review. Applied Ergonomics 37 (2006) 17-32
74. Flach R., Osman M., Dickinson A., and Heyes C. The interaction between response effects during the acquisition of response priming. Acta Psychologica 122 (2006) 11-26
75. Fredrickson J.W., and Mitchell T.R. Strategic decision processes: Comprehensiveness and performance in an industry with an unstable environment. Academy of Management Journal 27 (1984) 399-423
76. Funke J. Dynamic systems as tools for analyzing human judgment. Thinking and Reasoning 7 (2001) 69-89
77. Gardner P.H., Chmiel N., and Wall T. Implicit knowledge and fault diagnosis in the control of advanced manufacturing technology. Behaviour & Information Technology 15 (1996) 205-212
78. Gatfield D. Can cognitive science improve the training of industrial process operators. Journal of Safety Research 30 (1999) 133-142
79. Gebauer G.F., and Mackintosh N.J. Psychometric intelligence dissociates implicit and explicit learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 33 (2007) 34-54
80. Geddes B.W., and Stevenson R.J. Explicit learning of a dynamic system with a non-salient pattern. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 50 A (1997) 742-765
81. Gibson F.P. Learning and transfer in dynamic decision environments. Computational and Mathematical Organizational Theory 13 (2007) 39-61
82. Gibson F.P., Fichman M., and Plaut D.C. Learning in dynamic decision tasks: Computational model and empirical evidence. Organizational Behavior and Human Performance 71 (1997) 1-35
83. Gilboa I., and Schmeidler D. Case-based decision theory. The Quarterly Journal of Economics 110 (1995) 605-639
84. Goa J., and Lee J. Extending the decision field theory to model operators' reliance on automation in supervisory control situations. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 36 (2006) 943-959
85. Goldsmith M., and Koriat A. The strategic regulation of memory accuracy and informativeness. In: Benjamin A., and Ross B. (Eds). The psychology of learning and motivation, Vol. 48: Skill and strategy in memory use 48 (2008), Academic Press, Amsterdam, the Netherlands 1-60
86. Goldsmith M., Koriat A., and Pansky A. Strategic regulation of grain size in memory reporting over time. Journal of Memory and Language 52 (2005) 505-525
87. Gonzales C. Decision support for real-time, dynamic decision-making tasks. Organizational Behavior and Human Decision Processes 96 (2005) 142-154
88. Gonzalez C., Lerch J.F., and Lebiere C. Instance-based learning in dynamic decision making. Cognitive Science 27 (2003) 591-635
89. Gonzalez C., Vanyukov P., and Martin M.K. The use of microworlds to study dynamic decision making. Computers in Human Behavior 21 (2005) 273-286
90. Gray W.D. Simulated task environments: The role of high-fidelity simulations, scaled worlds, synthetic environments, and laboratory tasks in basic and applied cognitive research. Cognitive Science Quarterly 2 (2002) 205-227
91. Gray W.D., Schoelles M.J., and Myers C.W. Computational cognitive models ISO ecologically optimal strategies. 46th Annual Conference of the Human Factors and Ergonomics Society (2002), Human Factors and Ergonomics Society, Santa Monica, CA 492-496
92. Hoffman R., Shadbolt N., Burton M., and Klein G. Eliciting knowledge from experts: A methodological analysis. Organizational Behavior and Human Decision Processes 62 (1995) 126-158
93. Hogarth R.-M., and Makridakis S. Forecasting and planning: An evaluation. Management Science 27 (1981) 115-138
94. Hommel B. Perceiving one's own action-and what it leads to. In: Jordan J.S. (Ed). Systems theories and a priori aspects of perception (1998), Elsevier Science, Amsterdam, the Netherlands 143-179
95. Horvitz E.J., Breese J.S., and Henrion M. Decision theory in expert systems and artificial intelligence. International Journal of Approximate Reasoning 3 (1988) 247-302
96. Hsiao, N., & Richardson, G. P. (1999, July). In search of theories of dynamic decision making: A literature review. Paper presented at the 17th International Conference of the System Dynamics Society, Wellington, New Zealand. Retrieved from http://www.systemdynamics.org/conferences/1999/PAPERS/PLEN16.PDF
97. Huettel S., Song A., and McCarthy G. Decision under uncertainty: Probabilistic context influences activation of prefrontal and parietal cortices. The Journal of Neuroscience 25 (2005) 3304-3311
98. Hunter K.O., Hart W.E., and Forsythe C. A naturalistic decision making model for simulated human combatants (Technical Rep. No. SAND2000-0974) (2000), Sandia National Laboratories, Albuquerque, NM
99. Jagacinski R.J., and Flach J.M. Control theory for humans: Quantitative approaches to modeling performance (2003), Erlbaum, Mahwah, NJ
100. Jamieson G.A., Miller C.M., Ho W.H., and Vicente K.J. Integrating task- and work domain-based work analysis in ecological interface design: A process control case study. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 6 (2007) 887-905
101. Jensen E., and Brehmer B. Understanding and control of a simple dynamic system. System Dynamics Review 19 (2003) 119-137
102. Jonassen D., and Hung W. All problems are not equal: Implications for problem-based learning. The Interdisciplinary Journal of Problem-Based Learning 2 (2008) 6-28
103. Jones P., and Mitchell C. Model-based communicative acts: Human-computer collaboration in supervisory control. International Journal of Human Computer Studies 41 (1994) 527-551
104. Joslyn S., and Hunt E. Evaluating individual differences in response to time-pressure situations. Journal of Experimental Psychology: Applied 4 (1998) 16-43
105. Jungermann H., and Thüring M. Causal knowledge and the expression of uncertainty. In: Strube G., and Wender K.F. (Eds). The cognitive psychology of knowledge (1993), Elsevier Science, Amsterdam, the Netherlands 53-73
106. Kaber D.B., and Endsley M.R. The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomics Science 5 (2004) 113-153
107. Kanfer R., and Ackerman P.L. Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approach to skill acquisition [Monograph]. Journal of Applied Psychology 74 (1989) 657-690
108. Kanfer R., Ackerman P.L., Murtha T.C., Dugdale B., and Nelson L. Goals setting, conditions of practice, and task performance: A resource allocation perspective. Journal of Applied Psychology 79 (1994) 826-835
109. Karelaia N., and Hogarth R. Determinants of linear judgment: A meta-analysis of lens model studies. Psychological Bulletin 134 (2008) 404-426
110. Karoly P. Mechanisms of self-regulation: A systems view. Annual Review of Psychology 44 (1993) 23-52
111. Kerstholt J.H. The effect of information cost on strategy selection in dynamic tasks. Acta Psychologica 94 (1996) 273-290
112. Kerstholt J.H., and Raaijmakers J.G.W. Decision making in dynamic task environments. In: Ranyard R., Crozier R.W., and Svenson O. (Eds). Decision making: Cognitive models and explanations (1997), Rutledge, New York, NY 205-217
113. Kirlik A. Conceptual and technical issues in extending computational cognitive modeling to aviation. In: Jacko J. (Ed). Human-computer interaction. Interaction design and usability, 12th International Conference, HCI International 2007, Beijing, China, July 22-27, 2007, Proceedings, Part I (2007), Springer-Verlag, Berlin 872-881
114. Kirlik A., Miller R.A., and Jagacinski R.J. Supervisory control in a dynamic and uncertain environment: A process model of skilled human-environment interaction. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 23 (1993) 929-952
115. Kirlik A., and Strauss R. Situation awareness as judgment: I. Statistical modeling and quantitative measurement. International Journal of Industrial Ergonomics 36 (2006) 463-474
116. Klahr D., and Dunbar K. Dual space search during scientific reasoning. Cognitive Science 12 (1988) 1-55
117. Klahr D., and Simon H. Studies of scientific discovery: Complementary approaches and convergent findings. Psychological Bulletin 125 (1999) 524-543
118. Klein G. A recognition-primed decision (RPD) model of rapid decision making. In: Klein G.A., Orasanu J., Calderwood R., and Zambok C.E. (Eds). Decision making in action: Models and methods (1993), Ablex, Norwood, CT
119. Klein G. Developing expertise in decision making. Thinking and Reasoning 3 (1997) 337-352
120. Klein G., and Hoffman R.R. Perceptual-cognitive aspects of expertise. In: Rabinowiz M. (Ed). Cognitive science foundations of instruction (1993), Erlbaum, Hillsdale, NJ 203-226
121. Klein, G., & Wolf, (1995). Decision-centered training. In Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting (pp. 1249-1252). Santa Monica, CA: Human Factors and Ergonomics Society.
122. Kleinmuntz D.N. Cognitive heuristics and feedback in a dynamic decision environment. Management Science 31 (1985) 680-702
123. Klostermann A., and Thüring M. Visualisation of topological structures as a training tool for acquiring causal models of complex systems. In: Brinkman W.-P., Ham D.-H., and Wong B.L.W. (Eds). ECCE 2007-Proceedings of the 14th European Conference on Cognitive Ergonomics (2007), ACM, New York 307-308
124. Kluge A. Performance assessments with microworlds and their difficulty. Applied Psychological Measurement 32 (2008) 156-180
125. Kluge A. What you train is what you get? Task requirements and training methods in complex problem-solving. Computers in Human Behavior 24 (2008) 284-308
126. Knowlton B.J., Mangels J.A., and Squire L.R. A neostriatal habit learning system in humans. Science 273 (1996, September 6) 1399-1402
127. Kobus D., Proctor S., and Holste S. Effects of experience and uncertainty during dynamic decision making. International Journal of Industrial Ergonomics 28 (2001) 275-290
128. Kording K.P., and Wolpert D.M. Bayesian decision theory in sensorimotor control. Trends in Cognitive Sciences 10 (2006) 319-326
129. Koriat A. Metamemory: The feeling of knowing and its vagaries. In: Sabourin M., Craik F.I.M., and Robert M. (Eds). Advances in psychological science 2 (1998), Psychology Press, Hove, England 461-469
130. Koriat A., Ma'ayan H., and Nussinson R. The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior. Journal of Experimental Psychology: General 135 (2006) 36-69
131. Kornell N., Son L.K., and Terrace H.S. Transfer of metacognitive skills and hint seeking in monkeys. Psychological Science 18 (2007) 64-71
132. Krueger G.P. Sustained work, fatigue, sleep loss and performance: A review of the issues. Work Stress 3 (1989) 129-141
133. Krynski T., and Tenenbaum J. The role of causality in judgment under uncertainty. Journal of Experimental Psychology: General 136 (2007) 430-450
134. Lagnado D., and Sloman S. The advantage of timely intervention. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 856-876
135. Laird J.E., Newell A., and Rosenbloom P.S. Soar: An architecture for general intelligence. Artificial Intelligence 33 (1987) 1-64
136. Langley P.A., and Morecroft J.D. Performance and learning in a simulation of oil industry dynamics. European Journal of Operational Research 155 (2004) 715-732
137. Lee Y. Effects of learning contexts on implicit and explicit learning. Memory & Cognition 23 (1995) 723-734
138. Leen G., and Heffernan D. Expanding automotive electronic systems. Computer 35 (2002) 88-93
139. Lehmann A.C., and Ericsson K.A. Research on expert performance and deliberate practice: Implications for the education of amateur musicians and music students. Psychomusicology 16 (1997) 40-58
140. Lerch F.J., and Harter D.E. Cognitive support for real-time dynamic decision making. Information Systems Research 12 (2001) 63-82
141. Lichacz F. Examining the effects of combined stressors on dynamic task performance. International Journal of Aviation Psychology 15 (2005) 45-66
142. Linou N., and Kontogiannis T. The effect of training systemic information on the retention of fault-finding skills in manufacturing industries. Human Factors and Ergonomics in Manufacturing 14 (2004) 197-217
143. Lipshitz R., and Barak D. Hindsight wisdom: Outcome knowledge and the evaluation of decisions. Acta Psychologica 88 (1995) 105-125
144. Lipshitz R., Klein G., Orasanu J., and Salas E. Taking stock of naturalistic decision making. Journal of Behavioral Decision Making 14 (2001) 332-351
145. Lipshitz R., and Strauss O. Coping with uncertainty: A naturalistic decision-making analysis. Organizational Behavior and Human Decision Processes 69 (1997) 149-163
146. Locke E.A. Goal theory vs. control theory: Contrasting approaches to understanding work motivation. Motivation and Emotion 15 (1991) 9-28
147. Locke E.A. Motivation, cognition, and action: An analysis of studies of task goals and knowledge. Applied Psychology: An International Review 49 (2000) 408-429
148. Locke E.A., and Latham G.P. A theory of goal setting and task performance (1990), Prentice-Hall, Englewood Cliffs, NJ
149. Locke E.A., and Latham G.P. Building a practically useful theory of goal setting and task motivation. American Psychologist 57 (2002) 705-717
150. Logan G. Towards an instance based theory of automatization. Psychological Review 95 (1988) 492-527
151. Marescaux P.-J., Luc F., and Karnas G. Modes d'apprentissage selectif et nonselectif et connaissances acquies au control d'un processes: Evaluation d'un modele simule [Selective and nonselective learning modes and acquiring knowledge of process control: Evaluation of a simulation model]. Cahiers de Psychologie Cognitive 9 (1989) 239-264
152. McAdams H.H., and Shapiro L. Circuit simulation of genetic networks. Science 269 (1995, August 4) 650-656
153. Medin D.L., and Schaffer M.M. Context theory of classification learning. Psychological Review 85 (1978) 207-238
154. Metzger U., and Parasuraman R. Automation in future air traffic management: Effects of decision aid reliability on controller performance and mental workload. Human Factors 47 (2005) 35-49
155. Miller C.S., Lehman J.F., and Koedinger K.R. Goals and learning in microworlds. Cognitive Science 23 (1999) 305-336
156. Miller G.A., Galanter E., and Pribram K.H. Plans and the structure of behavior (1960), Holt, New York, NY
157. Morin L., and Latham G.P. Effect of mental practice and goal setting as a transfer of training intervention on supervisors' self-efficacy and communication skills: An exploratory study. Applied Psychology: An International Review 49 (2000) 566-578
158. Mosier K.L., Sethi N., McCauley S., and Khoo L. What you don't know can hurt you: Factors impacting diagnosis in the automated cockpit. Human Factors 49 (2007) 300-310
159. Moxnes E. Not only the tragedy of the commons: Misperceptions of feedback and policies for sustainable development. System Dynamics Review 16 (2000) 325-348
160. Newell A., and Simon H.A. Human problem solving (1972), Prentice-Hall, Englewood, NJ
161. Nosofsky R.M., Kruschke J.K., and McKinley S.C. Combining exemplar-based category representations and connectionist learning rules. Journal of Experimental Psychology: Learning, Memory, and Cognition 18 (1992) 211-233
162. Olson J., Roese N., and Zanna M. Expectancies. In: Higgins E., and Kruglanski A. (Eds). Social psychology: Handbook of basic principles (1996), Guilford Press, London, England 211-238
163. Orasanu J., and Connolly T. The reinvention of decision making. In: Klein G., Orasanu J., and Calderwood R. (Eds). Decision making in action: Models and methods (1993), Ablex, Norwood, NJ 3-20
164. Osman M. Should action be awarded a special status in learning?. In: Galwye V.N. (Ed). Progress in educational psychology research (2007), Nova, Hauppauge, NY 23-47
165. Osman M. Observation can be as effective as action in problem solving. Cognitive Science 32 (2008) 162-183
166. Osman M. Positive transfer and negative transfer/antilearning of problem-solving skills. Journal of Experimental Psychology: General 137 (2008) 97-115
167. Osman M. Seeing is as good as doing [Article 3]. Journal of Problem Solving 2 1 (2008). http://docs.lib.purdue.edu/jps/vol2/iss1/3 Retrieved from http://docs.lib.purdue.edu/jps/vol2/iss1/3
168. Osman M., Wilkinson L., Beigi M., Parvez C., and Jahanshahi M. The striatum and learning to control a complex system?. Neuropsychologia 46 (2008) 2355-2363
169. Paas F., Renkl A., and Sweller J. Cognitive load theory and instructional design: Recent developments. Educational Psychologist 38 (2003) 1-4
170. Pacherie E. The phenomenology of action: A conceptual framework. Cognition 107 (2008) 179-217
171. Papadelis C., Kourtidou-Papadeli C., Bamidis P., and Albani M. Effects of imagery training on cognitive performance and use of physiological measures as an assessment tool of mental effort. Brain and Cognition 64 (2007) 74-85
172. Patel V.L., and Groen G.J. The general and specific nature of medical expertise: A critical look. In: Ericsson K.A., and Smith J. (Eds). Toward a general theory of expertise: Prospects and limits (1991), Cambridge University Press, Cambridge, England 93-125
173. Patrick J., and James N. Process tracing of complex cognitive work tasks. Journal of Occupational and Organizational Psychology 77 (2004) 259-280
174. Pearl J. Causality: Models, reasoning, and inference (2000), Cambridge University Press, Cambridge, England
175. Pomerol J.-Ch., and Brézillon P. Dynamics between contextual knowledge and proceduralized context. In: Bouquet P., Serafini L., Brézillon P., Benerecetti M., and Castellani F. (Eds). Modeling and using context: Second International and Interdisciplinary Conference, CONTEXT'99, Trento, Italy, September 9-11, 1999, Proceedings (1999), Springer-Verlag, Berlin 284-295
176. Pomerol J.-C., and Brézillon P. About some relationships between knowledge and context. In: Bouquet P., Serafini L., Brézillon P., Benerecetti M., and Castellani F. (Eds). Modeling and using context: Third International and Interdisciplinary Conference, CONTEXT, 2001, Dundee, UK, July 27-30, 2001, Proceedings (2001), Springer-Verlag, Berlin 461-464
177. Powers W.T. Quantitative analysis of purposive systems: Some spadework at the foundations of scientific psychology. Psychological Review 85 (1978) 417-435
178. Quesada J., Kintsch W., and Gomez E. Complex problem solving: A field in search for a definition?. Theoretical Issues in Ergonomic Science 6 (2005) 5-33
179. Randel J.M., Pugh L., and Reed S.K. Differences in expert and novice situation awareness in naturalistic decision making. International Journal of Human Computer Studies 45 (1996) 579-597
180. Rasmussen J. The role of hierarchical knowledge representation in decision making and system management. IEEE Transactions on Systems, Man, and Cybernetics, SMC-15 (1985) 234-243
181. Rigas G., and Brehmer B. Mental processes in intelligence tests and dynamics decision making tasks (1999), Erlbaum, London, England
182. Rigas G., Carling E., and Brehmer B. Reliability and validity of performance measures in microworlds. Intelligence 30 (2002) 463-480
183. Rossano M.J. Expertise and the evolution of consciousness. Cognition 89 (2003) 207-236
184. Rothrock L., and Kirlik A. Inferring rule-based strategies in dynamic judgment tasks: Towards a noncompensatory formulation of the lens model. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 33 (2003) 58-72
185. Salden R.J.C.M., Paas F., Broers N.J., and van Merriënboer J.J.G. Mental effort and performance as determinants for the dynamic selection of learning tasks in air traffic control training. Instructional Science 32 (2004) 153-172
186. Sanderson P.M. Verbalizable knowledge and skilled task performance: Association, dissociation, and mental models. Journal of Experimental Psychology: Learning, Memory, and Cognition 15 (1989) 729-747
187. Sarter N.B., Mumaw R.J., and Wickens C.D. Pilots' monitoring strategies and performance on automated flight decks: An empirical study combining behavioral and eye-tracking data. Human Factors 49 (2007) 347-357
188. Sauer J., Burkolter D., Kluge A., Ritzmann S., and Schüler K. The effects of heuristic rule training on operator performance in a simulated process control environment. Ergonomics 7 (2008) 953-967
189. Schmitt J.F., and Klein G. Fighting in the fog: Dealing with battlefield uncertainty. Marine Corps Gazette 80 (1996) 62-69
190. Schoppek W. Examples, rules and strategies in the control of dynamic systems. Cognitive Science Quarterly 2 (2002) 63-92
191. Seijts G.H., and Latham G.P. The effect of learning, outcome, and proximal goals on a moderately complex task. Organizational Behavior and Human Decision Processes 46 (2001) 118-134
192. Shanks D.R., and St. John M.F. Characteristics of dissociable human learning systems. Behavioral and Brain Sciences 17 (1994) 367-447
193. Shanteau J., and Stewart T.R. Why study expert decision making?. Organizational Behavior and Human Decision Processes 53 (1992) 95-106
194. Sheridan T.B. Humans and automation: Systems design and research issues (2002), Wiley, Santa Monica, CA
195. Simon H.A., and Lea G. Problem solving and rule induction: A unified view. In: Gregg L.W. (Ed). Knowledge and cognition (1974), Erlbaum, Hillsdale, NJ 105-127
196. Smith J.D., Shields W.E., and Washburn D.A. The comparative psychology of uncertainty monitoring and metacognition. Behavioral and Brain Sciences 26 (2003) 317-373
197. Spering M., Wagener D., and Funke J. The role of emotions in complex problem-solving. Cognition & Emotion 19 (2005) 1252-1261
198. Squire L. Mechanisms of memory. Science 232 (1986, June 27) 1612-1619
199. Stanley W.B., Mathews R.C., Buss R.R., and Kotler-Cope S. Insight without awareness: On the interaction of verbalization, instruction, and practice in a simulated process control task. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 41 A (1989) 553-577
200. Sterman J.D. Misperceptions of feedback in dynamic decision making. Organizational Behavior and Human Decision Processes 43 (1989) 301-335
201. Sterman J.D. Learning in and about complex systems. System Dynamics Review 10 (1994) 291-330
202. Sterman J.D. All models are wrong: Reflections on becoming a systems scientist. System Dynamics Review 18 (2002) 501-531
203. Steyvers M., Tenenbaum J.B., Wagenmakers E.J., and Blum B. Inferring causal networks from observations and interventions. Cognitive Science 27 (2003) 453-489
204. Strauss R., and Kirlik A. Situation awareness as judgment: II. Experimental demonstration. International Journal of Industrial Ergonomics 36 (2006) 475-484
205. Strohschneider S., and Guss D. The fate of the MOROS: A cross-cultural exploration of strategies in complex and dynamic decision making. International Journal of Psychology 34 (1999) 235-252
206. Sun R., Merrill E., and Peterson T. From implicit skills to explicit knowledge: A bottom-up model of skill learning. Cognitive Science 25 (2001) 203-244
207. Sun R., Slusarz P., and Terry C. The interaction of the explicit and the implicit in skill learning: A dual-process approach. Psychological Review 112 (2005) 159-192
208. Sun R., Zhang X., Slusarz P., and Mathews R. The interaction of implicit learning, explicit hypothesis testing learning and implicit-to-explicit knowledge extraction. Neural Networks 20 (2007) 34-47
209. Sutton R.S., and Barto A.G. Reinforcement learning: An introduction (1998), MIT Press, Cambridge, MA
210. Sweller J. Cognitive load during problem solving: Effects of learning. Cognitive Science 12 (1988) 257-285
211. Sweller J. Evolution of human cognitive architecture. Psychology of Learning and Motivation: Advances in Research and Theory 43 (2003) 215-266
212. Taatgen N.A., and Lee F.J. Production composition: A simple mechanism to model complex skill acquisition. Human Factors 45 (2003) 61-76
213. Tenenbaum J.B., Griffiths T.L., and Kemp C. Theory-based Bayesian models for inductive learning and reasoning. Trends in Cognitive Sciences 10 (2006) 309-318
214. Thomas M.L., and Russo M.B. Neurocognitive monitors: Towards the prevention of cognitive performance decrements and catastrophic failures in the operational environment. Aviation, Space, and Environmental Medicine 78 (2007) 144-152
215. Toda M. The design of the fungus eater: A model of human behavior in an unsophisticated environment. Behavioral Science 7 (1962) 164-183
216. Van Merriënboer J.J.G., and Sweller J. Cognitive load theory and complex learning: Recent development and future directions. Educational Psychology Review 17 (2005) 147-174
217. Vancouver J.B., and Kendall L. When self-efficacy negatively relates to motivation and performance in a learning context. Journal of Applied Psychology 91 (2006) 1146-1153
218. Vancouver J.B., More K.M., and Yoder R.J. Self-efficacy and resource allocation: Support for a nonmonotonic discontinuous model. Journal of Applied Psychology 93 (2008) 35-47
219. Vancouver J.B., and Putka D.J. Analyzing goal-striving processes and a test of the generalizability of perceptual control theory. Organizational Behavior and Human Decision Processes 82 (2000) 334-362
220. VanLehn K. Cognitive skill acquisition. Annual Review of Psychology 47 (1996) 513-539
221. Vicente K.J. Ecological interface design: Process and challenges. Human Factors 44 (2002) 62-78
222. Vicente K.J., Roth E.M., and Mumaw R.J. How do operators monitor a complex, dynamic work domain? The impact of control room technology. Journal of Human-Computer Studies 54 (2001) 831-856
223. Vicente K.J., and Wang J.H. An ecological theory of expertise effects in memory recall. Psychological Review 105 (1998) 33-57
224. Vollmeyer R., Burns B.D., and Holyoak K.J. The impact of goal specificity and systematicity of strategies on the acquisition of problem structure. Cognitive Science 20 (1996) 75-100
225. Wiener N. Cybernetics: Or control and communication in the animal and the machine (1948), Wiley, New York, NY
226. Witt K., Daniels C., Daniel V., Schmitt-Eliassen J., Volkmann J., and Deuschl G. Patients with Parkinson's disease learn to control complex systems-An indication for intact implicit cognitive skill learning. Neuropsychologia 44 (2006) 2445-2451
227. Wood R.E., and Bandura A. Impact of conceptions of ability on self-regulatory mechanisms and complex decision making. Journal of Personality and Social Psychology 56 (1989) 407-415
228. Yeo G.B., and Neal A. An examination of the dynamic relationship between self-efficacy and performance across levels of analysis and levels of specificity. Journal of Applied Psychology 91 (2006) 1088-1101
229. Yu A., and Dayan P. Uncertainty, neuromodulation, and attention. Neuron 46 (2005) 681-692