Training Robust Decision Making in Immersive Environments

Journal of Cognitive Engineering and Decision Making

Volumn 3, Issue 4, 2009, Pages 331-361

  Patterson, Robert ^a   Pierce, Byron ^a   Bell, Herbert H ^a   Andrews, Dee ^a   Winterbottom, Marc ^a  

^a AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84993708274     PISSN: 15553434     EISSN: None     Source Type: Journal    
DOI: 10.1518/155534309X12599553478836     Document Type: Article

References (133)

1. Ackerman P. L. (1988). Determinants of individual differences during skill acquisition: Cognitive abilities and information processing Journal of Experimental Psychology: General, 117, 288-318
2. Air Education and Training Command. (2008, January 30). On learning: The future of Air Force education and training (HQ AETC/A5/8/9). Randolph Air Force Base, TX: Author. Retrieved October 8, 2009, from http://www.aetc.af.mil/shared/media/document/AFD-080130-066.pdf
3. Allport A. Wylie G. (2000). Task switching, stimulus-response bindings, and negative priming In Monsell S., Driver J.,(Eds.), Control of cognitive processes: Attention and performance XVIII. Cambridge, MA: MIT Press
4. Andrews D. H. Bell H. H. (2000). Simulation-based training In Tobias S., Fletcher J. D.,(Eds.), Training and retraining (pp. 357-384). New York: Macmillan
5. Aslin R. N. Saffran J. R. Newport E. L. (1998). Computation of conditional probability statistics by 8-month-old infants Psychological Science, 9, 321-324
6. Baddeley A. D. (1986). Working memory. New York Oxford University Press
7. Baddeley A. D. (2003). Working memory: Looking back and looking forward Nature Reviews Neuroscience, 4, 829-839
8. Baddeley A. D. Hitch G. J. (1974). Working memory In Bower G. H.,(Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 8, pp. 47-89). New York: Academic Press
9. Baddeley A. D. Logie R. H. (1999). Working memory: The multi-component model In Miyake A., Shah P.,(Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 28-61). New York: Cambridge University Press
10. Bargh J. A.,(Ed.). (2006). Social psychology and the unconscious: The automaticity of higher mental processes. Philadelphia Psychology Press
11. Bargh J. A. Green M. Fitzsimons G. (2008). The selfish goal: Unintended consequences of intended goal pursuits Social Cognition, 26, 520-540
12. Bargh J. A. Morsella E. (2008). The unconscious mind Perspectives on Psychological Science, 3, 173-179
13. Bechara A. Damasio H. Tranel H. D. Damasio A. R. (1997). Deciding advantageously before knowing the advantageous strategy Science, 275, 1293-1295
14. Brooks L. R. Vokey J. R. (1991). Abstract analogies and abstract grammars: Comments on Reber (1989) and Mathews et al. (1989) Journal of Experimental Psychology: General, 120, 316-323
15. Brunswik E. (1956). Perception and the representative design of psychological experiments. Berkeley University of California Press
16. Calderwood R. Klein G. A. Crandall B. W. (1988). Time pressure, skill, and move quality in chess American Journal of Psychology, 101, 481-493
17. Cannon-Bowers J. A. Salas E. (1998). Individual and team decision making In Cannon-Bowers J. A., Salas E.,(Eds.), Making decisions under stress (pp. 17-38). Washington, DC: American Psychological Association
18. Chalmers D. J. French R. M. Hofstadter D. R. (1992). High-level perception, representation, and analogy: A critique of artificial intelligence methodology Journal of Experimental and Theoretical Artificial Intelligence, 4, 185-211
19. Cleeremans A. Destrebecqz A. Boyer M. (1998). Implicit learning: News from the front Trends in Cognitive Sciences, 2, 406-416
20. Cohen M. S. Freeman J. T. Thompson B. B. (1997). Training the naturalistic decision maker In Zsambok C. E., Klein G.,(Eds.), Naturalistic decision making (pp. 257-268). Mahwah, NJ: Erlbaum
21. Collyer S. C. Malecki G. S. (1998). Tactical decision making under stress: History and overview In Cannon-Bowers J. A., Salas E.,(Eds.), Making decisions under stress (pp. 3-15). Washington, DC: American Psychological Association
22. Conway A. R. A. Jarrold C. Kane M. J. Miyake A. Towse J. N. (2008). Variation in working memory: An introduction In Conway A. R. A., Jarrold C., Kane M. J., Miyake A., Towse J. N.,(Eds.), Variation in working memory (pp. 3-20). New York: Oxford University Press
23. Cowan N. (1995). Attention and memory: An integrated framework. New York Oxford University Press
24. Cowan N. (1999). An embedded-process model of working memory In Miyake A., Shah P.,(Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 62-101). New York: Cambridge University Press
25. Damasio A. (1994). Descartes' error. New York Penguin Group
26. Defense Science Board (DSB) & the Defence Scientific Advisory Council (DSAC). (2006, March). Joint U.S. Defense Science Board, UK Defence Scientific Advisory Council Task Force on Defense Critical Technologies. Washington, DC/London: Office of the Undersecretary of Defense for Acquisition, Technology and Logistics/Defence Scientific Advisory Council. Retrieved October 8, 2009, from http://www.dtic.mil/cgi-bin/GetTRDoc?AD=ADA446196&Location=U2&doc=GetTRDoc.pdf
27. Donald M. (1991). Origins of the modern mind. Cambridge, MA Harvard University Press
28. Dreyfus H. L. (1972/1992). What computers still can't do. A critique of artificial reason. Cambridge, MA: MIT Press
29. Dreyfus H. L. (1997). Intuitive, deliberative, and calculative models of expert performance In Zsambok C. E., Klein G.,(Eds.), Naturalistic decision making (pp. 17-28). Mahwah, NJ: Erlbaum
30. Driskell J. E. Salas E. Hall J. K. (1994, April). The effect of vigilant and hyper-vigilant decision training on performance. Paper presented at the 1994 Annual Meeting of the Society of Industrial and Organizational Psychology, San Diego, CA
31. Edsall R. Larson K. L. (2006, June). Decision making in a virtual environment: Effectiveness of a semi-immersive “Decision Theater” in understanding and assessing human-environment interaction. Paper presented at the AutoCarto Symposium, Vancouver, WA
32. Einhorn H. J. Hogarth R. M. (1981). Behavioral decision theory: Processes of judgment and choice Annual Review of Psychology, 32, 53-88
33. Engle R. W. Kane M. J. Tuholski S. W. (1999). Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex In Miyake A., Shah P.,(Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 102-134). New York: Cambridge University Press
34. Eraut M. (2000). Non-formal learning and tacit knowledge in professional work British Journal of Educational Psychology, 70, 113-136
35. Evans J. S. B. T. (1984). Heuristic and analytic processes in reasoning British Journal of Psychology, 75, 451-468
36. Evans J. S. B. T. (2003). In two minds: Dual-process accounts of reasoning Trends in Cognitive Sciences, 17, 454-459
37. Evans J. S. B. T. (2008). Dual-processing accounts of reasoning, judgment and social cognition Annual Review of Psychology, 59, 255-278
38. Fiser J. Aslin R. N. (2001). Unsupervised statistical learning of higher-order spatial structures from visual scenes Psychological Science, 12, 499-504
39. Fiser J. Aslin R. N. (2002). Statistical learning of higher-order temporal structure from visual shape sequences Journal of Experimental Psychology: Learning, Memory, and Cognition, 28, 458-467
40. Gazzaniga M. S. Ivry R. B. Mangun G. R. (2002). Cognitive neuroscience: The biology of the mind. New York Norton & Co
41. Gick M. L. Holyoak K. J. (1980). Analogical problem solving Cognitive Psychology, 12, 306-355
42. Gick M. L. Holyoak K. J. (1983). Schema induction and analogical reasoning Cognitive Psychology, 15, 1-38
43. Gigerenzer G. (1991). How to make cognitive illusions disappear: Beyond heuristics and biases European Review of Social Psychology, 2, 83-115
44. Gigerenzer G. (1996a). On narrow norms and vague heuristics: A reply to Kahneman and Tversky (1996) Psychological Review, 103, 592-596
45. Gigerenzer G. (1996b). The psychology of good judgment: Frequency formats and simple algorithms Medical Decision Making, 16, 273-280
46. Gigerenzer G. (2001). The adaptive toolbox In Gigerenzer G., Selten R.,(Eds.), Bounded rationality: The adaptive toolbox (pp. 37-50). Cambridge, MA: MIT Press
47. Gigerenzer G. Goldstein D. G. (1996). Reasoning the fast and frugal way: Models of bounded rationality Psychological Review, 103, 650-669
48. Gigerenzer G. Hell W. Blank H. (1988). Presentation and context: The use of base rates as a continuous variable Journal of Experimental Psychology: Human Perception and Performance, 14, 513-525
49. Gigerenzer G. Murray D. J. (1987). Cognition as intuitive statistics. Mahwah, NJ Erlbaum
50. Gigerenzer G. Selten R. (2001). Rethinking rationality In Gigerenzer G., Selten R.,(Eds.), Bounded rationality: The adaptive toolbox (pp. 1-12). Cambridge, MA: MIT Press
51. Goldstein E. B. (2008). Cognitive psychology. Belmont, CA Thomson Wadsworth
52. Hamm R. M. (1988). Moment-by-moment variation in expert's analytic and intuitive cognitive activity IEEE Transactions on Systems, Man, and Cybernetics, 18, 757-776
53. Hammond K. R. (2007). Beyond rationality: The search for wisdom in a troubled time. New York Oxford University Press
54. Hammond K. R. Hamm R. M. Grassia J. (1986). Generalizing over conditions by combining the multitrait-multimethod matrix and the representative design of experiments Psychological Bulletin, 100, 257-269
55. Hammond K. R. Hamm R. M. Grassia J. Pearson T. (1997). Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment In Goldstein W. M., Hogarth R. M.,(Eds.), Research on judgment and decision making: Currents, connections and controversies (pp. 144-180). New York: Cambridge University Press
56. Hastie R. Park B. (1997). The relationship between memory and judgment depends on whether the judgment task is memory-based or on-line In Goldstein W. M., Hogarth R. M.,(Eds.), Research on judgment and decision making: Currents, connections and controversies (pp. 432-453). New York: Cambridge University Press
57. Hofstadter D. R. (2001). Epilogue: Analogy as the core of cognition In Gentner D., Holyoak K. J., Kokinov B. N.,(Eds.), The analogical mind: Perspectives from cognitive science (pp. 499-538). Cambridge, MA: MIT Press
58. Hogarth R. (2001). Educating intuition. Chicago University of Chicago Press
59. Hogarth R. (2002, October). Deciding analytically or trusting your intuition? The advantages and disadvantages of analytic and intuitive thought (UPF Economics and Business Working Paper No. 654). Barcelona: Universitat Pompeu Fabra-Faculty of Economic and Business Sciences. Available from http://ssrn.com/abstract=394920
60. Holland J. H. Holyoak K. J. Nisbett R. E. Thagard P. (1986). Induction: Processes of inference, learning, and discovery. Cambridge, MA MIT Press
61. Holyoak K. J. Gentner D. Kokinov B. N. (2001). Introduction: The place of analogy in cognition In Gentner D., Holyoak K. J., Kokinov B. N.,(Eds.), The analogical mind: Perspectives from cognitive science (pp. 1-20). Cambridge, MA: MIT Press
62. Hutchins E. (1995). Cognition in the wild. Cambridge, MA MIT Press
63. Hutchinson J. M. C. Gigerenzer G. (2005). Simple heuristics and rules of thumb: Where psychologists and behavioral biologists might meet Behavioral Processes, 69, 97-124
64. Janis I. L. Mann L. (1977). Decision making: A psychological analysis of conflict, choice, and commitment. New York Free Press
65. Juthe A. (2005). Argument by analogy Argumentation, 19, 1-27
66. Kahneman D. (1973). Attention and effort. Englewood Cliffs, NJ Prentice-Hall
67. Kahneman D. Frederick S. (2002). Representativeness revisited: Attribute substitution in intuitive judgment In Gilovich T., Griffin D., Kahneman D.,(Eds.), Heuristics and biases: The psychology of intuitive judgment (pp. 49-81). New York: Cambridge University Press
68. Kahneman D., Slovic P., Tversky A.,(Eds.). (1982). Judgment under uncertainty: Heuristics and biases. New York Cambridge University Press
69. Kahneman D. Tversky A. (1972). Subjective probability: A judgment of representativeness Cognitive Psychology, 3, 430-454
70. Kahneman D. Tversky A. (1973). On the psychology of prediction Psychological Review, 80, 237-251
71. Kahneman D. Tversky A. (1979). Prospect theory: An analysis of decisions under risk Econometrica, 47, 313-327
72. Kane M. J. Conway A. R. A. Hambrick D. Z. Engle R. W. (2008). Variation in working memory capacity as variation in executive attention and control In Conway A. R. A., Jarrold C., Kane M. J., Miyake A., Towse J. N.,(Eds.), Variation in working memory (pp. 21-48). New York: Oxford University Press
73. Klein G. (1987). Applications of analogical reasoning Metaphor and Symbolic Activity, 2, 201-218
74. Klein G. (1997). The recognition-primed decision (RPD) model: Looking back, looking forward In Zsambok C. E., Klein G.,(Eds.), Naturalistic decision making (pp. 285-292). Mahwah, NJ: Erlbaum
75. Klein G. (1998). Sources of power: How people make decisions. Cambridge, MA MIT Press
76. Klein G. (2008). Naturalistic decision making Human Factors, 50, 456-460
77. Klein G. A. Ross K. G. Moon B. M. Klein D. E. Hoffman R. R. Hollnagel E. (2003). Macrocognition IEEE Intelligent Systems, 18, 81-85
78. Klein G. A. Wolf S. Militello L. Zsambok C. (1995). Characteristics of skilled option generation in chess Organizational Behavior and Human Decision Processes, 62, 63-69
79. Krokhmal P. Murphey R. Pardalos P. Uryasev S. Zrazhevsky G. (2003). Robust decision making: Addressing uncertainties in distributions In Butenko S., Murphey R., Pardalos P. M.,(Eds.), Cooperative control: Models, applications and algorithms (pp. 165-185). Dordrecht, Netherlands: Kluwer
80. Lockhart R. S. Blackburn A. B. (1993). Implicit processes in problem solving In Graf P., Masson M. E. J.,(Eds.), Implicit memory: New directions in cognition, development, and neuropsychology (pp. 95-117). Mahwah, NJ: Erlbaum
81. Logie R. H. (1995). Visuo-spatial working memory. Hove, UK Erlbaum
82. Lopes L. L. (1981). Decision making in the short run Journal of Experimental Psychology: Human Learning and Memory, 1, 377-385
83. Lopes L. L. (1991). The rhetoric of irrationality Theory and Psychology, 1, 65-82
84. Lopes L. L. (1996). When time is of the essence: Averaging, aspiration, and the short run Organizational Behavior and Human Decision Processes, 65, 179-189
85. Lopes L. L. Oden G. C. (1991). The rationality of intelligence In Eells E., Maruszewski T.,(Eds.), Probability and rationality: Studies of L. Jonathan Cohen's philosophy of science (pp. 199-223). Amsterdam: Rodopi
86. Lovett M. C. Reder L. M. Lebiere C. (1999). An ACT-R perspective on working memory In Miyake A., Shah P.,(Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 135-182). New York: Cambridge University Press
87. Markman A. B. Moreau C. P. (2001). Analogy and analogical comparison in choice In Gentner D., Holyoak K. J., Kokinov B. N.,(Eds.), The analogical mind: Perspectives from cognitive science (pp. 363-400). Cambridge, MA: MIT Press
88. Mathews R. C. Buss R. R. Stanley W. B. Blanchard-Fields F. Cho J. R. Druhan B. (1989). Role of implicit and explicit processes in learning from examples: A synergistic effect Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 1083-1100
89. Miller G. A. (1956). The magic number seven, plus or minus two: Some limits on our capacity for processing information Psychological Review, 63, 81-97
90. Miyake A. Shah P. (1999). Emerging consensus, unresolved issues, future directions In Miyake A., Shah P.,(Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 442-482). New York: Cambridge University Press
91. Mosier K. L. (1997). Myths of expert decision making and automated decision aids In Zsambok C. E., Klein G.,(Eds.), Naturalistic decision making (pp. 319-330). Mahwah, NJ: Erlbaum
92. Navon D. Gopher D. (1979). On the economy of the human processing system Psychological Review, 86, 214-255
93. Norman D. A. Shallice T. (1986). Attention to action: Willed and automatic control of behavior In Davidson R. J., Schwartz G. E., Shapiro D.,(Eds.), Consciousness and self-regulation (Vol. 4, pp. 1-18). New York: Plenum Press
94. Oberauer K. Sub H.-M. Wilhelm O. Sander N. (2008). Individual differences in working memory capacity and reasoning ability In Conway A. R. A., Jarrold C., Kane M. J., Miyake A., Towse J. N.,(Eds.), Variation in working memory (pp. 49-75). New York: Oxford University Press
95. Patterson R. Silzars A. (2009). Immersive stereo displays, intuitive reasoning, and cognitive engineering Journal of the Society for Information Display, 17, 443-448
96. Patterson R. Winterbottom M. Pierce B. J. (2006). Perceptual issues with the use of head-mounted displays Human Factors, 48, 555-573
97. Perruchet P. Pacton S. (2006). Implicit learning and statistical learning: One phenomenon, two approaches Trends in Cognitive Sciences, 10, 233-238
98. Polanyi M. (1958). Personal knowledge. Towards a post critical philosophy. London Routledge
99. Polanyi M. (1966). The tacit dimension. New York Doubleday
100. Posner M. (1995). Attention in cognitive neuroscience: An overview In Gazzaniga M.,(Ed.), The cognitive neuroscience (pp. 615-624). Cambridge, MA: MIT Press
101. Posner M. Peterson S. (1990). The attention system of the human brain Annual Review of Neuroscience, 13, 25-42
102. Posner M. Raichle M. E. (1994). Images of the mind. New York Scientific American Books
103. Reber A. (1967). Implicit learning of artificial grammars Journal of Verbal Learning and Verbal Behavior, 6, 855-863
104. Reber A. (1989). Implicit learning and tacit knowledge Journal of Experimental Psychology: General, 118, 219-235
105. Reber A. Kassin S. M. Lewis S. Cantor G. (1980). On the relationship between implicit and explicit modes in the learning of a complex rule structure Journal of Experimental Psychology: Human Learning and Memory, 6, 492-502
106. Regan H. M. Ben-Haim Y. Langford B. Wilson W. G. Lundberg P. Andelman S. J., et al(2005). Robust decision-making under severe uncertainty for conservation management Ecological Applications, 15, 1471-1477
107. Schneider W. Shiffrin R. M. (1977). Controlled and automatic human information processing: I. Detection, search, and attention Psychological Review, 84, 1-42
108. Shepard R. N. (1984). Ecological constraints on internal representation: Resonant kinematics of perceiving, imagining, thinking, and dreaming Psychological Review, 91, 417-447
109. Simon H. A. (1956). Rational choice and the structure of the environment Psychological Review, 63, 129-138
110. Simon H. A. (1957). Models of man: Social and rational. Mathematical essays on rational human behavior in a social setting. New York Wiley
111. Simon H. A. (1982). Models of bounded rationality. Cambridge, MA MIT Press
112. Sloman S. A. (1996). The empirical case for two systems of reasoning Psychological Bulletin, 119, 3-22
113. Sloman S. A. (2002). Two systems of reasoning In Gilovich T., Griffin D., Kahneman D.,(Eds.), Heuristics and biases (pp. 379-396). Cambridge, MA: Cambridge University Press
114. Sniezek J. A. Wilkins D. C. Wadlington P. L. (2001). Advanced training for crisis decision making: Simulation, critiquing, and immersive interfaces. In HICSS-34th Annual Hawaii International Conference on System Sciences (Vol. 3, p. 3042). Retrieved October 8, 2009, from http://www2.computer.org/portal/web/csdl/doi/10.1109/HICSS.2001.926337
115. Stanovich K. E. West R. F. (2000). Individual differences in reasoning: Implications for the rationality debate Behavioral and Brain Sciences, 23, 645-665
116. Stanovich K. E. West R. F. (2002). Individual differences in reasoning: Implications for the rationality debate In Gilovich T., Griffin D., Kahneman D.,(Eds.), Heuristics and biases (pp. 421-440). Cambridge, MA: Cambridge University Press
117. Sterman J. D. (2000). Business dynamics: Systems thinking and modeling for a complex world. Boston McGraw-Hill
118. Stock C. Bishop I. D. (2005). Helping rural communities envision their future In Bishop I. D., Lange E.,(Eds.), Visualization in landscape and environmental planning (pp. 145-151). London: Taylor & Francis
119. Todd P. M. (2001). Fast and frugal heuristics for environmentally bounded minds In Gigerenzer G., Selten R.,(Eds.), Bounded rationality: The adaptive toolbox (pp. 51-70). Cambridge, MA: MIT Press
120. Trick L. M. Pylyshyn Z. W. (1993). What enumeration studies can show us about spatial attention: Evidence for limited capacity preattentive processing Journal of Experimental Psychology: Human Perception and Performance, 19, 331-351
121. Tversky A. (1972). Elimination by aspects: A theory of choice Psychological Review, 79, 281-299
122. Tversky A. Kahneman D. (1971). Belief in the law of small numbers Psychological Bulletin, 76, 105-110
123. Tversky A. Kahneman D. (1973). Availability: A heuristic for judging frequency and probability Cognitive Psychology, 5, 207-232
124. Tversky A. Kahneman D. (1974). Judgment under uncertainty: Heuristics and biases Science, 185, 1124-1131
125. Tversky A. Kahneman D. (1981). The framing of decisions and the psychology of choice Science, 221, 453-458
126. Tversky A. Kahneman D. (1983). Extensional vs. intuitive reasoning: The conjunction fallacy in probability judgment Psychological Review, 90, 293-315
127. Ullman D. G. (2006). Making robust decisions: Decision management for technical, business, & service teams. Victoria, Canada Trafford
128. U.S. Air Force. (2003, November). The U.S. Air Force transformation flight plan. Washington, DC: Pentagon, HQ USAF/XPXC, Future Concepts and Transformation Division. Retrieved October 8, 2009, from http://www.au.af.mil/au/awc/awcgate/af/af_trans_flightplan_nov03.pdf
129. Westcott M. R. (1968). Toward a contemporary psychology of intuition. New York Holt, Rinehart, & Winston
130. Wickens C. D. (1984). Processing resources in attention In Parasuraman R., Davies D. R.,(Eds.), Varieties of attention (pp. 63-102). New York: Academic Press
131. Willie D. (1999, May). Immersive environments enhance team collaboration World Oil, pp. 1-3
132. Wright J. Hartman F. Cooper B. (1998, June). Immersive environment for mission operations: Beyond Mars Pathfinder. Paper presented at SpaceOps '98 (Paper ID: 2a006), Tokyo. Retrieved October 8, 2009, from http://www-dial.jpl.nasa.gov/public_html/john/papers/SpaceOps98/SpaceOps98.pdf
133. Zsambok C. E. Klein G. (1997). Naturalistic decision making. Mahwah, NJ Erlbaum