Representing Cognition in Games and Simulations

Assessment of Problem Solving Using Simulations

Volumn , Issue , 2017, Pages 107-137

  Fletcher, J D ^a   Morrison, John E ^a  

^a INSTITUTE FOR DEFENSE ANALYSES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85144353746     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781315096773-6     Document Type: Chapter

References (98)

1. Acquisti, A., Clancey, W. J., van Hoof, R., Scott, M., and Sierhuis, M. (2001, December).Brahms tutorial (Technical Memorandum TM01-0002, Version 0.9.9.4 RFC). Moffett Field, CA: NASA Ames Research Center.
2. Alluisi, E. A. (1991). The development of technology for collective training: SIMNET, a case history. Human Factors, 33, 343-362.
3. Anderson, J. R. (1993). Rules of the mind. Hillsdale, NJ: Erlbaum.
4. Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., and Qin, Y. (2004). An integrated theory of the mind. Psychological Review, 111, 1036-1060.
5. Anderson, J. R., and Bower, G. H. (1973). Human associative memory. Washington, DC: Winston.
6. Bailenson, J. N., Swinth, K. R., Hoyt C. L., Persky, S., Dimov, A., and Blascovich, J. (2005). The independent and interactive effects of embodied agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments. Presence: Teleoperators and Virtual Environments, 14, 379-393.
7. Bartl, C., and Dorner, D. (1998). Comparing the behaviour of PSI with human behavior in the BioLab game (Memorandum Number 32). Bamburg, Germany:Universitat Bamburg, Lehrstuhl Psychologie II.
8. Bartle, R. (1990). Early MUD history. Retrieved January 25, 2006 from www.mud.co.uk/richard/mudhist.htm
9. Bennett, R. E., Jenkins, F., Persky, H., and Weiss, A. (2003). Assessing complex problem solving performances. Assessment in Education, 10, 347-359.
10. Cannon-Bowers, J. A., Salas, E., and Pruitt, J. S. (1996). Establishing the boundaries of a paradigm for decision-making research. Human Factors, 38, 193-205.
11. Card, S. K., Moran, T. P., and Newell, A. (1983). The psychology of human-computer interaction. Hillsdale, NJ: Erlbaum.
12. Chase, W. G., and Simon, H. A. (1973). The mind’s eye in chess. In W. G. Chase (Ed.), Visual information processing. New York: Academic Press.
13. Ciancarini, P., Donohue, G., Lorenz, D., Panzarasa, P., Pritchett, A., Swartout, W., et al. (2002). Simulation and agent oriented software engineering: Working group report of the grand challenges Dagstuhl Seminar. In R. Fujimoto, D. Lunceford, E. Page, and A. M. Uhrmacher (Eds.), Grand challenges for modeling and simulation-Dagstuhl report (pp. 62-66). Retrieved May 12, 2005 from http://www.informatik.uni-rostock.de/-lin/GC/report/Dagstuhl_Report.pdf
14. Clancey, W. J., Sachs, P., Sierhuis, M., and van Hoof, R. (1998). Brahms: Simulating practice for work systems design. International Journal of Human-Computer Studies, 49, 831-865.
15. Cooper, R., Yule, P., and Sutton, D. (1998). COGENT: An environment for the development of cognitive models. In U. Schmid, J. F. Krems, and F. Wysotzki (Eds.), A cognitive science approach to reasoning, learning, and discovery (pp. 55-82). Lengerich, Germany: Pabst Science.
16. Corker, K. M., and Smith, B. R. (1993). An architecture and model for cognitive engineering simulation analysis: Application to advanced aviation automation. In Proceedings of the AIAA Computing in Aerospace 9 Conference (pp. 1079-1088).Santa Monica, CA: American Institute of Aeronautics and Astronautics.
17. deGroot, A. D. (1965). Thought and choice in chess. The Hague: Mouton Press.
18. Deutsch, S. (1998). Multi-disciplinary foundations for multiple-task human performance modeling in OMAR (pp. 303-308).Paper presented at the 20th annual meeting of the Cognitive Science Society, Madison, WI.
19. Deutsch, S. E., MacMillian, J., Cramer, N. L. (1993). Operator model architecture (OMAR) demonstration final report (AL/HR-TR-1996-0161). Wright-Patterson Air Forc Base, OH: Armstrong Laboratory, Logistics Research Division.
20. Drasgow, F., and Mattern, K. (2005). New tests and new items: Opportunities and issues. In D. Bartram and R. Hambelton (Eds.), Computer-based testing and the Internet: Issues and answers (pp. 59-76).Chichester, West Sussex, UK: Wiley.
21. Eggleston, R. G., Young, M. J., and McCreight, K. L. (2000). Distributed cognition:A new type of human performance model. In M. Freed (Ed.), Simulating human agents: Papers from the 2000 AAAI Fall Symposium (Technical Report FS-00-03, pp. 8-14).Menlo Park, CA: AAAI Press.
22. Eggleston, R. G., Young, M. J., and McCreight, K. L. (2001). Modeling human work through distributed cognition. In Proceedings of the 10th Conference on Computer Generated Forces and Behavioral Representation (pp. 99-104).Orlando, FL: Simulation Interoperability Standards Organization.
23. Endsley, M. R. (1995). Toward a theory of situation awareness in dynamic systems.Human Factors, 37, 32-64.
24. Fletcher, J. D. (1975). Models of the learner in computer-assisted instruction. Journal of Computer-Based Instruction, 3, 118-126.
25. Fletcher, J. D. (1999). Using networked simulation to assess problem solving by tactical teams. Computers in Human Behavior, 15, 375-402.
26. Fletcher, J. D. (2002). Is it worth it? Some comments on research and technology in assessment and instruction. In Technology and Assessment: Thinking Ahead (pp. 26-39).Washington, DC: National Academy of Science.
27. Fletcher, J. D. (2006). The ADL vision. In H. F. O’Neill and R. Perez (Eds.), Web-based learning: Theory, research and practice (pp. 31-53).Mahwah, NJ: Erlbaum.
28. Fletcher, J. D., and Rockway, M. R. (1986). Computer-based training in the military.In J. A. Ellis (Ed.), Military contributions to instructional technology (pp. 171-222).New York: Praeger.
29. Freed, M., Dahlman, E., Dalal, M., and Harris, R. (2002). Apex reference manual for Apex version 2.2. Moffett Field, CA: NASA ARC.
30. Garau, M., Slater, M., Bee, S., and Sasse, M. A. (2001). The impact of eye gaze on communication using humanoid avatars. In Proceedings SIGCHI '01 (pp. 309-316).March 31 to April 4, Seattle, WA.
31. Garmine, E., and Pearson, G. (Eds). (2006). Tech tally: Approaches to assessing technological literacy. Washington, DC: National Academy Press.
32. Giordano, J. C., Reynolds, P. F., Jr., and Brogan, D. C. (2004). Exploring the constraints of human behavior representation. In R. G. Ingalls, M. D. Rossetti, J. S. Smith, and B. A. Peters (Eds.), Proceedings of the 2004 Winter Simulation Conference (pp. 912-920).
33. Glenn, F., Schwartz, S., and Ross, L. (1992). Development of a human operator simulator version V (HOS-V): Design and implementation (Research Note 92-PERI-POX). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
34. Gopher, D., Weil, M., and Bareket, T. (1994). Transfer of skill from a computer game trainer to flight. Human Factors, 36, 387-405.
35. Goldstine, H. H. (1972). The computer from PASCAL to von Neumann. Princeton, NJ: Princeton University Press.
36. Green, C. S., and Bavelier, D. (2003). Action video game modifies visual selective attention. Nature, 423, 534-537.
37. Greenfield, P. M., deWinstanley, P., Kilpatrick, H., and Kaye, D. (1994). Action video games and informal education: Effects on strategies for dividing visual attention. Journal of Applied Developmental Psychology, 15, 195-223.
38. Grossberg, S. (1976a). Adaptive pattern classification and universal recoding. I: Parallel development and coding of neural feature detectors. Biological Cybernetics, 23, 121-134.
39. Grossberg, S. (1976b). Adaptive pattern classification and universal recoding. II:Feedback, expectation, olfaction, and illusions. Biological Cybernetics, 23, 187-202.
40. Harris, R., Iavecchia, H. P., and Dick, A. O. (1989). The human operator simulator (HOS-IV). In G. R. McMillan, D. Beevis, E. Salis, M. H. Strub, R. Sutton, and L. Van Breda (Eds.), Application of human performance models to system design (pp. 275-280).New York: Plenum Press.
41. Hart, S. G., and Battiste, V. (1992). Flight test of a video game trainer. In Proceedings of the Human Factors Society 36th Annual Meeting (pp. 1291-1295).Santa Monica, CA: Human Factors and Ergonomics Society.
42. Hart, S. G., Dahn, D., Atencio, A., and Dalal, K. M. (2001). Evaluation and application of MIDAS v2.0 (SAE Technical Paper 2001-01-2648). Warrendale, PA:Society of Automotive Engineers.
43. Hayes, R. T. (2005). The effectiveness of instructional games: A literature review and discussion (Technical Report 2005-004). Orlando, FL: Training Systems Division, Naval Air Warfare Center.
44. Hill, R. W., Jr. (1999). Modeling perceptual attention in virtual humans. In Proceedings of the Eighth Conference on Computer Generated Forces and Behavioral Representation (pp. 563-573).Orlando, FL: Simulation Interoperability Standards Organization.
45. Hong, J. C., and Liu, M. C. (2003). A study on thinking strategy between experts and novices of computer games. Computers in Human Behavior, 19, 245-258.
46. Just, M. A., and Carpenter, P. A. (1992). A capacity theory of comprehension:Individual differences in working memory. Psychological Review, 99, 122-149.
47. Just, M. A., Carpenter, P. A., and Varma, S. (1999). Computational modeling of highlevel cognition and brain function. Human Brain Mapping, 8, 128-136.
48. Kieras, D. E. (1999). A guide to GOMS model usability evaluation using GOMSL and GLEAN3. Retrieved August 27, 2002, from the University of Michigan’s Electrical Engineering and Computer Science Department site: http://www. eecs.umich.edu/people/kieras/GOMS/GOMSL_Guide.pdf
49. Kieras, D. E., and Meyer, D. E. (1995). An overview of the EPIC architecture for cognition and performance with application to human-computer interaction (EPIC Report No. 5). Ann Arbor: University of Michigan.
50. Kieras, D. E., and Polson, P. G. (1985). An approach to the formal analysis of user complexity. International Journal of Man-Machine Studies, 22, 365-394.
51. Kintsch, W. (1998). Comprehension: A paradigm for cognition. New York: Cambridge University Press.
52. Kitajima, M., Blackmon, M. H., and Polson, P. G. (2000). A comprehension-based model of Web navigation and its application to Web usability analysis.In S. McDonald, Y. Waern, and G. Cockton (Eds.), People and Computers XIV-Usability or Else! [Proceedings of HCI 2000] (pp. 357-373).Heidelberg, Germany: Springer-Verlag.
53. Klein, G. A. (1989). Recognition-primed decisions. In W. B. Rouse (Ed.), Advances in man-machine systems research (pp. 47-92).Greenwich, CT: JAI Press.
54. Krafft, M. F. (2002, October). Adaptive resonance theory. Retrieved March 5, 2003, from the University of Zurich, Department of Information Technology Web site: http://www.ifi.unizh.ch/staff/krafft/papers/2001/wayfinding/html/node97.html
55. Laird, J. E., Congdon, C. B., and Coulter, K. J. (1999). The Soar user’s manual: Version 8.2. Retrieved June 4, 2000, from http://ai.eecs.umich.edu/soar/docs/manuals/soar8manual.pdf
56. Laughery, K. R., Jr., and Corker, K. (1997). Computer modeling and simulation. In G. Salvendy (Ed.), Handbook of human factors and ergonomics (2nd ed., pp. 1375-1408).New York: Wiley.
57. Lewis, R. L. (2001). Cognitive theory, Soar. In N. J. Smelser and P. B. Baltes (Eds.), International encyclopedia of the social and behavioral sciences (pp. 2178-2183).Amsterdam: Pergamon (Elsevier Science).
58. Lovett, M. C., and Anderson, J. R. (2005). Thinking as a production system.In K. Holyoak and R. Morrison (Eds.), Cambridge handbook of thinking and reasoning (pp. 401-430).New York: Cambridge University Press.
59. Mayer, R. E., and Wittrock, M. C. (1996). Problem solving transfer. In D. C. Berliner and R. C. Calfee (Eds.), Handbook of educational psychology (pp. 47-62).New York: Macmillan.
60. Mayer, S. R. (1970). Trends in human factors research for military information systems. Human Factors, 12, 177-186.
61. Miller, G. A., Galanter, E. H., and Pribram, K. H. (1960). The plans and structures of behavior. New York: Holt, Rinehart, and Winston.
62. Mislevy, R. J., Almond, R. G., and Lukas, J. F. (2003). A brief introduction to evidencecentered design (RR-03-16). Princeton, NJ: Educational Testing Service.
63. Morrison, J. E. (2003). A review of computer-based human behavior representations and their relation to military simulations (IDA Paper P-3845). Alexandria, VA: Institute for Defense Analyses.
64. Mulgund, S. S., Harper, K. A., Zacharias, G. L., and Menke, T. E. (2000). SAMPLE:Situation awareness model for pilot-in-the-loop evaluation. In Proceedings of the Ninth Conference on Computer Generated Forces and Behavioral Representation (pp. 377-378).Orlando, FL: Simulation Interoperability Standards Organization.
65. Newell, A. (1973). You can’t play 20 questions with nature and win: Projective comments on the papers of this symposium. In W. G. Chase (Ed.), Visual information processing (pp. 283-310).New York: Academic Press.
66. Newell, A., Shaw, J. C., and Simon, H. A. (1957). Empirical explorations of the logic theory machine: A case study in heuristics. In Proceedings of the 1957 Western Joint Computer Conference (pp. 218-230). Also reprinted in E. A.Feigenbaum and J. Feldman (Eds.), Computers and thought (pp. 109-133).New York: McGraw-Hill, 1963.
67. Newell, A., Shaw, J. C., and Simon, H. A. (1958). Elements of a theory of human problem solving. Psychological Review, 65, 151-166.
68. Newell, A., and Simon, H. A. (1956). The logic theory machine: A complex information processing system. IRE Transactions in Information Theory, IT-2, 61-79.
69. Newell, A., and Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.
70. Olsen, J. R., and Bass, V. B. (1982). The application of performance technology in the military: 1960-1980. NSPI Journal, 41, 32-36.
71. O’Neil, H. F., Jr. (1999). Perspectives on computer-based performance assessment of problem solving. Computers in Human Behavior, 15, 255-268.
72. O’Neil, H. F., Jr., Allred, K., and Dennis, R. A. (1997). Validation of a computer simulation for assessment of interpersonal skill. In H. F. O’Neil (Ed.), Workplace readiness:Competencies and assessment (pp. 229-254).Mahwah, NJ: Erlbaum.
73. O’Neil, H. F., Jr., Chung, G. K., and Brown, R. S. (1997). Use of networked simulations as a context to measure team competencies. In H. F. O’Neil (Ed.), Workplace readiness: Competencies and assessment (pp. 411-452).Mahwah, NJ: Erlbaum.
74. O’Neil, H. F., Jr., Wainess, R., and Baker, E. L. (2005). Classification of learning outcomes: Evidence from the computer games literature. The Curriculum Journal, 16, 455-474.
75. Pew, R. W., and Mavor, A. S. (Eds.). (1998). Modeling human and organizational behavior:Applications to military simulations. Washington, DC: National Academy Press.
76. Rasmussen, J. (1983), Skills, rules and knowledge: Signals, signs and symbols and other distinctions in human performance models. IEEE Transactions on Systems, Man and Cybernetics, SMC-13, 257-266.
77. Ritter, F. E., Baxter, G. D., Avaramides, M., and Wood, A. B. (2002). Soar: Frequently asked questions list. Retrieved May 29, 2002, from the Pennsylvania State University’s Soar Web site: http://ritter.ist.psu.edu/soar-faq/soar-faq.html
78. Ritter, F. E., Shadbolt, N. R., Elliman, D., Young, R., Gobet, F., and Baxter, G. D. (2002b). Techniques for modeling human and organizational behaviour in synthetic environments: A supplementary review. Wright-Patterson Air Force Base, OH: Human Systems Information Analysis Center.
79. Robar, J. (2004). Multiplayer technology: A primer. MSandT Magazine, 6, 26-29.
80. Rosenbloom, P. S., Laird, J. E., Newell, A., and McCarl, R. (1991). A preliminary analysis of the Soar architecture as a basis for general intelligence. Artificial Intelligence, 47, 289-325.
81. Rouse, W. B., Cannon-Bowers, J. A., and Salas, E. (1992). The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man, and Cybernetics, 22, 1296-1308.
82. Rowell, J. T., and Streich, E. R. (1964). The SAGE system training program for the Air Force Defense Command. Human Factors, 6, 537-548.
83. Selfridge, O. (1959). Pandemonium: A paradigm for learning. In Symposium on the Mechanization of Thought Processes (pp. 511-529).London: HM Stationary Office.
84. Simon, H. A. (1956). Rational choice and the structure of the environment. Psychological Review, 63, 129-138.
85. Sleeman, D., and Brown, J. S. (Eds.). (1982). Intelligent tutoring systems. New York:Academic Press.
86. Sloman, A. (2003). How many separately evolved emotional beasties live within us? In R. Trappl, P. Petta, and S. Payr (Eds.), Emotions in humans and artifacts (pp. 35-114).Cambridge, MA: MIT Press.
87. Sternberg, R. J., and Davidson, J. E. (1992). Problem solving. In M. C. Alkin (Ed.), Encyclopedia of educational research (Vol. 3, pp. 1037-1045).New York:Macmillan.
88. Subrahmanyam, K., and Greenfield, P. M. (1994). Effect of video game practice on spatial skills in girls and boys. Special issue: Effects of interactive entertainment technologies on development. Journal of Applied Developmental Psychology, 15, 13-32.
89. Tambe, M. (1996). Teamwork in real-world, dynamic environments. In Proceedings of the First International Conference on Multi-Agent Systems (pp. 361-368).Menlo Park, CA: American Association for Artificial Intelligence.
90. Tambe, M., Adibi, J., Al-Onaizan, Y., Erdem, A., Kaminka, G. A., Marsella, S. C., et al. (1999). Building agent teams using an explicit teamwork model and learning. Artificial Intelligence, 110, 215-239.
91. Thibadeau, R., Just, M. A., and Carpenter, P. A. (1982). A model of the time course and content of reading. Cognitive Science, 6, 157-203.
92. Tobias, S., and Fletcher, J. D. (in press). What research has to say about designing computer games for learning. Educational Technology.
93. Turing, A. M. (1950). Computing machinery and intelligence. Mind, 236, 433-460.
94. Wherry, R. J. (1976). The human operator simulator -HOS. In T. B. Sheridan and G. Johannsen (Eds.), Monitoring behavior and supervisory control (pp. 283-293).New York: Plenum Press.
95. Yule, P., and Cooper, R. (2000, August). The COGENT tutorial. Paper presented at the 22nd Annual Conference of the Cognitive Science Society, Philadelphia, PA.
96. Zachary, W., Campbell, G. E., Laughery, K. R., Glenn, F., and Cannon-Bowers, J. A. (2001). The application of human modeling technology to the design, evaluation and operation of complex systems. In E. Salas (Ed.), Advances in human performance and cognitive engineering research (Vol. 1, pp. 199-247).New York: JAI Press.
97. Zachary, W. W., Ryder, J. M., and Hicinbothom, J. H. (1998). Cognitive task analysis and modeling of decision-making in complex environments. In J. Cannon-Bowers and E. Salas (Eds.), Decision-making under stress: Implications for training and simulation (pp. 315-344).Washington, DC: American Psychological Association.
98. Zachary, W., Ryder, J., and Le Mentec, J.-C. (2002). Applied modeling of human competence and performance with COGNET and COGNET-P. Unpublished manuscript.