Human-Computer Cooperative Problem Solving: Theory, Design, and Evaluation of an Intelligent Associate System

IEEE Transactions on Systems, Man, and Cybernetics

Volumn 25, Issue 7, 1995, Pages 1039-1053

  Jones, Patricia M ^a   Mitchell, Christine M ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER GRAPHICS; COMPUTER SOFTWARE; COMPUTER VISION; DECISION SUPPORT SYSTEMS; EVALUATION; PERFORMANCE; PROBLEM SOLVING; SCADA SYSTEMS; USER INTERFACES;

CONTEXT SENSITIVE RESOURCES; HUMAN COMPUTER COOPERATIVE PROBLEM SOLVING; INTELLIGENT ASSOCIATE SYSTEM; PRINCIPLES; SATELLITE GROUND CONTROL SYSTEM;

KNOWLEDGE BASED SYSTEMS;

EID: 0029345533     PISSN: 00189472     EISSN: 21682909     Source Type: Journal    
DOI: 10.1109/21.391286     Document Type: Article

References (72)

1. L. Bainbridge, “Mathematical equations or processing routines?” J. Rasmussen and W. B. Rouse, Eds., Human Detection and Diagnosis of System Failures. New York: Plenum, 1981.
2. L. Bainbridge, “Ironies of automation,” Automatica, vol. 19, pp. 775–779, 1983.
3. L. Bainbridge, J. Beishon, J. H. Hemming, and M. Splaine, “A study of real-time human decision-making using a plant simulator,” E. Edwards and F. P. Lees, Eds., The Human Operator in Process Control. London: Taylor and Francis, 1974.
4. C. E. Billings, “Human-centered aircraft automation: A concept and guidelines,” NASA Technical Memorandum 103885, NASA Ames Research Center, Moffett Field, CA, 1991.
5. A. H. Bond and L. Gasser, “An analysis of problems and research in DAI,” in Readings in Distributed Artificial Intelligence, A. H. Bond and L. Gasser, Eds. San Mateo, CA: Morgan Kaufmann, 1988.
6. B. Borys, “Ways of supporting ergonomically and technically correct display design,” in Human-Computer Interaction and Complex Systems, G. R. S. Weir and J. L. Alty, Eds. London: Academic Press, 1991, pp. 211–222.
7. G. A. Boy, “Operator assistant systems,” Int. J. Man-Machine Studies, vol. 27, pp. 541–554, 1987.
8. J. S. Brown, “From cognitive to social ergonomics and beyond,” D. Norman and S. Draper, Eds., User Centered System Design. Hillsdale, NJ: Lawrence Erlbaum, 1986, pp. 457–486.
9. J. B. Bushman, C. M. Mitchell, P. M. Jones, and K. S. Rubin, “Ally: An operator's associate system for cooperative supervisory control,” IEEE Trans. Syst. Man Cyber. vol. 23, pp. 111–128, 1993.
10. J. M. Carroll and J. McKendree, “Interface design issues for advice-giving expert systems,” Comm. of the ACM, vol. 30, no. 1, pp. 14–31, 1987.
11. R. W. Chu, “Towards the tutor/aid paradigm: Design of intelligent tutoring systems for operators of supervisory control systems,” Ph.D. dissertation, Center for Human-Machine Systems Research, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta.
12. R. W. Chu, P. M. Jones, and C. M. Mitchell, “GT-POCC: Visualization and animation of a complex dynamic system,” in Proc. 1991 IEEE Int Conf. on Systems, Man, and Cybernetics, vol. 2, pp. 1289–1294, 1991.
13. R. W. Chu, P. M. Jones, and C. M. Mitchell, “The Georgia Tech Payload Operations Control Center simulation: Design and implementation in C++,” in Proc. Society for Computer Simulation Multiconf. on Object-Oriented Simulation 1991, Simulation Series, vol. 23, no. 3, pp. 167–174, 1991.
14. R. W. Chu, P. M. Jones, and C. M. Mitchell, “Using OFM/OFMspert as the basis for an intelligent tutoring system: Towards a tutor/aid paradigm for operators of supervisory control systems,” IEEE Trans. Syst. Man Cyber, vol. 25, pp. 1054–1075, July 1995.
15. R. T. Craig and K. Tracy, Eds., Conversational Coherence: Form, Structure, and Strategy. Beverly Hills, CA: Sage, 1983.
16. R. E. Cullingford and J. L. Kolodner, “Interactive advice giving,” in Proc. 1986 IEEE Int Conf. on Systems, Man, and Cybernetics, pp. 709–714.
17. D. Dorner, “Heuristics and cognition in complex systems,” in Methods of Heuristics, R. Groner, M. Groner, and W. F. Bischof, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1983.
18. E. H. Durfee, V. R. Lesser, and D. D. Corkill, “Trends in cooperative distributed problem solving,” IEEE Trans. Knowl. Data Eng. vol. 1, no. 1, pp. 63–83, Mar. 1989.
19. B. A. Fox, “Repair as factor in interface design,” Dept. of Linguistics and Institute of Cognitive Science, University of Colorado, Boulder, 1987.
20. B. A. Fox, “Cognitive and interactional aspects of correction in tutoring,” Technical Report 88-2, Dept. of Linguistics and Institute of Cognitive Science, University of Colorado, Boulder, 1988.
21. A. Gershman and T. Wolf, “The dynamics of man-machine interaction in a conversational advisory system,” Proc. 1986 IEEE Int. Conf. on Systems, Man, and Cybernetics, pp. 721–725.
22. J. Gibbons, Nonparametric Statistical Inference. New York: Dekker, 1985.
23. I. Greif, Ed., Computer-Supported Cooperative Work: A Book of Readings. Los Altos, CA: Morgan Kaufmann, 1989.
24. B. J. Haslett, Communication: Strategic Action in Context. Hillsdale, NJ: Lawrence Erlbaum, 1987.
25. M. Huhns, Ed., Distributed Artificial Intelligence. Los Altos, CA: Morgan Kaufmann, 1987.
26. M. Huhns and L. Gasser, Eds., Distributed artificial intelligence: Volume II. Los Altos, CA: Morgan Kaufmann, 1989.
27. G. Johannsen, “Towards a new quality of automation in complex man-machine systems,” Automatica, vol. 28, pp. 355–373, 1992.
28. G. Johannsen and W. B. Rouse, “Studies of planning behavior of aircraft pilots in normal, abnormal, and emergency situations,” IEEE Trans. Syst. Man Cyber. vol. 13, pp. 267–278, 1983.
29. L. Johannsen and D. D. Woods, “Human interaction with intelligent systems: Trends, problems, and new direction,” in Proc. 1991 IEEE Int. Conf. on Systems, Man, and Cybernetics, vol. 2, pp. 1337–1342, 1991.
30. P. M. Jones, “Human-computer cooperative problem solving in supervisory control,” Ph.D. thesis, Center for Human-Machine Systems Research, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, 1991.
31. P. M. Jones, “Cooperative support for distributed supervisory control: Requirements, issues, and an example from mission operations,” Proc. Inter. Workshop on Intell. User Interfaces, Orlando, FL, Jan. 1993, pp. 239–242.
32. P. M. Jones and V. Goyle, “Cooperative support for distributed supervisory control: Issues in modeling cooperative work in complex dynamic systems,” in Proc. 1992 IEEE Int. Conf. on Systems, Man, and Cybernetics
33. P. M. Jones, R. W. Chu, and C. M. Mitchell, “A methodology for human-machine systems engineering research: Knowledge engineering, modeling, and simulation,” IEEE Trans. Syst. Man Cyber, vol. 25, pp. 1025–1038, July 1995.
34. P. M. Jones and C. M. Mitchell, “Human-computer cooperative problem solving I: A case study of an expert system for real-time monitoring,” in Proc. 1990 IEEE Int. Conf. on Systems, Man, and Cybernetics, pp. 505–507.
35. P. M. Jones and C. M. Mitchell, “A mechanism for knowledge-based reminding and advice-giving in the supervisory control of a complex dynamic system,” Proc. 1991 IEEE Int. Conf. on Systems, Man, and Cybernetics vol. 2, pp. 1295–1300, 1994.
36. P. M. Jones and C. M. Mitchell, “Model-based communicative acts: Human-computer collaboration in supervisory control,” accepted for publication in Int. J. Human-Computer Studies, 1994.
37. P. M. Jones, C. M. Mitchell, and K. S. Rubin, “Intent inferencing with a model-based operator's associate,” Proc. Sixth Symp. Empirical Foundations of Information and Software Sciences, Atlanta, GA, 1988, pp. 249–258.
38. P. M. Jones, C. M. Mitchell, and K. S. Rubin, “Validation of intent inferencing by a model-based operator's associate,” Int. J. Man-Machine Studies, vol. 33, pp. 177–202, 1990.
39. A. L. Kidd and W. P. Sharpe, “Goals for expert system research: An analysis of tasks and domains,” in Research and Development in Expert Systems IV, D. S. Moralee, Ed. Cambridge, MA: Cambridge University Press, 1988, pp. 146–152.
40. H. Kragt and J. A. Landeweerd, “Mental skills in process control,” in The Human Operator in Process Control E. Edwards and F. P. Lees, Eds. London: Taylor and Francis, 1974.
41. C. E. Larson and F. M. J. LaFasto, Teamwork: What Must Go Right/What Can Go Wrong. Newbury Park, CA: Sage, 1989.
42. J. Lee and N. Moray, “Trust, self-confidence, and operators' adaptation to automation,” Int. J. Human-Computer Studies, vol. 40, pp. 153–184, 1994.
43. J. C. McCarthy, V. C. Miles, and A. F. Monk, “An experimental study of common ground in text-based communication,” CHI '91 Proc. 1991.
44. M. L. McLaughlin, Conversation: How Talk is Organized. Beverly Hills, CA: Sage, 1984.
45. C. M. Mitchell, “GT-MSOCC: A research domain for modeling human-computer interaction and aiding decision making in supervisory control systems,” IEEE Trans. Syst. Man Cyber. vol. SMC-17, pp. 553–570, 1987.
46. B. Muir, “Trust between humans and machines, and the design of decision aids,” Int. J. Man-Machine Studies, vol. 27, pp. 527–539, 1987.
47. S. Mura, “Licensing violations: Legitimate violations of Grice's conversation principle,” in Conversational Coherence: Form, Structure, and Strategy. R. T. Craig and K. Tracy, Eds. Beverly Hills, CA: Sage, 1983.
48. S. Nirenburg and V. Lesser, “Providing intelligent assistance in distributed office environments,” Proc ACM Conf. Office Inform. Syst., 1986, pp. 104–112.
49. H. Oberquelle, I. Kupka, and S. Maass, “A view of human-machine communication and cooperation,” Int. J. Man-Machine Studies, vol. 19, pp. 309–333, 1983.
50. S. Potter and D. D. Woods, “Event-driven timeline displays: Beyond message lists in human-intelligent system interaction,” in Proc. 1991 IEEE Inter. Conf. Systems, Man, and Cybernetics, vol. 2, pp. 1283–1288, 1991.
51. S. Ragan, “Alignment and conversational coherence,” in Conversational Coherence: Form, Structure, and Strategy. R. T. Craig and K. Tracy, Eds. Beverly Hills, CA: Sage, 1983, pp. 157–176.
52. J. Rasmussen, Inform. Proc. Human-Machine Inter: An Approach to Cognitive Eng. New York: North-Holland, 1986.
53. J. Reason, Human Error. Cambridge, MA: Cambridge University Press, 1990.
54. R. Reichman, Getting Computers to Talk Like You and Me. Cambridge, MA: MIT Press, 1985.
55. E. M. Roth, K. B. Bennett, and D. D. Woods, “Human interaction with an ‘intelligent’ machine,” Int. J. Man-Machine Studies, vol. 27, pp. 479–525, 1987.
56. W. B. Rouse, “Adaptive aiding for human/computer control,” Human Factors, vol. 30, no. 4, pp. 431–444, 1988.
57. K. S. Rubin, P. M. Jones, and C. M. Mitchell, “OFMspert: Inference of operator intentions in supervisory control using a blackboard architecture,” IEEE Trans. Syst. Man Cyber. vol. 18, pp. 618–637, 1988.
58. K. Schmidt, “Cooperative work: A conceptual framework,” in Distributed Decision Making: Cognitive Models for Cooperative Work. J. Rasmussen, B. Brehmer, and J. Leplat, Eds. Chichester, UK: Wiley, 1991, pp. 75–110.
59. J. Senders and N. Moray, Eds., Human Error: Cause, Prediction, and Reduction. Hillsdale NJ: Lawrence Erlbaum, 1991.
60. T. B. Sheridan, “Human and computer roles in supervisory control and telerobotics: Musings about function, language, and hierarchy,” in L. P. Goodstein, H. B. Andersen, and S. E. Olsen, Eds., Tasks, Errors, and Mental Models. London: Taylor and Francis, 1988, pp. 149–160.
61. T. Sheridan and G. Johannsen, Eds., Monitoring Behavior and Supervisory Control. New York: Plenum, 1976.
62. R. L. Steele and C. H. Whitley, “Structuring CAD for intelligent cooperative problem solving,” NCR Corporation, Fort Collins, CO, 1990.
63. L. Suchman, Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge, MA: Cambridge University Press, 1987.
64. TAE Plus, TAE Plus 4.1 User's Manual, TAE Support Office, NASA Goddard Space Flight Center, Greenbelt, MD, 1990.
65. L. Terveen, Making Interaction Accountable, MCC Technical Report ACA-HI-377-88. Advanced Computer Architecture, Human Interface Laboratory, Microelectronics and Computer Technology Corporation, Austin, TX, 1988.
66. E. Wenger, Artificial Intelligence and Tutoring Systems. Los Altos, CA: Morgan Kaufmann, 1987.
67. C. D. Wickens, Engineering Psychology and Human Performance. Columbus, OH: Charles Merrill, 1984.
68. D. D. Woods, “Cognitive technologies: The design of joint human-machine cognitive systems,” AI Magazine, vol. 6, pp. 86–92, 1986.
69. D. D. Woods, “Coping with complexity: The psychology of human behavior in complex systems,” in Tasks, Errors, and Mental Models, L. P. Goodstein, H. B. Andersen, and S. E. Olsen, Eds. London: Taylor and Francis, 1988, pp. 128–148.
70. D. D. Woods, “Modeling and predicting human error,” in Human Performance Models for Computer-Aided Engineering, J. I. Elkind, S. K. Card, J. Hochberg, and B. M. Huey, Eds. San Diego: Academic Press, 1990.
71. D. D. Woods, “Representation aiding: A ten year retrospective,” Proc. of the 1991 IEEE Int. Conf. on Systems, Man, and Cybernetics, vol. 2, pp. 1173–1176, 1991.
72. D. D. Woods and E. M. Roth, “Cognitive engineering: Human problem solving with tools,” Human Factors, vol. 30, no. 4, pp. 415–430, 1988.