An approach to quantify workload in a system of agents

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 2, Issue , 2015, Pages 1041-1050

  Stocker, Richard ^a   Rungta, Neha ^a   Mercer, Eric ^b   Raimondi, Franco ^c   Holbrook, Jon ^d   Cardoza, Colleen ^d   Goodrich, Michael ^b  

^a NASA AMES RESEARCH CENTER   (United States)

^b BRIGHAM YOUNG UNIVERSITY   (United States)

^c MIDDLESEX UNIVERSITY   (United Kingdom)

^d SAN JOSE STATE UNIVERSITY   (United States)

Author keywords

Bdi system; Reduced flight crew operations; Workload computation

Indexed keywords

DESIGN; MULTI AGENT SYSTEMS; NASA;

AUTOMATION MONITORING; BDI SYSTEM; BELIEF-DESIRE-INTENTIONS; FLIGHT CREWS; HUMAN COGNITION; PILOT OPERATIONS; PROTOTYPE SYSTEM; WORKLOAD MEASUREMENTS;

AUTONOMOUS AGENTS;

EID: 84945200960     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (58)

1. E. M. Altmann and J. G. Trafton. Task interruption: Resumption lag and the role of cues. In Proceedings of the 26th annual conference of the Cognitive Science Society, pages 43-48, 2004.
2. J. R. Anderson, M. Matessa, and C. Lebiere. ACT-R: A theory of higher level cognition and its relation to visual attention. Human-Computer Interaction, 12(4):439-462, 1997.
3. K. J. Arrow. The Limits of Organization. W. W. Norton and Company, 1974.
4. A. Baddeley and S. Delia Sala. Working memory and executive control. Philosophical Transactions: Biological Sciences, 351(1346):1397-1404, http://dx.doi.org/10.1098/rstb.1996.0123, 1996.
5. C. Bearman, S. B. Paletz, J. Orasanu, and M. J. Thomas. The breakdown of coordinated decision making in distributed systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 52(2):173-188, 2010.
6. K. D. Bilimoria, W. W. Johnson, and P. C. Schutte. Conceptual framework for single pilot operations. HCI-Aero, 2014.
7. E. R. Boer, T. Futami, T. Nakamura, and O. Nakayama. Development of a steering entropy method for evaluating driver workload. In SAE 2001 World Congress, Detroit, Michigan, USA, March 5-8 2001. SAE paper # 1999-01-0892.
8. M. Bratman. Intention, plans, and practical reason. 1987.
9. M. D. Byrne and A. Kirlik. Using computational cognitive modeling to diagnose possible sources of aviation error. The international journal of aviation psychology, 15(2):135-155, 2005.
10. N. J. Cepeda, A. F. Kramer, and J. C. M. G. de Sather. Changes in executive control across the life span: Examination of task-switching performance. Developmental Psychology, 37(5):715-730, 2001.
11. C. Chou, D. Madhavan, and K. Funk. Studies of cockpit task management errors. The International Journal of Aviation Psychology, 6(4):307-320, 1996.
12. W. J. Clancey, P. Sachs, M. Sierhuis, and R. van Hoof. Brahms: Simulating practice for work systems design. Int. J. Hum.-Comput. Stud., 49(6):831-865, Dec. 1998.
13. D. Damos. Dual-task methodology: Some common problems. Multiple-task performance, pages 101-119, 1991.
14. P. F. Drucker. The Practice of Management. Harper Collins, 1954.
15. P. F. Drucker. The management horizon. The Journal of Business, 28(3):155-164, 1955.
16. M. R. Endsley. Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37(1):32-64, 1995.
17. M. R. Endsley. The role of situation awareness in naturalistic decision making. In C. E. Zsambok and G. Klein, editors, Naturalistic Decision Making, chapter 26, pages 269-283. Lawrence Erlbaum Associates, Hillsdale, N. J., 1997.
18. K. A. Ericsson and P. F. Delaney. Long-term working memory as an alternative to capacity models of working memory in everyday skilled performance. In A. Miyake and P. Shah, editors, Models of Working Memory: Mechanisms of Active Maintenance and Executive Control, pages 257-297. Cambridge University Press.
19. F. B. Gilbreth and L. M. Gilbreth. Applied motion study: A collection of papers on the efficient method to industrial preparedness. Macmillan, 1919.
20. M. A. Goodrich, M. R. Quigley, and K. A. Cosenzo. Task switching and multi-robot teams. In Proceedings of the 2005 NRL Workshop on Multi-Robot Systems, pages 185-195, 2005.
21. S. Hart and L. E. Staveland. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52:139-183, 1988.
22. K. V. Hindriks, F. S. De Boer, W. Van der Hoek, and J.-J. C. Meyer. Agent programming in 3APL. Autonomous Agents and Multi-Agent Systems, 2(4):357-401, 1999.
23. J. Hunter, F. Raimondi, N. Rungta, and R. Stocker. A synergistic and extensible framework for multi-agent system verification. In M. L. Gini, O. Shehory, T. Ito, and C. M. Jonker, editors, AAMAS, pages 869-876. IFAAMAS, 2013.
24. D. B. Kaber and J. M. Riley. Adaptive automation of a dynamic control task based on secondary task workload measurement. International journal of cognitive ergonomics, 3(3):169-187, 1999.
25. A. F. Kramer. Physiological metrics of mental workload: A review of recent progress. Multiple-task performance, pages 279-328, 1991.
26. S. A. Kripke. Semantical considerations on modal logic. Acta Philosophica Fennica, 16(1963):83-94, 1963.
27. J. Lachter, S. L. Brandt, V. Battiste, S. V. Ligda, M. Matessa, and W. W. Johnson. Toward single pilots operations: Developing a ground station. HCI-Aero, 2014.
28. J. E. Laird, A. Newell, and P. S. Rosenbloom. Soar: An architecture for general intelligence. Artificial intelligence, 33(1):1-64, 1987.
29. C. Lebiere, F. Jentsch, and S. Ososky. Cognitive models of decision making processes for human-robot interaction. In Virtual Augmented and Mixed Reality. Designing and Developing Augmented and Virtual Environments, pages 285-294. Springer, 2013.
30. Y. Liu. QN-ACES: Integrating queueing network and ACT-R, CAPS, EPIC, and Soar architectures for multitask cognitive modeling. International Journal of Human-Computer Interaction, 25(6):554-581, 2009.
31. M. Lundin. Simulating the effects of mental workload on performance in tankcrew.
32. N. Meiran, B. Hommel, U. Bibi, and I. Lev. Consciousness and control in task switching. Consciousness and Cognition, 11:10-33, 2002.
33. A. Miyake and P. Shah, editors. Models of Working Memory: Mechanisms of Active Maintenance and Executive Control. Cambridge University Press, 1999.
34. J. J. Moore, R. Ivie, T. J. Gledhill, E. Mercer, and M. A. Goodrich. Modeling human workload in unmanned aerial systems. In AAAI Spring Symposium Series: Formal Verification and Modeling in Human-Machine Systems, pages 44-49, 2014.
35. N. Moray, M. J. Dessouky, B. A. Kijowski, and R. Adapathya. Strategic behavior, workload, and performance in task scheduling. Human Factors, 33(6):607-629, 1991.
36. L. A. Muse, S. G. Harris, and H. S. Feild. Has the inverted-u theory of stress and job performance had a fair test? Human Performance, 16(4):349-364, 2003.
37. NASA Task Load Index (TLX) users manual.
38. D. A. Norman and D. G. Bobrow. On data-limited and resource-limited processes. Cognitive psychology, 7(1):44-64, 1975.
39. M. Norman. Economic opportunities and technological challenges for reduced crew operations, technical paper prepared for: Crew vehicle interface element, 2007.
40. R. Parasuraman, R. Molloy, and I. L. Singh. Performance consequences of automation-induced 'complacency'. The International Journal of Aviation Psychology, 3(1):1-23, 1993.
41. R. Parasuraman, T. B. Sheridan, and C. D. Wickens. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man and Cybernetics - Part A: Systems and Humans, 30(3):286-297, May 2000.
42. H. Pashler. The Psychology of Attention. MIT Press, Cambridge, Massachusetts, USA, 1998.
43. A. R. Pritchett and K. M. Feigh. Simulating first-principles models of situated human performance. In Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), 2011 IEEE First International Multi-Disciplinary Conference on, pages 144-151. IEEE, 2011.
44. A. Rao. AgentSpeak (L): BDI agents speak out in a logical computable language. In Agents Breaking Away, pages 42-55. Springer, 1996.
45. A. S. Rao and M. P. Georgeff. Modeling rational agents within a BDI-architecture. KR, 91:473-484, 1991.
46. H. E. Resource. NASA-TLX (NASA Task Load Index).
47. D. D. Salvucci and N. A. Taatgen. Threaded cognition: an integrated theory of concurrent multitasking. Psychological review, 115(1):101-130, 2008.
48. S. Schuch and I. Koch. The role of response selection for inhibition of task sets in task shifting. Journal of Experimental Psychology: Human Perception and Performance, 29:92-105, 2003.
49. T. B. Sheridan. Telerobotics, Automation, and Human Supervisory Control. MIT Press, 1992.
50. M. Sierhuis. Modeling and Simulating Work Practice. Brahms: a multiagent modeling and simulation language for work system analysis and design. PhD thesis, Social Science and Informatics (SWI), University of Amsterdam, SIKS Dissertation Series No. 2001-10, Amsterdam, The Netherlands, 2001.
51. F. W. Taylor. The principles of scientific management. Harper, 1914.
52. G. G. P. M. Todd. Simple Heuristice That Make Us Smart. Oxford University Press, New York, 1999.
53. J. G. Trafton, E. M. Altmann, D. P. Brock, and F. E. Mintz. Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal. International Journal of Human-Computer Studies, 58:583-603, 2003.
54. M. K. Tulga and T. B. Sheridan. Dynamic decisions and work load in multitask supervisory control. IEEE Transactions on Systems, Man, and Cybernetics, 10(5):217-232, 1980.
55. C. D. Wickens. Engineering psychology and human performance. HarperCollins Publishers, 1992.
56. C. D. Wickens. Multiple resources and performance prediction. Theoretical issues in ergonomics science, 3(2):159-177, 2002.
57. E. L. Wiener. Application of vigilance research: rare, medium, or well done? Human Factors: The Journal of the Human Factors and Ergonomics Society, 29(6):725-736, 1987.
58. C. E. Zsambok and G. Klein, editors. Naturalistic Decision Making, Hillsdale, N. J., 1997. Lawrence Erlbaum Associates.