Human system performance metrics for evaluation of mixed-initiative heterogeneous autonomous systems

Performance Metrics for Intelligent Systems (PerMIS) Workshop

Volumn , Issue , 2007, Pages 120-126

  Billman, Lisa ^a   Steinberg, Marc ^b  

^a ARTNC Engineering Services

^b OFFICE OF NAVAL RESEARCH   (United States)

Author keywords

Human system performance metrics; Mixed initiative; UAV; USV; UUV

Indexed keywords

DECISION MAKING; INTELLIGENT SYSTEMS; SUBMERSIBLES; UNMANNED AERIAL VEHICLES (UAV);

AUTONOMOUS DECISION; AUTONOMOUS SYSTEMS; AUTONOMY LEVELS; HUMAN INTERFACE; INDIVIDUAL SYSTEMS; MIXED INITIATIVE; PERFORMANCE METRICS; UNMANNED SYSTEM;

CONTROL THEORY;

EID: 45349104276     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1660877.1660893     Document Type: Conference Paper

References (18)

1. Steinberg, M., ""Human Interface and Autonomy Technologies for Multiple Unmanned Air, Sea, and Undersea Vehicles," in proceedings of AUVSI Unmanned Systems North America, 2007, to appear.
2. Steinberg, M. "Intelligent Autonomy for Unmanned Naval Vehicles," in proceedings of the SPIE Unmanned Systems Technology Conference, 2006.
3. Mitchell, P., Cummings, M., Sheridan, T., "Human Supervisory Control Issues in Network Centric Warfare" (HAL2004-01) ,September 2004.
4. Billman, L., Cristina, C., and Balmer, D., "Operator Feedback On The Lockheed Martin Intelligent Control And Autonomous Replanning Of Unmanned Systems (ICARUS) And Draper Labs/Charles River Risk-Aware Mixed-Initiative Dynamic Replanning (RMDR)," CSS/TR-06/XX, to appear.
5. Steinfeld, A., Fong, Kaber, T., Lewis, M., Scholtz, J., Schultz, A., Goodrich, M."Common Metrics for Human-Robot Interaction," in proceedings of 2006 Human-Robot Interaction Conference, ACM, March, 2006.
6. Goodrich, M., Olsen, D. R.: "Seven Principles of Efficient Human-Robot Interaction" in proceedings of International Conference on Systems, Man, and Cybernetics, IEEE, 2003.
7. Kilgore, R., Harper, K., Cummings, M., and Nehme, C., "Mission Planning and Monitoring for Heterogeneous Unmanned Vehicle Teams: A Human-Centered Perspective" in proceedings of the AIAA Infotech @Aerospace 2007 Conference, 2007, to appear.
8. Lingang, M., Stoner, H., Patterson, M., Seppelt, B., Hoffman, J., Crittendon, Z., Lee, J.,"Human-Automation Collaboration in Dynamic Mission Planning: A Challenge Requiring an Ecological Approach," Human Factors and Ergonomics Society Annual Meeting, 2006.
9. Ulam, P, Endo, Y., Wagner, A., Arkin, R.C., "Integrated Mission Specification and Task Allocation for Robot Teams - Design and Implementation", in proceedings of ICRA, 2007.
10. Page, L., Nervegna, M., DiBiaso, D., "Unmanned System Risk Management," in proceedings of AUVSI Unmanned Systems North America, 2007.
11. Nervegna, M., Ricard, M., "Risk-Aware Mixed-Initiative Dynamic Replanning (RMDR) Program Update," in proceedings of AUVSI Unmanned Systems North America, 2006.
12. Ahmadzadeh, A., Buchman, G., Cheng, P., Jadbabaie, A., Keller, J., Kumar, V., Pappas, G., "Cooperative Control of UAVs for Search and Coverage," in proceedings of AUVSI Unmanned Systems North America, 2007.
13. J. Franke, V. Zaychik, T. Spura, E. Accettullo, "Inverting the Operator/Vehicle Ratio: Approaches to Next Generation UAV Command and Control," in proceedings of AUVSI Unmanned Systems North America, 2005.
14. Snyder F., Morris D., Haley P., Collins R., "Maritime Image Understanding" in proceedings of SPIE Philadelphia Conference, 2004.
15. M. Godwin, S. Spry, Hedrick, K., "Distributed Collaboration with Limited Communication using Mission State Estimates," in proceedings of the American Control Conference, Minneapolis, USA, June 2006.
16. Ryan, A. et al "Decentralized Control of Unmanned Aerial Vehicle Sensing Missions," in proceedings of the American Controls Conference, 2007.
17. Endsley, M., "Measurement of Situation Awareness in Dynamic Systems." Human Factors," 37(1), 65-84, 1995.
18. Hart, SG, and Staveland, LE, "Development of the NASA-TLX (task load index): Results of empirical and theoretical research," 1988.