Measuring the effectiveness of human autonomy teaming

Advances in Intelligent Systems and Computing

Volumn 586, Issue , 2018, Pages 23-33

  Strybel, Thomas Z ^a   Keeler, Jillian ^a   Mattoon, Natassia ^a   Alvarez, Armando ^a   Barakezyan, Vanui ^a   Barraza, Edward ^a   Park, James ^a   Vu, Kim Phuong L ^a   Battiste, Vernol ^b  

^a CALIFORNIA STATE UNIVERSITY   (United States)

^b NASA AMES RESEARCH CENTER   (United States)

Author keywords

Autonomous constrained flight planner; Human autonomy teaming

Indexed keywords

COMPUTER PROGRAMMING; COMPUTER SCIENCE;

AUTONOMOUS CONSTRAINED FLIGHT PLANNER; EYE-GAZE; FLIGHT PLANS; HUMAN-AUTONOMY-TEAMING; OPERATOR WORKLOAD; SUBJECTIVE WORKLOAD;

FLIGHT SIMULATORS;

EID: 85021788494     PISSN: 21945357     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-319-60642-2_3     Document Type: Conference Paper

References (23)

1. National Research Council: Autonomy Research for Civil Aviation: Toward a New Era of Flight. National Academies Press, Washington D.C. (2014)
2. Langan-Fox, J., Canty, J.M., Sankey, M.J.: Human-automation teams and adaptable control for future air traffic management. Int. J. Ind. Ergon. 39, 894–903 (2009)
3. Chen, J.Y.C., Barnes, M.J.: Human-Agent Teaming for Multi-Robot Control: A Literature Review (ARL-TR-6328). Human Research and Engineering Directorate, Aberdeen Proving Grounds (2013)
4. Shively, R.J., Lachter, J., Brandt, S., Matessa, M., Battiste, V., Johnson, W.W.: Why human-autonomy teaming? In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
5. Fern, L., Shively, R.J.: A comparison of varying levels of automation on the supervisory control of multiple UASs. In: Proceedings of AUVSI’s Unmanned Systems North America, Washington, DC (2009)
6. Brandt, S., Lachter, J.B., Russel, R., Shively, R.J.: A human-autonomy teaming approach for a flight-following task. In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
7. Lachter, J.B., Brandt, S., Sadler, G. Shively, R.: Beyond point design: general pattern to specific implementations. In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
8. Endsley, M.R., Jones, D.G.: Designing for situation awareness: an approach to human-centered design, 2nd edn. CRC Press, New York (2012)
9. Matessa, M.: Using a crew resource management framework to develop human-autonomy teaming measures. In: Proceedings of the 8th Annual International Conference on Applied Human Factors and Ergonomics (AHFE 2017), Los Angeles, CA (this volume)
10. Joe, J.C., O’Hara, J., Medema, H.D., Oxstrand, J.H.: Identifying requirements for effective human-automation teamwork. In: Probabilistic Safety Assessment and Management PSAM 2012, Honolulu, HI (2014)
11. Parasuraman, R., Sheridan, T.B., Wickens, C.D.: Humans: still vital after all these years of automation. Hum. Factors Gold. Anniv. Spec. Issue 50, 511–520 (2008)
12. Cummings, M.L., Stimpson, A., Clamann, M.: Functional Requirements for Onboard Intelligent Automation in Single Pilot Operations. AIAA 2016-1652. AIAA Infotech @ Aerospace, San Diego (2016)
13. Chen, J.Y.C., Barnes, M.J., Harper-Sciarini, M.: Humans: still vital after all these years of automation. IEEE Trans. Syst. Man Cybern.—Part C: Appl. Rev. 41, 435–454 (2011)
14. Endsley, M.R.: From here to autonomy: lessons learned from human–automation research. Hum. Factors 59, 5–27 (2016)
15. Donmez, B., Pina, P.E., Cummings, M.L.: Evaluation criteria for human-automation performance metrics. In: Madhavan, R., Tunstel, E., Messina, E. (eds.) Performance Evaluation and Benchmarking of Intelligent Systems, pp. 21–40. Springer, Heidelberg (2009)
16. Birsen, D., Pina, P.E., Cummings, M.L.: Evaluation criteria for human-automation performance metrics. In: Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems. Gaithersburg, Maryland, pp. 77–82 (2008)
17. Battiste, V., Bortolussi, M.: Transport pilot workload: a comparison of two subjective techniques. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 32(2), 150–154 (1988)
18. Salmon, P.M., Stanton, N.A., Walker, G.H., Jenkins, D., Ladva, D., Rafferty, L., Young, M.: Measuring Situation Awareness in complex systems: comparison of measures study. Int. J. Ind. Ergon. 39(3), 490–500 (2009)
19. Jian, J., Bisantz, A., Drury, C.: Foundations for an empirically determined scale of trust in automated systems. Int. J. Cogn. Ergon. 4, 53–71 (2000)
20. Dickinson T.L., McIntyre R.M.: A conceptual framework for teamwork measurement. In: Team Performance Assessment and Measurement: Theory, Methods, and Applications, pp. 19–43. Lawrence Erlbaum (1997)
21. Higham, T., Vu, K.-P., Miles, J., Strybel, T.Z., Battiste, V.: Training air traffic controller trust in automation within a NextGen environment. In: Yamamoto, S. (ed.) HIMI/HCII 2013, Part II. LNCS, pp. 76–84. Springer, Heidelberg (2013)
22. Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y.C., de Visser, E.J., Parasuraman, R.: A meta-analysis of factors affecting trust in automation in human-robot interaction. Hum. Factors 53, 518–527 (2011)
23. Muir, B.M., Moray, N.: Trust in automation: Part II. Experimental studies of trust and human intervention on a process control simulation. Ergonomics 39, 429–460 (1996)