Evaluating autonomous ground-robots

Journal of Field Robotics

Volumn 29, Issue 5, 2012, Pages 689-706

  Finn, Anthony ^a   Jacoff, Adam ^b   Del Rose, Mike ^c   Kania, Bob ^c   Overholt, Jim ^c   Silva, Udam ^d   Bornstein, Jon ^e  

^a UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

^b NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^c Development and Engineering Center   (United States)

^d Communications Electronics Research and Development Center ^*  (United States)

^e U S ARMY RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINUOUS TRACKING; DOMAIN SPECIFIC; METRICS OF PERFORMANCE; MULTI-VEHICLES; OVERALL EFFECTIVENESS; PERFORMANCE EVALUATION; PERFORMANCE TESTS; REAL TIME; ROBOT SOCCER; SPECIFIC TASKS; TEST METHOD; URBAN ENVIRONMENTS;

COMPUTER SIMULATION; ROBOTICS;

INTELLIGENT ROBOTS;

EID: 84865259844     PISSN: 15564959     EISSN: 15564967     Source Type: Journal    
DOI: 10.1002/rob.21433     Document Type: Article

References (28)

1. Bruemmer, D., et al. (2004, April). How to trust robots further than we can throw them. Paper presented at the CHI Conference on Human Factors in Computing Systems, Vienna.
2. Cohen, M., Parasuranman, R., &, Freeman, J., (1999). Trust in decision aids: Amodel and its training implications (Tech. Rep. USAATCOM TR-97-D-4).
3. Cummings, M.L., (2003). Supervisory control challenges in NCW. Doctoral dissertation, University of Virginia, Charlottesville, VA.
4. Cummings, M.L., et al. (2009). Predicting operator capacity for supervisory control of multiple UAVs. In Innovations in intelligent machines. Springer.
5. Davidson, E.J., (2005). Evaluation methodology: The nuts & bolts of sound evaluation. Sage Publications.
6. Del Rose, M., Kania, R., &, Overholt, J., (2012). MAGIC 2010 Review (Tech. Rep.). Tank & Automotive Research Development & Engineering Centre (TARDEC).
7. th International Symposium on Aviation Psychology. Dayton, OH.
8. Draper, J.V., &, Kaber, D.B., (1999). Human-robot interaction, In, A. Mital, et al. (Eds.), Industrial & occupational ergonomics: Users' encyclopaedia.
9. Endsley, M.R., &, Kaber, D.B., (1999). Level of automation effects on performance, situational awareness, and workload in a dynamic control task. Journal of Ergonomics, 42 (3), 462-492. (Pubitemid 29074295)
10. Finn, R.A., &, Chalmers, G., (2001). Operations analysis methodology for force level electronic warfare (Res. Rep. DSTO-RR-0298). DSTO.
11. Finn, R.A., &, Scheding, S., (2010, March). Challenges for autonomous & unmanned vehicles. Springer.
12. Goodrich, M., &, Olsen, D., (2003). Seven principles of efficient human-robot interaction. In Proceedings of the IEEE Conference on Systems, Man & Cybernetics (pp. 3943-3948). IEEE.
13. Granda, T. M., Kirkpatrick, T., Julien, L., &, Peterson, L.A., (1990, October). The evolutionary role of humans in the human-robot system. In Proceedings of the Human Factors Society 34th Annual Meeting (pp. 664-668). Santa Monica, CA.
14. Hart, S., &, Staveland, L., (1988). Development of the NASA task load index: Research in empirical and theoretical results. In, P. Hancock, &, N. Meshkati, (Eds.), Human mental workload. North Holland Press.
15. Hinds, P.J., Roberts, T.L., &, Jones, H., (2004). Whose job is it anyway? A study of human-robot interaction. Journal of Human Computer Interaction, 19, 151-181.
16. Huang, H.M., (2006, August). Autonomy levels for unmanned systems (ALFUS) framework. In Proceedings of the Performance Metrics for Intelligent Systems (PerMIS) Workshop, Gaithersburg, MD.
17. Jacoff, A., Messina, E., &, Evans, J., (2002). Performance evaluation of autonomous mobile robots. Industrial Robot: An International Journal, 29 (3).
18. Kaupp, T., &, Makarenko, A., (2008, May). Measuring human-robot team effectiveness to determine an appropriate autonomy level. In Proceedings of the IEEE Conference on Robotics & Automation. Pasadena, CA: IEEE.
19. McCarley, J.S., &, Wickens, C.D., (2005). Human factors implications of UAVs in the national airspace (Tech. Rep. AHFD-05-05/FAA-05-01), Aviation Human Factors Division, Institute of Aviation.
20. Nourbakhsh, I.R., et al. (2005). Human-robot teaming for search & rescue, Pervasive Computing, IEEE Computer Society, January-March.
21. O'Day, S., et al. (2004). Metrics for intelligent autonomy. In Proceedings of the Performance Metrics for Intelligent Systems (PerMIS).
22. Olsen, S.R., &, Goodrich, M.A., (2003). Metrics for evaluating human-robot interactions. In Proceedings of the Performance Metrics for Intelligent Systems, Gaithersburg, MD.
23. Rantanen, E., &, Nunes, A., (2003). Taxonomies of measures in air traffic controlresearch. In Proceedings of the International Symposium on Aviation Psychology.
24. Rehmann, A.J., (1995). Guide to human performance measurements and crew requirements (Tech. Rep.), DOT/FAA/CT-TN95-49, Dept. Transport.
25. Rodriguez, G., &, Weisbin, C., (2003). A new method to evaluate human-robot systems performance. Autonomous Robots, 14, 165-178.
26. Steinfeld, A., et al. (2006, March). Common metrics for human-robot interaction. In Proceedings of Human-Robot Interaction, Salt Lake City, UT.
27. Wickens, C., (1999). Automation in air traffic control: The human performance issues. In, M. Scerbo, &, M. Mouloua, (Eds.). Automation technology & human research trends. Lawrence Erbaum Assoc.
28. Yanco, H., &, Drury, J., (2002, November). Ataxonomyfor human-robot interaction. In Proceedings of the AAAI Fall Symposium on Human-Robot Interaction (pp. 111-119), North Falmouth, MA.