An objective function to evaluate performance of human-robot collaboration in target recognition tasks

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 39, Issue 6, 2009, Pages 611-620

  Bechar, Avital ^a   Meyer, Joachim ^b   Edan, Yael ^b  

^a VOLCANI CENTER   (Israel)

^b BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Human robot interaction; Levels of automation; Objective function; Target recognition; Unstructured environments

Indexed keywords

HUMAN OPERATOR; HUMAN ROBOT INTERACTIONS; HUMAN SENSITIVITY; HUMAN-ROBOT COLLABORATION; OBJECTIVE FUNCTIONS; OPTIMAL PERFORMANCE; OPTIMAL SOLUTIONS; OPTIMAL VALUES; PERFORMANCE MEASURE; ROBOT PARAMETERS; ROBOTIC SYSTEMS; SENSOR ACCURACY; SIGNAL DETECTION THEORY; SYSTEM CHARACTERISTICS; TARGET RECOGNITION; TIME COST; UNSTRUCTURED ENVIRONMENTS;

FUNCTION EVALUATION; HUMAN COMPUTER INTERACTION; MAN MACHINE SYSTEMS; OPTIMAL SYSTEMS; OPTIMIZATION; ROBOTICS; SENSORS; SIGNAL DETECTION; TARGETS;

HUMAN ROBOT INTERACTION;

EID: 77955089321     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2009.2020174     Document Type: Article

References (43)

1. I. Lopez-Juarez and M. Howarth, "Knowledge acquisition and learning in unstructured robotic assembly environments, " Inf. Sci., vol. 145, no. 1-2, pp. 89-111, 2002.
2. E. J. Gonzalez-Galvan, S. R. Cruz-Ramirez, M. J. Seelinger, and J. J. Cervantes-Sanchez, "An efficient multi-camera, multi-target scheme for the three-dimensional control of robots using uncalibrated vision, " Robot. Comput.-Integr. Manuf., vol. 19, no. 5, pp. 387-400, 2003.
3. A. Bechar and Y. Edan, "Human-robot collaboration for improved target recognition of agricultural robots, " Ind. Robot, vol. 30, no. 5, pp. 432-436, 2003.
4. S. Everett and R. Dubey, "Human-machine cooperative telerobotics using uncertain sensor and model data, " in Proc. IEEE Int. Conf. Robot. Autom., Leuven, Belgium, 1998, pp. 1615-1622.
5. A. A. S. Al-Jumaily and S. H. M. Amin, "Blending multi-behaviors of intelligent reactive navigation for legged walking robot in unstructured environment, " in Proc. TENCON, 2000, vol. 2, pp. 297-302.
6. L. Fletcher, G. Loy, N. Barnes, and A. Zelinsky, "Correlating driver gaze with the road scene for driver assistance systems, " Robot. Auton. Syst., vol. 52, pp. 71-84, 2005.
7. H. J. Kim and D. H. Shim, "A flight control system for aerial robots: Algorithms and experiments, " Contr. Eng. Practice, vol. 11, no. 12, pp. 1389-1400, 2003.
8. A. Steinfeld, "Interface lessons for fully and semi-autonomous mobile robots, " in Proc. ICRA, 2004, vol. 3, pp. 2752-2757.
9. E. Bicho, P. Mallet, and G. Schoner, "Target representation on an autonomous vehicle with low-level sensors, " Int. J. Robot. Res., vol. 19, no. 5, pp. 424-447, 2004.
10. Y. M. Ye and J. K. Tsotsos, "Sensor planning for 3D object search, " Comput. Vis. Image Understanding, vol. 73, no. 2, pp. 145-168, 1999.
11. Y. Edan, "Food and agricultural robots, " in Handbook of Industrial Robotics, S. Y. Nof, Ed., 2nd ed. New York: Wiley, 1999, pp. 1143-1155.
12. W. Ponweiser, M. Vincze, and M. Zillich, "A software framework to integrate vision and reasoning components for cognitive vision systems, " Robot. Auton. Syst., vol. 52, pp. 101-114, 2005.
13. B. Bhanu, Y. Q. Lin, G. Jones, and J. Peng, "Adaptive target recognition, " Mach. Vis. Appl., vol. 11, no. 6, pp. 289-299, 2000.
14. K. Venkataramani, S. Qidwai, and B. V. K. Vijayakumar, "Face authentication from cell phone camera images with illumination and temporal variations, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 3, pp. 411-418, Aug. 2005.
15. M. Maltz, "Decision modeling for a target acquisition task, " Opt. Eng., vol. 39, no. 9, pp. 2581-2584, 2000.
16. J. A. Swets, R. M. Dawes, and J. Monahan, "Better decisions through science, " Sci. Amer., vol. 283, pp. 82-87, 2000.
17. A. Filippidis, L. C. Jain, and N. Martin, "Multisensor data fusion for surface land-mine detection, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 30, no. 1, pp. 145-150, Feb. 2000.
18. Z. Sun, G. Bebis, and R. Miller, "Object detection using feature subset selection, " Pattern Recognit, vol. 37, no. 11, pp. 2165-2176, 2004.
19. S. C. Pei and C. L. Lai, "A morphological approach of target detection on perspective plane, " Signal Process., vol. 81, no. 9, pp. 1975-1984, 2001.
20. W. Gao and M. K. Hinders, "Mobile robot sonar interpretation algorithm for distinguishing trees from poles, " Robot. Auton. Syst., vol. 53, no. 2, pp. 89-98, 2005.
21. G. Liu and R. M. Haralick, "Optimal matching problem in detection and recognition performance evaluation, " Pattern Recognit., vol. 35, no. 10, pp. 2125-2139, 2002.
22. A. Bechar, "Human-robot collaboration methods for target recognition tasks in unstructured environments, " Ph. D. dissertation, Dept. Ind. Eng. Manag., Ben-Gurion Univ. Negev, Beer-Sheva, Israel, 2006.
23. G. Rodriguez and C. R. Weisbin, "A new method to evaluate human-robot system performance, " Auton. Robots, vol. 14, pp. 165-178, 2003.
24. J. W. Matthews, F. U. Rosenberger, W. R. Bosch, W. B. Harms, and J. A. Purdy, "Real-time 3D dose calculation and display: A tool for plan optimization, " Int. J. Radiat. Oncol. Biol. Phys., vol. 36, no. 1, pp. 159-165, 1996.
25. H. Hill, F. G. Schyns, and S. Akamatsu, "Information and viewpoint dependence in face recognition, " Cognition, vol. 62, no. 2, pp. 201-222, 1997.
26. B. Ayrulu and B. Barshan, "Neural networks for improved target differentiation and localization with sonar, " Neural Netw., vol. 14, no. 3, pp. 355-373, 2001.
27. J. B. F. Van Erp and H. A. H. C. Van Veen, "Vibrotactile in-vehicle navigation system, " Transp. Res., Part F: Traffic Psychol. Behav., vol. 7, no. 4-5, pp. 247-256, 2004.
28. R. Parasuraman, T. B. Sheridan, and C. D. Wickens, "A model for types and levels of human interaction with automation, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 30, no. 3, pp. 286-297, May 2000.
29. J. L. Burke, R. R. Murphy, E. Rogers, V. J. Lumelsky, and J. Scholtz, "Final report for the DARPA/NSF interdisciplinary study on human-robot interaction, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 34, no. 2, pp. 103-112, May 2004.
30. A. Bechar, Y. Edan, and J. Meyer, "An objective function for performance measurement of human-robot target recognition systems in unstructured environments, " presented at the IEEE Int. Conf. Syst., Man, Cybern., The Hague, The Netherlands, 2004, Paper 520.
31. G. Guida and G. Lamperti, "AMMETH: A methodology for requirements analysis of advanced human-system interfaces, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 30, no. 3, pp. 298-321, May 2000.
32. T. B. Sheridan and W. L. Verplank, "Human and computer control of undersea teleoperators, " MIT, Cambridge, MA, Tech. Rep., 1978.
33. D. J. Bruemmer, D. A. Few, R. A. Boring, J. A. Marble, M. C. Walton, and C. W. Nielsen, "Shared understanding for collaborative control, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 35, no. 4, pp. 494-504, Jul. 2005.
34. S. B. Hughes and M. Lewis, "Task-driven camera operations for robotic exploration, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 35, no. 4, pp. 513-522, Jul. 2005.
35. A. R. Graves and C. Czarnecki, "Design patterns for behavior-based robotics, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 30, no. 1, pp. 36-41, Jan. 2000.
36. A. Kirlik, B. D. Plamondon, L. Lytton, R. J. Jagacinski, and R. A. Miller, "Supervisory control in a dynamic and uncertain environment: Laboratory task and crew performance, " IEEE Trans. Syst., Man, Cybern., vol. 23, no. 4, pp. 1130-1138, Jul./Aug. 1993.
37. H. Sidenbladh, D. Kragic, and H. I. Christensen, "A person following behavior for a mobile robot, " in Proc. IEEE Int. Conf. Robot. Autom., 1999, pp. 670-675.
38. T. Itoh, K. Kosuge, and T. Fukuda, "Human-machine cooperative telemanipulation with motion and force scaling using task-oriented virtual tool dynamics, " IEEE Trans. Robot. Autom., vol. 16, no. 5, pp. 505-516, Oct. 2000.
39. D. E. Robinson and R. D. Sorkin, "A contingent criterion model of computer assisted detection, " Trends Ergonom./Human Factors, vol. 2, pp. 75-82, 1985.
40. R. D. Sorkin and D. D. Woods, "Systems with human monitors: A signal detection analysis, " Human-Comput. Interact., vol. 1, no. 1, pp. 49-75, 1985.
41. A. Bechar, Y. Edan, and J. Meyer, "An objective function to evaluate performance of human-robot systems for target recognition tasks, " presented at the IEEE Int. Conf. Syst., Man, Cybern., Montreal, QC, Canada, 2007, Paper 710.
42. C. F. Chi and C. G. Drury, "Do people choose an optimal response criterion in an inspection task?, " IIE Trans., vol. 30, pp. 257-266, 1998.
43. T. Tsuji and Y. Tanaka, "Tracking control properties of human-robotic systems based on impedance control, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 35, no. 4, pp. 523-535, Jul. 2005.