HRI usability evaluation of interaction modes for a teleoperated agricultural robotic sprayer

Applied Ergonomics

Volumn 62, Issue , 2017, Pages 237-246

  Adamides, George ^a   Katsanos, Christos ^b,c   Parmet, Yisrael ^d   Christou, Georgios ^e   Xenos, Michalis ^b   Hadzilacos, Thanasis ^a,f,g   Edan, Yael ^d  

^a OPEN UNIVERSITY OF CYPRUS   (Cyprus)

^b HELLENIC OPEN UNIVERSITY   (Greece)

^c Technological Educational Institute of Western Greece ^*  (Greece)

^d BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

^e EUROPEAN UNIVERSITY CYPRUS   (Cyprus)

^f CYPRUS INSTITUTE   (Cyprus)

^g EPFL   (Switzerland)

Author keywords

Agricultural robot; Human robot interaction; Teleoperation; Usability

Indexed keywords

AGRICULTURE; HELMET MOUNTED DISPLAYS; HUMAN COMPUTER INTERACTION; KNOBS; MACHINE DESIGN; MAN MACHINE SYSTEMS; REMOTE CONTROL; ROBOTICS; SURVEYS; USABILITY ENGINEERING; USER INTERFACES; VISUAL SERVOING;

AGRICULTURAL ROBOT; EFFECTIVENESS AND EFFICIENCIES; HEAD MOUNTED DISPLAYS; HUMAN-ROBOT COLLABORATION; HUMAN-ROBOT INTERFACE; PERCEIVED USABILITY; USABILITY; USABILITY EVALUATION;

HUMAN ROBOT INTERACTION;

ADULT; AGED; ARTICLE; COMPUTER; COMPUTER INPUT DEVICE; CONTROLLED STUDY; DISPLAY SYSTEM; FEMALE; GAMEPAD; GENERAL DEVICE; HEAD MOUNTED DISPLAY; HUMAN; HUMAN EXPERIMENT; HUMAN ROBOT INTERACTION; INFORMATION PROCESSING; INFORMATION TECHNOLOGY DEVICE; KEYBOARD; MALE; MODULAR USER INTERFACE; MULTIPLE VIEW; PERSONAL COMPUTER SCREEN; RELIABILITY; SINGLE VIEW; TELEOPERATED AGRICULTURAL ROBOTIC SPRAYER; VINEYARD; WORKLOAD; AGRICULTURE; COMPUTER INTERFACE; COMPUTER TERMINAL; CONSUMER ATTITUDE; DEVICES; MAN MACHINE INTERACTION; MIDDLE AGED; QUESTIONNAIRE; ROBOTICS; TASK PERFORMANCE;

ADULT; AGED; AGRICULTURE; COMPUTER TERMINALS; CONSUMER BEHAVIOR; DATA DISPLAY; FEMALE; HUMANS; MALE; MAN-MACHINE SYSTEMS; MIDDLE AGED; ROBOTICS; SURVEYS AND QUESTIONNAIRES; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE; WORKLOAD;

EID: 85016017890     PISSN: 00036870     EISSN: 18729126     Source Type: Journal    
DOI: 10.1016/j.apergo.2017.03.008     Document Type: Article

References (68)

1. Adamides, G., User Interfaces for Human-robot Interaction: Application on a Semi-autonomous Agricultural Robot Sprayer. (PhD Doctoral Dissertation), 2016, Open University of Cyprus, Lefkosia.
2. Adamides, G., Christou, G., Katsanos, C., Xenos, M., Hadzilacos, T., Usability guidelines for the design of robot teleoperation: a taxonomy. IEEE Trans. Human-Machine Syst. 45:2 (2015), 256–262, 10.1109/thms.2014.2371048.
3. Adamides, G., Katsanos, C., Xenos, M., Hadzilacos, T., & Edan, Y. (2016). Heuristic usability evaluation of user interfaces for a semi-autonomous vineyard robot sprayer. Paper presented at the 5th Israeli Conference on Robotics, Herzillya, Israel.
4. Adamides, G., Katsanos, C., Christou, G., Xenos, M., Kostaras, N., Hadzilacos, T., Human-robot interaction in agriculture: Usability evaluation of three input devices for spraying grape clusters. Proc. EFITA-WCCA-CIGR Conf. Sustainable Agriculture Through ICT Innovation, 2013.
5. Bac, C.W., Henten, E.J., Hemming, J., Edan, Y., Harvesting robots for high-value crops: state-of-the-art review and challenges ahead. J. Field Robotics 31:6 (2014), 888–911.
6. Bangor, A., Kortum, P.T., Miller, J.T., An empirical evaluation of the system usability scale. Intl. J. Human–Computer Interact. 24:6 (2008), 574–594.
7. Bechar, A., Edan, Y., Human-robot collaboration for improved target recognition of agricultural robots. Industrial robot. Int. J. 30 (2003), 432–436.
8. Berenstein, R., A Human-robot Collaborative Vineyard Selective Sprayer. (PhD), 2016, Ben-Gurion University of the Negev, Israel.
9. Blackmore, S., Stout, B., Wang, M., Runov, B., Robotic agriculture–the future of agricultural mechanisation. Proceedings of the 5th European Conference on Precision Agriculture, 2005, 621–628.
10. Brooke, J., SUS-A quick and dirty usability scale. Jordan, B.T.P.W., Weerdmeester, B.A., McClelland, A.L., (eds.) Usability Evaluation in Industry, vol. 189, 1996, Taylor and Francis, London, 4–7.
11. Casper, J., Murphy, R.R., Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center. IEEE Trans. Syst. Man, Cybern. Part B Cybern. 33:3 (2003), 367–385.
12. Chen, J.Y.C., Haas, E.C., Barnes, M.J., Human performance issues and user interface design for teleoperated robots. IEEE Trans. Syst. Man, Cybern. Part C Appl. Rev. 37 (2007), 1231–1245.
13. Clarkson, E., & Arkin, R. C. (2007). Applying Heuristic Evaluation to Human-Robot Interaction Systems. Paper presented at the FLAIRS Conference.
14. Correa, C., Valero, C., Barreiro, P., Diago, M. P., & Tardáguila, J. (2012). Feature extraction on vineyard by gustafson kessel fcm and k-means. Paper presented at the 16th IEEE Mediterranean Electrotechnical Conference (MELECON).
15. Doisy, G., Ronen, A., Edan, Y., Comparison of three different techniques for camera and motion control of a teleoperated robot. Appl. Ergon. 58 (2017), 527–534.
16. Drury, J. L., Yanco, H. A., & Keyes, B. (2007). LASSOing HRI: analyzing situation awareness in map-centric and video-centric interfaces. Paper presented at the Proceedings of the ACM/IEEE international conference on Human-robot interaction.
17. Eaton, R., Where Robotics and Agriculture Meet: Autonomous Vehicles for Precision Farming. 2009 Retrieved 01/01/2014, 2014, from http://www.sensorsandsystems.com/article/features/7319-where-robotics-and-agriculture-meet-autonomous-vehicles-for-precision-farming.html.
18. Edan, Y., Design of an autonomous agricultural robot. Appl. Intell. 5 (1995), 41–50.
19. Edan, Y., Food and agriculture robotics. Nof, S.Y., (eds.) Handbook of Industrial Robotics, second ed. ed., 1999, John Wiley & Sons, Inc.
20. Edan, Y., Shufeng, H., Naoshi, K., Automation in Agriculture Springer Handbook of Automation. 2009, Springer, 1095–1128.
21. Eliav, A., Lavie, T., Parmet, Y., Stern, H., Edan, Y., Advanced methods for displays and remote control of robots. Appl. Ergon. 42:6 (2011), 820–829 http://dx.doi.org/10.1016/j.apergo.2011.01.004.
22. Endsley, M.R., Design and evaluation for situation awareness enhancement. Hum. Factors ergon Soc. Annu. Meet. Proc. 32 (1988), 97–101.
23. Endsley, M.R., Toward a theory of situation awareness in dynamic systems. Hum. Factors J. Hum. Factors ergon Soc. 37 (1995), 32–64.
24. Field, A., Discovering Statistics Using IBM SPSS Statistics. 2013, Sage.
25. Finstad, K., The System Usability Scale and non-native english speakers. J. Usability Stud. 1:4 (2006), 185–188.
26. Fong, T., Thorpe, C., Baur, C., Advanced interfaces for vehicle teleoperation: collaborative control, sensor fusion displays, and remote driving tools. Aut. robot. 11 (2001), 77–85.
27. Garcia-Alegre, M. C., Ribeiro, A., Garcia-Perez, L., Martinez, R., & Guinea, D. (2001). Autonomous robot in agricultural tasks. Paper presented at the European Conference on Precision Agriculture.
28. Glynou, E., Schwarzer, R., Jerusalem, M., Greek Adaptation of the General Self-efficacy Scale. 2013. 1994 from http://userpage.fu-berlin.de/∼health/greek.htm.
29. Gongal, S., Amatya, M., Karkee, Q., Zhang, K.L., Sensors and systems for fruit detection and localization: a review. Comput. Electron. Agric. 116 (2015), 8–19.
30. Guo, C., & Sharlin, E. (2008). Exploring the use of tangible user interfaces for human-robot interaction: a comparative study. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.
31. Guzman, R., Navarro, R., Beneto, M., Carbonell, D., Robotnik—professional Service Robotics Applications with ROS Robot Operating System (ROS). 2016, Springer, 253–288.
32. Hart, S. G. (2006). NASA-task load index (NASA-TLX); 20 years later. Paper presented at the Proceedings of the human factors and ergonomics society annual meeting.
33. Hart, S.G., Staveland, L.E., Development of NASA-TLX (task load index): results of empirical and theoretical research. Hum. Ment. workload 1 (1988), 139–183.
34. Hegarty, M., Richardson, A.E., Montello, D.R., Lovelace, K., Subbiah, I., Development of a self-report measure of environmental spatial ability. Intelligence 30:5 (2002), 425–447.
35. Hollingum, J., Robots in agriculture. Industrial robot. Int. J. industrial Serv. robot. 26 (1999), 438–446.
36. Isaacs, G.W., Robotic applications in agriculture. Acta Hortic., 1986, 123–128.
37. ISO, Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) – Part 11: Guidance on Usability. 1998.
38. Jerusalem, M., Schwarzer, R., Schwarzer, R., Self-efficacy as a resource factor in stress appraisal processes. Self-efficacy Thought control action, 1992, 195–213.
39. Jie, Z., Xiangyu, W., Rosenman, M., Fusing multiple sensors information into mixed reality-based user interface for robot teleoperation. Paper Presented at the IEEE International Conference on Systems, Man and Cybernetics, 2009, 11–14 Oct. 2009, SMC 2009.
40. Kapach, K., Barnea, E., Mairon, R., Edan, Y., Ben-Shahar, O., Computer vision for fruit harvesting robots - state of the art and challenges ahead. Int. J. Comput. Vis. Robotics 3:1/2 (2012), 4–34.
41. Katsanos, C., Tselios, N., Xenos, M., Perceived usability evaluation of learning management systems: a first step towards standardization of the System Usability Scale in Greek. Paper Presented at the 16th Pan-Hellenic Conference on Informatics with International Participation, 2012, PCI 2012, Piraeus, Greece.
42. Lee, W.S., Slaughter, D., Giles, D., Robotic weed control system for tomatoes. Precis. Agric. 1:1 (1999), 95–113.
43. Leech, N.L., Barrett, K.C., Morgan, G.A., IBM SPSS for Intermediate Statistics: Use and Interpretation. 2012, Routledge.
44. Li, M., Imou, K., Wakabayashi, K., Yokoyama, S., Review of research on agricultural vehicle autonomous guidance. Int. J. Agric. Biol. Eng. 2 (2009), 1–16.
45. Lichtenstern, M., Angermann, M., Frassl, M., Berthold, G., Julian, B.J., Rus, D., Pose and paste—an intuitive interface for remote navigation of a multi-robot system. Paper Presented at the International Conference on Intelligent Robots and Systems (IROS), 2013, 2013, IEEE/RSJ.
46. Martins, H., & Ventura, R. (2009). Immersive 3-D teleoperation of a search and rescue robot using a head-mounted display. Paper presented at the IEEE Conference on Emerging Technologies & Factory Automation.
47. McCulloch, C.E., Searle, S.R., Generalized, Linear, and Mixed Models. 2000.
48. Molich, R., Nielsen, J., Improving a human-computer dialogue. ACM Commun. 33 (1990), 338–348, 10.1145/77481.77486.
49. Monferrer, A., Bonyuet, D., Cooperative robot teleoperation through virtual reality interfaces. Paper presented at the Proceedings. Sixth International Conference on Information Visualisation, 2002.
50. Moreno, F.-A., Cielniak, G., Duckett, T., Evaluation of Laser Range-finder Mapping for Agricultural Spraying Vehicles towards Autonomous Robotic Systems. 2014, Springer, 210–221.
51. Murakami, N., Ito, A., Will, J.D., Steffen, M., Inoue, K., Kita, K., Miyaura, S., Development of a teleoperation system for agricultural vehicles. Comput. Electron. Agric. 63 (2008), 81–88.
52. Norman, D.A., The Psychology of Everyday Things. 1988.
53. Oberti, R., Marchi, M., Tirelli, P., Calcante, A., Iriti, M., Hocevar, M., Baur, J., Pfaff, J., Schütz, C., Ulbrich, H., Selective spraying of grapevine's diseases by a modular agricultural robot. J. Agric. Eng. 44 (2013), 149–153.
54. Ogawa, Y., Kondo, N., Monta, M., Shibusawa, S., Spraying Robot for Grape Production Field and Service Robotics. 2006, Springer, 539–548.
55. Orfanou, K., Tselios, N., Katsanos, C., Perceived usability evaluation of learning management systems: empirical evaluation of the system usability scale. Int. Rev. Res. Open Distributed Learn. 16:2 (2015), 227–246.
56. Randelli, G., Venanzi, M., & Nardi, D. (2011). Evaluating tangible paradigms for ground robot teleoperation. Paper presented at the IEEE RO-MAN.
57. Rastogi, A., Design of an Interface for Teleoperation in Unstructured Environments Using Augmented Reality. MA Sc. Thesis, 1996, Department of Industrial Engineering, University of Toronto, Toronto.
58. Ricks, B., Nielsen, C. W., & Goodrich, M. A. (2004). Ecological displays for robot interaction: A new perspective. Paper presented at the Intelligent Robots and Systems, 2004. (IROS 2004). Proceedings. 2004 IEEE/RSJ International Conference on.
59. Schwarzer, R., General Perceived Self-efficacy in 14 Cultures. 1999 Retrieved 2/12/2015, 2015, from http://userpage.fu-berlin.de/∼health/world14.htm.
60. Schwarzer, R., Jerusalem, M., Generalized self-efficacy scale. Meas. health Psychol. A user's portf. Causal control beliefs 1 (1995), 35–37.
61. Slaughter, D.C., Giles, D.K., Downey, D., Autonomous robotic weed control systems: a review. Comput. Electron. Agric. 61 (2008), 63–78.
62. Steinfeld, A., Fong, T., Kaber, D., Lewis, M., Scholtz, J., Schultz, A., & Goodrich, M. (2006). Common metrics for human-robot interaction. Paper presented at the Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction.
63. Velasco, N., Chipantasi, D. J. M., & Cruz, A. B. (2015). User interfaces applied to teleoperate mobile robots with keyboard command, PS3 controller and mobile phone. Paper presented at the The 7th International Conference on Information Technology (ICIT15).
64. Verbeke, G., Molenberghs, G., Linear Mixed Models for Longitudinal Data. 2000.
65. Vertanen, K., Adamides, G., NASA-TLX in HTML and JavaScript. 2012 2012, from http://www.keithv.com/software/nasatlx/nasa-tlx-greek.html.
66. Wilde, M., & Walter, U. (2010). A robotic camera arm for increased situational awareness in telepresent on-orbit servicing. Paper presented at the IEEE Aerospace Conference.
67. Witmer, B.G., Singer, M.J., Measuring presence in virtual environments: a presence questionnaire. Presence Teleoperators virtual Environ. 7:3 (1998), 225–240.
68. Yanco, H.A., Drury, J.L., Rescuing interfaces: a multi-year study of human-robot interaction at the AAAI robot rescue competition. Aut. robot. 22 (2007), 333–352, 10.1007/s10514-006-9016-5.