Supervised autonomy for online learning in human-robot interaction

Pattern Recognition Letters

Volumn 99, Issue , 2017, Pages 77-86

  Senft, Emmanuel ^a   Baxter, Paul ^b   Kennedy, James ^a   Lemaignan, Séverin ^a   Belpaeme, Tony ^a,c  

^a UNIVERSITY OF PLYMOUTH   (United Kingdom)

^b UNIVERSITY OF LINCOLN   (United Kingdom)

^c GHENT UNIVERSITY   (Belgium)

Author keywords

Human Robot interaction; Interactive machine learning; Progressive Autonomy; Reinforcement learning; Robotics; Supervised autonomy

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONTROL THEORY; E-LEARNING; LEARNING SYSTEMS; MAN MACHINE SYSTEMS; REINFORCEMENT LEARNING; ROBOTICS; ROBOTS; TEACHING;

ACTION POLICIES; EXPLORATION PHASE; INTERACTIVE MACHINE LEARNING; INTERACTIVE REINFORCEMENT LEARNING; INTUITIVE CONTROLS; PROGRESSIVE AUTONOMY; QUANTITATIVE RESULT; SUPERVISED AUTONOMY;

HUMAN ROBOT INTERACTION;

EID: 85016436619     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2017.03.015     Document Type: Article

References (30)

1. Fong, T., Nourbakhsh, I., Dautenhahn, K., A survey of socially interactive robots. Rob. Auton. Syst. 42:3 (2003), 143–166.
2. Gorostiza, J.F., Salichs, M.A., End-user programming of a social robot by dialog. Rob. Auton. Syst. 59:12 (2011), 1102–1114.
3. Hoffman, G., Openwoz: A runtime-configurable wizard-of-oz framework for human-robot interaction. 2016 AAAI Spring Symposium Series, 2016.
4. Amershi, S., Cakmak, M., Knox, W.B., Kulesza, T., Power to the people: the role of humans in interactive machine learning. AI Magazine 35:4 (2014), 105–120.
5. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature, 2015.
6. Sutton, R.S., Barto, A.G., Reinforcement learning: an introduction. 1, 1998, MIT press Cambridge.
7. Fails, J.A., Olsen Jr, D.R., Interactive machine learning. Proceedings of the 8th International Conference on Intelligent User Interfaces, 2003, ACM, 39–45.
8. Olsen, D., Building interactive systems: principles for human-computer interaction. 2009, Cengage Learn.
9. Holzinger, A., Interactive machine learning for health informatics: when do we need the human-in-the-loop?. Brain Inf., 2016, 119–131.
10. Stumpf, S., Rajaram, V., Li, L., Burnett, M., Dietterich, T., Sullivan, E., Drummond, R., Herlocker, J., Toward harnessing user feedback for machine learning. Proceedings of the 12th International Conference on Intelligent User Interfaces, 2007.
11. Senft, E., Baxter, P., Kennedy, J., Belpaeme, T., Sparc: Supervised progressively autonomous robot competencies. International Conference on Social Robotics, 2015, Springer, 603–612.
12. Thomaz, A.L., Breazeal, C., Teachable robots: understanding human teaching behavior to build more effective robot learners. Artif. Intell. 172:6 (2008), 716–737.
13. Billard, A., Calinon, S., Dillmann, R., Schaal, S., Robot Programming by Demonstration. Springer Handbook of Robotics, 2008, Springer, 1371–1394.
14. Argall, B.D., Chernova, S., Veloso, M., Browning, B., A survey of robot learning from demonstration. Rob Auton Syst 57:5 (2009), 469–483.
15. Taylor, M.E., Suay, H.B., Chernova, S., Integrating reinforcement learning with human demonstrations of varying ability. The 10th International Conference on Autonomous Agents and Multiagent Systems-Volume 2, 2011.
16. Settles, B., Active Learning Literature Survey. University of Wisconsin, Madison, 52(55–66), 2010, 11.
17. Chyzhyk, D., Ayerdi, B., Maiora, J., Active learning with bootstrapped dendritic classifier applied to medical image segmentation. Pattern Recognit. Lett. 34:14 (2013), 1602–1608.
18. Chernova, S., Veloso, M., Interactive policy learning through confidence-based autonomy. J. Artif. Intell. Res., 34(1), 2009, 1.
19. Cakmak, M., Thomaz, A.L., Designing robot learners that ask good questions. Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, 2012, ACM, 17–24.
20. Knox, W.B., Stone, P., Combining manual feedback with subsequent mdp reward signals for reinforcement learning. Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1-Volume 1, 2010, International Foundation for Autonomous Agents and Multiagent Systems, 5–12.
21. Thill, S., Pop, C.A., Belpaeme, T., Ziemke, T., Vanderborght, B., Robot-assisted therapy for autism spectrum disorders with (partially) autonomous control: challenges and outlook. Paladyn, J.Behav. Rob. 3:4 (2012), 209–217.
22. Riek, L.D., Wizard of oz studies in hri: a systematic review and new reporting guidelines. J Human-Rob. Interact., 1(1), 2012.
23. Senft, E., Baxter, P., Belpaeme, T., Human-guided learning of social action selection for robot-assisted therapy. 4th Workshop on Machine Learning for Interactive Systems, 2015.
24. Hart, S.G., Staveland, L.E., Development of nasa-tlx (task load index): results of empirical and theoretical research. Adv. Psychol. 52 (1988), 139–183.
25. Senft, E., Lemaignan, S., Baxter, P.E., Belpaeme, T., Sparc: an efficient way to combine reinforcement learning and supervised autonomy. FILM Workshop at NIPS’16, 2016.
26. Kaochar, T., Peralta, R.T., Morrison, C.T., Fasel, I.R., Walsh, T.J., Cohen, P.R., Towards understanding how humans teach robots. International Conference on User Modeling, Adaptation, and Personalization, 2011, Springer, 347–352.
27. Adams, J.A., Critical considerations for human-robot interface development. Proceedings of 2002 AAAI Fall Symposium, 2002, 1–8.
28. Złotowski, J., Proudfoot, D., Yogeeswaran, K., Bartneck, C., Anthropomorphism: opportunities and challenges in human–robot interaction. Int. J. Soc. Robot 7:3 (2015), 347–360.
29. Liu, P., Glas, D.F., Kanda, T., Learning interactive behavior for service robots the challenge of mixed-initiative interaction. Proceedings of the Workshop on Behavior Adaptation, Interaction and Learning for Assistive Robotics, 2016.
30. Liu, P., Glas, D.F., Kanda, T., Ishiguro, H., Hagita, N., How to train your robot-teaching service robots to reproduce human social behavior. Robot and Human Interactive Communication, 2014 RO-MAN: The 23rd IEEE International Symposium on, 2014, IEEE, 961–968.