Principles and experimentations of self-organizing embedded agents allowing learning from demonstration in ambient robotics

Future Generation Computer Systems

Volumn 64, Issue , 2016, Pages 78-87

  Verstaevel, Nicolas ^a,b   Régis, Christine ^a   Gleizes, Marie Pierre ^a   Robert, Fabrice ^b  

^a UNIVERSITÉ PAUL SABATIER   (France)

^b Sogeti High Tech   (France)

Author keywords

Adaptive agents; Context awareness; Cooperative multi agent systems; Machine learning; Robotics in ambient systems

Indexed keywords

ARTIFICIAL INTELLIGENCE; DEMONSTRATIONS; LEARNING SYSTEMS; ROBOTICS;

ADAPTIVE AGENTS; AMBIENT SYSTEM; CONTEXT- AWARENESS; EMBEDDED AGENTS; HETEROGENEOUS DEVICES; HUMAN-SYSTEM INTERACTION; LEARNING FROM DEMONSTRATION; LEARNING TECHNIQUES;

MULTI AGENT SYSTEMS;

EID: 84963850942     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2016.03.023     Document Type: Article

References (34)

1. [1] G.A. Kaminka, Autonomous agents research in robotics: A report from the trenches, in: 2012 AAAI Spring Symposium Series, 2012.
2. [2] Chung, J., Ambient robotics for meaningful life of the elderly. 2014, 43.
3. [3] Russell, S., Norvig, P., Artificial Intelligence: A Modern Approach. 1995, Prentice-Hall, Englewood Cliffs.
4. [4] Hagras, H., Callaghan, V., Colley, M., Clarke, G., Pounds-Cornish, A., Duman, H., Creating an ambient-intelligence environment using embedded agents. IEEE Intell. Syst. 19:6 (2004), 12–20.
5. [5] Kearns, M.J., Schapire, R.E., Sellie, L.M., Toward efficient agnostic learning. Mach. Learn. 17:2–3 (1994), 115–141.
6. [6] Argall, B.D., Chernova, S., Veloso, M., Browning, B., A survey of robot learning from demonstration. Robot. Auton. Syst. 57:5 (2009), 469–483.
7. [7] Lefèvre, S., Carvalho, A., Borrelli, F., Autonomous car following: A learning-based approach. Intelligent Vehicles Symposium (IV), 2015 IEEE, 2015, IEEE, 920–926.
8. [8] Vuković, N., Mitić, M., Miljković, Z., Trajectory learning and reproduction for differential drive mobile robots based on gmm/hmm and dynamic time warping using learning from demonstration framework. Eng. Appl. Artif. Intell. 45 (2015), 388–404.
9. [9] Silver, D., Bagnell, J.A., Stentz, A., Learning from demonstration for autonomous navigation in complex unstructured terrain. Int. J. Robot. Res., 2010.
10. [10] Power, M., Rafii-Tari, H., Bergeles, C., Vitiello, V., Yang, G.-Z., A cooperative control framework for haptic guidance of bimanual surgical tasks based on learning from demonstration. 2015 IEEE International Conference on Robotics and Automation (ICRA), 2015, IEEE, 5330–5337.
11. [11] Billard, A., Calinon, S., Dillmann, R., Schaal, S., Robot programming by demonstration. Springer Handbook of Robotics, 2008, Springer, 1371–1394.
12. [12] Billing, E.A., Hellström, T., A formalism for learning from demonstration*, Paladyn. J. Behav. Robot. 1:1 (2010), 1–13.
13. [13] Nehaniv, C.L., Dautenhahn, K., The correspondance problem. Imitation in Animals and Artifacts, 2002, MIT press.
14. [14] Riedmiller, M., Merke, A., Learning by experience from others—Social learning and imitation in animals and robots. Adaptivity and Learning, 2003, Springer, 217–241.
15. [15] Dautenhahn, K., Nehaniv, C.L., The Agent-Based Perspective on Imitation. 2002, MIT Press.
16. [16] Verstaevel, N., Régis, C., Guivarch, V., Gleizes, M.-P., Robert, F., Extreme sensitive robotic—A context-aware ubiquitous learning. International Conference on Agents and Artificial Intelligence (ICAART 2015), Vol. 1, 2015, INSTICC, 242–248.
17. [17] Mitić, M., Miljković, Z., Neural network learning from demonstration and epipolar geometry for visual control of a nonholonomic mobile robot. Soft Comput. 18:5 (2014), 1011–1025.
18. [18] Chernova, S., Veloso, M., Confidence-based policy learning from demonstration using Gaussian mixture models. Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, 2007, ACM, 233.
19. [19] Saunders, J., Nehaniv, C.L., Dautenhahn, K., Teaching robots by moulding behavior and scaffolding the environment. Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human–Robot Interaction, 2006, ACM, 118–125.
20. [20] T. Brys, A. Harutyunyan, H.B. Suay, S. Chernova, M.E. Taylor, A. Nowé, Reinforcement learning from demonstration through shaping, in: Proceedings of the International Joint Conference on Artificial Intelligence, IJCAI, 2015.
21. [21] Knox, W.B., Stone, P., Breazeal, C., Training a robot via human feedback: A case study. Social Robotics, 2013, Springer International Publishing, 460–470.
22. [22] Mollard, Y., Munzer, T., Baisero, A., Toussaint, M., Lopes, M., Robot programming from demonstration, feedback and transfer. Intelligent Robots and Systems (IROS), 2015.
23. [23] Guivarch, V., Camps, V., Péninou, A., Glize, P., Self-adaptation of a learnt behaviour by detecting and by managing user's implicit contradictions. Proceedings of the 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT)-Vol. 03, 2014, IEEE Computer Society, 24–31.
24. 2 2014, 2014, p. 350.
25. [25] Gleizes, M.-P., Self-adaptive complex systems. Multi-Agent Systems, 2012, Springer, 114–128.
26. [26] Capera, D., Georgé, J.-P., Gleizes, M.-P., Glize, P., The AMAS theory for complex problem solving based on self-organizing cooperative agents. Twelfth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, 2003. WET ICE 2003. Proceedings, 2003, IEEE, 383–388.
27. [27] Bonjean, N., Mefteh, W., Gleizes, M.-P., Maurel, C., Migeon, F., Adelfe 2.0. Handbook on Agent-Oriented Design Processes, 2014, Springer, 19–63.
28. [28] Lemouzy, S., Camps, V., Glize, P., Principles and properties of a mas learning algorithm: A comparison with standard learning algorithms applied to implicit feedback assessment. 2011 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), Vol. 2, 2011, IEEE, 228–235.
29. [29] Moore, A.W., Efficient memory-based learning for robot control. (Thesis), 1990, University of Cambridge, Computer Laboratory.
30. [30] Sutton, R.S., Barto, A.G., Reinforcement learning: An introduction. Robotica 17:2 (1999), 229–235.
31. [31] Gatti, C., The mountain car problem. Design of Experiments for Reinforcement Learning, 2015, Springer, 95–109.
32. [32] W.B. Knox, A.B. Setapen, P. Stone, Reinforcement learning with human feedback in mountain car, in: AAAI Spring Symposium: Help Me Help You: Bridging the Gaps in Human-Agent Collaboration, 2011.
33. [33] B. Siciliano, F. Caccavale, E. Zwicker, M. Achtelik, N. Mansard, C. Borst, M. Achtelik, N.O. Jepsen, R. Awad, R. Bischoff, Euroc-the challenge initiative for European robotics, in: ISR/Robotik 2014; 41st International Symposium on Robotics; Proceedings of, VDE, 2014, pp. 1–7.
34. [34] J. Boes, J. Nigon, N. Verstaevel, M.-P. Gleizes, F. Migeon, The self-adaptive context learning pattern: Overview and proposal, in: International and Interdisciplinary Conference on Modeling and Using Context, CONTEXT, 2015.