Robot introspection through learned hidden Markov models

Artificial Intelligence

Volumn 170, Issue 2, 2006, Pages 59-113

  Fox, Maria ^a   Ghallab, Malik ^b   Infantes, Guillaume ^b   Long, Derek ^a  

^a UNIVERSITY OF STRATHCLYDE   (United Kingdom)

^b LAAS CNRS   (France)

Author keywords

Hidden Markov models; Robot behaviour; Stochastic learning

Indexed keywords

LEARNING SYSTEMS; MARKOV PROCESSES; MATHEMATICAL MODELS; SENSORS;

HIDDEN MARKOV MODELS (HMM); ROBOT BEHAVIOR; STOCHASTIC LEARNING;

ROBOTS;

EID: 29344449424     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2005.05.007     Document Type: Article

References (42)

1. S. Koenig, R.G. Simmons, Unsupervised learning of probabilistic models for robot navigation, in: Proceedings of the International Conference on Robotics and Automation, 1996, pp. 2301-2308
2. S. Koenig, R.G. Simmons, Passive distance learning for robot navigation, in: Proceedings of International Conference on Machine Learning (ICML), 1996, pp. 266-274
3. H. Shatkay, and L.P. Kaelbling Learning geometrically constrained hidden Markov models for robot navigation: Bridging the geometrical-topological gap J. AI Res. 16 2002 167 207
4. G. Theocharous, K. Rohanimanesh, S. Mahadevan, Learning hierarchical partially observable Markov decision process models for robot navigation, in: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), 2001, pp. 511-516
5. L.R. Rabiner A tutorial on hidden Markov models and selected applications in speech recognition Proc. IEEE 77 2 1989 257 286
6. H. Bui, A general model for online probabilistic plan recognition, in: Proceedings of 18th International Joint Conference on AI (IJCAI-03), Acapulco, Mexico, 2003, pp. 1309-1318
7. H. Bui, S. Venkatesh, and G. West Policy recognition in the abstract hidden Markov model J. AI Res. 17 2002 451 499
8. L. Liao, D. Fox, H. Kautz, Learning and inferring transportation routines, in: Proceedings of the 19th National Conference on AI (AAAI-04), San Jose, CA, 2004, pp. 348-354
9. S. Osentoski, V. Manfredi, S. Mahadevan, Learning hierarchical models of activity, in: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2004
10. I. Cohen, N. Sebe, L. Chen, A. Garg, and T.S. Huang Facial expression recognition from video sequences: Temporal and static modelling Computer Vision and Image Understanding (Special Issue on Face Recognition) 91 2003 160 187
11. A. Wilson, and A. Bobick Hidden Markov models for modeling and recognizing gesture under variation Internat. J. Pattern Recognition Artificial Intelligence 15 1 2001 123 160
12. A. Bobick, and J. Davis The recognition of human movement using temporal templates IEEE Trans. Pattern Anal. Machine Intelligence 23 3 2001 257 267
13. A. Wilson, and A. Bobick Parametric hidden Markov models for gesture recognition IEEE Trans. Pattern Anal. Machine Intelligence 21 9 1999 884 900
14. Y. Nam, K. Wohn, Recognition of space-time hand gestures using hidden Markov models, in: ACM Symposium on Virtual Reality Software and Technology, 1996, pp. 51-58
15. T. Oates, M. Schmill, P. Cohen, A method for clustering the experiences of a mobile robot that accords with human judgements, in: Proceedings of the 17th National Conference on AI (AAAI-00), Austin, TX, 2000, pp. 846-851
16. L. Chrisman, Reinforcement learning with perceptual aliasing, in: Proceedings of the 10th National Conference on AI (AAAI-92), San Jose, CA, 1992, pp. 183-188
17. K. Basye, T. Dean, J.S. Vitter, Coping with uncertainty in map learning, in: Proceedings of the 11th International Joint Conference on AI (IJCAI-89), Detroit, MI, 1989, pp. 663-668
18. T. Dean, D. Angluin, K. Basye, S. Engelson, L. Kaelbling, E. Kokkevis, O. Maron, Inferring finite automata with stochastic output functions and an application to map learning, in: Proceedings of the 10th National Conference on AI (AAAI-92), San Jose, CA, 1992, pp. 208-214
19. J. Firby, Modularity issues in reactive planning, in: Proceedings of the 3rd International Conference on AI Planning Systems (AIPS), 1996, pp. 78-85
20. M. Beetz, Structured reactive controllers: A computational model of everyday activity, in: Proceedings of the 3rd International Conference on Autonomous Agents, 1999, pp. 228-235
21. B.C. Williams, P.P. Nayak, A model-based approach to adaptive self-configuring systems, in: Proceedings of the 13th National Conference on AI (AAAI-96), Portland, OR, 1996, pp. 971-978
22. R.G. Simmons, D. Apfelbaum, A task description language for robot control, in: Proceedings of Intelligent Robotics and Systems, 1998, pp. 1931-1937
23. F.F. Ingrand, M. Georgeff, and A.S. Rao An architecture for real-time reasoning and system control IEEE Expert 7 6 1992 34 44
24. G.D. Forney The Viterbi algorithm Proc. IEEE 61 1973 268 278
25. A.P. Dempster, N.M. Laird, and D.B. Rubin Maximum likelihood from incomplete data via the EM algorithm J. Roy. Statist. Soc. 39 1 1977 1 38
26. L.R. Rabiner An introduction to hidden Markov models IEEE ASSP Magazine 1986 4 16
27. J. Makhoul, S. Roucos, and H. Gish Vector quantization in speech coding Proc. IEEE 73 11 1985 1551 1588
28. T. Kohonen Self-Organisation and Associative Memory 1984 Springer-Verlag Berlin
29. J.B. MacQueen, Some methods for classification and analysis of multivariate observations, in: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, 1967, pp. 281-297
30. A. Stolcke, S. Omohundro, Hidden Markov model induction by Bayesian model merging, in: Advances in Neural Information Processing Systems 5, NIPS Conference, 1992, pp. 11-18
31. L.E. Baum, and J.A. Egon An inequality with applications to statistical estimation for probabilistic functions of a Markov process and to a model for ecology Bull. Amer. Meteorolog. Soc. 73 1967 360 363
32. L.E. Baum, and G.R. Sell Growth functions for transformations on manifolds Pacific J. Math. 27 2 1968 211 227
33. K. Murphy, The Bayes net toolbox for MATLAB, in: Computing Science and Statistics, 2001
34. R. Alami, R. Chatila, S. Fleury, M. Ghallab, and F. Ingrand An architecture for autonomy Internat. J. Robotics Res. 17 4 1998 315 337
35. S. Fleury, M. Herrb, R. Chatila, GenoM: A Tool for the specification and the implementation of operating modules in a distributed robot architecture, in: Proceedings of the International Conference on Intelligent Robots and Systems (IROS), Grenoble, France, vol. 2, 1997, pp. 842-848
36. J. Minguez, J. Osuna, L. Montano, A "divide and conquer" strategy based on situations to achieve reactive collision avoidance in troublesome scenarios, in: Proceedings of the International Conference on Robotics and Automation (ICRA), New Orleans, USA, 2004
37. J. Minguez, L. Montano, T. Simeon, R. Alami, Global nearness diagram navigation (GND), in: Proceedings of the International Conference on Robotics and Automation (ICRA), Korea, 2001, pp. 33-39
38. J. Minguez, and L. Montano Nearness diagram navigation (ND): Collision avoidance in troublesome scenarios IEEE Trans. Robotics Automation 20 1 2004 45 59
39. A.V. Oppenheim, R.W. Shafer, and J.R. Buck Discrete Time Signal Processing second ed. 1999 Prentice-Hall Englewood Cliffs, NJ
40. F. Jelinek Continuous Speech recognition by statistical methods Proc. IEEE 64 1976 532 536
41. P. Kim, B.C. Williams, M. Abramson, Execution of reactive model-based programs through graph-based temporal planning, in: Proceedings of the 17th International Joint Conference on AI (IJCAI-01), Seattle, WA, 2001, pp. 487-493
42. N. Muscettola, P.P. Nayak, B. Pell, and B.C. Williams Remote agent: To boldly go where no AI system has gone before Artificial Intelligence 100 1998 5 47