Growing hidden markov models: An incremental tool for learning and predicting human and vehicle motion

International Journal of Robotics Research

Volumn 28, Issue 11-12, 2009, Pages 1486-1506

  Vasquez, Dizan ^a   Fraichard, Thierry ^b   Laugier, Christian ^b  

^a ETH ZURICH   (Switzerland)

^b UNIV GRENOBLE ALPES   (France)

Author keywords

Hidden Markov models; Motion prediction; Structure learning

Indexed keywords

CURRENT TECHNIQUES; INTERNAL STATE; LASER SCANNER; MACHINE LEARNING TECHNIQUES; MOTION MODELS; MOTION PATTERN; MOTION PREDICTION; OFF-LINE LEARNING; REAL TRAJECTORIES; RESEARCH DOMAINS; STATISTICAL MODELS; STRUCTURE LEARNING; VEHICLE MOTION;

COMPUTATIONAL GRAMMARS; EDUCATION; LEARNING ALGORITHMS; LEARNING SYSTEMS;

HIDDEN MARKOV MODELS;

EID: 70449392781     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364909342118     Document Type: Conference Paper

References (42)

1. Bennewitz, M., Burgard, W., Cielniak, G. and Thrun, S. (2005). Learning motion patterns of people for compliant robot motion. The Internationl Journal of Robotics Research, 24 (1). 31-48.
2. Bennewitz, M., Burgard, W. and Thrun, S. (2002). Learning motion patterns of persons for mobile service robots. Proceedings of the IEEE International Conference on Robotics and Automation, Washington, DC, pp. 3601-3606.
3. Brand, M., Oliver, N. and Pentland, A. (1997). Coupled hidden Markov models for complex action recognition. Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 994-999.
4. Bruce, A. and Gordon, G. (2004). Better motion prediction for people-tracking. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA.
5. Bui, H., Venkatesh, S. and West, G. (2002). Policy recognition in the abstract hidden Markov models. Journal of Artificial Intelligence Research, 17: 451-499.
6. Buzan, D., Sclaroff, S. and Kollios, G. (2004). Extraction and clustering of motion trajectories on video. Proceedings of the International Conference on Pattern Recognition, Cambridge, UK.
7. Calinon, S. and Billard, A. (2007). Incremental learning of gestures by imitation in a humanoid robot. Proceedings of the ACM/IEEE Conference on Human-Robot Interaction, pp. 255-262.
8. Dee, H. and Hogg, D. (2004). Detecting inexplicable behaviour. Proceedings of the British Machine Vision Conference, Kingston, UK, pp. 49-55.
9. Dee, H.-M. (2005). Explaining visible behaviour. PhD Thesis, University of Leeds.
10. Dixon, K.R., Dolan, J.M. and Khosla, P.K. (2004). Predictive robot programming: theoretical and experimental analysis. The International Journal of Robotics Research, 23 (9). 955-973.
11. Foka, A.F. and Trahanias, P.E. (2002). Predictive autonomous robot navigation. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and System, Lausanne, Switzerland, Vol. 1, pp. 490-495.
12. Gong, S. and Xiang, T. (2003). Recognition of group activities using dynamic probabilistic networks. Proceedings of the 9th IEEE International Conference on Computer Vision, Vol. 2, Washington,DC, pp. 742-749.
13. Hoogs, A. and Perera, A.A. (2008). Video activity recognition in the real world. Proceedings of the 23rd AAAI Conference on Artificial Intelligence, Chicago, IL, pp. 1551-1554. Howard, R.A. (1960). Dynamic Programming and Markov Process. Cambridge, MA, MIT Press.
14. Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T. and Maybank, S. (2006). A system for learning statistical motion patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28 (9). 1450-1464.
15. Hu, W., Xie, D., Tieniu, T. and Maybank, S. (2004). Learning activity patterns using fuzzy self-organizing neural network. IEEE Transactions on Systems, Man, and Cybernetics, 34 (3). 1618-1626.
16. Jockusch, J. and Ritter, H. (1999). An instantaneous topological map for correlated stimuli. Proceedings of the International Joint Conference on Neural Networks, Vol. 1, Washington, DC, pp. 529-534.
17. Johnson, N. and Hogg, D. (1995). Learning the distribution of object trajectories for event recognition. Proceedings of the British Machine Vision Conference, Vol. 2, pp. 583-592.
18. Juang, B.-H., Levinson, S.E. and Sondhi, M.M. (1986). Maximum likelihood estimation for multivariate mixture observations of Markov chains. IEEE Transactions on Information Theory, 32 (2). 307-309.
19. Junejo, I., Javed, O. and Shah, M. (2004). Multi feature path modeling for video surveillance. Proceedings of the 17th Conference of the International Conference on Pattern Recognition (ICPR), pp. 716-719.
20. Kolen, J.F. and Hutcheson, T. (2002). Reducing the complexity of the fuzzy C-means algorithm. IEEE Transactions on Fuzzy Systems, 10 (2). 263-267.
21. Kulic, D., Takano, W. and Nakamura, Y. (2008). Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hidden markov chains. The International Journal of Robotics Research, 27 (7). 761-784.
22. Langley, P. (1995). Order effects in incremental learning. Learning in Humans and Machines: Towards an Interdisciplinary Learning Science, Reimman, P. and Spada, H. (eds). Amsterdam, Elsevier.
23. Liao, L., Fox, D. and Kautz, H. (2004). Learning and inferring transportation routines. Proceedings of the National Conference on Artificial Intelligence AAAI-04.
24. Magee, D. (2004). Tracking multiple vehicles using foreground, background and shape models. Image and Vision Computing, 22: 143-155.
25. Makris, D. and Ellis, T. (2001). Finding paths in video sequences. Proceedings of the British Machine Vision Conference, pp. 263-272.
26. Makris, D. and Ellis, T. (2002). Spatial and probabilistic modelling of pedestrian behavior. Proceedings of the British Machine Vision Conference, Cardiff, UK, pp. 557-566.
27. Neal, R.M. and Hinton, G.E. (1998). A new view of the EM algorithm that justifies incremental, sparse and other variants. Learning in Graphical Models, Jordan, M. I. (ed.). Dordrecht, Kluwer, pp. 355-368.
28. Oliver, N.M., Rosario, B. and Pentland, A.P. (2000). A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22 (8). 831-843.
29. Osentoski, S., Manfredi, V. and Mahadevan, S. (2004). Learning hierarchical models of activity. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan.
30. Rabiner, L.R. (1990). A tutorial on hidden Markov models and selected applications in speech recognition. Readings in Speech Recognition, pp. 267-296.
31. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6 (2). 461-464.
32. Stauffer, C. and Grimson, E. (2000). Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22 (8). 747-757.
33. Stolcke, A. and Omohundro, S. (1993). Hidden Markov model induction by Bayesian model merging. Advances in Neural Information Processing Systems, Vol. 5, Hanson, S. J., Cowan, J. D. and Giles, C. L. (eds) San Mateo, CA, Morgan Kaufmann, pp. 11-18.
34. Sumpter, N. and Bulpitt, A. (2000). Learning spatio-temporal patterns for predicting object behaviour. Image and Vision Computing, 18 (9). 697-704.
35. Vasquez, D. (2007). Incremental learning for motion prediction of pedestrians and vehicles. PhD Thesis, Institut National Polytechnique de Grenoble, Grenoble, France.
36. Vasquez, D. and Fraichard, T. (2004). Motion prediction for moving objects: a statistical approach. Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, pp. 3931-3936.
37. Vasquez, D. and Fraichard, T. (2005). Intentional motion on-line learning and prediction. Field and Service Robotics, Port Douglas, Australia.
38. Vasquez, D., Fraichard, T. and Laugier, C. (2007). Incremental learning of statistical motion patterns with growing hidden Markov models. 13th International Symposium of Robotics Research. Hiroshima, Japan.
39. Walter, M., Psarrow, A. and Gong, S. (1999). Learning prior and observation augmented density models for behaviour recognition. Proceedings of the British Machine Vision Conference, pp. 23-32.
40. Wang, X., Tieu, K. and Grimson, E. (2006). Learning semantic models by trajectory analysis. Technical Report, Massachussets Institute of Technology.
41. Xiang, T. and Gong, S. (2006). Beyond tracking: modelling activity and understanding behaviour. International Journal of Computer Vision, 67 (1). 21-51.
42. Xie, X.L. and Beni, G. (1991). A validity measure for fuzzy clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13 (8). 841-847.