Unsupervised segmentation of human motion data using a sticky hierarchical dirichlet process-hidden markov model and minimal description length-based chunking method for imitation learning

Advanced Robotics

Volumn 25, Issue 17, 2011, Pages 2143-2172

  Taniguchi, Tadahiro ^a   Hamahata, Keita ^a   Iwahashi, Naoto ^b  

^a RITSUMEIKAN UNIVERSITY   (Japan)

^b NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

Author keywords

ergodic HMM; imitation learning; nonparametric bayesian model; sticky hdp HMM; Unsegmented human motion

Indexed keywords

ERGODICS; HUMAN MOTIONS; IMITATION LEARNING; NON-PARAMETRIC BAYESIAN; STICKY HDP-HMM;

BAYESIAN NETWORKS;

HIDDEN MARKOV MODELS;

EID: 80054003159     PISSN: 01691864     EISSN: 15685535     Source Type: Journal    
DOI: 10.1163/016918611X594775     Document Type: Article

References (50)

1. Y. Kuniyosh, M. Inaba and H. Inoue, Learning by watching: extracting reusable task knowledge from visual observation of human performance, IEEE Trans. Robotics Automat. 10, 799-822 (1994).
2. V. Krger, D. Kragic, A. Ude and C. Geib, The meaning of action: a review on action recognition and mapping, Adv. Robotics 21, 1473-1501 (2007). (Pubitemid 47529843)
3. S. Schaal, A. Ijspeert and A. Billard, Computational approaches to motor learning by imitation, Philos. Trans. R. Soc. London B 1431, 537-547 (2003). (Pubitemid 36380533)
4. A. Alissandrakis, C. L. Nehaniv and K. Dautenhahn, Imitation with Alice: learning to imitate corresponding actions across dissimilar embodiments, IEEE Trans. Syst. Man Cybernet. A 32, 482-496 (2002).
5. C. L. Nehaniv and K. Dautenhahn (Eds), The correspondence problem, Imitation in Animals and Artifacts, pp. 41-61, MIT Press, Cambridge, MA (2002).
6. A. Billard, Y. Epars, S. Calinon, S. Schaal and G. Cheng, Discovering optimal imitation strategies, Robotics Autonomous Syst. 47, 69-77 (2004).
7. K. Sugiura, N. Iwahashi, H. Kashioka and S. Nakamura, Learning, generation, and recognition of motions by reference-point-dependent probabilistic models, Adv. Robotics 25, 825-848 (2011).
8. J. M. Rubin andW. A. Richards, Boundaries of visual motion, AI Memo 835, Artificial Intelligence Laboratory, MIT (1985).
9. A. Fod, M. J. Matarić and O. C. Jenkins, Automated derivation of primitives for movement classification, Autonomous Robots 12, 39-54 (2002). (Pubitemid 34156621)
10. H. Kawashima and T. Matsuyama, Multiphase learning for an interval-based hybrid dynamical system, IEICE Trans. Fundam. Electron. Commun. Comp. Sci. E88-A, 3022-3035 (2005).
11. K. Samejima, K. Katagiri, K. Doya and M. Kawato, Symbolization and imitation learning of motion sequence using competitive modules, IEICE Trans. Inform. Syst. 85, 90-100 (2002).
12. J. Barbič, A. Safonova, J. Y. Pan, C. Faloutsos, J. K. Hodgins and N. S. Pollard, Segmenting motion capture data into distinct behaviors, in: Proc. of Graphics Interface 2004, London, ON, pp. 185-194 (2004).
13. Y. Li, T. Wang and H. Y. Shum, Motion texture: a two-level statistical model for character motion synthesis, in: Proc. 29th Annu. Conf. on Computer Graphics and Interactive Techniques, San Antonio, TX, pp. 465-472 (2002).
14. J. Kohlmorgen and S. Lemm, A dynamic HMM for on-line segmentation of sequential data, Adv. Neural Inform. Process. Syst. 1, 793-800 (2002).
15. T. Ogata, S. Matsumoto, J. Tani, K. Komatani and H. G. Okuno, Human-robot cooperation using quasi-symbols generated by RNNPB model, in: Proc. IEEE Int. Conf. on Robotics and Automation, Rome, pp. 2156-2161 (2007). (Pubitemid 350140498)
16. R. Yokoya, T. Ogata, J. Tani, K. Komatani and H. G. Okuno, Experience based imitation using RNNPB, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Beijing, pp. 3669-3674 (2006). (Pubitemid 46928498)
17. J. Tani, M. Ito and Y. Sugita, Self-organization of distributedly represented multiple behavior schemata in a mirror system: reviews of robot experiments using RNNPB, Neural Networks 17, 1273-1289 (2004). (Pubitemid 39539542)
18. W. Hinoshita, H. Arie, J. Tani, H. G. Okuno and T. Ogata, Emergence of hierarchical structure mirroring linguistic composition in a recurrent neural network, Neural Networks 24, 311-320 (2011).
19. J. Tani and S. Nol, Learning to perceive the world as articulated: an approach for, Neural Networks 12, 1131-1141 (1999).
20. M. Okada, D. Nakamura and Y. Nakamura, Self-organizing symbol acquisition and motion generation based on dynamics-based information processing system, in: Proc. 2nd Int. Workshop on Man-Machine Symbiotic Systems, Kyoto, pp. 219-229 (2004).
21. J. M. Wang, D. J. Fleet, and A. Hertzmann, Gaussian process dynamical models, Adv. Neural Inform. Process. Syst. 18, 1441-1448 (2006).
22. H. Kadone and Y. Nakamura, Segmentation, memorization, recognition and abstraction of humanoid motions based on correlations and associative memory, in: Proc. IEEE-RAS Int. Conf. on Humanoid Robotics, Genova, pp. 1-6 (2006).
23. S. Chiappa and J. Peters, Movement extraction by detecting dynamics switches and repetitions, Adv. Neural Inform. Process. Syst. 23, 388-396 (2010).
24. E. B. Fox, E. B. Sudderth, M. I. Jordan and A. S. Willsky, The sticky HDP-HMM: Bayesian nonparametric hidden markov models with persistent states, Technical Report 2777, MIT Laboratory for Information and Decision Systems (2007).
25. T. Taniguchi, N. Iwahashi, K. Sugiura and T. Sawaragi, Constructive approach to role-reversal imitation through unsegmented interactions, J. Robotics Mechatron. 20, 567-577 (2008).
26. K. P. Murphy, Switching Kalman filters, Technical Reports, DEC / Compaq Cambridge Research Labs (1998).
27. S. L. Scott, Bayesian methods for hiddenMarkov models: recursive computing in the 21st century, J. Am. Stat. Ass. 97, 337-351 (2002).
28. T. Inamura, I. Toshima, H. Tanie and Y. Nakamura, Embodied symbol emergence based on mimesis theory, Int. J. Robotics Res. 23, 363-377 (2004).
29. W. Takano, H. Imagawa, D. Kulic and Y. Nakamura, What do you expect from a robot that tells your future? The crystal ball, in: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Taipei, pp. 1780-1785 (2010).
30. Y. Kihara and Y. Yokokohji, Skill transfer from human to robot by direct teaching and task sharing -a case study with origami folding task, in: Proc. 11th IFAC/IFIP/IFORS/IEA Symp. on Analysis, Design, and Evaluation of Human-Machine Systems, Valenciennnes, DOI: 10.3182/20100831-4- FR-2021.00080 (2010).
31. K. A. Heller, Y. W. Teh, D. Gürür and G. Unit, Infinite hierarchical hidden Markov models, in: Proc. 12th Int. Conf. on Artificial Intelligence and Statistics, Clearwater Beach, FL, Vol. 5, pp. 224-231 (2009).
32. T. S. Ferguson, A Bayesian analysis of some nonparametric problems, Ann. Stat. 1, 209-230 (1973).
33. J. Sethuraman, A constructive definition of Dirichlet priors, Stat. Sin. 4, 639-650 (1994).
34. J. Pitman, Poisson-Dirichlet and GEM invariant distributions for split-and-merge transformations of an interval partition, Combinat. Prob. Comput. 11, 501-514 (2002).
35. D. Blackwell and J. B. MacQueen, Ferguson distributions via Pólya urn schemes, Ann. Stat. 1, 353-355 (1973).
36. Y. W. Teh, M. I. Jordan, M. J. Beal and D. M. Blei, Hierarchical Dirichlet processes, J. Am. Stat. Ass. 101, 1566-1581 (2006).
37. Y. W. Teh and M. I. Jordan, Hierarchical Bayesian nonparametric models with applications, Bayesian Nonparametrics 28, 1-47 (2009).
38. M. J. Beal, Z. Ghahramani and C. E. Rasmussen, The infinite hidden Markov model, Adv. Neural Inform. Process. Syst. 1, 577-584 (2002).
39. J. Van Gael, Y. Saatci, Y. W. Teh and Z. Ghahramani, Beam sampling for the infinite hidden Markov model, in: Proc. 25th Int. Conf. on Machine Learning, Helsinki, pp. 1088-1095 (2008).
40. T. Taniguchi and N. Iwahashi, Computational model of role reversal imitation through continuous human-robot interaction, in: Proc. 2007 Workshop on Multimodal Interfaces in Semantic Interaction, Nagoya, pp. 25-31 (2007).
41. K. Umemura, Related word-pairs extraction without dictionaries, Technical Report, IPA Exploratory Software Project Development Result Report, http://www.ipa.go.jp/NBP/12nendo/12mito/mdata/10-36h/10-36h.pdf (in Japanese) (2000).
42. Y. Tanaka, K. Iwamoto and K. Uehara, Discovery of time-series motif from multi-dimensional data based on MDL principle, Mach. Learn. 58, 269-300 (2005). (Pubitemid 40400640)
43. T. Taniguchi and N. Iwahashi, Imitation learning from unsegmented human motion based on ngram statistics of linear prediction models, J. Japan Soc. Fuzzy Theory Intell. Inform. 21, 1143-1154 (2009).
44. T. Taniguchi and N. Iwahashi, Imitation learning from unsegmented human motion using switching autoregressive model and singular vector decomposition, Adv. Neuro-Inform. Process. 5506, pp. 953-961 (2009).
45. N. D. Lawrence, Gaussian process latent variable models for visualisation of high dimensional data, Adv. Neural Inform. Process. Syst. 16, 329-336 (2004).
46. B. Schülkopf, A. Smola and K. R. Müller, Kernel principal component analysis, in: Proc. Conf. on Artificial Neural Networks, Lausanne, pp. 583-588 (1997).
47. T. Funato, S. Aoi, H. Oshima and K. Tsuchiya, Variant and invariant patterns embedded in human locomotion through whole body kinematic coordination, Exp. Brain Res. 205, 1-15 (2010).
48. C. M. Bishop, Pattern Recognition and Machine Learning. Springer, Berlin (2006).
49. D. Mochihashi, T. Yamada and N. Ueda, Bayesian unsupervised word segmentation with nested Pitman-Yor language modeling, in: Proc. Joint Conf. of the 47th Annual Meeting of the ACL and the 4th Int. Joint Conf. on Natural Language Processing of the AFNLP, Singapore, Vol. 1, pp. 100-108 (2009).
50. Y. W. Teh, A hierarchical Bayesian language model based on Pitman-Yor processes, in: Proc. 21st Int. Conf. on Computational Linguistics and the 44th Ann. Meeting of the Association for Computational Linguistics, Sydney, pp. 985-992 (2006).