Learning actions from observations

IEEE Robotics and Automation Magazine

Volumn 17, Issue 2, 2010, Pages 30-43

  Krüger, Volker ^a   Herzog, Dennis ^b   Baby, Sanmohan ^f   Ude, Aleš ^c,d   Kragic, Danica ^e  

^a AALBORG UNIVERSITY   (Denmark)

^b CVMI   (Denmark)

^c ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^d JO EF STEFAN INSTITUTE   (Slovenia)

^e ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^f NONE

Author keywords

Action grammars; Action primitives; Human body tracking; Motor primitives; Parametric hidden Markov models

Indexed keywords

ACTION PRIMITIVES; ELEMENTARY BUILDING BLOCKS; HUMAN BODY TRACKING; HUMAN MOVEMENTS; IMITATION LEARNING; MOTOR PRIMITIVES; MOVEMENT TRAJECTORIES; RESEARCH PROBLEMS; UNIFIED FRAMEWORK;

HIDDEN MARKOV MODELS;

EID: 77953328682     PISSN: 10709932     EISSN: None     Source Type: Journal    
DOI: 10.1109/MRA.2010.936961     Document Type: Article

References (48)

1. A. D. Wilson and A. F. Bobick, "Parametric hidden Markov models for gesture recognition," IEEE Trans. Pattern Anal. Machine Intell., vol.21, no.9, pp. 884-900, 1999.
2. D. Herzog, V. Krueger, and D. Grest, "Parametric hidden Markov models for recognition and synthesis of movements," in Proc. British Machine Vision Conf., Leeds, U.K., Sept. 1-4, 2008, pp. 163-172.
3. C. Breazeal and B. Scassellati, "Robots that imitate humans," Trends Cogn. Sci., vol.6, no.11, pp. 481-487, 2002.
4. A. Billard, Y. Epars, S. Calinon, S. Schaal, and G. Cheng, "Discovering optimal imitation strategies," Robot. Autonom. Syst., vol.47, no.2-3, pp. 69-77, 2004.
5. V. Kruger, D. Kragic, A. Ude, and C. Geib, "The meaning of action: A review on action recognition and mapping," Adv. Robot., vol.21, no.13, pp. 1473-1501, 2007.
6. J. Kober, B. Mohler, and J. Peters, "Learning perceptual coupling for motor primitives," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2008, pp. 834-839.
7. G. Rizzolatti, L. Fogassi, and V. Gallese, "Neurophysiological mechanisms underlying the understanding and imitation of action," Nat. Rev., vol.2, pp. 661-670, Sept. 2001.
8. G. Rizzolatti, L. Fogassi, and V. Gallese, "Parietal cortex: From sight to action," Curr. Opin. Neurobiol., vol.7, no.4, pp. 562-567, 1997.
9. F. Mussa-Ivaldi and E. Bizzi, "Motor learning through the combination of primitives," Phil. Trans. R. Soc. London B, vol.355, no.1404, pp. 1755-1769, 2000.
10. G. Guerra-Filho and Y. Aloimonos, "A sensory-motor language for human activity understanding," in Proc. 6th IEEE-RAS Int. Conf. Humanoid Robots, Genova, Italy, Dec. 4-6, 2006.
11. D. Kulic and Y. Nakamura, "Scaffolding on-line segmentation of full body human motion parameters," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2008, pp. 2860-2866.
12. I. S. Vicente, V. Kyrki, and D. Kragic, "Action recognition and understanding through motor primitives," Adv. Robot., vol.21, no.15, pp. 1687-1707, 2007.
13. S. Baby and V. Krueger, "Primitive based action representation and recognition," in Proc. Scandinavian Conf. Image Analysis, Oslo, Norway, June 15-18, 2009, pp. 31-40.
14. P. Fitzpatrick, G. Metta, L. Natale, S. Rao, and G. Sandini, "Learning about objects through action-initial steps towards artificial cognition," in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), Sept. 2003, vol.3, pp. 3140-3145.
15. S. Griffith, J. Sinapov, M. Miller, and A. Stoytchev, "Toward interactive learning of object categories by a robot: A case study with container and non-container objects," in Proc. IEEE 8th Int. Conf. Development and Learning (ICDL), June 2009, pp. 1-6.
16. L. Montesano, M. Lopes, A. Bernardino, and J. Santos-Victor, "Learning object affordances: From sensory-motor coordination to imitation," IEEE Trans. Robot., vol.24, no.1, pp. 15-26, Feb. 2008.
17. H. Kozima, C. Nakagawa, and H. Yano, "Emergence of imitation mediated by objects," in Proc. 2nd Int. Workshop on Epigenetic Robotics, 2002, pp. 59-61.
18. M. Dogar, M. Cakmak, E. Ugur, and E. Sahin, "From primitive behaviors to goal-directed behavior using affordances," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS), 2007, pp. 729-734.
19. M. Lopes and J. S. Victor, "Visual learning by imitation with motor representations," IEEE Trans. Syst., Man, Cybern., vol.35, no.3, pp. 438-449, June 2005.
20. J. Sinapov and A. Stoytchev, "Detecting the functional similarities between tools using a hierarchical representation of outcomes," in Proc. 7th IEEE Int. Conf. Development and Learning, (ICDL), Aug. 2008, pp. 91-96.
21. H.-K. Lee and J. Kim, "An HMM-based threshold model approach for gesture recognition," IEEE Trans. Pattern Anal. Machine Intell., vol.21, no.10, pp. 961-973, Oct. 1999.
22. D. Kuli-c,W. Takano, and Y. Nakamura, "Incremental learning, clustering and hierarchy formation of whole body motion patterns using adaptive hiddenMarkov chains," Int. J. Robot. Res., vol.27, no.7, pp. 761-784, 2008.
23. L. R. Rabiner and B. H. Juang, "An introduction to hidden Markov models," IEEE ASSP Mag., vol.3, no.1, pp. 4-15, Jan. 1986.
24. D. S. Hirschberg, "Algorithms for the longest common subsequence problem," J. ACM, vol.24, no.4, pp. 664-675, 1977.
25. X. Huang, Y. Ariki, and M. Jack, Hidden Markov Models for Speech Recognition. New York, NY, USA: Columbia Univ. Press, 1990.
26. D. Herzog, A. Ude, and V. Krueger, "Motion imitation and recognition using parametric hidden Markov models," in Proc. IEEE-RAS Int. Conf. Humanoid Robots (Humanoids), Daejeon, South Korea, Dec. 1-3, 2008, pp. 339-346.
27. T. Moeslund, A. Hilton, and V. Krueger, "A survey of advances in vision-based human motion capture and analysis," Comput. Vis. Image Understand., vol.104, no.2-3, pp. 90-127, 2006.
28. M. Lee and R. Nevatia, "Human pose tracking in monocular sequences using multilevel structured models," IEEE Trans. Pattern Anal. Machine Intell., vol.31, no.1, pp. 27-38, 2009.
29. H. Moon, R. Chellappa, and A. Rosenfeld, "3d object tracking using shape-encoded particle propagation," in Proc. Int. Conf. Computer Vision, Vancouver, Canada, July 9-12, 2001, vol.2, pp. 307-314. (Pubitemid 32795075)
30. J. Gall, J. Patthoff, C. Schnoerr, B. Rosenhahn, and H.-P. Seidel, "Interacting and annealing particle filters: Mathematics and recipe for applications," J. Math. Imag. Vis., vol.28, no.1, pp. 1-18, May 2007.
31. M. Isard and A. Blake, "Condensation-Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol.29, no.1, pp. 5-28, 1998.
32. J. Deutscher, A. Blake, and I. Reid, "Articulated body motion capture by annealed particle filtering," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2000, vol.2, pp. 126-133.
33. D. MacKay, "Introduction to Monte Carlo methods," Learning in Graphical Models, M. Jordan, Ed. Cambridge, MA: MIT Press, 1999, pp. 175-204.
34. A. Bobick, "Movement, activity, and action: The role of knowledge in the perception of motion," Philos. Trans. Royal Soc. Lond., vol.352, no.1358, pp. 1257-1265, 1997.
35. C. Stauffer and W. Grimson, "Learning patterns of activity using realtime tracking," IEEE Trans. Pattern Anal. Machine Intell., vol.22, no.8, pp. 747-757, 2000.
36. N. Robertson and I. Reid, "Behaviour understanding in video: A combined method," in Proc. Int. Conf. Computer Vision, Beijing, China, Oct. 15-21, 2005, pp. 808-815.
37. V. Gallese, L. Fadiga, L. Fogassi, and G. Rizzolatti, "Action recognition in the premotor cortex," Brain, vol.119, no.2, pp. 593-609, 1996.
38. K. Nelissen, G. Luppino, W. Vanduffel, G. Rizzolatti, and G. A. Orban, "Observing others: Multiple action representation in the frontal lobe," Science, vol.310, no.5746, pp. 332-336, 2005.
39. B. N. Daniel and Michael E. J. Masson, "Gestural knowledge evoked by objects as part of conceptual representations," Aphasiology, vol.20, no. 9-11, pp. 1112-1124, Nov. 2006.
40. S. Ullman, High-Level Vision: Object Recognition and Visual Cognition. Cambridge, MA: MIT Press, July 1996.
41. D. Moore, I. Essa, I. Hayes, and M. H., "Exploiting human actions and object context for recognition tasks," in Proc. 7th IEEE Int. Conf. Computer Vision, 1999, vol.1, pp. 80-86.
42. A. Gupta and L. Davis, "Objects in action: An approach for combining action understanding and object perception," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007 (CVPR '07), June 2007, pp. 1-8.
43. T. Inamura, I. Toshima, H. Tanie, and Y. Nakamura, "Embodied symbol emergence based on mimesis theory," Int. J. Robot. Res., vol.23, no.4-5, pp. 363-377, 2004.
44. A. Billard, S. Calinon, and F. Guenter, "Discriminative and adaptive imitation in uni-manual and bi-manual tasks," Robot. Autonom. Syst., vol.54, no.5, pp. 370-384, 2006.
45. T. Asfour, F. Gyarfas, P. Azad, and R. Dilmann, "Imitation learning of dual-arm manipulation tasks in humanoid robots," Int. J. Humanoid Robot., vol.5, no.2, pp. 183-202, 2008.
46. O. Jenkins and M. Mataric, "Deriving action and behavior primitives from human motion data," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Lausanne, Switzerland, Sept. 30-Oct. 2002, pp. 2551-2556.
47. G. Guerra-Filho and Y. Aloimonos, "A language for human action," IEEE Comput. Soc., vol.40, pp. 42-51, May 2007.
48. Y. Ivanov and A. Bobick, "Recognition of visual activities and interactions by stochastic parsing," IEEE Trans. Pattern Anal. Machine Intell., vol.22, no.8, pp. 852-872, 2000.