Real-time stylistic prediction for whole-body human motions

Neural Networks

Volumn 25, Issue , 2012, Pages 191-199

  Matsubara, Takamitsu ^a,b   Hyon, Sang Ho ^b,c   Morimoto, Jun ^b  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^c RITSUMEIKAN UNIVERSITY   (Japan)

Author keywords

Human motion prediction; Multifactor state space models; Style content separation; Stylistic prediction

Indexed keywords

DISCRETE MOTION; EFFICIENT COMPUTATION; ESTIMATED STATE; GENERATIVE MODEL; HUMAN MOTIONS; HUMAN TRACKING; HUMAN WALKING; MOTION SEQUENCES; MOTION STYLES; MULTI-FACTOR; NONSTATIONARY; OBSERVATION MODEL; OFF-LINE PROCESS; REAL-TIME ADAPTATION; RHYTHMIC MOTION; SIMPLE MODIFICATIONS; STATE VARIABLES; WHOLE-BODY;

ALGORITHMS; COMPUTER GRAPHICS; COMPUTER VISION; FORECASTING; REAL TIME CONTROL; ROBOTICS;

REAL VARIABLES;

ALGORITHM; ARTICLE; COMPUTER; COMPUTER GRAPHICS; COMPUTER VISION; CONTROLLED STUDY; DYNAMICS; GENERATIVE MODEL; JUMPING; MODEL; MOTION; PREDICTION; PRIORITY JOURNAL; REAL TIME STYLISTIC PREDICTION FOR WHOLE BODY HUMAN MOTION; ROBOTICS; RUNNING; WALKING;

ADAPTATION, PHYSIOLOGICAL; COMPUTER SYSTEMS; FORECASTING; HUMANS; MOTION; WALKING;

EID: 82355169486     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2011.08.008     Document Type: Article

References (35)

1. Bishop C.M. Neural networks for pattern recognition 1995, Oxford University Press.
2. Brand, M., & Hertzmann, A. (2000). Style machines. In SIGGRAPH (pp. 183-192).
3. Chai J., Hodgins J.K. Performance animation from low-dimensional control signals. ACM Transactions on Graphics 2005, 24:686-696.
4. Dempster A.P., Laird N.M., Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B 1977, 39:1-38.
5. Fukuda O., Tsuji T., Kaneko M., Otsuka A. A human-assisting manipulator teleoperated by EMG signals and arm motions. IEEE Transaction on Robotics and Automation 2003, 19:210-222.
6. Ghahramani, Z., & Hinton, G. E. (1996). Parameter estimation for linear dynamical systems. Technical report. Dept. Computer Science, Univ. of Toronto (pp. 1-6).
7. Grochow K., Martin S.L., Hertzmann A., Popovic Z. Style-based inverse kinematics. ACM Transactions on Graphics 2004, 23(1):522-531.
8. Haykin S. Adaptive filter theory 2002, Prentice Hall.
9. Howe N.R., Leventon M.E., Freeman W.T. Bayesian reconstruction of 3D human motion from single-camera video. Advances in neural information processing systems 2000, Vol. 12:820-826.
10. Hsu E., Pulli K., Popovic J. Style translation for human motion. ACM Transactions on Graphics 2005, 24(3):1082-1089.
11. Ijspeert A.J., Nakanishi J., Schaal S. Learning attractor landscapes for learning motor primitives. Advances in neural information processing systems 2002, Vol. 15:1523-1530.
12. Inamura, T., Toshima, I., & Nakamura, Y. (2002). Acquisition and embodiment of motion elements in closed mimesis loop. In IEEE international conference on robotics and automation (pp. 1539-1544).
13. Kawamoto, H., Kanbe, S., & Sankai, Y. (2003). Power assist method for HAL-3 using EMG-based feedback controller. In IEEE international conference on systems, man and cybernetics (pp. 1648-1653).
14. Ko, J., & Fox, D. (2008). GP-Bayes filters: Bayesian filtering using Gaussian process prediction and observation models. In IEEE/RSJ international conference on intelligent robots and systems (pp. 3471-3476).
15. Lawrence, N. (2007). Learning for larger datasets with the Gaussian process latent variable model. In Proceedings of the eleventh international workshop on artificial intelligence and statistics (pp. 243-250).
16. Liu, X., & Goldsmith, A. (2004). Kalman filtering with partial observation losses. In IEEE conferences on decision and control (pp. 4180-4186).
17. Li Y., Wang T., Shum H.-Y. Motion texture: a two-level statistical model for character motion synthesis. ACM Transactions on Graphics 2002, 21(3):465-472.
18. Onishi, M., Luo, Z., Odashima, T., Hirano, S., Tahara, K., & Mukai, T. (2007). Generation of human care behaviors by human-interactive robot RI-MAN. In IEEE international conference on robotics and automation (pp. 3128-3129).
19. Ormoneit D., Sidenbladh H., Blank M., Hastie T. Learning and tracking cyclic human motion. Advances in neural information processing systems 2001, Vol. 13:894-900.
20. Pavlovic V., Rehg J.M., MacCormick J. Learning switching linear models of human motion. Advances in neural information processing systems 2000, Vol. 12:981-987.
21. Rasmussen C.E., Williams C.K.I. Gaussian processes for machine learning 2006, MIT Press.
22. Riley, M., Ude, A., Wada, K., & Atkeson, C.G. (2003). Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids. In IEEE international conference robotics and automation (pp. 2368-2374).
23. Sato M., Ishii S. On-line em algorithm for the normalized Gaussian network. In Neural Computation 2000, 12:407-432.
24. Shapiro, A., Cao, Y., & Faloutsos, P. (2006). Style components. In Graphics interface (pp. 33-39).
25. Shumway R.H., Stoffer D.S. An approach to time series smoothing and forecasting using the EM algorithm. Journal of Time Series Analysis 1982, 3:253-264.
26. Sidenbladh, H., Black, M. J., & Fleet, D. J. (2000). Stochastic tracking of 3D human figures using 2D image motion. In European conference computer vision. Vol. 2 (pp. 702-718).
27. Taylor, G. W., & Hinton, G. E. (2009). Factored conditional restricted Bolzmann machines for modeling motion style. In International conference on machine learning (pp. 1025-1032).
28. Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2006). Modeling human motion using binary latent variables. In Proceedings of advances in neural information processing systems (pp. 1345-1352).
29. Tenenbaum J.B., Freeman W.T. Separating style and content with bilinear models. Neural Computation 2000, 12:1247-1283.
30. Torresani L., Hackney P., Bregler C. Learning motion style synthesis from perceptual observations. Advances in Neural Information Processing Systems 2006, Vol. 19:1393-1400.
31. Urtasun, R., Fleet, D.J., & Fua, P. (2006). 3D people tracking with Gaussian process dynamical models. In IEEE Computer society conference on computer vision and pattern recognition (pp. 238-245).
32. Urtasun, R., Fleet, D.J., Hertzmann, A., & Fua, P. (2005). Priors for people tracking from small training sets. In IEEE international conference on computer vision(pp. 403-410).
33. Urtasun, R., & Fua, P. (2004). 3D Human body tracking using deterministic temporal motion models. In European Conference on Computer Vision. Vol. 3(pp. 92-106).
34. Wang, J. M., Fleet, D. J., & Hertzmann, A. (2007). Multifactor Gaussian process models for style-content separation. In International conference on machine learning(pp. 975-982).
35. Wang J.M., Fleet D.J., Hertzmann A. Gaussian process dynamical models for human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence 2008, 30:283-298.