Low-dimensional feature extraction for humanoid locomotion using kernel dimension reduction

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2008, Pages 2711-2716

  Morimoto, Jun ^a,b   Hyon, Sang Ho ^a,b   Atkeson, Christopher G ^c   Cheng, Gordon ^a,b  

^a JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

^b ATR Computational Neuroscience Laboratories

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FEATURE SPACES;

BIOMECHANICS; BIPED LOCOMOTION; COMPUTER NETWORKS; INDUSTRIAL ENGINEERING; INTELLIGENT ROBOTS; LEARNING SYSTEMS; LOCOMOTIVES; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOTICS; ROBOTS; STATE SPACE METHODS;

FEATURE EXTRACTION;

EID: 51649124516     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2008.4543621     Document Type: Conference Paper

References (17)

1. J. Morimoto and K. Doya, "Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning," Robotics and Autonomous Systems, vol. 36, pp. 37-51, 2001.
2. R. Tedrake, T. W. Zhang, and H. S. Seung, "Stochastic policy gradient reinforcement learning on a simple 3d biped," in Proceedings of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2004, pp. 2849-2854.
3. J. Morimoto, J. Nakanishi, G. Endo, G. Cheng, C. G. Atkeson, and G. Zeglin, "Poincare-Map-Based Reinforcement Learning For Biped Walking," in Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2005, pp. 2392-2397.
4. T. Matsubara, J. Morimoto, J. Nakanishi, M. Sato, and K. Doya, "Learning CPG-based Biped Locomotion with a Policy Gradient Method," Robotics and Autonomous Systems, vol. 54, no. 11, pp. 911-920, 2006.
5. K. Fukumizu, F. R. Bach, and M. I. Jordan, "Dimensionality reduction for supervised learning with reproducing kernel Hilbert spaces," Journal of Machine Learning Research, vol. 5, pp. 73-99, 2004.
6. K. Fukumizu, , F. R. Bach, and M. I. Jordan, "Kernel dimension reduction in regression," Technical Report of the Department of Statistics, University of California, Berkeley, 2006.
7. G. Cheng, S. Hyon, J. Morimoto, A. Ude, J. G. Hale, G. Colvin, W. Scroggin, and S. C. Jacobsen, "CB: A Humanoid Research Platform for Exploring NeuroScience," Advanced Robotics, vol. 21, no. 10, 2007.
8. J. Morimoto, G. Endo, J. Nakanishi, S. Hyon, G. Cheng, C. G. Atkeson, and D. Bentivegna, "Modulation of Simple Sinusoidal Patterns by a Coupled Oscillator Model for Biped Walking," in Proceedings of the 2006 IEEE International Conference on Robotics and Automation, 2006, pp. 1579-1584.
9. S. H. Strogatz, Nonlinear Dynamics and Chaos. Addison-Wesley Publishing Company, 1994.
10. N. Aronszajn, "Theory of rproducing kernels," Trans. Amer. Math. Soc., vol. 69, no. 3, pp. 337-404, 1950.
11. B. Scholkopf and A. J. Smola, Learning with Kernels. Cambridge, MA: The MIT Press, 2002.
12. H. Kimura and S. Kobayashi, "An analysis of actor/critic algorithms using eligibility traces: Reinforcement learning with imperfect value functions," in Proceedings of the 15th Int. Conf. on Machine Learning, 1998, pp. 284-292.
13. K. Doya, "Reinforcement Learning in Continuous Time and Space," Neural Computation, vol. 12, no. 1, pp. 219-245, 2000.
14. F. Miyazaki and S. Arimoto, "Implementation of a hierarchical control for biped locomotion," in 8th IFAC, 1981, pp. 43-48.
15. H. Miura and I. Shimoyama, "Dynamical walk of biped locomotion," Int. J. of Robotics Research, vol. 3, no. 2, pp. 60-74, 1984.
16. T. Sugihara and Y. Nakamura, "Whole-body Cooperative COG Control through ZMP Mnipulation for Humanoid Robots," in IEEE Int. Conf. on Robotics and Automation, Washington DC, USA, 2002.
17. S. Hyon and G. Cheng, "Passivity-based full-body force control for humanoids and application to dynamic balancing and locomotion," in IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 2006, pp. 4915-4922.