Apprenticeship learning for helicopter control

Communications of the ACM

Volumn 52, Issue 7, 2009, Pages 97-105

  Coates, Adam ^a   Abbeel, Pieter ^b   Ng, Andrew Y ^a  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPRENTICESHIP LEARNING; AUTONOMOUS HELICOPTERS; CONTROL PROBLEMS; DESIGN CONTROLLERS; DYNAMICAL BEHAVIORS; FLIGHT REGIME; HELICOPTER CONTROL; HIGH-PERFORMANCE CONTROL SYSTEMS; HUMAN PILOTS; MODELING AND CONTROL; STANFORD;

CONTROL SYSTEM ANALYSIS; EDUCATION; HELICOPTERS;

FLIGHT CONTROL SYSTEMS;

EID: 67650065351     PISSN: 00010782     EISSN: 15577317     Source Type: Journal    
DOI: 10.1145/1538788.1538812     Document Type: Article

References (32)

1. Abbeel, P., Coates, A., Hunter, T., Ng, A.Y. Autonomous autorotation of an RC helicopter. ISER11 (2008).
2. Abbeel, P., Coates, A., Quigley, M., Ng, A.Y. An application of reinforcement learning to aerobatic helicopter flight. NIPS 19 (2007), 1-8.
3. Abbeel, P., Ganapathi, V., Ng, A. Learning vehicular dynamics, with application to modeling helicopters. NIPS 18 (2006), 1-8.
4. Abbeel, P., Ng, A.Y. Apprenticeship learning via inverse reinforcement learning. In Proceedings of ICML (2004).
5. Abbeel, P., Quigley, M., Ng, A.Y. Using inaccurate models in reinforcement learning. In Proceedings of ICML (2006), ACM, NY, 1-8.
6. An, C.H., Atkeson, C.G., Hollerbach, J.M. Model-Based Control of a Robot Manipulator. MIT Press, 1988.
7. Anderson, B., Moore, J. Optimal Control: Linear Quadratic Methods. Prentice-Hall, 1989.
8. Atkeson, C., Schaal, S. Robot learning from demonstration. In Proceedings of ICML (1997).
9. Bagnell, J., Schneider, J. Autonomous helicopter control using reinforcement learning policy search methods. In IEEE International Conference on Robotics and Automation (2001).
10. Boutilier, C., Friedman, N., Goldszmidt, M., Koller, D. Context-specific independence in Bayesian networks. In Proceedings of UAI (1996).
11. Calinon, S., Guenter, F., Billard, A. On learning, representing and generalizing a task in a humanoid robot. In IEEE Transactions on Systems, Man and Cybernetics, Part B, volume 37, 2007
12. Coates, A., Abbeel, P., Ng, A.Y. Learning for control from multiple demonstrations. In Proceedings of ICML (2008), 144-151.
13. Dempster, A.P., Laird, N.M., Rubin, D.B. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. (1977).
14. Gavrilets, V., Martinos, I., Mettler, B., Feron, E. Control logic for automated aerobatic flight of miniature helicopter. In AIAA Guidance, Navigation and Control Conference (2002).
15. Jacobson, D.H., Mayne, D.Q. Differential Dynamic Programming. Elsevier, 1970.
16. La Civita, M. Integrated Modeling and Robust Control for Full-Envelope Flight of Robotic Helicopters. PhD thesis, Carnegie Mellon University, 2003.
17. La Civita, M., Papageorgiou, G., Messner, W.C., Kanade, T. Design and flight testing of a high-bandwidth H loop shaping controller for a robotic helicopter. J. Guid. Control. Dynam., 29, 2 (Mar.-Apr. 2006), 485-494.
18. Leishman, J. Principles of Helicopter Aerodynamics. Cambridge University Press, 2000.
19. Listgarten, J. Analysis of Sibling Time Series Data: Alignment and Difference Detection. PhD thesis, University of Toronto, 2006.
20. Listgarten, J., Neal, R.M., Roweis, S.T., Emili, A. Multiple alignment of continuous time series. In NIPS 17 (2005).
21. Needleman, S., Wunsch, C. A general method applicable to the search for similarities in the amino acid sequence of two proteins. J. Mol. Biol., 1970.
22. Neu, G., Szepesvari, C. Apprenticeship learning using inverse reinforcement learning and gradient methods. In Proceedings of UAI (2007).
23. Ng, A.Y., Coates, A., Diel, M., Ganapathi, V., Schulte, J., Tse, B., Berger, E., Liang, E. Autonomous inverted helicopter flight via reinforcement learning. In ISER (2004).
24. Ng, A.Y., Kim, H.J., Jordan, M., Sastry, S. Autnonomous helicopter flight via reinforcement learning. In NIPS 16 (2004).
25. Ng, A.Y., Russell, S. Algorithms for inverse reinforcement learning. In Proceedings of ICML (2000).
26. Ramachandran, D., Amir, E. Bayesian inverse reinforcement learning. In Proceedings of IJCAI (2007).
27. Ratliff, N., Bagnell, J., Zinkevich, M. Maximum margin planning. In Proceedings of ICML (2006).
28. Roberts, J.M., Corke, P.I., Buskey, G. Low-cost flight control system for a small autonomous helicopter. In IEEE International Conference on Robotics and Automation (2003).
29. Sakoe, H., Chiba, S. Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing (1978).
30. Saripalli, S., Montgomery, J., Sukhatme, G. Visually-guided landing of an unmanned aerial vehicle, 2003.
31. Seddon, J. Basic Helicopter Aerodynamics. AIAA Education Series, American Institute of Aeronautics and Astronautics, 1990.
32. Syed, U., Schapire, R.E. A game-theoretic approach to apprenticeship learning. In NIPS 20 (2008).