Apprenticeship learning for helicopter control
- 1 July 2009
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Communications of the ACM
- Vol. 52 (7), 97-105
- https://doi.org/10.1145/1538788.1538812
Abstract
Autonomous helicopter flight is widely regarded to be a highly challenging control problem. As helicopters are highly unstable and exhibit complicated dynamical behavior, it is particularly difficult to design controllers that achieve high performance over a broad flight regime. While these aircraft are notoriously difficult to control, there are expert human pilots who are nonetheless capable of demonstrating a wide variety of maneuvers, including aerobatic maneuvers at the edge of the helicopter's performance envelope. In this paper, we present algorithms for modeling and control that leverage these demonstrations to build high-performance control systems for autonomous helicopters. More specifically, we detail our experiences with the Stanford Autonomous Helicopter, which is now capable of extreme aerobatic flight meeting or exceeding the performance of our own expert pilot.Keywords
This publication has 12 references indexed in Scilit:
- Autonomous Autorotation of an RC HelicopterSpringer Tracts in Advanced Robotics, 2009
- Learning for control from multiple demonstrationsPublished by Association for Computing Machinery (ACM) ,2008
- On Learning, Representing, and Generalizing a Task in a Humanoid RobotIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2007
- Maximum margin planningPublished by Association for Computing Machinery (ACM) ,2006
- Using inaccurate models in reinforcement learningPublished by Association for Computing Machinery (ACM) ,2006
- Apprenticeship learning via inverse reinforcement learningPublished by Association for Computing Machinery (ACM) ,2004
- Low-cost flight control system for a small autonomous helicopterPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Autonomous helicopter control using reinforcement learning policy search methodsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Maximum Likelihood from Incomplete Data Via the EM AlgorithmJournal of the Royal Statistical Society: Series B (Methodological), 1977
- A general method applicable to the search for similarities in the amino acid sequence of two proteinsJournal of Molecular Biology, 1970