Distributed Wildfire Surveillance with Autonomous Aircraft Using Deep Reinforcement Learning
Open Access
- 1 August 2019
- journal article
- conference paper
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Guidance, Control, and Dynamics
- Vol. 42 (8), 1768-1778
- https://doi.org/10.2514/1.g004106
Abstract
Teams of autonomous unmanned aircraft can be used to monitor wildfires, enabling firefighters to make informed decisions. However, controlling multiple autonomous fixed-wing aircraft to maximize forest fire coverage is a complex problem. The state space is high dimensional, the fire propagates stochastically, the sensor information is imperfect, and the aircraft must coordinate with each other to accomplish their mission. This work presents two deep reinforcement learning approaches for training decentralized controllers that accommodate the high dimensionality and uncertainty inherent in the problem. The first approach controls the aircraft using immediate observations of the individual aircraft. The second approach allows aircraft to collaborate on a map of the wildfire’s state and maintain a time history of locations visited, which are used as inputs to the controller. Simulation results show that both approaches allow the aircraft to accurately track wildfire expansions and outperform an online receding-horizon controller. Additional simulations demonstrate that the approach scales with different numbers of aircraft and generalizes to different wildfire shapes.Keywords
Funding Information
- National Science Foundation (DGE-1656518)
This publication has 21 references indexed in Scilit:
- Real-time fire segmentation via Active Contours for UAV integrated wildfire propagation predictionPublished by American Institute of Aeronautics and Astronautics (AIAA) ,2018
- A comparison of Monte Carlo tree search and rolling horizon optimization for large-scale dynamic resource allocation problemsEuropean Journal of Operational Research, 2017
- Detection and Localization using Unmanned Aerial Systems for Firefighting ApplicationsPublished by American Institute of Aeronautics and Astronautics (AIAA) ,2016
- An Implementation of the Rothermel Fire Spread Model in the R Programming LanguageFire Technology, 2014
- A Survey of Small-Scale Unmanned Aerial Vehicles: Recent Advances and Future Development TrendsUnmanned Systems, 2014
- An Unmanned Aircraft System for Automatic Forest Fire Monitoring and MeasurementJournal of Intelligent & Robotic Systems, 2011
- The Ikhana unmanned airborne system (UAS) western states fire imaging missions: from concept to reality (2006–2010)Geocarto International, 2011
- A stochastic forest fire growth modelEnvironmental and Ecological Statistics, 2008
- Fire detection and fire growth monitoring using satellite dataPublished by Springer Science and Business Media LLC ,1999
- FARSITE: Fire Area Simulator-model development and evaluationPublished by USDA Forest Service ,1998