Deep Learning Techniques for Autonomous Spacecraft Guidance During Proximity Operations
- 1 November 2021
- journal article
- research article
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Spacecraft and Rockets
- Vol. 58 (6), 1774-1785
- https://doi.org/10.2514/1.a35076
Abstract
This paper investigates the use of deep learning techniques for real-time optimal spacecraft guidance during terminal rendezvous maneuvers, in presence of both operational constraints and stochastic effects, such as an inaccurate knowledge of the initial spacecraft state and the presence of random in-flight disturbances. The performance of two well-studied deep learning methods, behavioral cloning (BC) and reinforcement learning (RL), is investigated on a linear multi-impulsive rendezvous mission. To this aim, a multilayer perceptron network, with custom architecture, is designed to map any observation of the actual spacecraft relative position and velocity to the propellant-optimal control action, which corresponds to a bounded-magnitude impulsive velocity variation. In the BC approach, the deep neural network is trained by supervised learning on a set of optimal trajectories, generated by routinely solving the deterministic optimal control problem via convex optimization, starting from scattered initial conditions. Conversely, in the RL approach, a state-of-the-art actor–critic algorithm, proximal policy optimization, is used for training the network through repeated interactions with the stochastic environment. Eventually, the robustness and propellant efficiency of the obtained closed-loop control policies are assessed and compared by means of a Monte Carlo analysis, carried out by considering different test cases with increasing levels of perturbations.Keywords
This publication has 26 references indexed in Scilit:
- Real-Time Optimal Control for Spacecraft Orbit Transfer via Multiscale Deep Neural NetworksIEEE Transactions on Aerospace and Electronic Systems, 2018
- Real-Time Optimal Control via Deep Neural Networks: Study on Landing ProblemsJournal of Guidance, Control, and Dynamics, 2018
- Deep learning in robotics: a review of recent researchAdvanced Robotics, 2017
- Introducing Computational Guidance and ControlJournal of Guidance, Control, and Dynamics, 2017
- Deep Reinforcement Learning framework for Autonomous DrivingElectronic Imaging, 2017
- System test results from the GNC experiments on the PRISMA in-orbit test bedActa Astronautica, 2011
- Navigating the Road to Autonomous Orbital RendezvousJournal of Spacecraft and Rockets, 2007
- Convex OptimizationPublished by Cambridge University Press (CUP) ,2004
- Performance Evaluation of Rendezvous Using Model Predictive ControlPublished by American Institute of Aeronautics and Astronautics (AIAA) ,2003
- Terminal Guidance System for Satellite RendezvousJournal of the Aerospace Sciences, 1960