Exploring Behaviors of Caterpillar-Like Soft Robots with a Central Pattern Generator-Based Controller and Reinforcement Learning
Open Access
- 1 October 2019
- journal article
- research article
- Published by Mary Ann Liebert Inc in Soft Robotics
- Vol. 6 (5), 579-594
- https://doi.org/10.1089/soro.2018.0126
Abstract
Due to their flexibility, soft-bodied robots can potentially achieve rich and various behaviors within a single body. However, to date, no methodology has effectively harnessed these robots to achieve such diverse desired functionalities. Controllers that accomplish only a limited range of behaviors in such robots have been handcrafted. Moreover, the behaviors of these robots should be determined through body–environment interactions because an appropriate behavior may not always be manifested even if the body dynamics are given. Therefore, we have proposed SenseCPG-PGPE, a method for automatically designing behaviors for caterpillar-like soft-bodied robots. This method optimizes mechanosensory feedback to a central pattern generator (CPG)-based controller, which controls actuators in a robot, using policy gradients with parameter-based exploration (PGPE). In this article, we deeply investigated this method. We found that PGPE can optimize a CPG-based controller for soft-bodied robots that exhibit viscoelasticity and large deformation, whereas other popular policy gradient methods, such as trust region policy optimization and proximal policy optimization, cannot. Scalability of the method was confirmed using simulation as well. Although SenseCPG-PGPE uses a CPG-based controller, it can achieve nonsteady motion such as climbing a step in a simulated robot. The approach also resulted in distinctive behaviors depending on different body–environment conditions. These results demonstrate that the proposed method enables soft robots to explore a variety of behaviors automatically.Keywords
This publication has 26 references indexed in Scilit:
- Evolving Soft Locomotion in Aquatic and Terrestrial Environments: Effects of Material Properties and Environmental TransitionsSoft Robotics, 2018
- A Quadruped Robot Exhibiting Spontaneous Gait Transitions from Walking to Trotting to GallopingScientific Reports, 2017
- Soft robotics: a bioinspired evolution in roboticsTrends in Biotechnology, 2013
- CPG-Inspired Workspace Trajectory Generation and Adaptive Locomotion Control for Quadruped RobotsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2011
- Central pattern generators for locomotion control in animals and robots: A reviewNeural Networks, 2008
- Controlling swimming and crawling in a fish robot using a central pattern generatorAutonomous Robots, 2007
- From Swimming to Walking with a Salamander Robot Driven by a Spinal Cord ModelScience, 2007
- AmphiBot I: an amphibious snake-like robotRobotics and Autonomous Systems, 2005
- Realization of Dynamic Walking and Running of the Quadruped Using Neural OscillatorAutonomous Robots, 1999
- Intrinsic function of a neuronal network — a vertebrate central pattern generatorBrain Research Reviews, 1998