Towards learning hierarchical skills for multi-phase manipulation tasks
- 1 May 2015
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 1503-1510
- https://doi.org/10.1109/icra.2015.7139389
Abstract
Most manipulation tasks can be decomposed into a sequence of phases, where the robot's actions have different effects in each phase. The robot can perform actions to transition between phases and, thus, alter the effects of its actions, e.g. grasp an object in order to then lift it. The robot can thus reach a phase that affords the desired manipulation. In this paper, we present an approach for exploiting the phase structure of tasks in order to learn manipulation skills more efficiently. Starting with human demonstrations, the robot learns a probabilistic model of the phases and the phase transitions. The robot then employs model-based reinforcement learning to create a library of motor primitives for transitioning between phases. The learned motor primitives generalize to new situations and tasks. Given this library, the robot uses a value function approach to learn a high-level policy for sequencing the motor primitives. The proposed method was successfully evaluated on a real robot performing a bimanual grasping task.Keywords
This publication has 25 references indexed in Scilit:
- Learning contact-rich manipulation skills with guided policy searchPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Goal directed multi-finger manipulation: Control policies and analysisComputers & Graphics, 2013
- A hierarchical approach to manipulation with diverse actionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Robot learning from demonstration by constructing skill treesThe International Journal of Robotics Research, 2011
- Randomized multi-modal motion planning for a humanoid robot manipulation taskThe International Journal of Robotics Research, 2010
- Coding and use of tactile signals from the fingertips in object manipulation tasksNature Reviews Neuroscience, 2009
- Control strategies in object manipulation tasksCurrent Opinion in Neurobiology, 2006
- Movement imitation with nonlinear dynamical systems in humanoid robotsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Hierarchical learning of reactive behaviors in an autonomous mobile robotPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Reinforcement learning of multiple tasks using a hierarchical CMAC architectureRobotics and Autonomous Systems, 1995