An Adaptable Robot Vision System Performing Manipulation Actions With Flexible Objects
- 30 May 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 11 (3), 749-765
- https://doi.org/10.1109/tase.2014.2320157
Abstract
This paper describes an adaptable system which is able to perform manipulation operations (such as Peg-in-Hole or Laying-Down actions) with flexible objects. As such objects easily change their shape significantly during the execution of an action, traditional strategies, e.g, for solve path-planning problems, are often not applicable. It is therefore required to integrate visual tracking and shape reconstruction with a physical modeling of the materials and their deformations as well as action learning techniques. All these different submodules have been integrated into a demonstration platform, operating in real-time. Simulations have been used to bootstrap the learning of optimal actions, which are subsequently improved through real-world executions. To achieve reproducible results, we demonstrate this for casted silicone test objects of regular shape. Note to Practitioners - The aim of this work was to facilitate the setup of robot-based automation of delicate handling of flexible objects consisting of a uniform material. As examples, we have considered how to optimally maneuver flexible objects through a hole without colliding and how to place flexible objects on a flat surface with minimal introduction of internal stresses in the object. Given the material properties of the object, we have demonstrated in these two applications how the system can be programmed with minimal requirements of human intervention. Rather than being an integrated system with the drawbacks in terms of lacking flexibility, our system should be viewed as a library of new technologies that have been proven to work in close to industrial conditions. As a rather basic, but necessary part, we provide a technology for determining the shape of the object when passing on, e.g., a conveyor belt prior to being handled. The main technologies applicable for the manipulated objects are: A method for real-time tracking of the flexible objects during manipulation, a method for model-based offline prediction of the static deformation of grasped, flexible objects and, finally, a method for optimizing specific tasks based on both simulated and real-world executions.Keywords
This publication has 33 references indexed in Scilit:
- Survey on model-based manipulation planning of deformable objectsRobotics and Computer-Integrated Manufacturing, 2012
- Learning Grasp Affordance DensitiesPaladyn, Journal of Behavioral Robotics, 2011
- Combining active learning and reactive control for robot graspingRobotics and Autonomous Systems, 2010
- The relationship between Shore hardness of elastomeric dental materials and Young's modulusDental Materials, 2009
- Hybrid scheduling for the parallel solution of linear systemsParallel Computing, 2006
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005
- Automatic Visual Recognition of Deformable Objects for Grasping and ManipulationIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2004
- A Fully Asynchronous Multifrontal Solver Using Distributed Dynamic SchedulingSIAM Journal on Matrix Analysis and Applications, 2001
- Mode-finding for mixtures of Gaussian distributionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- DYNAMICS OF TRANSVERSELY VIBRATING BEAMS USING FOUR ENGINEERING THEORIESJournal of Sound and Vibration, 1999