A Vision-Based Two-Stage Framework for Inferring Physical Properties of the Terrain
Open Access
- 17 September 2020
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 10 (18), 6473
- https://doi.org/10.3390/app10186473
Abstract
The friction and stiffness properties of the terrain are very important pieces of information for mobile robots in motion control, dynamics parameter adjustment, trajectory planning, etc. Inferring the friction and stiffness properties in advance can improve the safety, adaptability and reliability, and reduce the energy consumption of the robot. This paper proposes a vision-based two-stage framework for pre-estimating physical properties of the terrain. We established a field terrain image dataset with weak annotations. A semantic segmentation network that can segment terrains at the pixel level was designed. Given that the same terrain also has different physical properties, we designed two kinds of image features, and we use a decision-making model to realize the mapping from terrain to physical properties. We trained and tested the network comprehensively, and experimented with the complete framework for estimating physical properties. The experimental results show that our framework has good performance.Funding Information
- Natural Science Foundation of China (No.61773139)
- The Foundation for Innovative Research Groups of the National Natural Science Foundation of China (No.51521003)
This publication has 19 references indexed in Scilit:
- The Cityscapes Dataset for Semantic Urban Scene UnderstandingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- Momentum control with hierarchical inverse dynamics on a torque-controlled humanoidAutonomous Robots, 2015
- Foot–terrain interaction mechanics for legged robots: Modeling and experimental validationThe International Journal of Robotics Research, 2013
- Perceptual qualities and material classesJournal of Vision, 2013
- Transformation from image-based to perceptual representation of materials along the human ventral visual pathwayNeuroImage, 2011
- SmcHD1, containing a structural-maintenance-of-chromosomes hinge domain, has a critical role in X inactivationNature Genetics, 2008
- LabelMe: A Database and Web-Based Tool for Image AnnotationInternational Journal of Computer Vision, 2007
- Modelling and simulation of artificial locomotion systemsRobotica, 2005
- A linear differential formulation of friction forces for adaptive estimator algorithmsRobotica, 2001
- Design of an image edge detection filter using the Sobel operatorIEEE Journal of Solid-State Circuits, 1988