Dynamic locomotion synchronization of bipedal robot and human operator via bilateral feedback teleoperation
Open Access
- 30 October 2019
- journal article
- research article
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 4 (35)
- https://doi.org/10.1126/scirobotics.aav4282
Abstract
Despite remarkable progress in artificial intelligence, autonomous humanoid robots are still far from matching human-level manipulation and locomotion proficiency in real applications. Proficient robots would be ideal first responders to dangerous scenarios such as natural or man-made disasters. When handling these situations, robots must be capable of navigating highly unstructured terrain and dexterously interacting with objects designed for human workers. To create humanoid machines with human-level motor skills, in this work, we use whole-body teleoperation to leverage human control intelligence to command the locomotion of a bipedal robot. The challenge of this strategy lies in properly mapping human body motion to the machine while simultaneously informing the operator how closely the robot is reproducing the movement. Therefore, we propose a solution for this bilateral feedback policy to control a bipedal robot to take steps, jump, and walk in synchrony with a human operator. Such dynamic synchronization was achieved by (i) scaling the core components of human locomotion data to robot proportions in real time and (ii) applying feedback forces to the operator that are proportional to the relative velocity between human and robot. Human motion was sped up to match a faster robot, or drag was generated to synchronize the operator with a slower robot. Here, we focused on the frontal plane dynamics and stabilized the robot in the sagittal plane using an external gantry. These results represent a fundamental solution to seamlessly combine human innate motor control proficiency with the physical endurance and strength of humanoid robots.Keywords
Funding Information
- Naver Labs
- Hon Hai Precision Industry
This publication has 31 references indexed in Scilit:
- DeepMimicACM Transactions on Graphics, 2018
- Bipedal oriented whole body master-slave system for dynamic secured locomotion with LIP safety constraintsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2017
- Dancing Humanoid Robots: Systematic Use of OSID to Compute Dynamically Consistent Movements Following a Motion Capture PatternIEEE Robotics & Automation Magazine, 2015
- Adapting human motions to humanoid robots through time warping based on a general motion feasibility indexPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Humanoid Robot Teleoperation with Vibrotactile Based Balancing FeedbackLecture Notes in Computer Science, 2014
- Extraction of person-specific motion style based on a task model and imitation by humanoid robotPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- Human motion tracking control with strict contact force constraints for floating-base humanoid robotsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Learning of compliant human–robot interaction using full-body haptic interfaceAdvanced Robotics, 2013
- Generation of dynamic humanoid behaviors through task-space control with conic optimizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Whole-body imitation of human motions with a nao humanoidPublished by Association for Computing Machinery (ACM) ,2012