A Multimodal Interface to Control a Robot Arm via the Web: A Case Study on Remote Programming
- 5 December 2005
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 52 (6), 1506-1520
- https://doi.org/10.1109/tie.2005.858733
Abstract
In this paper, we present the user interface and the system architecture of an Internet-based telelaboratory, which allows researchers and students to remotely control and program two educational online robots. In fact, the challenge has been to demonstrate that remote programming combined with an advanced multimedia user interface for remote control is very suitable, flexible, and profitable for the design of a telelaboratory. The user interface has been designed by using techniques based on augmented reality and nonimmersive virtual reality, which enhance the way operators get/put information from/to the robotic scenario. Moreover, the user interface provides the possibility of letting the operator manipulate the remote environment by using multiple ways of interaction (i.e., from the simplification of the natural language to low-level remote programming). In fact, the paper focuses on the lowest level of interaction between the operator and the robot, which is remote programming. As explained in the paper, the system architecture permits any external program (i.e., remote experiment, speech-recognition module, etc.) to have access to almost every feature of the telelaboratory (e.g., cameras, object recognition, robot control, etc.). The system validation was performed by letting 40 Ph.D. students within the "European Robotics Research Network Summer School on Internet and Online Robots for Telemanipulation" workshop (Benica/spl grave/ssim, Spain, 2003) program several telemanipulation experiments with the telelaboratory. Some of these experiments are shown and explained in detail. Finally, the paper focuses on the analysis of the network performance for the proposed architecture (i.e., time delay). In fact, several configurations are tested through various networking protocols (i.e., Remote Method Invocation, Transmission Control Protocol/IP, User Datagram Protocol/IP). Results show the real possibilities offered by these remote-programming techniques, in order to design experiments intended to be performed from both home and the campus.Keywords
This publication has 11 references indexed in Scilit:
- A very high level interface to teleoperate a robot via Web including augmented realityPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Automatic speech recognition to teleoperate a robot via WebPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- A predictive interface based on virtual and augmented reality for task specification in a Web telerobotic systemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Object recognition and incremental learning algorithms for a web-based telerobotic systemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- The development of Internet-based laboratory environments for teaching robotics and artificial intelligencePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- The UJI Online Robot: An Education and Training ExperienceAutonomous Robots, 2003
- Vision-guided grasping of unknown objects for service robotsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Model-based telerobotics with visionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Internet robots: a new robotics nicheIEEE Robotics & Automation Magazine, 2000
- Beyond the Web: manipulating the real worldComputer Networks and ISDN Systems, 1995