BIRON, where are you? Enabling a robot to learn new places in a real home environment by integrating spoken dialog and visual localization
- 1 October 2006
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 934-940
- https://doi.org/10.1109/iros.2006.281770
Abstract
An ambitious goal in modern robotic science is to build mobile robots that are able to interact as companions in real world environments. Especially for caretaking of elderly people a system robustly working at private homes is essential, requiring a very natural and human oriented way of communication. Since home environments are usually very individual a first task for a newly acquired robot is to get familiar with its new environment. This paper gives a short overview on how we integrated a vision based localization using the advantages of a very modular architecture and extending a spoken dialog system for online labeling and interaction about different locations. We present results from the integrated system working in a real, fully furnished home environment where it was able to learn the names of different rooms. This system enables us to perform real user studies in future without the need to fall back to Wizard-of-Oz experiments. Ongoing work aims at enabling the robot to take initiative by asking for unknown locations. A future extension is the ability to generalize over features of known rooms to make predictions when encountering unknown roomsKeywords
This publication has 15 references indexed in Scilit:
- A dialog system for comparative user studies on robot verbal behaviorPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Hierarchical map building and planning based on graph partitioningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Global localization and relative positioning based on scale-invariant keypointsRobotics and Autonomous Systems, 2005
- A multi-modal object attention system for a mobile robotPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Hierarchical map building using visual landmarks and geometric constraintsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- An XML based framework for cognitive vision architecturesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Providing the basis for human-robot-interactionPublished by Association for Computing Machinery (ACM) ,2003
- Jijo-2: an office robot that communicates and learnsIEEE Intelligent Systems, 2001
- Normalized cuts and image segmentationIeee Transactions On Pattern Analysis and Machine Intelligence, 2000