On the Illumination Influence for Object Learning on Robot Companions
Open Access
- 21 January 2020
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Robotics and AI
Abstract
Most collaborative tasks require interaction with everyday objects (e.g., utensils while cooking). Thus, robots must perceive everyday objects in an effective and efficient way. This highlights the necessity of understanding environmental factors and their impact on visual perception, such as illumination changes throughout the day on robotic systems in the real world. In object recognition, two of these factors are changes due to illumination of the scene and differences in the sensors capturing it. In this paper, we will present data augmentations for object recognition that enhance a deep learning architecture. We will show how simple linear and non-linear illumination models and feature concatenation can be used to improve deep learning-based approaches. The aim of this work is to allow for more realistic Human-Robot Interaction scenarios with a small amount of training data in combination with incremental interactive object learning. This will benefit the interaction with the robot to maximize object learning for long-term and location-independent learning in unshaped environments. With our model-based analysis, we showed that changes in illumination affect recognition approaches that use Deep Convolutional Neural Network to encode features for object recognition. Using data augmentation, we were able to show that such a system can be modified toward a more robust recognition without retraining the network. Additionally, we have shown that using simple brightness change models can help to improve the recognition across all training set sizes.This publication has 17 references indexed in Scilit:
- Striking individual differences in color perception uncovered by ‘the dress’ photographCurrent Biology, 2015
- CaffePublished by Association for Computing Machinery (ACM) ,2014
- CNN Features Off-the-Shelf: An Astounding Baseline for RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- An Innovative SIFT-Based Method for Rigid Video Object RecognitionMathematical Problems in Engineering, 2014
- A comparative study on illumination preprocessing in face recognitionPattern Recognition, 2013
- Color constancyVision Research, 2011
- A Brief Survey of Color Image Preprocessing and Segmentation TechniquesJournal of Pattern Recognition Research, 2011
- Automatic Gain Control for Image-Intensified CameraIEEE Transactions on Instrumentation and Measurement, 2004
- Physical relation and expression: joint attention for human~robot interactionIEEE Transactions on Industrial Electronics, 2003
- Random sample consensusCommunications of the ACM, 1981