Affordance Estimation For Vision-Based Object Replacement on a Humanoid Robot
Conference: ISR 2016 - 47st International Symposium on Robotics
06/21/2016 - 06/22/2016 at München, Germany
Proceedings: ISR 2016
Pages: 9Language: englishTyp: PDF
Personal VDE Members are entitled to a 10% discount on this title
Authors:
Mustafa, Wail (The Mærsk Mc-Kinney Møller Institute, University of Southern Denmark, Odense, De)
Waechter, Mirko (Institute for Anthropomatics, Karlsruhe Institute of Technology, Karlsruhe, Germany)
Szedmak, Sandor (Institute of Computer Science, University of Innsbruck, Innsbruck, Austria)
Agostini, Alejandro (Third Institute of Physics and BCCN, University of Göttingen, Germany)
Abstract:
In this paper, we address the problem of finding replacements of missing objects, involved in the execution of manipulation tasks. Our approach is based on estimating functional affordances for the unknown objects in order to propose replacements. We use a vision-based affordance estimation system utilizing object-wise global features and a multi-label learning method. This method also associates confidence values to the estimated affordances. We evaluate our approach on kitchen-related manipulation affordances. The evaluation also includes testing different scenarios for training the system using large-scale datasets. The results indicate that the system is able to successfully predict the affordances of novel objects. We also implement our system on a humanoid robot and demonstrate the affordance estimation in a real scene.