DeepAI AI Chat
Log In Sign Up

Invariant Feature Mappings for Generalizing Affordance Understanding Using Regularized Metric Learning

by   Martin Hjelm, et al.

This paper presents an approach for learning invariant features for object affordance understanding. One of the major problems for a robotic agent acquiring a deeper understanding of affordances is finding sensory-grounded semantics. Being able to understand what in the representation of an object makes the object afford an action opens up for more efficient manipulation, interchange of objects that visually might not be similar, transfer learning, and robot to human communication. Our approach uses a metric learning algorithm that learns a feature transform that encourages objects that affords the same action to be close in the feature space. We regularize the learning, such that we penalize irrelevant features, allowing the agent to link what in the sensory input caused the object to afford the action. From this, we show how the agent can abstract the affordance and reason about the similarity between different affordances.


page 1

page 7

page 8

page 9


Online Deep Metric Learning

Metric learning learns a metric function from training data to calculate...

SCOD: Active Object Detection for Embodied Agents using Sensory Commutativity of Action Sequences

We introduce SCOD (Sensory Commutativity Object Detection), an active me...

Metric Learning With HORDE: High-Order Regularizer for Deep Embeddings

Learning an effective similarity measure between image representations i...

Embodied vision for learning object representations

Recent time-contrastive learning approaches manage to learn invariant ob...

3D Human Action Recognition with Siamese-LSTM Based Deep Metric Learning

This paper proposes a new 3D Human Action Recognition system as a two-ph...

Linear Readout of Object Manifolds

Objects are represented in sensory systems by continuous manifolds due t...

Robotic self-representation improves manipulation skills and transfer learning

Cognitive science suggests that the self-representation is critical for ...