Are standard Object Segmentation models sufficient for Learning Affordance Segmentation?

07/05/2021
by   Hugo Caselles-Dupré, et al.
0

Affordances are the possibilities of actions the environment offers to the individual. Ordinary objects (hammer, knife) usually have many affordances (grasping, pounding, cutting), and detecting these allow artificial agents to understand what are their possibilities in the environment, with obvious application in Robotics. Proposed benchmarks and state-of-the-art prediction models for supervised affordance segmentation are usually modifications of popular object segmentation models such as Mask R-CNN. We observe that theoretically, these popular object segmentation methods should be sufficient for detecting affordances masks. So we ask the question: is it necessary to tailor new architectures to the problem of learning affordances? We show that applying the out-of-the-box Mask R-CNN to the problem of affordances segmentation outperforms the current state-of-the-art. We conclude that the problem of supervised affordance segmentation is included in the problem of object segmentation and argue that better benchmarks for affordance learning should include action capacities.

READ FULL TEXT

page 1

page 7

research
08/25/2023

Integrating Boxes and Masks: A Multi-Object Framework for Unified Visual Tracking and Segmentation

Tracking any given object(s) spatially and temporally is a common purpos...
research
04/13/2021

Pointly-Supervised Instance Segmentation

We propose point-based instance-level annotation, a new form of weak sup...
research
03/16/2018

Learning to Segment via Cut-and-Paste

This paper presents a weakly-supervised approach to object instance segm...
research
07/17/2020

Boundary-preserving Mask R-CNN

Tremendous efforts have been made to improve mask localization accuracy ...
research
08/22/2023

LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training

Learning object segmentation in image and video datasets without human s...
research
11/25/2020

Fast Object Segmentation Learning with Kernel-based Methods for Robotics

Object segmentation is a key component in the visual system of a robot t...
research
11/27/2018

Beyond One Glance: Gated Recurrent Architecture for Hand Segmentation

As mixed reality is gaining increased momentum, the development of effec...

Please sign up or login with your details

Forgot password? Click here to reset