AsyInst: Asymmetric Affinity with DepthGrad and Color for Box-Supervised Instance Segmentation

12/07/2022
by   Siwei Yang, et al.
7

The weakly supervised instance segmentation is a challenging task. The existing methods typically use bounding boxes as supervision and optimize the network with a regularization loss term such as pairwise color affinity loss for instance segmentation. Through systematic analysis, we found that the commonly used pairwise affinity loss has two limitations: (1) it works with color affinity but leads to inferior performance with other modalities such as depth gradient, (2)the original affinity loss does not prevent trivial predictions as intended but actually accelerates this process due to the affinity loss term being symmetric. To overcome these two limitations, in this paper, we propose a novel asymmetric affinity loss which provides the penalty against the trivial prediction and generalizes well with affinity loss from different modalities. With the proposed asymmetric affinity loss, our method outperforms the state-of-the-art methods on the Cityscapes dataset and outperforms our baseline method by 3.5

READ FULL TEXT

page 1

page 3

page 4

page 6

page 8

page 11

research
12/07/2021

Deep Level Set for Box-supervised Instance Segmentation in Aerial Images

Box-supervised instance segmentation has recently attracted lots of rese...
research
02/12/2019

MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation

We propose a new approach for 3D instance segmentation based on sparse c...
research
03/15/2020

Deep Affinity Net: Instance Segmentation via Affinity

Most of the modern instance segmentation approaches fall into two catego...
research
11/29/2020

Learning Affinity-Aware Upsampling for Deep Image Matting

We show that learning affinity in upsampling provides an effective and e...
research
08/03/2021

Adaptive Affinity Loss and Erroneous Pseudo-Label Refinement for Weakly Supervised Semantic Segmentation

Semantic segmentation has been continuously investigated in the last ten...
research
04/17/2023

STRAP: Structured Object Affordance Segmentation with Point Supervision

With significant annotation savings, point supervision has been proven e...
research
09/09/2017

A Deep Structured Learning Approach Towards Automating Connectome Reconstruction from 3D Electron Micrographs

We present a deep structured learning method for neuron segmentation fro...

Please sign up or login with your details

Forgot password? Click here to reset