Conditional Convolutions for Instance Segmentation

03/12/2020
by   Zhi Tian, et al.
7

We propose a simple yet effective instance segmentation framework, termed CondInst (conditional convolutions for instance segmentation). Top-performing instance segmentation methods such as Mask R-CNN rely on ROI operations (typically ROIPool or ROIAlign) to obtain the final instance masks. In contrast, we propose to solve instance segmentation from a new perspective. Instead of using instance-wise ROIs as inputs to a network of fixed weights, we employ dynamic instance-aware networks, conditioned on instances. CondInst enjoys two advantages: 1) Instance segmentation is solved by a fully convolutional network, eliminating the need for ROI cropping and feature alignment. 2) Due to the much improved capacity of dynamically-generated conditional convolutions, the mask head can be very compact (e.g., 3 conv. layers, each having only 8 channels), leading to significantly faster inference. We demonstrate a simpler instance segmentation method that can achieve improved performance in both accuracy and inference speed. On the COCO dataset, we outperform a few recent methods including well-tuned Mask RCNN baselines, without longer training schedules needed. Code is available: https://github.com/aim-uofa/adet

READ FULL TEXT

page 2

page 4

research
02/05/2021

Instance and Panoptic Segmentation Using Conditional Convolutions

We propose a simple yet effective framework for instance and panoptic se...
research
03/26/2020

Mask Encoding for Single Shot Instance Segmentation

To date, instance segmentation is dominated by twostage methods, as pion...
research
02/06/2023

Top-Down Beats Bottom-Up in 3D Instance Segmentation

Most 3D instance segmentation methods exploit a bottom-up strategy, typi...
research
07/15/2022

3D Instances as 1D Kernels

We introduce a 3D instance representation, termed instance kernels, wher...
research
02/14/2020

Layered Embeddings for Amodal Instance Segmentation

The proposed method extends upon the representational output of semantic...
research
12/09/2021

Implicit Feature Refinement for Instance Segmentation

We propose a novel implicit feature refinement module for high-quality i...
research
03/23/2020

SOLOv2: Dynamic, Faster and Stronger

In this work, we aim at building a simple, direct, and fast instance seg...

Please sign up or login with your details

Forgot password? Click here to reset