Panoptic Feature Pyramid Networks

by   Alexander Kirillov, et al.

The recently introduced panoptic segmentation task has renewed our community's interest in unifying the tasks of instance segmentation (for thing classes) and semantic segmentation (for stuff classes). However, current state-of-the-art methods for this joint task use separate and dissimilar networks for instance and semantic segmentation, without performing any shared computation. In this work, we aim to unify these methods at the architectural level, designing a single network for both tasks. Our approach is to endow Mask R-CNN, a popular instance segmentation method, with a semantic segmentation branch using a shared Feature Pyramid Network (FPN) backbone. Surprisingly, this simple baseline not only remains effective for instance segmentation, but also yields a lightweight, top-performing method for semantic segmentation. In this work, we perform a detailed study of this minimally extended version of Mask R-CNN with FPN, which we refer to as Panoptic FPN, and show it is a robust and accurate baseline for both tasks. Given its effectiveness and conceptual simplicity, we hope our method can serve as a strong baseline and aid future research in panoptic segmentation.


page 2

page 8


Panoptic Segmentation with a Joint Semantic and Instance Segmentation Network

We present an end-to-end method for the task of panoptic segmentation. T...

Unifying Instance and Panoptic Segmentation with Dynamic Rank-1 Convolutions

Recently, fully-convolutional one-stage networks have shown superior per...

Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation

In this work, we introduce Panoptic-DeepLab, a simple, strong, and fast ...

IMP: Instance Mask Projection for High Accuracy Semantic Segmentation of Things

In this work, we present a new operator, called Instance Mask Projection...

Panoptic Segmentation

We propose and study a novel 'Panoptic Segmentation' (PS) task. Panoptic...

Classifying Breast Histopathology Images with a Ductal Instance-Oriented Pipeline

In this study, we propose the Ductal Instance-Oriented Pipeline (DIOP) t...

InstanceCut: from Edges to Instances with MultiCut

This work addresses the task of instance-aware semantic segmentation. Ou...

Code Repositories


Panoptic Feature Pyramid Networks

view repo


use FPN to FPN-Semantic-segmentation。pytorch version

view repo



view repo

Please sign up or login with your details

Forgot password? Click here to reset