Dynamic Feature Integration for Simultaneous Detection of Salient Object, Edge and Skeleton

04/18/2020
by   Jiang-Jiang Liu, et al.
0

In this paper, we solve three low-level pixel-wise vision problems, including salient object segmentation, edge detection, and skeleton extraction, within a unified framework. We first show some similarities shared by these tasks and then demonstrate how they can be leveraged for developing a unified framework that can be trained end-to-end. In particular, we introduce a selective integration module that allows each task to dynamically choose features at different levels from the shared backbone based on its own characteristics. Furthermore, we design a task-adaptive attention module, aiming at intelligently allocating information for different tasks according to the image content priors. To evaluate the performance of our proposed network on these tasks, we conduct exhaustive experiments on multiple representative datasets. We will show that though these tasks are naturally quite different, our network can work well on all of them and even perform better than current single-purpose state-of-the-art methods. In addition, we also conduct adequate ablation analyses that provide a full understanding of the design principles of the proposed framework. To facilitate future research, source code will be released.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 7

page 10

page 11

page 13

research
03/27/2018

Three Birds One Stone: A Unified Framework for Salient Object Segmentation, Edge Detection and Skeleton Extraction

In this paper, we aim at solving pixel-wise binary problems, including s...
research
01/05/2018

Hi-Fi: Hierarchical Feature Integration for Skeleton Detection

In natural images, skeleton scales (thickness) may significantly vary am...
research
10/19/2019

SpatialFlow: Bridging All Tasks for Panoptic Segmentation

The newly proposed panoptic segmentation task, which aims to encompass t...
research
03/09/2022

A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detection

Humans tend to mine objects by learning from a group of images or severa...
research
09/27/2022

View-aware Salient Object Detection for 360° Omnidirectional Image

Image-based salient object detection (ISOD) in 360 scenarios is signific...
research
01/03/2023

PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentation

Panoptic Part Segmentation (PPS) unifies panoptic segmentation and part ...
research
07/25/2018

Linear Span Network for Object Skeleton Detection

Robust object skeleton detection requires to explore rich representative...

Please sign up or login with your details

Forgot password? Click here to reset