Occlusion-shared and Feature-separated Network for Occlusion Relationship Reasoning

08/16/2019
by   Rui Lu, et al.
1

Occlusion relationship reasoning demands closed contour to express the object, and orientation of each contour pixel to describe the order relationship between objects. Current CNN-based methods neglect two critical issues of the task: (1) simultaneous existence of the relevance and distinction for the two elements, i.e, occlusion edge and occlusion orientation; and (2) inadequate exploration to the orientation features. For the reasons above, we propose the Occlusion-shared and Feature-separated Network (OFNet). On one hand, considering the relevance between edge and orientation, two sub-networks are designed to share the occlusion cue. On the other hand, the whole network is split into two paths to learn the high-level semantic features separately. Moreover, a contextual feature for orientation prediction is extracted, which represents the bilateral cue of the foreground and background areas. The bilateral cue is then fused with the occlusion cue to precisely locate the object regions. Finally, a stripe convolution is designed to further aggregate features from surrounding scenes of the occlusion edge. The proposed OFNet remarkably advances the state-of-the-art approaches on PIOD and BSDS ownership dataset. The source code is available at https://github.com/buptlr/OFNet.

READ FULL TEXT

page 1

page 3

page 7

page 11

page 12

research
08/12/2021

MT-ORL: Multi-Task Occlusion Relationship Learning

Retrieving occlusion relation among objects in a single image is challen...
research
03/21/2019

Context-Constrained Accurate Contour Extraction for Occlusion Edge Detection

Occlusion edge detection requires both accurate locations and context co...
research
11/26/2019

DDNet: Dual-path Decoder Network for Occlusion Relationship Reasoning

Occlusion relationship reasoning based on convolution neural networks co...
research
12/02/2019

Patchy Image Structure Classification Using Multi-Orientation Region Transform

Exterior contour and interior structure are both vital features for clas...
research
07/23/2020

Pixel-Pair Occlusion Relationship Map(P2ORM): Formulation, Inference Application

We formalize concepts around geometric occlusion in 2D images (i.e., ign...
research
05/05/2023

Asynchronous Events-based Panoptic Segmentation using Graph Mixer Neural Network

In the context of robotic grasping, object segmentation encounters sever...
research
07/26/2021

Robotic Occlusion Reasoning for Efficient Object Existence Prediction

Reasoning about potential occlusions is essential for robots to efficien...

Please sign up or login with your details

Forgot password? Click here to reset