Personal Fixations-Based Object Segmentation with Object Localization and Boundary Preservation

by   Gongyang Li, et al.

As a natural way for human-computer interaction, fixation provides a promising solution for interactive image segmentation. In this paper, we focus on Personal Fixations-based Object Segmentation (PFOS) to address issues in previous studies, such as the lack of appropriate dataset and the ambiguity in fixations-based interaction. In particular, we first construct a new PFOS dataset by carefully collecting pixel-level binary annotation data over an existing fixation prediction dataset, such dataset is expected to greatly facilitate the study along the line. Then, considering characteristics of personal fixations, we propose a novel network based on Object Localization and Boundary Preservation (OLBP) to segment the gazed objects. Specifically, the OLBP network utilizes an Object Localization Module (OLM) to analyze personal fixations and locates the gazed objects based on the interpretation. Then, a Boundary Preservation Module (BPM) is designed to introduce additional boundary information to guard the completeness of the gazed objects. Moreover, OLBP is organized in the mixed bottom-up and top-down manner with multiple types of deep supervision. Extensive experiments on the constructed PFOS dataset show the superiority of the proposed OLBP network over 17 state-of-the-art methods, and demonstrate the effectiveness of the proposed OLM and BPM components. The constructed PFOS dataset and the proposed OLBP network are available at



page 1

page 4

page 5

page 6

page 9

page 10

page 11

page 12


Enhanced Boundary Learning for Glass-like Object Segmentation

Glass-like objects such as windows, bottles, and mirrors exist widely in...

RDSNet: A New Deep Architecture for Reciprocal Object Detection and Instance Segmentation

Object detection and instance segmentation are two fundamental computer ...

Unsupervised Object Segmentation with Explicit Localization Module

In this paper, we propose a novel architecture that iteratively discover...

Unified Interactive Image Matting

Recent image matting studies are developing towards proposing trimap-fre...

Anabranch Network for Camouflaged Object Segmentation

Camouflaged objects attempt to conceal their texture into the background...

Localized Interactive Instance Segmentation

In current interactive instance segmentation works, the user is granted ...

Where is my Phone ? Personal Object Retrieval from Egocentric Images

This work presents a retrieval pipeline and evaluation scheme for the pr...

Code Repositories


[TIP2021] Personal Fixations-Based Object Segmentation with Object Localization and Boundary Preservation

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.