Panoptic Lintention Network: Towards Efficient Navigational Perception for the Visually Impaired

03/06/2021
by   Wei Mao, et al.
0

Classic computer vision algorithms, instance segmentation, and semantic segmentation can not provide a holistic understanding of the surroundings for the visually impaired. In this paper, we utilize panoptic segmentation to assist the navigation of visually impaired people by offering both things and stuff awareness in the proximity of the visually impaired efficiently. To this end, we propose an efficient Attention module – Lintention which can model long-range interactions in linear time using linear space. Based on Lintention, we then devise a novel panoptic segmentation model which we term Panoptic Lintention Net. Experiments on the COCO dataset indicate that the Panoptic Lintention Net raises the Panoptic Quality (PQ) from 39.39 to 41.42 with 4.6% performance gain while only requiring 10% fewer GFLOPs and 25% fewer parameters in the semantic branch. Furthermore, a real-world test via our designed compact wearable panoptic segmentation system, indicates that our system based on the Panoptic Lintention Net accomplishes a relatively stable and exceptionally remarkable panoptic segmentation in real-world scenes.

READ FULL TEXT

page 1

page 4

page 6

research
07/20/2020

Can we cover navigational perception needs of the visually impaired by panoptic segmentation?

Navigational perception for visually impaired people has been substantia...
research
03/06/2021

Perception Framework through Real-Time Semantic Segmentation and Scene Recognition on a Wearable System for the Visually Impaired

As the scene information, including objectness and scene type, are impor...
research
03/23/2020

EPSNet: Efficient Panoptic Segmentation Network with Cross-layer Attention Fusion

Panoptic segmentation is a scene parsing task which unifies semantic seg...
research
09/03/2020

SCG-Net: Self-Constructing Graph Neural Networks for Semantic Segmentation

Capturing global contextual representations by exploiting long-range pix...
research
05/22/2019

Spatial Sampling Network for Fast Scene Understanding

We propose a network architecture to perform efficient scene understandi...
research
07/07/2021

Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real World

Common fully glazed facades and transparent objects present architectura...

Please sign up or login with your details

Forgot password? Click here to reset