Exploiting Richness of Learned Compressed Representation of Images for Semantic Segmentation

07/04/2023
by   Ravi Kakaiya, et al.
0

Autonomous vehicles and Advanced Driving Assistance Systems (ADAS) have the potential to radically change the way we travel. Many such vehicles currently rely on segmentation and object detection algorithms to detect and track objects around its surrounding. The data collected from the vehicles are often sent to cloud servers to facilitate continual/life-long learning of these algorithms. Considering the bandwidth constraints, the data is compressed before sending it to servers, where it is typically decompressed for training and analysis. In this work, we propose the use of a learning-based compression Codec to reduce the overhead in latency incurred for the decompression operation in the standard pipeline. We demonstrate that the learned compressed representation can also be used to perform tasks like semantic segmentation in addition to decompression to obtain the images. We experimentally validate the proposed pipeline on the Cityscapes dataset, where we achieve a compression factor up to 66 × while preserving the information required to perform segmentation with a dice coefficient of 0.84 as compared to 0.88 achieved using decompressed images while reducing the overall compute by 11%.

READ FULL TEXT

page 1

page 2

page 4

research
04/10/2023

Are Visual Recognition Models Robust to Image Compression?

Reducing the data footprint of visual content via image compression is e...
research
09/03/2022

Semantic Segmentation in Learned Compressed Domain

Most machine vision tasks (e.g., semantic segmentation) are based on ima...
research
07/12/2022

A Near Sensor Edge Computing System for Point Cloud Semantic Segmentation

Point cloud semantic segmentation has attracted attentions due to its ro...
research
05/06/2019

Simultaneous Object Detection and Semantic Segmentation

Both object detection in and semantic segmentation of camera images are ...
research
04/22/2020

Distributed Learning and Inference with Compressed Images

Modern computer vision requires processing large amounts of data, both w...
research
01/10/2023

Towards High-Definition Maps: a Framework Leveraging Semantic Segmentation to Improve NDT Map Compression and Descriptivity

High-Definition (HD) maps are needed for robust navigation of autonomous...
research
07/26/2019

A Comparative Study of High-Recall Real-Time Semantic Segmentation Based on Swift Factorized Network

Semantic Segmentation (SS) is the task to assign a semantic label to eac...

Please sign up or login with your details

Forgot password? Click here to reset