Learned Image Coding for Machines: A Content-Adaptive Approach

08/23/2021
by   Nam Le, et al.
8

Today, according to the Cisco Annual Internet Report (2018-2023), the fastest-growing category of Internet traffic is machine-to-machine communication. In particular, machine-to-machine communication of images and videos represents a new challenge and opens up new perspectives in the context of data compression. One possible solution approach consists of adapting current human-targeted image and video coding standards to the use case of machine consumption. Another approach consists of developing completely new compression paradigms and architectures for machine-to-machine communications. In this paper, we focus on image compression and present an inference-time content-adaptive finetuning scheme that optimizes the latent representation of an end-to-end learned image codec, aimed at improving the compression efficiency for machine-consumption. The conducted experiments show that our online finetuning brings an average bitrate saving (BD-rate) of -3.66 respect to our pretrained image codec. In particular, at low bitrate points, our proposed method results in a significant bitrate saving of -9.85 our pretrained-and-then-finetuned system achieves -30.54 state-of-the-art image/video codec Versatile Video Coding (VVC).

READ FULL TEXT
research
07/09/2022

Video Coding Using Learned Latent GAN Compression

We propose in this paper a new paradigm for facial video compression. We...
research
08/23/2021

Image coding for machines: an end-to-end learned approach

Over recent years, deep learning-based computer vision systems have been...
research
06/28/2023

Multi-Scale Deformable Alignment and Content-Adaptive Inference for Flexible-Rate Bi-Directional Video Compression

The lack of ability to adapt the motion compensation model to video cont...
research
02/27/2021

Transform Network Architectures for Deep Learning based End-to-End Image/Video Coding in Subsampled Color Spaces

Most of the existing deep learning based end-to-end image/video coding (...
research
04/18/2018

Video Compression through Image Interpolation

An ever increasing amount of our digital communication, media consumptio...
research
06/04/2019

Content Adaptive Optimization for Neural Image Compression

The field of neural image compression has witnessed exciting progress as...
research
08/13/2020

Towards Modality Transferable Visual Information Representation with Optimal Model Compression

Compactly representing the visual signals is of fundamental importance i...

Please sign up or login with your details

Forgot password? Click here to reset