Rate-Distortion Theory in Coding for Machines and its Application

05/26/2023
by   Alon Harell, et al.
0

Recent years have seen a tremendous growth in both the capability and popularity of automatic machine analysis of images and video. As a result, a growing need for efficient compression methods optimized for machine vision, rather than human vision, has emerged. To meet this growing demand, several methods have been developed for image and video coding for machines. Unfortunately, while there is a substantial body of knowledge regarding rate-distortion theory for human vision, the same cannot be said of machine analysis. In this paper, we extend the current rate-distortion theory for machines, providing insight into important design considerations of machine-vision codecs. We then utilize this newfound understanding to improve several methods for learnable image coding for machines. Our proposed methods achieve state-of-the-art rate-distortion performance on several computer vision tasks such as classification, instance segmentation, and object detection.

READ FULL TEXT

page 2

page 9

page 18

page 19

page 20

page 21

page 22

page 24

research
08/23/2021

Image coding for machines: an end-to-end learned approach

Over recent years, deep learning-based computer vision systems have been...
research
09/21/2022

Rate-Distortion in Image Coding for Machines

In recent years, there has been a sharp increase in transmission of imag...
research
05/04/2023

Conditional and Residual Methods in Scalable Coding for Humans and Machines

We present methods for conditional and residual coding in the context of...
research
05/17/2023

VVC+M: Plug and Play Scalable Image Coding for Humans and Machines

Compression for machines is an emerging field, where inputs are encoded ...
research
07/05/2023

Base Layer Efficiency in Scalable Human-Machine Coding

A basic premise in scalable human-machine coding is that the base layer ...
research
11/03/2021

Learned Image Compression for Machine Perception

Recent work has shown that learned image compression strategies can outp...

Please sign up or login with your details

Forgot password? Click here to reset