Deep Implicit Volume Compression

05/18/2020
by   Danhang Tang, et al.
1

We describe a novel approach for compressing truncated signed distance fields (TSDF) stored in 3D voxel grids, and their corresponding textures. To compress the TSDF, our method relies on a block-based neural network architecture trained end-to-end, achieving state-of-the-art rate-distortion trade-off. To prevent topological errors, we losslessly compress the signs of the TSDF, which also upper bounds the reconstruction error by the voxel size. To compress the corresponding texture, we designed a fast block-based UV parameterization, generating coherent texture maps that can be effectively compressed using existing video compression algorithms. We demonstrate the performance of our algorithms on two 4D performance capture datasets, reducing bitrate by 66 the same distortion, or alternatively reducing the distortion by 50 same bitrate, compared to the state-of-the-art.

READ FULL TEXT

page 1

page 5

page 7

page 8

page 14

research
01/05/2022

Learning True Rate-Distortion-Optimization for End-To-End Image Compression

Even though rate-distortion optimization is a crucial part of traditiona...
research
02/01/2018

Variational image compression with a scale hyperprior

We describe an end-to-end trainable model for image compression based on...
research
12/08/2021

Implicit Neural Representations for Image Compression

Recently Implicit Neural Representations (INRs) gained attention as a no...
research
12/28/2022

Multi-Realism Image Compression with a Conditional Generator

By optimizing the rate-distortion-realism trade-off, generative compress...
research
07/01/2021

End-to-end Compression Towards Machine Vision: Network Architecture Design and Optimization

The visual signal compression is a long-standing problem. Fueled by the ...
research
05/26/2023

Random-Access Neural Compression of Material Textures

The continuous advancement of photorealism in rendering is accompanied b...
research
03/03/2022

Region-of-Interest Based Neural Video Compression

Humans do not perceive all parts of a scene with the same resolution, bu...

Please sign up or login with your details

Forgot password? Click here to reset