Coding of 3D Videos Based on Visual Discomfort

11/21/2018
by   Dogancan Temel, et al.
0

We propose a rate-distortion optimization method for 3D videos based on visual discomfort estimation. We calculate visual discomfort in the encoded depth maps using two indexes: temporal outliers (TO) and spatial outliers (SO). These two indexes are used to measure the difference between the processed depth map and the ground truth depth map. These indexes implicitly depend on the amount of edge information within a frame and on the amount of motion between frames. Moreover, we fuse these indexes considering the temporal and spatial complexities of the content. We test the proposed method on a number of videos and compare the results with the default rate-distortion algorithms in the H.264/AVC codec. We evaluate rate-distortion algorithms by comparing achieved bit-rates, visual degradations in the depth sequences and the fidelity of the depth videos measured by SSIM and PSNR.

READ FULL TEXT
research
04/21/2021

Visual Analysis Motivated Rate-Distortion Model for Image Coding

Optimized for pixel fidelity metrics, images compressed by existing imag...
research
01/08/2018

Depth Sequence Coding with Hierarchical Partitioning and Spatial-domain Quantisation

Depth coding in 3D-HEVC for the multiview video plus depth (MVD) archite...
research
02/13/2023

Content-Adaptive Motion Rate Adaption for Learned Video Compression

This paper introduces an online motion rate adaptation scheme for learne...
research
06/30/2021

Extraction of Key-frames of Endoscopic Videos by using Depth Information

A deep learning-based monocular depth estimation (MDE) technique is prop...
research
05/08/2018

Optimization of Occlusion-Inducing Depth Pixels in 3-D Video Coding

The optimization of occlusion-inducing depth pixels in depth map coding ...
research
11/21/2018

Effectiveness of 3VQM in Capturing Depth Inconsistencies

The 3D video quality metric (3VQM) was proposed to evaluate the temporal...
research
09/12/2016

Examining Representational Similarity in ConvNets and the Primate Visual Cortex

We compare several ConvNets with different depth and regularization tech...

Please sign up or login with your details

Forgot password? Click here to reset