HVS-Inspired Signal Degradation Network for Just Noticeable Difference Estimation

08/16/2022
by   Jian Jin, et al.
6

Significant improvement has been made on just noticeable difference (JND) modelling due to the development of deep neural networks, especially for the recently developed unsupervised-JND generation models. However, they have a major drawback that the generated JND is assessed in the real-world signal domain instead of in the perceptual domain in the human brain. There is an obvious difference when JND is assessed in such two domains since the visual signal in the real world is encoded before it is delivered into the brain with the human visual system (HVS). Hence, we propose an HVS-inspired signal degradation network for JND estimation. To achieve this, we carefully analyze the HVS perceptual process in JND subjective viewing to obtain relevant insights, and then design an HVS-inspired signal degradation (HVS-SD) network to represent the signal degradation in the HVS. On the one hand, the well learnt HVS-SD enables us to assess the JND in the perceptual domain. On the other hand, it provides more accurate prior information for better guiding JND generation. Additionally, considering the requirement that reasonable JND should not lead to visual attention shifting, a visual attention loss is proposed to control JND generation. Experimental results demonstrate that the proposed method achieves the SOTA performance for accurately estimating the redundancy of the HVS. Source code will be available at https://github.com/jianjin008/HVS-SD-JND.

READ FULL TEXT

page 1

page 2

page 5

page 7

page 8

page 9

research
04/01/2021

Unsupervised Degradation Representation Learning for Blind Super-Resolution

Most existing CNN-based super-resolution (SR) methods are developed base...
research
07/30/2021

Brain-Inspired Deep Imitation Learning for Autonomous Driving Systems

Autonomous driving has attracted great attention from both academics and...
research
08/30/2019

Domain Intersection and Domain Difference

We present a method for recovering the shared content between two visual...
research
10/16/2019

CFEA: Collaborative Feature Ensembling Adaptation for Domain Adaptation in Unsupervised Optic Disc and Cup Segmentation

Recently, deep neural networks have demonstrated comparable and even bet...
research
07/20/2023

Physics-Driven Turbulence Image Restoration with Stochastic Refinement

Image distortion by atmospheric turbulence is a stochastic degradation, ...
research
03/01/2022

Full RGB Just Noticeable Difference (JND) Modelling

Just Noticeable Difference (JND) has many applications in multimedia sig...
research
08/11/2021

Towards Top-Down Just Noticeable Difference Estimation of Natural Images

Existing efforts on Just noticeable difference (JND) estimation mainly d...

Please sign up or login with your details

Forgot password? Click here to reset