CEN-HDR: Computationally Efficient neural Network for real-time High Dynamic Range imaging

02/10/2023
by   Steven Tel, et al.
0

High dynamic range (HDR) imaging is still a challenging task in modern digital photography. Recent research proposes solutions that provide high-quality acquisition but at the cost of a very large number of operations and a slow inference time that prevent the implementation of these solutions on lightweight real-time systems. In this paper, we propose CEN-HDR, a new computationally efficient neural network by providing a novel architecture based on a light attention mechanism and sub-pixel convolution operations for real-time HDR imaging. We also provide an efficient training scheme by applying network compression using knowledge distillation. We performed extensive qualitative and quantitative comparisons to show that our approach produces competitive results in image quality while being faster than state-of-the-art solutions, allowing it to be practically deployed under real-time constraints. Experimental results show our method obtains a score of 43.04 mu-PSNR on the Kalantari2017 dataset with a framerate of 33 FPS using a Macbook M1 NPU.

READ FULL TEXT

page 9

page 14

research
06/16/2022

FWD: Real-time Novel View Synthesis with Forward Warping and Depth

Novel view synthesis (NVS) is a challenging task requiring systems to ge...
research
12/17/2021

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition

The great success of deep learning is mainly due to the large-scale netw...
research
11/29/2022

Real-time Blind Deblurring Based on Lightweight Deep-Wiener-Network

In this paper, we address the problem of blind deblurring with high effi...
research
01/31/2018

Fast and Accurate Reconstruction of Compressed Color Light Field

Light field photography has been studied thoroughly in recent years. One...
research
04/15/2020

Real-time sparse-sampled Ptychographic imaging through deep neural networks

Ptychography has rapidly grown in the fields of X-ray and electron imagi...
research
05/24/2023

Generative Adversarial Shaders for Real-Time Realism Enhancement

Application of realism enhancement methods, particularly in real-time an...
research
11/18/2021

A Modular 1D-CNN Architecture for Real-time Digital Pre-distortion

This study reports a novel hardware-friendly modular architecture for im...

Please sign up or login with your details

Forgot password? Click here to reset