DeepAI AI Chat
Log In Sign Up

Real-time Image Enhancer via Learnable Spatial-aware 3D Lookup Tables

by   PetsTime, et al.
HUAWEI Technologies Co., Ltd.

Recently, deep learning-based image enhancement algorithms achieved state-of-the-art (SOTA) performance on several publicly available datasets. However, most existing methods fail to meet practical requirements either for visual perception or for computation efficiency, especially for high-resolution images. In this paper, we propose a novel real-time image enhancer via learnable spatial-aware 3-dimentional lookup tables(3D LUTs), which well considers global scenario and local spatial information. Specifically, we introduce a light weight two-head weight predictor that has two outputs. One is a 1D weight vector used for image-level scenario adaptation, the other is a 3D weight map aimed for pixel-wise category fusion. We learn the spatial-aware 3D LUTs and fuse them according to the aforementioned weights in an end-to-end manner. The fused LUT is then used to transform the source image into the target tone in an efficient way. Extensive results show that our model outperforms SOTA image enhancement methods on public datasets both subjectively and objectively, and that our model only takes about 4ms to process a 4K resolution image on one NVIDIA V100 GPU.


page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 9


Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-time

Recent years have witnessed the increasing popularity of learning based ...

StarEnhancer: Learning Real-Time and Style-Aware Image Enhancement

Image enhancement is a subjective process whose targets vary with user p...

Real-time Local Feature with Global Visual Information Enhancement

Local feature provides compact and invariant image representation for va...

KBNet: Kernel Basis Network for Image Restoration

How to aggregate spatial information plays an essential role in learning...

Content-aware Warping for View Synthesis

Existing image-based rendering methods usually adopt depth-based image w...

Wider and Higher: Intensive Integration and Global Foreground Perception for Image Matting

This paper reviews recent deep-learning-based matting research and conce...

Generative Adversarial Shaders for Real-Time Realism Enhancement

Application of realism enhancement methods, particularly in real-time an...