Image Restoration for Under-Display Camera

03/10/2020
by   Yuqian Zhou, et al.
0

The new trend of full-screen devices encourages us to position a camera behind a screen. Removing the bezel and centralizing the camera under the screen brings larger display-to-body ratio and enhances eye contact in video chat, but also causes image degradation. In this paper, we focus on a newly-defined Under-Display Camera (UDC), as a novel real-world single image restoration problem. First, we take a 4k Transparent OLED (T-OLED) and a phone Pentile OLED (P-OLED) and analyze their optical systems to understand the degradation. Second, we design a novel Monitor-Camera Imaging System (MCIS) for easier real pair data acquisition, and a model-based data synthesizing pipeline to generate UDC data only from display pattern and camera measurements. Finally, we resolve the complicated degradation using learning-based methods. Our model demonstrates a real-time high-quality restoration trained with either real or synthetic data. The presented results and methods provide good practice to apply image restoration to real-world applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 10

page 15

page 16

08/18/2020

UDC 2020 Challenge on Image Restoration of Under-Display Camera: Methods and Results

This paper is the report of the first Under-Display Camera (UDC) image r...
04/19/2021

Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Network

Recent development of Under-Display Camera (UDC) systems provides a true...
11/02/2021

ISP-Agnostic Image Reconstruction for Under-Display Cameras

Under-display cameras have been proposed in recent years as a way to red...
09/23/2022

Modular Degradation Simulation and Restoration for Under-Display Camera

Under-display camera (UDC) provides an elegant solution for full-screen ...
02/13/2022

Zero-Reference Image Restoration for Under-Display Camera of UAV

The exposed cameras of UAV can shake, shift, or even malfunction under t...
09/20/2020

Transform Domain Pyramidal Dilated Convolution Networks For Restoration of Under Display Camera Images

Under-display camera (UDC) is a novel technology that can make digital i...
11/21/2017

Optimized Pre-Compensating Compression

In imaging systems, following acquisition, an image/video is transmitted...