WESPE: Weakly Supervised Photo Enhancer for Digital Cameras

09/04/2017
by   Andrey Ignatov, et al.
0

Low-end and compact mobile cameras demonstrate limited photo quality mainly due to space, hardware and budget constraints. In this work, we propose a deep learning solution that translates photos taken by cameras with limited capabilities into DSLR-quality photos automatically. We tackle this problem by introducing a weakly supervised photo enhancer (WESPE) - a novel image-to-image Generative Adversarial Network-based architecture. The proposed model is trained by weakly supervised learning: unlike previous works, there is no need for strong supervision in the form of a large annotated dataset of aligned original/enhanced photo pairs. The sole requirement is two distinct datasets: one from the source camera, and one composed of arbitrary high-quality images that can be generally crawled from the Internet - the visual content they exhibit may be unrelated. Hence, our solution is repeatable for any camera: collecting the data and training can be achieved in a couple of hours. Our experiments on the DPED, Kitti and Cityscapes datasets as well as pictures from several generations of smartphones demonstrate that WESPE produces comparable qualitative results with state-of-the-art strongly supervised methods, while not requiring the tedious work to obtain aligned datasets.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

research
02/11/2021

Deep Photo Scan: Semi-supervised learning for dealing with the real-world degradation in smartphone photo scanning

Physical photographs now can be conveniently scanned by smartphones and ...
research
04/08/2017

DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks

Despite a rapid rise in the quality of built-in smartphone cameras, thei...
research
12/30/2020

Towards Unsupervised Deep Image Enhancement with Generative Adversarial Network

Improving the aesthetic quality of images is challenging and eager for t...
research
04/11/2023

Point-and-Shoot All-in-Focus Photo Synthesis from Smartphone Camera Pair

All-in-Focus (AIF) photography is expected to be a commercial selling po...
research
12/31/2018

Fast Perceptual Image Enhancement

The vast majority of photos taken today are by mobile phones. While thei...
research
03/21/2018

Generative Adversarial Talking Head: Bringing Portraits to Life with a Weakly Supervised Neural Network

This paper presents Generative Adversarial Talking Head (GATH), a novel ...
research
11/26/2018

Art2Real: Unfolding the Reality of Artworks via Semantically-Aware Image-to-Image Translation

The applicability of computer vision to real paintings and artworks has ...

Please sign up or login with your details

Forgot password? Click here to reset