Rendering Natural Camera Bokeh Effect with Deep Learning

06/10/2020
by   Andrey Ignatov, et al.
51

Bokeh is an important artistic effect used to highlight the main object of interest on the photo by blurring all out-of-focus areas. While DSLR and system camera lenses can render this effect naturally, mobile cameras are unable to produce shallow depth-of-field photos due to a very small aperture diameter of their optics. Unlike the current solutions simulating bokeh by applying Gaussian blur to image background, in this paper we propose to learn a realistic shallow focus technique directly from the photos produced by DSLR cameras. For this, we present a large-scale bokeh dataset consisting of 5K shallow / wide depth-of-field image pairs captured using the Canon 7D DSLR with 50mm f/1.8 lenses. We use these images to train a deep learning model to reproduce a natural bokeh effect based on a single narrow-aperture image. The experimental results show that the proposed approach is able to render a plausible non-uniform bokeh even in case of complex input data with multiple objects. The dataset, pre-trained models and codes used in this paper are available on the project website.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 7

page 8

page 9

research
02/21/2023

Bokeh Rendering Based on Adaptive Depth Calibration Network

Bokeh rendering is a popular and effective technique used in photography...
research
02/13/2020

Replacing Mobile Camera ISP with a Single Deep Learning Model

As the popularity of mobile photography is growing constantly, lots of e...
research
06/11/2018

Synthetic Depth-of-Field with a Single-Camera Mobile Phone

Shallow depth-of-field is commonly used by photographers to isolate a su...
research
07/09/2022

Direct Handheld Burst Imaging to Simulated Defocus

A shallow depth-of-field image keeps the subject in focus, and the foreg...
research
11/10/2020

AIM 2020 Challenge on Rendering Realistic Bokeh

This paper reviews the second AIM realistic bokeh effect rendering chall...
research
05/28/2020

Depth-aware Blending of Smoothed Images for Bokeh Effect Generation

Bokeh effect is used in photography to capture images where the closer o...
research
11/04/2020

BGGAN: Bokeh-Glass Generative Adversarial Network for Rendering Realistic Bokeh

A photo captured with bokeh effect often means objects in focus are shar...

Please sign up or login with your details

Forgot password? Click here to reset