Sky Optimization: Semantically aware image processing of skies in low-light photography

06/15/2020
by   Orly Liba, et al.
0

The sky is a major component of the appearance of a photograph, and its color and tone can strongly influence the mood of a picture. In nighttime photography, the sky can also suffer from noise and color artifacts. For this reason, there is a strong desire to process the sky in isolation from the rest of the scene to achieve an optimal look. In this work, we propose an automated method, which can run as a part of a camera pipeline, for creating accurate sky alpha-masks and using them to improve the appearance of the sky. Our method performs end-to-end sky optimization in less than half a second per image on a mobile device. We introduce a method for creating an accurate sky-mask dataset that is based on partially annotated images that are inpainted and refined by our modified weighted guided filter. We use this dataset to train a neural network for semantic sky segmentation. Due to the compute and power constraints of mobile devices, sky segmentation is performed at a low image resolution. Our modified weighted guided filter is used for edge-aware upsampling to resize the alpha-mask to a higher resolution. With this detailed mask we automatically apply post-processing steps to the sky in isolation, such as automatic spatially varying white-balance, brightness adjustments, contrast enhancement, and noise reduction.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

page 12

page 13

page 14

research
05/16/2019

Inductive Guided Filter: Real-time Deep Image Matting with Weakly Annotated Masks on Mobile Devices

Recently, significant progress has been achieved in deep image matting. ...
research
02/13/2021

Fast, Accurate Barcode Detection in Ultra High-Resolution Images

Object detection in Ultra High-Resolution (UHR) images has long been a c...
research
05/10/2023

Low-Light Image Enhancement via Structure Modeling and Guidance

This paper proposes a new framework for low-light image enhancement by s...
research
04/14/2023

Learning Semantic-Aware Knowledge Guidance for Low-Light Image Enhancement

Low-light image enhancement (LLIE) investigates how to improve illuminat...
research
12/15/2022

Text-guided mask-free local image retouching

In the realm of multi-modality, text-guided image retouching techniques ...
research
10/28/2022

Adaptive Mask-based Pyramid Network for Realistic Bokeh Rendering

Bokeh effect highlights an object (or any part of the image) while blurr...
research
06/26/2017

Image Processing in Floriculture Using a robotic Mobile Platform

Colombia has a privileged geographical location which makes it a corners...

Please sign up or login with your details

Forgot password? Click here to reset