Practical Wide-Angle Portraits Correction with Deep Structured Models

04/26/2021
by   Shan Zhao, et al.
19

Wide-angle portraits often enjoy expanded views. However, they contain perspective distortions, especially noticeable when capturing group portrait photos, where the background is skewed and faces are stretched. This paper introduces the first deep learning based approach to remove such artifacts from freely-shot photos. Specifically, given a wide-angle portrait as input, we build a cascaded network consisting of a LineNet, a ShapeNet, and a transition module (TM), which corrects perspective distortions on the background, adapts to the stereographic projection on facial regions, and achieves smooth transitions between these two projections, accordingly. To train our network, we build the first perspective portrait dataset with a large diversity in identities, scenes and camera modules. For the quantitative evaluation, we introduce two novel metrics, line consistency and face congruence. Compared to the previous state-of-the-art approach, our method does not require camera distortion parameters. We demonstrate that our approach significantly outperforms the previous state-of-the-art approach both qualitatively and quantitatively.

READ FULL TEXT

page 1

page 5

page 6

page 8

research
05/18/2019

Learning Perspective Undistortion of Portraits

Near-range portrait photographs often contain perspective distortion art...
research
09/14/2021

Semi-Supervised Wide-Angle Portraits Correction by Multi-Scale Transformer

We propose a semi-supervised network for wide-angle portraits correction...
research
02/23/2023

DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANs

Close-up facial images captured at close distances often suffer from per...
research
07/27/2019

Reprojection R-CNN: A Fast and Accurate Object Detector for 360° Images

360 images are usually represented in either equirectangular projection ...
research
08/15/2023

Improved mirror ball projection for more accurate merging of multiple camera outputs and process monitoring

Using spherical mirrors in place of wide-angle cameras allows for cost-e...
research
10/08/2020

Temporally-smooth Antialiasing and Lens Distortion with Rasterization Map

Current GPU rasterization procedure is limited to narrow views in rectil...
research
09/22/2017

Happy Travelers Take Big Pictures: A Psychological Study with Machine Learning and Big Data

In psychology, theory-driven researches are usually conducted with exten...

Please sign up or login with your details

Forgot password? Click here to reset