A Deep Ordinal Distortion Estimation Approach for Distortion Rectification

07/21/2020
by   Kang Liao, et al.
0

Distortion is widely existed in the images captured by popular wide-angle cameras and fisheye cameras. Despite the long history of distortion rectification, accurately estimating the distortion parameters from a single distorted image is still challenging. The main reason is these parameters are implicit to image features, influencing the networks to fully learn the distortion information. In this work, we propose a novel distortion rectification approach that can obtain more accurate parameters with higher efficiency. Our key insight is that distortion rectification can be cast as a problem of learning an ordinal distortion from a single distorted image. To solve this problem, we design a local-global associated estimation network that learns the ordinal distortion to approximate the realistic distortion distribution. In contrast to the implicit distortion parameters, the proposed ordinal distortion have more explicit relationship with image features, and thus significantly boosts the distortion perception of neural networks. Considering the redundancy of distortion information, our approach only uses a part of distorted image for the ordinal distortion estimation, showing promising applications in the efficient distortion rectification. To our knowledge, we first unify the heterogeneous distortion parameters into a learning-friendly intermediate representation through ordinal distortion, bridging the gap between image feature and distortion rectification. The experimental results demonstrate that our approach outperforms the state-of-the-art methods by a significant margin, with approximately 23 improvement on the quantitative evaluation while displaying the best performance on visual appearance.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 9

page 10

page 11

research
05/28/2018

Image Distortion Detection using Convolutional Neural Network

Image distortion classification and detection is an important task in ma...
research
04/22/2019

Learning to Calibrate Straight Lines for Fisheye Image Rectification

This paper presents a new deep-learning based method to simultaneously c...
research
07/31/2019

Video Stitching for Linear Camera Arrays

Despite the long history of image and video stitching research, existing...
research
07/05/2022

FishFormer: Annulus Slicing-based Transformer for Fisheye Rectification with Efficacy Domain Exploration

Numerous significant progress on fisheye image rectification has been ac...
research
11/30/2018

Hybrid Distortion Aggregated Visual Comfort Assessment for Stereoscopic Image Retargeting

Visual comfort is a quite important factor in 3D media service. Few rese...
research
01/07/2022

Auto-Weighted Layer Representation Based View Synthesis Distortion Estimation for 3-D Video Coding

Recently, various view synthesis distortion estimation models have been ...
research
01/27/2017

Quasi-homography warps in image stitching

Naturalness of warping is gaining extensive attention in image stitching...

Please sign up or login with your details

Forgot password? Click here to reset