Learning Edge-Preserved Image Stitching from Large-Baseline Deep Homography

12/11/2020
by   Lang Nie, et al.
0

Image stitching is a classical and crucial technique in computer vision, which aims to generate the image with a wide field of view. The traditional methods heavily depend on the feature detection and require that scene features be dense and evenly distributed in the image, leading to varying ghosting effects and poor robustness. Learning methods usually suffer from fixed view and input size limitations, showing a lack of generalization ability on other real datasets. In this paper, we propose an image stitching learning framework, which consists of a large-baseline deep homography module and an edge-preserved deformation module. First, we propose a large-baseline deep homography module to estimate the accurate projective transformation between the reference image and the target image in different scales of features. After that, an edge-preserved deformation module is designed to learn the deformation rules of image stitching from edge to content, eliminating the ghosting effects as much as possible. In particular, the proposed learning framework can stitch images of arbitrary views and input sizes, thus contribute to a supervised deep image stitching method with excellent generalization capability in other real images. Experimental results demonstrate that our homography module significantly outperforms the existing deep homography methods in the large baseline scenes. In image stitching, our method is superior to the existing learning method and shows competitive performance with state-of-the-art traditional methods.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 6

page 8

page 9

page 10

research
06/24/2021

Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images

Traditional feature-based image stitching technologies rely heavily on f...
research
03/08/2022

Deep Rectangling for Image Stitching: A Learning Baseline

Stitched images provide a wide field-of-view (FoV) but suffer from unple...
research
07/06/2021

Depth-Aware Multi-Grid Deep Homography Estimation with Contextual Correlation

Homography estimation is an important task in computer vision, such as i...
research
05/11/2023

SparseGNV: Generating Novel Views of Indoor Scenes with Sparse Input Views

We study to generate novel views of indoor scenes given sparse input vie...
research
11/13/2022

SCOTCH and SODA: A Transformer Video Shadow Detection Framework

Shadows in videos are difficult to detect because of the large shadow de...
research
09/27/2022

View-aware Salient Object Detection for 360° Omnidirectional Image

Image-based salient object detection (ISOD) in 360 scenarios is signific...
research
01/04/2023

RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning

The wide-angle lens shows appealing applications in VR technologies, but...

Please sign up or login with your details

Forgot password? Click here to reset