Learning Residual Elastic Warps for Image Stitching under Dirichlet Boundary Condition

09/04/2023
by   Minsu Kim, et al.
0

Trendy suggestions for learning-based elastic warps enable the deep image stitchings to align images exposed to large parallax errors. Despite the remarkable alignments, the methods struggle with occasional holes or discontinuity between overlapping and non-overlapping regions of a target image as the applied training strategy mostly focuses on overlap region alignment. As a result, they require additional modules such as seam finder and image inpainting for hiding discontinuity and filling holes, respectively. In this work, we suggest Recurrent Elastic Warps (REwarp) that address the problem with Dirichlet boundary condition and boost performances by residual learning for recurrent misalign correction. Specifically, REwarp predicts a homography and a Thin-plate Spline (TPS) under the boundary constraint for discontinuity and hole-free image stitching. Our experiments show the favorable aligns and the competitive computational costs of REwarp compared to the existing stitching methods. Our source code is available at https://github.com/minshu-kim/REwarp.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 7

page 8

research
02/16/2023

Learning Thin-Plate Spline Motion and Seamless Composition for Parallax-Tolerant Unsupervised Deep Image Stitching

Traditional image stitching approaches tend to leverage increasingly com...
research
09/19/2023

Γ-convergence of Nonlocal Dirichlet Energies With Penalty Formulations of Dirichlet Boundary Data

We study nonlocal Dirichlet energies associated with a class of nonlocal...
research
09/04/2023

Implicit Neural Image Stitching With Enhanced and Blended Feature Reconstruction

Existing frameworks for image stitching often provide visually reasonabl...
research
08/09/2020

Recurrent Feature Reasoning for Image Inpainting

Existing inpainting methods have achieved promising performance for reco...
research
06/18/2021

A transformation-based approach for solving stiff two-point boundary value problems

A new approach for solving stiff boundary value problems for systems of ...
research
07/07/2022

ExpansionNet: exploring the sequence length bottleneck in the Transformer for Image Captioning

Most recent state of art architectures rely on combinations and variatio...
research
05/20/2023

Embracing Compact and Robust Architectures for Multi-Exposure Image Fusion

In recent years, deep learning-based methods have achieved remarkable pr...

Please sign up or login with your details

Forgot password? Click here to reset