Perception-based energy functions in seam-cutting

01/22/2017
by   Nan Li, et al.
0

Image stitching is challenging in consumer-level photography, due to alignment difficulties in unconstrained shooting environment. Recent studies show that seam-cutting approaches can effectively relieve artifacts generated by local misalignment. Normally, seam-cutting is described in terms of energy minimization, however, few of existing methods consider human perception in their energy functions, which sometimes causes that a seam with minimum energy is not most invisible in the overlapping region. In this paper, we propose a novel perception-based energy function in the seam-cutting framework, which considers the nonlinearity and the nonuniformity of human perception in energy minimization. Our perception-based approach adopts a sigmoid metric to characterize the perception of color discrimination, and a saliency weight to simulate that human eyes incline to pay more attention to salient objects. In addition, our seam-cutting composition can be easily implemented into other stitching pipelines. Experiments show that our method outperforms the seam-cutting method of the normal energy function, and a user study demonstrates that our composed results are more consistent with human perception.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2018

Coarse-to-fine Seam Estimation for Image Stitching

Seam-cutting and seam-driven techniques have been proven effective for h...
research
03/12/2020

A Polyhedral Approach to Bisubmodular Function Minimization

We consider minimization problems with bisubmodular objective functions....
research
03/04/2019

Optimizing Object-based Perception and Control by Free-Energy Principle

One of the well-known formulations of human perception is a hierarchical...
research
04/07/2020

Cutting cycles of rods in space is FPT

In this short note, we show that cutting cycles of rods is fixed-paramet...
research
04/20/2022

Situational Perception Guided Image Matting

Most automatic matting methods try to separate the salient foreground fr...
research
08/09/2022

An Integrated Actuation-Perception Framework for Robotic Leaf Retrieval: Detection, Localization, and Cutting

Contemporary robots in precision agriculture focus primarily on automate...
research
03/04/2021

Point Cloud Distortion Quantification based on Potential Energy for Human and Machine Perception

Distortion quantification of point clouds plays a stealth, yet vital rol...

Please sign up or login with your details

Forgot password? Click here to reset