Contour-guided Image Completion with Perceptual Grouping

11/22/2021
by   Morteza Rezanejad, et al.
5

Humans are excellent at perceiving illusory outlines. We are readily able to complete contours, shapes, scenes, and even unseen objects when provided with images that contain broken fragments of a connected appearance. In vision science, this ability is largely explained by perceptual grouping: a foundational set of processes in human vision that describes how separated elements can be grouped. In this paper, we revisit an algorithm called Stochastic Completion Fields (SCFs) that mechanizes a set of such processes – good continuity, closure, and proximity – through contour completion. This paper implements a modernized model of the SCF algorithm, and uses it in an image editing framework where we propose novel methods to complete fragmented contours. We show how the SCF algorithm plausibly mimics results in human perception. We use the SCF completed contours as guides for inpainting, and show that our guides improve the performance of state-of-the-art models. Additionally, we show that the SCF aids in finding edges in high-noise environments. Overall, our described algorithms resemble an important mechanism in the human visual system, and offer a novel framework that modern computer vision models can benefit from.

READ FULL TEXT

page 2

page 6

page 8

page 10

research
04/27/2023

Contour Completion by Transformers and Its Application to Vector Font Data

In documents and graphics, contours are a popular format to describe spe...
research
06/21/2020

Learning compact generalizable neural representations supporting perceptual grouping

Work at the intersection of vision science and deep learning is starting...
research
03/25/2020

Deep Grouping Model for Unified Perceptual Parsing

The perceptual-based grouping process produces a hierarchical and compos...
research
08/05/2018

Principles of perceptual grouping: implications for image-guided surgery

Gestalt theory has provided perceptual science with a conceptual framewo...
research
06/15/2022

Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images

Graphical User Interface (GUI) is not merely a collection of individual ...
research
02/09/2023

Contour Completion using Deep Structural Priors

Humans can easily perceive illusory contours and complete missing forms ...
research
08/16/2012

Contour Completion Around a Fixation Point

The paper presents two edge grouping algorithms for finding a closed con...

Please sign up or login with your details

Forgot password? Click here to reset