Learning a perceptual manifold with deep features for animation video resequencing

11/02/2021
by   Charles C. Morace, et al.
0

We propose a novel deep learning framework for animation video resequencing. Our system produces new video sequences by minimizing a perceptual distance of images from an existing animation video clip. To measure perceptual distance, we utilize the activations of convolutional neural networks and learn a perceptual distance by training these features on a small network with data comprised of human perceptual judgments. We show that with this perceptual metric and graph-based manifold learning techniques, our framework can produce new smooth and visually appealing animation video results for a variety of animation video styles. In contrast to previous work on animation video resequencing, the proposed framework applies to wide range of image styles and does not require hand-crafted feature extraction, background subtraction, or feature correspondence. In addition, we also show that our framework has applications to appealing arrange unordered collections of images.

READ FULL TEXT

page 7

page 9

page 11

page 13

page 14

research
08/26/2021

State of the Art: Image Hashing

Perceptual image hashing methods are often applied in various objectives...
research
12/13/2019

Music-oriented Dance Video Synthesis with Pose Perceptual Loss

We present a learning-based approach with pose perceptual loss for autom...
research
11/27/2018

Automatic Image Stylization Using Deep Fully Convolutional Networks

Color and tone stylization strives to enhance unique themes with artisti...
research
09/12/2015

Good Colour Maps: How to Design Them

Many colour maps provided by vendors have highly uneven perceptual contr...
research
05/28/2020

Augmenting reality: On the shared history of perceptual illusion and video projection mapping

Perceptual illusions based on the spatial correspondence between objects...
research
11/20/2020

Perceptual Evaluation of Liquid Simulation Methods

This paper proposes a novel framework to evaluate fluid simulation metho...
research
12/18/2017

Graphic Narrative with Interactive Stylization Design

We present a system to convert any set of images (e.g., a video clip or ...

Please sign up or login with your details

Forgot password? Click here to reset