AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies

11/10/2022
by   Li Siyao, et al.
0

Existing correspondence datasets for two-dimensional (2D) cartoon suffer from simple frame composition and monotonic movements, making them insufficient to simulate real animations. In this work, we present a new 2D animation visual correspondence dataset, AnimeRun, by converting open source three-dimensional (3D) movies to full scenes in 2D style, including simultaneous moving background and interactions of multiple subjects. Our analyses show that the proposed dataset not only resembles real anime more in image composition, but also possesses richer and more complex motion patterns compared to existing datasets. With this dataset, we establish a comprehensive benchmark by evaluating several existing optical flow and segment matching methods, and analyze shortcomings of these methods on animation data. Data, code and other supplementary materials are available at https://lisiyao21.github.io/projects/AnimeRun.

READ FULL TEXT

page 1

page 2

page 6

page 8

page 9

page 10

research
07/19/2022

ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wild

Estimating the pose of a moving camera from monocular video is a challen...
research
04/29/2020

VGGSound: A Large-scale Audio-Visual Dataset

Our goal is to collect a large-scale audio-visual dataset with low label...
research
03/08/2018

Multi-Hypothesis Visual-Inertial Flow

Estimating the correspondences between pixels in sequences of images is ...
research
09/26/2019

The Stroke Correspondence Problem, Revisited

We revisit the stroke correspondence problem [13,14]. We optimize this a...
research
12/27/2022

Infusing Definiteness into Randomness: Rethinking Composition Styles for Deep Image Matting

We study the composition style in deep image matting, a notion that char...
research
03/27/2023

3D Video Object Detection with Learnable Object-Centric Global Optimization

We explore long-term temporal visual correspondence-based optimization f...

Please sign up or login with your details

Forgot password? Click here to reset