Wassersplines for Stylized Neural Animation

01/28/2022
by   Paul Zhang, et al.
0

Much of computer-generated animation is created by manipulating meshes with rigs. While this approach works well for animating articulated objects like animals, it has limited flexibility for animating less structured creatures such as the Drunn in "Raya and the Last Dragon." We introduce Wassersplines, a novel trajectory inference method for animating unstructured densities based on recent advances in continuous normalizing flows and optimal transport. The key idea is to train a neurally-parameterized velocity field that represents the motion between keyframes. Trajectories are then computed by pushing keyframes through the velocity field. We solve an additional Wasserstein barycenter interpolation problem to guarantee strict adherence to keyframes. Our tool can stylize trajectories through a variety of PDE-based regularizers to create different visual effects. We demonstrate our tool on various keyframe interpolation problems to produce temporally-coherent animations without meshing or rigging.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
03/24/2023

Optimal transport and Wasserstein distances for causal models

In this paper we introduce a variant of optimal transport adapted to the...
research
01/18/2023

Learning Deformation Trajectories of Boltzmann Densities

We introduce a training objective for continuous normalizing flows that ...
research
05/16/2022

A scalable deep learning approach for solving high-dimensional dynamic optimal transport

The dynamic formulation of optimal transport has attracted growing inter...
research
08/02/2022

Multiview Regenerative Morphing with Dual Flows

This paper aims to address a new task of image morphing under a multivie...
research
10/22/2020

Fast and Smooth Interpolation on Wasserstein Space

We propose a new method for smoothly interpolating probability measures ...
research
01/06/2021

Fairness with Continuous Optimal Transport

Whilst optimal transport (OT) is increasingly being recognized as a powe...

Please sign up or login with your details

Forgot password? Click here to reset