Pre-computed Liquid Spaces with Generative Neural Networks and Optical Flow

04/25/2017
by   Lukas Prantl, et al.
0

Liquids exhibit highly complex, non-linear behavior under changing simulation conditions such as user interactions. We propose a method to map this complex behavior over a parameter range onto a reduced representation based on space-time deformations. In order to represent the complexity of the full space of inputs, we use deformations from optical flow solves with an improved alignment procedure, and we leverage the power of generative neural networks to synthesize additional deformations for refinement. We introduce a novel deformation-aware loss function, which enables optimization in the highly non-linear space of multiple deformations. To demonstrate the effectiveness of our approach, we showcase the method with several complex examples in two and four dimensions. Our representation makes it possible to rapidly generate implicit surfaces of liquids, which allows us to very efficiently display the scene from any angle, and to add secondary effects such as splash and foam particles. We have implemented a mobile application with our full pipeline to demonstrate that real-time interactions with complex liquid effects are possible with our approach. Our app yields effective speed-ups of several orders of magnitude compared to a regular simulation.

READ FULL TEXT

page 1

page 2

page 7

page 9

page 11

page 12

page 13

page 14

research
04/14/2023

Neuromorphic Optical Flow and Real-time Implementation with Event Cameras

Optical flow provides information on relative motion that is an importan...
research
12/15/2020

FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolation

A majority of approaches solve the problem of video frame interpolation ...
research
08/30/2016

Interpolations of Smoke and Liquid Simulations

We present a novel method to interpolate smoke and liquid simulations in...
research
04/12/2016

Full Flow: Optical Flow Estimation By Global Optimization over Regular Grids

We present a global optimization approach to optical flow estimation. Th...
research
10/13/2021

Optical-Flow-Reuse-Based Bidirectional Recurrent Network for Space-Time Video Super-Resolution

In this paper, we consider the task of space-time video super-resolution...
research
08/02/2021

Neural Image Representations for Multi-Image Fusion and Layer Separation

We propose a framework for aligning and fusing multiple images into a si...

Please sign up or login with your details

Forgot password? Click here to reset