AutoFlow: Learning a Better Training Set for Optical Flow

04/29/2021
by   Deqing Sun, et al.
10

Synthetic datasets play a critical role in pre-training CNN models for optical flow, but they are painstaking to generate and hard to adapt to new applications. To automate the process, we present AutoFlow, a simple and effective method to render training data for optical flow that optimizes the performance of a model on a target dataset. AutoFlow takes a layered approach to render synthetic data, where the motion, shape, and appearance of each layer are controlled by learnable hyperparameters. Experimental results show that AutoFlow achieves state-of-the-art accuracy in pre-training both PWC-Net and RAFT. Our code and data are available at https://autoflow-google.github.io .

READ FULL TEXT

page 4

page 6

page 7

page 12

page 13

page 14

page 15

page 16

research
05/28/2019

Hallucinating Optical Flow Features for Video Classification

Appearance and motion are two key components to depict and characterize ...
research
03/15/2023

Rethinking Optical Flow from Geometric Matching Consistent Perspective

Optical flow estimation is a challenging problem remaining unsolved. Rec...
research
07/22/2022

RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videos

Obtaining the ground truth labels from a video is challenging since the ...
research
08/14/2023

The Devil in the Details: Simple and Effective Optical Flow Synthetic Data Generation

Recent work on dense optical flow has shown significant progress, primar...
research
03/21/2022

What Makes RAFT Better Than PWC-Net?

How important are training details and datasets to recent optical flow m...
research
09/14/2018

Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimation

We investigate two crucial and closely related aspects of CNNs for optic...
research
02/27/2022

PanoFlow: Learning Optical Flow for Panoramic Images

Optical flow estimation is a basic task in self-driving and robotics sys...

Please sign up or login with your details

Forgot password? Click here to reset