DeepAI AI Chat
Log In Sign Up

Order Matters: Shuffling Sequence Generation for Video Prediction

07/20/2019
by   Junyan Wang, et al.
1

Predicting future frames in natural video sequences is a new challenge that is receiving increasing attention in the computer vision community. However, existing models suffer from severe loss of temporal information when the predicted sequence is long. Compared to previous methods focusing on generating more realistic contents, this paper extensively studies the importance of sequential order information for video generation. A novel Shuffling sEquence gEneration network (SEE-Net) is proposed that can learn to discriminate unnatural sequential orders by shuffling the video frames and comparing them to the real video sequence. Systematic experiments on three datasets with both synthetic and real-world videos manifest the effectiveness of shuffling sequence generation for video prediction in our proposed model and demonstrate state-of-the-art performance by both qualitative and quantitative evaluations. The source code is available at https://github.com/andrewjywang/SEENet.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 9

page 11

page 12

page 13

03/29/2022

VPTR: Efficient Transformers for Video Prediction

In this paper, we propose a new Transformer block for video future frame...
04/05/2023

Learning Knowledge-Rich Sequential Model for Planar Homography Estimation in Aerial Video

This paper presents an unsupervised approach that leverages raw aerial v...
04/04/2023

HyperCUT: Video Sequence from a Single Blurry Image using Unsupervised Ordering

We consider the challenging task of training models for image-to-video d...
07/29/2021

Video Generation from Text Employing Latent Path Construction for Temporal Modeling

Video generation is one of the most challenging tasks in Machine Learnin...
02/02/2023

Empirical Analysis of the AdaBoost's Error Bound

Understanding the accuracy limits of machine learning algorithms is esse...
11/07/2016

Memory-augmented Attention Modelling for Videos

We present a method to improve video description generation by modeling ...
02/25/2018

A Dataset To Evaluate The Representations Learned By Video Prediction Models

We present a parameterized synthetic dataset called Moving Symbols to su...