DeepAI AI Chat
Log In Sign Up

Order Matters: Shuffling Sequence Generation for Video Prediction

by   Junyan Wang, et al.

Predicting future frames in natural video sequences is a new challenge that is receiving increasing attention in the computer vision community. However, existing models suffer from severe loss of temporal information when the predicted sequence is long. Compared to previous methods focusing on generating more realistic contents, this paper extensively studies the importance of sequential order information for video generation. A novel Shuffling sEquence gEneration network (SEE-Net) is proposed that can learn to discriminate unnatural sequential orders by shuffling the video frames and comparing them to the real video sequence. Systematic experiments on three datasets with both synthetic and real-world videos manifest the effectiveness of shuffling sequence generation for video prediction in our proposed model and demonstrate state-of-the-art performance by both qualitative and quantitative evaluations. The source code is available at


page 1

page 3

page 4

page 6

page 9

page 11

page 12

page 13


VPTR: Efficient Transformers for Video Prediction

In this paper, we propose a new Transformer block for video future frame...

Learning Knowledge-Rich Sequential Model for Planar Homography Estimation in Aerial Video

This paper presents an unsupervised approach that leverages raw aerial v...

HyperCUT: Video Sequence from a Single Blurry Image using Unsupervised Ordering

We consider the challenging task of training models for image-to-video d...

Video Generation from Text Employing Latent Path Construction for Temporal Modeling

Video generation is one of the most challenging tasks in Machine Learnin...

Empirical Analysis of the AdaBoost's Error Bound

Understanding the accuracy limits of machine learning algorithms is esse...

Memory-augmented Attention Modelling for Videos

We present a method to improve video description generation by modeling ...

A Dataset To Evaluate The Representations Learned By Video Prediction Models

We present a parameterized synthetic dataset called Moving Symbols to su...