HOPE: Hierarchical Spatial-temporal Network for Occupancy Flow Prediction

06/21/2022
by   Yihan Hu, et al.
3

In this report, we introduce our solution to the Occupancy and Flow Prediction challenge in the Waymo Open Dataset Challenges at CVPR 2022, which ranks 1st on the leaderboard. We have developed a novel hierarchical spatial-temporal network featured with spatial-temporal encoders, a multi-scale aggregator enriched with latent variables, and a recursive hierarchical 3D decoder. We use multiple losses including focal loss and modified flow trace loss to efficiently guide the training process. Our method achieves a Flow-Grounded Occupancy AUC of 0.8389 and outperforms all the other teams on the leaderboard.

READ FULL TEXT
research
11/23/2020

Hierarchically Decoupled Spatial-Temporal Contrast for Self-supervised Video Representation Learning

We present a novel way for self-supervised video representation learning...
research
06/09/2018

Hierarchical Information Quadtree: Efficient Spatial Temporal Image Search for Multimedia Stream

Massive amount of multimedia data that contain times- tamps and geograph...
research
02/22/2020

Interpretable Crowd Flow Prediction with Spatial-Temporal Self-Attention

Crowd flow prediction has been increasingly investigated in intelligent ...
research
02/03/2015

Recognizing Focal Liver Lesions in Contrast-Enhanced Ultrasound with Discriminatively Trained Spatio-Temporal Model

The aim of this study is to provide an automatic computational framework...
research
12/22/2021

Deep Reinforcement Learning for Optimal Power Flow with Renewables Using Spatial-Temporal Graph Information

Renewable energy resources (RERs) have been increasingly integrated into...
research
08/09/2023

Histogram-guided Video Colorization Structure with Spatial-Temporal Connection

Video colorization, aiming at obtaining colorful and plausible results f...
research
07/03/2017

Temporal HeartNet: Towards Human-Level Automatic Analysis of Fetal Cardiac Screening Video

We present an automatic method to describe clinically useful information...

Please sign up or login with your details

Forgot password? Click here to reset