Spatio-temporal Graph-RNN for Point Cloud Prediction

02/15/2021
by   Pedro Gomes, et al.
9

In this paper, we propose an end-to-end learning network to predict future frames in a point cloud sequence. As main novelty, an initial layer learns topological information of point clouds as geometric features, to form representative spatio-temporal neighborhoods. This module is followed by multiple Graph-RNN cells. Each cell learns points dynamics (i.e., RNN states) by processing each point jointly with the spatio-temporal neighbouring points. We tested the network performance with a MINST dataset of moving digits, a synthetic human bodies motions and JPEG dynamic bodies datasets. Simulation results demonstrate that our method outperforms baseline ones that neglect geometry features information.

READ FULL TEXT
research
08/12/2020

ASAP-Net: Attention and Structure Aware Point Cloud Sequence Segmentation

Recent works of point clouds show that mulit-frame spatio-temporal model...
research
07/19/2023

AGAR: Attention Graph-RNN for Adaptative Motion Prediction of Point Clouds of Deformable Objects

This paper focuses on motion prediction for point cloud sequences in the...
research
03/11/2023

3DInAction: Understanding Human Actions in 3D Point Clouds

We propose a novel method for 3D point cloud action recognition. Underst...
research
03/27/2023

NeuralPCI: Spatio-temporal Neural Field for 3D Point Cloud Multi-frame Non-linear Interpolation

In recent years, there has been a significant increase in focus on the i...
research
02/05/2023

Spatio-Temporal Point Process for Multiple Object Tracking

Multiple Object Tracking (MOT) focuses on modeling the relationship of d...
research
10/19/2004

A Computational Study of Rotating Spiral Waves and Spatio-Temporal Transient Chaos in a Deterministic Three-Level Active System

Spatio-temporal dynamics of a deterministic three-level cellular automat...

Please sign up or login with your details

Forgot password? Click here to reset