Argoverse: 3D Tracking and Forecasting with Rich Maps

by   Ming-Fang Chang, et al.

We present Argoverse – two datasets designed to support autonomous vehicle machine learning tasks such as 3D tracking and motion forecasting. Argoverse was collected by a fleet of autonomous vehicles in Pittsburgh and Miami. The Argoverse 3D Tracking dataset includes 360 degree images from 7 cameras with overlapping fields of view, 3D point clouds from long range LiDAR, 6-DOF pose, and 3D track annotations. Notably, it is the only modern AV dataset that provides forward-facing stereo imagery. The Argoverse Motion Forecasting dataset includes more than 300,000 5-second tracked scenarios with a particular vehicle identified for trajectory forecasting. Argoverse is the first autonomous vehicle dataset to include "HD maps" with 290 km of mapped lanes with geometric and semantic metadata. All data is released under a Creative Commons license at In our baseline experiments, we illustrate how detailed map information such as lane direction, driveable area, and ground height improves the accuracy of 3D object tracking and motion forecasting. Our tracking and forecasting experiments represent only an initial exploration of the use of rich maps in robotic perception. We hope that Argoverse will enable the research community to explore these problems in greater depth.


page 1

page 3

page 4

page 7

page 15

page 16

page 17

page 18


Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecasting

We introduce Argoverse 2 (AV2) - a collection of three datasets for perc...

V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecasting

Utilizing infrastructure and vehicle-side information to track and forec...

Deconvolutional Networks for Point-Cloud Vehicle Detection and Tracking in Driving Scenarios

Vehicle detection and tracking is a core ingredient for developing auton...

Precise Synthetic Image and LiDAR (PreSIL) Dataset for Autonomous Vehicle Perception

We introduce the Precise Synthetic Image and LiDAR (PreSIL) dataset for ...

Point Cloud Forecasting as a Proxy for 4D Occupancy Forecasting

Predicting how the world can evolve in the future is crucial for motion ...

V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction

In this paper, we explore the use of vehicle-to-vehicle (V2V) communicat...

OdoViz: A 3D Odometry Visualization and Processing Tool

OdoViz is a reactive web-based tool for 3D visualization and processing ...

Please sign up or login with your details

Forgot password? Click here to reset