Are we ready for beyond-application high-volume data? The Reeds robot perception benchmark dataset

09/16/2021
by   Ola Benderius, et al.
0

This paper presents a dataset, called Reeds, for research on robot perception algorithms. The dataset aims to provide demanding benchmark opportunities for algorithms, rather than providing an environment for testing application-specific solutions. A boat was selected as a logging platform in order to provide highly dynamic kinematics. The sensor package includes six high-performance vision sensors, two long-range lidars, radar, as well as GNSS and an IMU. The spatiotemporal resolution of sensors were maximized in order to provide large variations and flexibility in the data, offering evaluation at a large number of different resolution presets based on the resolution found in other datasets. Reeds also provides means of a fair and reproducible comparison of algorithms, by running all evaluations on a common server backend. As the dataset contains massive-scale data, the evaluation principle also serves as a way to avoid moving data unnecessarily. It was also found that naive evaluation of algorithms, where each evaluation is computed sequentially, was not practical as the fetch and decode task of each frame would not scale well. Instead, each frame is only decoded once and then fed to all algorithms in parallel, including for GPU-based algorithms.

READ FULL TEXT

page 1

page 2

page 3

research
08/16/2021

TUM-VIE: The TUM Stereo Visual-Inertial Event Dataset

Event cameras are bio-inspired vision sensors which measure per pixel br...
research
09/11/2023

A Comparison between Frame-based and Event-based Cameras for Flapping-Wing Robot Perception

Perception systems for ornithopters face severe challenges. The harsh vi...
research
07/23/2020

Advanced Mapping Robot and High-Resolution Dataset

This paper presents a fully hardware synchronized mapping robot with sup...
research
06/09/2023

NERFBK: A High-Quality Benchmark for NERF-Based 3D Reconstruction

This paper introduces a new real and synthetic dataset called NeRFBK spe...
research
12/03/2019

Comparison and Evaluation of 2D and 3D Range Sensors

For mobile robots range sensors are important to perceive the environmen...
research
05/29/2023

SEIP: Simulation-based Design and Evaluation of Infrastructure-based Collective Perception

Infrastructure-based collective perception, which entails the real-time ...
research
11/07/2022

PeSOTIF: a Challenging Visual Dataset for Perception SOTIF Problems in Long-tail Traffic Scenarios

Perception algorithms in autonomous driving systems confront great chall...

Please sign up or login with your details

Forgot password? Click here to reset