Accurate, Low-Latency Visual Perception for Autonomous Racing:Challenges, Mechanisms, and Practical Solutions

07/28/2020
by   Kieran Strobel, et al.
5

Autonomous racing provides the opportunity to test safety-critical perception pipelines at their limit. This paper describes the practical challenges and solutions to applying state-of-the-art computer vision algorithms to build a low-latency, high-accuracy perception system for DUT18 Driverless (DUT18D), a 4WD electric race car with podium finishes at all Formula Driverless competitions for which it raced. The key components of DUT18D include YOLOv3-based object detection, pose estimation, and time synchronization on its dual stereovision/monovision camera setup. We highlight modifications required to adapt perception CNNs to racing domains, improvements to loss functions used for pose estimation, and methodologies for sub-microsecond camera synchronization among other improvements. We perform a thorough experimental evaluation of the system, demonstrating its accuracy and low-latency in real-world racing scenarios.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
01/24/2018

The challenge of simultaneous object detection and pose estimation: a comparative study

Detecting objects and estimating their pose remains as one of the major ...
research
10/12/2021

Event-Based high-speed low-latency fiducial marker tracking

Motion and dynamic environments, especially under challenging lighting c...
research
10/27/2020

Perception for Autonomous Systems (PAZ)

In this paper we introduce the Perception for Autonomous Systems (PAZ) s...
research
09/20/2022

Low latency communication over commercially available LTE and remote driving

In addition to autonomous car operation, in many cases it is desirable t...
research
09/26/2018

Redundant Perception and State Estimation for Reliable Autonomous Racing

In autonomous racing, vehicles operate close to the limits of handling a...
research
11/12/2020

StrObe: Streaming Object Detection from LiDAR Packets

Many modern robotics systems employ LiDAR as their main sensing modality...
research
04/09/2018

Design of an Autonomous Racecar: Perception, State Estimation and System Integration

This paper introduces flüela driverless: the first autonomous racecar to...

Please sign up or login with your details

Forgot password? Click here to reset