RODNet: Object Detection under Severe Conditions Using Vision-Radio Cross-Modal Supervision

03/03/2020
by   Yizhou Wang, et al.
13

Radar is usually more robust than the camera in severe autonomous driving scenarios, e.g., weak/strong lighting and bad weather. However, the semantic information from the radio signals is difficult to extract. In this paper, we propose a radio object detection network (RODNet) to detect objects purely from the processed radar data in the format of range-azimuth frequency heatmaps (RAMaps). To train the RODNet, we introduce a cross-modal supervision framework, which utilizes the rich information extracted by a vision-based object 3D localization technique to teach object detection for the radar. In order to train and evaluate our method, we build a new dataset – CRUW, containing synchronized video sequences and RAMaps in various scenarios. After intensive experiments, our RODNet shows favorable object detection performance without the presence of the camera. To the best of our knowledge, this is the first work that can achieve accurate multi-class object detection purely using radar data as the input.

READ FULL TEXT

page 1

page 2

page 6

page 8

research
02/09/2021

RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization

Various autonomous or assisted driving strategies have been facilitated ...
research
05/11/2021

Rethinking of Radar's Role: A Camera-Radar Dataset and Systematic Annotator via Coordinate Alignment

Radar has long been a common sensor on autonomous vehicles for obstacle ...
research
07/17/2023

Multi-Task Cross-Modality Attention-Fusion for 2D Object Detection

Accurate and robust object detection is critical for autonomous driving....
research
07/03/2021

Scene-aware Learning Network for Radar Object Detection

Object detection is essential to safe autonomous or assisted driving. Pr...
research
04/03/2023

CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perception

Autonomous driving requires an accurate and fast 3D perception system th...
research
10/05/2020

Adaptive Automotive Radar data Acquisition

In an autonomous driving scenario, it is vital to acquire and efficientl...
research
01/25/2022

RFMask: A Simple Baseline for Human Silhouette Segmentation with Radio Signals

Human silhouette segmentation, which is originally defined in computer v...

Please sign up or login with your details

Forgot password? Click here to reset