Revisiting 3D Object Detection From an Egocentric Perspective

12/14/2021
by   Boyang Deng, et al.
0

3D object detection is a key module for safety-critical robotics applications such as autonomous driving. For these applications, we care most about how the detections affect the ego-agent's behavior and safety (the egocentric perspective). Intuitively, we seek more accurate descriptions of object geometry when it's more likely to interfere with the ego-agent's motion trajectory. However, current detection metrics, based on box Intersection-over-Union (IoU), are object-centric and aren't designed to capture the spatio-temporal relationship between objects and the ego-agent. To address this issue, we propose a new egocentric measure to evaluate 3D object detection, namely Support Distance Error (SDE). Our analysis based on SDE reveals that the egocentric detection quality is bounded by the coarse geometry of the bounding boxes. Given the insight that SDE would benefit from more accurate geometry descriptions, we propose to represent objects as amodal contours, specifically amodal star-shaped polygons, and devise a simple model, StarPoly, to predict such contours. Our experiments on the large-scale Waymo Open Dataset show that SDE better reflects the impact of detection quality on the ego-agent's safety compared to IoU; and the estimated contours from StarPoly consistently improve the egocentric detection quality over recent 3D object detectors.

READ FULL TEXT
research
03/04/2022

Safety-aware metrics for object detectors in autonomous driving

We argue that object detectors in the safety critical domain should prio...
research
09/21/2022

Safety Metrics and Losses for Object Detection in Autonomous Driving

State-of-the-art object detectors have been shown effective in many appl...
research
07/03/2023

SSC3OD: Sparsely Supervised Collaborative 3D Object Detection from LiDAR Point Clouds

Collaborative 3D object detection, with its improved interaction advanta...
research
02/07/2022

Field-of-View IoU for Object Detection in 360° Images

360 cameras have gained popularity over the last few years. In this pape...
research
09/06/2019

Geometry-Aware Video Object Detection for Static Cameras

In this paper we propose a geometry-aware model for video object detecti...
research
10/29/2020

Recurrent Neural Networks for video object detection

There is lots of scientific work about object detection in images. For m...
research
08/02/2017

Temporal Dynamic Graph LSTM for Action-driven Video Object Detection

In this paper, we investigate a weakly-supervised object detection frame...

Please sign up or login with your details

Forgot password? Click here to reset