IDMS: Instance Depth for Multi-scale Monocular 3D Object Detection

12/03/2022
by   Chao Hu, et al.
0

Due to the lack of depth information of images and poor detection accuracy in monocular 3D object detection, we proposed the instance depth for multi-scale monocular 3D object detection method. Firstly, to enhance the model's processing ability for different scale targets, a multi-scale perception module based on dilated convolution is designed, and the depth features containing multi-scale information are re-refined from both spatial and channel directions considering the inconsistency between feature maps of different scales. Firstly, we designed a multi-scale perception module based on dilated convolution to enhance the model's processing ability for different scale targets. The depth features containing multi-scale information are re-refined from spatial and channel directions considering the inconsistency between feature maps of different scales. Secondly, so as to make the model obtain better 3D perception, this paper proposed to use the instance depth information as an auxiliary learning task to enhance the spatial depth feature of the 3D target and use the sparse instance depth to supervise the auxiliary task. Finally, by verifying the proposed algorithm on the KITTI test set and evaluation set, the experimental results show that compared with the baseline method, the proposed method improves by 5.27% in AP40 in the car category, effectively improving the detection performance of the monocular 3D object detection algorithm.

READ FULL TEXT
research
06/08/2018

Deep multi-scale architectures for monocular depth estimation

This paper aims at understanding the role of multi-scale information in ...
research
01/12/2022

MDS-Net: A Multi-scale Depth Stratification Based Monocular 3D Object Detection Algorithm

Monocular 3D object detection is very challenging in autonomous driving ...
research
08/22/2022

A Simple Baseline for Multi-Camera 3D Object Detection

3D object detection with surrounding cameras has been a promising direct...
research
03/30/2021

Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detection

The objective of this paper is to learn context- and depth-aware feature...
research
09/02/2023

S^3-MonoDETR: Supervised Shape Scale-perceptive Deformable Transformer for Monocular 3D Object Detection

Recently, transformer-based methods have shown exceptional performance i...
research
06/29/2021

An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Spatial Deep Features

Digital gigapixel whole slide image (WSI) is widely used in clinical dia...
research
12/02/2021

Object-aware Monocular Depth Prediction with Instance Convolutions

With the advent of deep learning, estimating depth from a single RGB ima...

Please sign up or login with your details

Forgot password? Click here to reset