Depth Estimation with Simplified Transformer

04/28/2022
by   John Yang, et al.
0

Transformer and its variants have shown state-of-the-art results in many vision tasks recently, ranging from image classification to dense prediction. Despite of their success, limited work has been reported on improving the model efficiency for deployment in latency-critical applications, such as autonomous driving and robotic navigation. In this paper, we aim at improving upon the existing transformers in vision, and propose a method for self-supervised monocular Depth Estimation with Simplified Transformer (DEST), which is efficient and particularly suitable for deployment on GPU-based platforms. Through strategic design choices, our model leads to significant reduction in model size, complexity, as well as inference latency, while achieving superior accuracy as compared to state-of-the-art. We also show that our design generalize well to other dense prediction task without bells and whistles.

READ FULL TEXT
research
02/07/2022

Transformers in Self-Supervised Monocular Depth Estimation with Unknown Camera Intrinsics

The advent of autonomous driving and advanced driver assistance systems ...
research
08/06/2022

MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformer

Self-supervised monocular depth estimation is an attractive solution tha...
research
09/22/2021

Improving 360 Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-supervised Learning

Due to difficulties in acquiring ground truth depth of equirectangular (...
research
06/08/2022

Dyna-DM: Dynamic Object-aware Self-supervised Monocular Depth Maps

Self-supervised monocular depth estimation has been a subject of intense...
research
03/18/2023

Channel-Aware Distillation Transformer for Depth Estimation on Nano Drones

Autonomous navigation of drones using computer vision has achieved promi...
research
11/04/2022

RCDPT: Radar-Camera fusion Dense Prediction Transformer

Recently, transformer networks have outperformed traditional deep neural...
research
08/15/2023

SST: A Simplified Swin Transformer-based Model for Taxi Destination Prediction based on Existing Trajectory

Accurately predicting the destination of taxi trajectories can have vari...

Please sign up or login with your details

Forgot password? Click here to reset