Channel-Aware Distillation Transformer for Depth Estimation on Nano Drones

03/18/2023
by   Ning Zhang, et al.
0

Autonomous navigation of drones using computer vision has achieved promising performance. Nano-sized drones based on edge computing platforms are lightweight, flexible, and cheap, thus suitable for exploring narrow spaces. However, due to their extremely limited computing power and storage, vision algorithms designed for high-performance GPU platforms cannot be used for nano drones. To address this issue this paper presents a lightweight CNN depth estimation network deployed on nano drones for obstacle avoidance. Inspired by Knowledge Distillation (KD), a Channel-Aware Distillation Transformer (CADiT) is proposed to facilitate the small network to learn knowledge from a larger network. The proposed method is validated on the KITTI dataset and tested on a nano drone Crazyflie, with an ultra-low power microprocessor GAP8.

READ FULL TEXT

page 4

page 5

research
09/14/2022

NanoFlowNet: Real-time Dense Optical Flow on a Nano Quadcopter

Nano quadcopters are small, agile, and cheap platforms that are well sui...
research
08/17/2023

Learning Lightweight Object Detectors via Multi-Teacher Progressive Distillation

Resource-constrained perception systems such as edge computing and visio...
research
10/14/2022

Lightweight Alpha Matting Network Using Distillation-Based Channel Pruning

Recently, alpha matting has received a lot of attention because of its u...
research
04/28/2022

Depth Estimation with Simplified Transformer

Transformer and its variants have shown state-of-the-art results in many...
research
06/27/2020

MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation

Predicting depth from a single image is an attractive research topic sin...
research
08/04/2023

Lightweight Endoscopic Depth Estimation with CNN-Transformer Encoder

In this study, we tackle the key challenges concerning accuracy and robu...
research
09/16/2020

Compressing Facial Makeup Transfer Networks by Collaborative Distillation and Kernel Decomposition

Although the facial makeup transfer network has achieved high-quality pe...

Please sign up or login with your details

Forgot password? Click here to reset