Model Compression for Resource-Constrained Mobile Robots

07/20/2022
by   Timotheos Souroulla, et al.
0

The number of mobile robots with constrained computing resources that need to execute complex machine learning models has been increasing during the past decade. Commonly, these robots rely on edge infrastructure accessible over wireless communication to execute heavy computational complex tasks. However, the edge might become unavailable and, consequently, oblige the execution of the tasks on the robot. This work focuses on making it possible to execute the tasks on the robots by reducing the complexity and the total number of parameters of pre-trained computer vision models. This is achieved by using model compression techniques such as Pruning and Knowledge Distillation. These compression techniques have strong theoretical and practical foundations, but their combined usage has not been widely explored in the literature. Therefore, this work especially focuses on investigating the effects of combining these two compression techniques. The results of this work reveal that up to 90 the total number of parameters of a computer vision model can be removed without any considerable reduction in the model's accuracy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2023

Analyzing Compression Techniques for Computer Vision

Compressing deep networks is highly desirable for practical use-cases in...
research
02/04/2023

Knowledge Distillation in Vision Transformers: A Critical Review

In Natural Language Processing (NLP), Transformers have already revoluti...
research
08/01/2018

SlimNets: An Exploration of Deep Model Compression and Acceleration

Deep neural networks have achieved increasingly accurate results on a wi...
research
11/30/2021

A Unified Pruning Framework for Vision Transformers

Recently, vision transformer (ViT) and its variants have achieved promis...
research
10/15/2021

Kronecker Decomposition for GPT Compression

GPT is an auto-regressive Transformer-based pre-trained language model w...
research
10/02/2020

Embedded Systems and Computer Vision Techniques utilized in Spray Painting Robots: A Review

The advent of the era of machines has limited human interaction and this...
research
05/12/2014

Resource-Aware Programming for Robotic Vision

Humanoid robots are designed to operate in human centered environments. ...

Please sign up or login with your details

Forgot password? Click here to reset