Approximations in Deep Learning

12/08/2022
by   Etienne Dupuis, et al.
0

The design and implementation of Deep Learning (DL) models is currently receiving a lot of attention from both industrials and academics. However, the computational workload associated with DL is often out of reach for low-power embedded devices and is still costly when run on datacenters. By relaxing the need for fully precise operations, Approximate Computing (AxC) substantially improves performance and energy efficiency. DL is extremely relevant in this context, since playing with the accuracy needed to do adequate computations will significantly enhance performance, while keeping the quality of results in a user-constrained range. This chapter will explore how AxC can improve the performance and energy efficiency of hardware accelerators in DL applications during inference and training.

READ FULL TEXT

page 6

page 9

page 12

page 23

page 26

research
09/14/2018

Hardware-Aware Machine Learning: Modeling and Optimization

Recent breakthroughs in Deep Learning (DL) applications have made DL mod...
research
02/02/2023

Energy Efficiency of Training Neural Network Architectures: An Empirical Study

The evaluation of Deep Learning models has traditionally focused on crit...
research
12/01/2022

CONVOLVE: Smart and seamless design of smart edge processors

With the rise of Deep Learning (DL), our world braces for AI in every ed...
research
09/23/2019

AI Matrix: A Deep Learning Benchmark for Alibaba Data Centers

Alibaba has China's largest e-commerce platform. To support its diverse ...
research
03/18/2019

Advanced Capsule Networks via Context Awareness

Capsule Networks (CN) offer new architectures for Deep Learning (DL) com...
research
09/05/2023

Dynamic Early Exiting Predictive Coding Neural Networks

Internet of Things (IoT) sensors are nowadays heavily utilized in variou...
research
02/26/2016

Scalable and Sustainable Deep Learning via Randomized Hashing

Current deep learning architectures are growing larger in order to learn...

Please sign up or login with your details

Forgot password? Click here to reset