Enabling Design Methodologies and Future Trends for Edge AI: Specialization and Co-design

by   Cong Hao, et al.

Artificial intelligence (AI) technologies have dramatically advanced in recent years, resulting in revolutionary changes in people's lives. Empowered by edge computing, AI workloads are migrating from centralized cloud architectures to distributed edge systems, introducing a new paradigm called edge AI. While edge AI has the promise of bringing significant increases in autonomy and intelligence into everyday lives through common edge devices, it also raises new challenges, especially for the development of its algorithms and the deployment of its services, which call for novel design methodologies catered to these unique challenges. In this paper, we provide a comprehensive survey of the latest enabling design methodologies that span the entire edge AI development stack. We suggest that the key methodologies for effective edge AI development are single-layer specialization and cross-layer co-design. We discuss representative methodologies in each category in detail, including on-device training methods, specialized software design, dedicated hardware design, benchmarking and design automation, software/hardware co-design, software/compiler co-design, and compiler/hardware co-design. Moreover, we attempt to reveal hidden cross-layer design opportunities that can further boost the solution quality of future edge AI and provide insights into future directions and emerging areas that require increased research focus.



There are no comments yet.


page 2

page 4


Edge Intelligence: the Confluence of Edge Computing and Artificial Intelligence

Along with the deepening development in communication technologies and t...

Edge-Cloud Polarization and Collaboration: A Comprehensive Survey

Influenced by the great success of deep learning via cloud computing and...

Wireless AI: Enabling an AI-Governed Data Life Cycle

Recent years have seen rapid deployment of mobile computing and Internet...

The Why, What and How of Artificial General Intelligence Chip Development

The AI chips increasingly focus on implementing neural computing at low ...

Structured access to AI capabilities: an emerging paradigm for safe AI deployment

Structured capability access ("SCA") is an emerging paradigm for the saf...

HRNET: AI on Edge for mask detection and social distancing

The purpose of the paper is to provide innovative emerging technology fr...

Enabling Cross-Domain Communication: How to Bridge the Gap between AI and HW Engineers

A key issue in system design is the lack of communication between hardwa...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.