AI Chat AI Image Generator AI Video Text to Speech

iMARS: An In-Memory-Computing Architecture for Recommendation Systems

02/18/2022

∙

by Mengyuan Li, et al.

∙

∙

Recommendation systems (RecSys) suggest items to users by predicting their preferences based on historical data. Typical RecSys handle large embedding tables and many embedding table related operations. The memory size and bandwidth of the conventional computer architecture restrict the performance of RecSys. This work proposes an in-memory-computing (IMC) architecture (iMARS) for accelerating the filtering and ranking stages of deep neural network-based RecSys. iMARS leverages IMC-friendly embedding tables implemented inside a ferroelectric FET based IMC fabric. Circuit-level and system-level evaluation show that achieves 16.8x (713x) end-to-end latency (energy) improvement compared to the GPU counterpart for the MovieLens dataset.

Mengyuan Li
12 publications
Ann Franchesca Laguna
5 publications
Dayane Reis
6 publications
Xunzhao Yin
5 publications
Michael Niemier
12 publications
Xiaobo Sharon Hu
20 publications

research

∙ 03/01/2021

High-Performance Training by Exploiting Hot-Embeddings in Recommendation Systems

Recommendation models are commonly used learning models that suggest rel...

9 Muhammad Adnan, et al. ∙

research

∙ 05/12/2023

Mem-Rec: Memory Efficient Recommendation System using Alternative Representation

Deep learning-based recommendation systems (e.g., DLRMs) are widely used...

0 Gopi Krishna Jha, et al. ∙

research

∙ 10/21/2020

Mixed-Precision Embedding Using a Cache

In recommendation systems, practitioners observed that increase in the n...

0 Jie Amy Yang, et al. ∙

research

∙ 08/08/2022

A Frequency-aware Software Cache for Large Recommendation System Embeddings

Deep learning recommendation models (DLRMs) have been widely applied in ...

0 Jiarui Fang, et al. ∙

research

∙ 04/19/2023

MTrainS: Improving DLRM training efficiency using heterogeneous memories

Recommendation models are very large, requiring terabytes (TB) of memory...

0 Hiwot Tadese Kassa, et al. ∙

research

∙ 01/29/2021

RecSSD: Near Data Processing for Solid State Drive Based Recommendation Inference

Neural personalized recommendation models are used across a wide variety...

0 Mark Wilkening, et al. ∙

research

∙ 05/31/2019

Deep Learning Recommendation Model for Personalization and Recommendation Systems

With the advent of deep learning, neural network-based recommendation mo...

0 Maxim Naumov, et al. ∙