In-Memory Nearest Neighbor Search with FeFET Multi-Bit Content-Addressable Memories

11/13/2020
by   Arman Kazemi, et al.
0

Nearest neighbor (NN) search is an essential operation in many applications, such as one/few-shot learning and image classification. As such, fast and low-energy hardware support for accurate NN search is highly desirable. Ternary content-addressable memories (TCAMs) have been proposed to accelerate NN search for few-shot learning tasks by implementing L_∞ and Hamming distance metrics, but they cannot achieve software-comparable accuracies. This paper proposes a novel distance function that can be natively evaluated with multi-bit content-addressable memories (MCAMs) based on ferroelectric FETs (FeFETs) to perform a single-step, in-memory NN search. Moreover, this approach achieves accuracies comparable to floating-point precision implementations in software for NN classification and one/few-shot learning tasks. As an example, the proposed method achieves a 98.34 classification task for the Omniglot dataset (only 0.8 software-based implementations) with a 3-bit MCAM. This represents a 13 accuracy improvement over state-of-the-art TCAM-based implementations at iso-energy and iso-delay. The presented distance function is resilient to the effects of FeFET device-to-device variations. Furthermore, this work experimentally demonstrates a 2-bit implementation of FeFET MCAM using AND arrays from GLOBALFOUNDRIES to further validate proof of concept.

READ FULL TEXT

page 1

page 5

research
01/02/2023

P3DC-Shot: Prior-Driven Discrete Data Calibration for Nearest-Neighbor Few-Shot Classification

Nearest-Neighbor (NN) classification has been proven as a simple and eff...
research
06/22/2021

MIMHD: Accurate and Efficient Hyperdimensional Inference Using Multi-Bit In-Memory Computing

Hyperdimensional Computing (HDC) is an emerging computational framework ...
research
06/07/2020

Distributionally Robust k-Nearest Neighbors for Few-Shot Learning

Learning a robust classifier from a few samples remains a key challenge ...
research
12/21/2021

Combining Minkowski and Chebyshev: New distance proposal and survey of distance metrics using k-nearest neighbours classifier

This work proposes a distance that combines Minkowski and Chebyshev dist...
research
04/15/2022

Experimentally realized memristive memory augmented neural network

Lifelong on-device learning is a key challenge for machine intelligence,...
research
06/04/2019

In-memory hyperdimensional computing

Hyperdimensional computing (HDC) is an emerging computing framework that...
research
05/15/2023

Learning More Discriminative Local Descriptors for Few-shot Learning

Few-shot learning for image classification comes up as a hot topic in co...

Please sign up or login with your details

Forgot password? Click here to reset