Vector Symbolic Architectures as a Computing Framework for Nanoscale Hardware

06/09/2021
by   Denis Kleyko, et al.
0

This article reviews recent progress in the development of the computing framework Vector Symbolic Architectures (also known as Hyperdimensional Computing). This framework is well suited for implementation in stochastic, nanoscale hardware and it naturally expresses the types of cognitive operations required for Artificial Intelligence (AI). We demonstrate in this article that the ring-like algebraic structure of Vector Symbolic Architectures offers simple but powerful operations on high-dimensional vectors that can support all data structures and manipulations relevant in modern computing. In addition, we illustrate the distinguishing feature of Vector Symbolic Architectures, "computing in superposition," which sets it apart from conventional computing. This latter property opens the door to efficient solutions to the difficult combinatorial search problems inherent in AI applications. Vector Symbolic Architectures are Turing complete, as we show, and we see them acting as a framework for computing with distributed representations in myriad AI settings. This paper serves as a reference for computer architects by illustrating techniques and philosophy of VSAs for distributed computing and relevance to emerging computing hardware, such as neuromorphic computing.

READ FULL TEXT

page 1

page 2

page 25

11/11/2021

A Survey on Hyperdimensional Computing aka Vector Symbolic Architectures, Part I: Models and Data Transformations

This two-part comprehensive survey is devoted to a computing framework m...
07/07/2020

Resonator networks for factoring distributed representations of data structures

The ability to encode and manipulate data structures with distributed ne...
10/15/2021

HyperSeed: Unsupervised Learning with Vector Symbolic Architectures

Motivated by recent innovations in biologically-inspired neuromorphic ha...
01/31/2020

A comparison of Vector Symbolic Architectures

Vector Symbolic Architectures (VSAs) combine a high-dimensional vector s...
03/11/2020

Vector symbolic architectures for context-free grammars

Background / introduction. Vector symbolic architectures (VSA) are a via...
02/10/2022

Understanding Hyperdimensional Computing for Parallel Single-Pass Learning

Hyperdimensional computing (HDC) is an emerging learning paradigm that c...
07/18/2022

Residual and Attentional Architectures for Vector-Symbols

Vector-symbolic architectures (VSAs) provide methods for computing which...