A 51.3 TOPS/W, 134.4 GOPS In-memory Binary Image Filtering in 65nm CMOS

07/25/2021
by   Sumon Kumar Bose, et al.
0

Neuromorphic vision sensors (NVS) can enable energy savings due to their event-driven that exploits the temporal redundancy in video streams from a stationary camera. However, noise-driven events lead to the false triggering of the object recognition processor. Image denoise operations require memoryintensive processing leading to a bottleneck in energy and latency. In this paper, we present in-memory filtering (IMF), a 6TSRAM in-memory computing based image denoising for eventbased binary image (EBBI) frame from an NVS. We propose a non-overlap median filter (NOMF) for image denoising. An inmemory computing framework enables hardware implementation of NOMF leveraging the inherent read disturb phenomenon of 6T-SRAM. To demonstrate the energy-saving and effectiveness of the algorithm, we fabricated the proposed architecture in a 65nm CMOS process. As compared to fully digital implementation, IMF enables > 70x energy savings and a > 3x improvement of processing time when tested with the video recordings from a DAVIS sensor and achieves a peak throughput of 134.4 GOPS. Furthermore, the peak energy efficiencies of the NOMF is 51.3 TOPS/W, comparable with state of the art inmemory processors. We also show that the accuracy of the images obtained by NOMF provide comparable accuracy in tracking and classification applications when compared with images obtained by conventional median filtering.

READ FULL TEXT

page 1

page 7

research
03/23/2020

A 75kb SRAM in 65nm CMOS for In-Memory Computing Based Neuromorphic Image Denoising

This paper presents an in-memory computing (IMC) architecture for image ...
research
10/04/2019

EBBIOT: A Low-complexity Tracking Algorithm for Surveillance in IoVT Using Stationary Neuromorphic Vision Sensors

In this paper, we present EBBIOT-a novel paradigm for object tracking us...
research
03/09/2010

Nonlinear Filter Based Image Denoising Using AMF Approach

This paper proposes a new technique based on nonlinear Adaptive Median f...
research
05/31/2020

EBBINNOT: A Hardware Efficient Hybrid Event-Frame Tracker for Stationary Neuromorphic Vision Sensors

In this paper, we present a hybrid event-frame approach for detecting an...
research
04/15/2023

Within-Camera Multilayer Perceptron DVS Denoising

In-camera event denoising reduces the data rate of event cameras by filt...
research
05/19/2017

Bitwise Operations of Cellular Automaton on Gray-scale Images

Cellular Automata (CA) theory is a discrete model that represents the st...

Please sign up or login with your details

Forgot password? Click here to reset