An Ultra Fast Low Power Convolutional Neural Network Image Sensor with Pixel-level Computing

01/09/2021
by   Ruibing Song, et al.
52

The separation of the data capture and analysis in modern vision systems has led to a massive amount of data transfer between the end devices and cloud computers, resulting in long latency, slow response, and high power consumption. Efficient hardware architectures are under focused development to enable Artificial Intelligence (AI) at the resource-limited end sensing devices. This paper proposes a Processing-In-Pixel (PIP) CMOS sensor architecture, which allows convolution operation before the column readout circuit to significantly improve the image reading speed with much lower power consumption. The simulation results show that the proposed architecture enables convolution operation (kernel size=3*3, stride=2, input channel=3, output channel=64) in a 1080P image sensor array with only 22.62 mW power consumption. In other words, the computational efficiency is 4.75 TOPS/w, which is about 3.6 times as higher as the state-of-the-art.

READ FULL TEXT

page 3

page 5

page 6

page 12

01/07/2021

A Low Power In-Memory Multiplication andAccumulation Array with Modified Radix-4 Inputand Canonical Signed Digit Weights

A mass of data transfer between the processing and storage units has bee...
02/18/2022

PISA: A Binary-Weight Processing-In-Sensor Accelerator for Edge Image Processing

This work proposes a Processing-In-Sensor Accelerator, namely PISA, as a...
01/31/2017

1.5 bit-per-stage 8-bit Pipelined CMOS A/D Converter for Neuromophic Vision Processor

Neuromorphic vision processor is an electronic implementation of vision ...
08/26/2020

An 8-bit In Resistive Memory Computing Core with Regulated Passive Neuron and Bit Line Weight Mapping

The rapid development of Artificial Intelligence (AI) and Internet of Th...
08/07/2018

Sprintz: Time Series Compression for the Internet of Things

Thanks to the rapid proliferation of connected devices, sensor-generated...
12/22/2020

Intelligent Resource Allocation in Dense LoRa Networks using Deep Reinforcement Learning

The anticipated increase in the count of IoT devices in the coming years...
01/24/2017

Variability-Aware Design for Energy Efficient Computational Artificial Intelligence Platform

Portable computing devices, which include tablets, smart phones and vari...