An Ultra Fast Low Power Convolutional Neural Network Image Sensor with Pixel-level Computing

by   Ruibing Song, et al.

The separation of the data capture and analysis in modern vision systems has led to a massive amount of data transfer between the end devices and cloud computers, resulting in long latency, slow response, and high power consumption. Efficient hardware architectures are under focused development to enable Artificial Intelligence (AI) at the resource-limited end sensing devices. This paper proposes a Processing-In-Pixel (PIP) CMOS sensor architecture, which allows convolution operation before the column readout circuit to significantly improve the image reading speed with much lower power consumption. The simulation results show that the proposed architecture enables convolution operation (kernel size=3*3, stride=2, input channel=3, output channel=64) in a 1080P image sensor array with only 22.62 mW power consumption. In other words, the computational efficiency is 4.75 TOPS/w, which is about 3.6 times as higher as the state-of-the-art.


page 3

page 5

page 6

page 12


A Low Power In-Memory Multiplication andAccumulation Array with Modified Radix-4 Inputand Canonical Signed Digit Weights

A mass of data transfer between the processing and storage units has bee...

PISA: A Binary-Weight Processing-In-Sensor Accelerator for Edge Image Processing

This work proposes a Processing-In-Sensor Accelerator, namely PISA, as a...

1.5 bit-per-stage 8-bit Pipelined CMOS A/D Converter for Neuromophic Vision Processor

Neuromorphic vision processor is an electronic implementation of vision ...

An 8-bit In Resistive Memory Computing Core with Regulated Passive Neuron and Bit Line Weight Mapping

The rapid development of Artificial Intelligence (AI) and Internet of Th...

Sprintz: Time Series Compression for the Internet of Things

Thanks to the rapid proliferation of connected devices, sensor-generated...

Intelligent Resource Allocation in Dense LoRa Networks using Deep Reinforcement Learning

The anticipated increase in the count of IoT devices in the coming years...

Variability-Aware Design for Energy Efficient Computational Artificial Intelligence Platform

Portable computing devices, which include tablets, smart phones and vari...