A 58.6mW Real-Time Programmable Object Detector with Multi-Scale Multi-Object Support Using Deformable Parts Model on 1920x1080 Video at 30fps

07/27/2016
by   Amr Suleiman, et al.
0

This paper presents a programmable, energy-efficient and real-time object detection accelerator using deformable parts models (DPM), with 2x higher accuracy than traditional rigid body models. With 8 deformable parts detection, three methods are used to address the high computational complexity: classification pruning for 33x fewer parts classification, vector quantization for 15x memory size reduction, and feature basis projection for 2x reduction of the cost of each classification. The chip is implemented in 65nm CMOS technology, and can process HD (1920x1080) images at 30fps without any off-chip storage while consuming only 58.6mW (0.94nJ/pixel, 1168 GOPS/W). The chip has two classification engines to simultaneously detect two different classes of objects. With a tested high throughput of 60fps, the classification engines can be time multiplexed to detect even more than two object classes. It is energy scalable by changing the pruning factor or disabling the parts classification.

READ FULL TEXT
research
05/30/2023

AutoMM: Energy-Efficient Multi-Data-Type Matrix Multiply Design on Heterogeneous Programmable System-on-Chip

As the increasing complexity of Neural Network(NN) models leads to high ...
research
04/22/2022

Real-time HOG+SVM based object detection using SoC FPGA for a UHD video stream

Object detection is an essential component of many vision systems. For e...
research
05/02/2022

A Real Time 1280x720 Object Detection Chip With 585MB/s Memory Traffic

Memory bandwidth has become the real-time bottleneck of current deep lea...
research
10/14/2022

Low-power In-pixel Computing with Current-modulated Switched Capacitors

We present a scalable in-pixel processing architecture that can reduce t...
research
06/16/2012

How important are Deformable Parts in the Deformable Parts Model?

The main stated contribution of the Deformable Parts Model (DPM) detecto...
research
09/15/2018

Navion: A 2mW Fully Integrated Real-Time Visual-Inertial Odometry Accelerator for Autonomous Navigation of Nano Drones

This paper presents Navion, an energy-efficient accelerator for visual-i...
research
09/01/2020

MORPH-DSLAM: Model Order Reduction for PHysics-based Deformable SLAM

We propose a new methodology to estimate the 3D displacement field of de...

Please sign up or login with your details

Forgot password? Click here to reset