FotonNet: A HW-Efficient Object Detection System Using 3D-Depth Segmentation and 2D-DNN Classifier

11/19/2018
by   Gurjeet Singh, et al.
0

Object detection and classification is one of the most important computer vision problems. Ever since the introduction of deep learning krizhevsky2012imagenet, we have witnessed a dramatic increase in the accuracy of this object detection problem. However, most of these improvements have occurred using conventional 2D image processing. Recently, low-cost 3D-image sensors, such as the Microsoft Kinect (Time-of-Flight) or the Apple FaceID (Structured-Light), can provide 3D-depth or point cloud data that can be added to a convolutional neural network, acting as an extra set of dimensions. In our proposed approach, we introduce a new 2D + 3D system that takes the 3D-data to determine the object region followed by any conventional 2D-DNN, such as AlexNet. In this method, our approach can easily dissociate the information collection from the Point Cloud and 2D-Image data and combine both operations later. Hence, our system can use any existing trained 2D network on a large image dataset, and does not require a large 3D-depth dataset for new training. Experimental object detection results across 30 images show an accuracy of 0.67, versus 0.54 and 0.51 for RCNN and YOLO, respectively.

READ FULL TEXT

page 2

page 4

page 5

page 7

research
10/29/2020

An Overview Of 3D Object Detection

Point cloud 3D object detection has recently received major attention an...
research
10/19/2022

Time and Cost-Efficient Bathymetric Mapping System using Sparse Point Cloud Generation and Automatic Object Detection

Generating 3D point cloud (PC) data from noisy sonar measurements is a p...
research
10/26/2012

Full Object Boundary Detection by Applying Scale Invariant Features in a Region Merging Segmentation Algorithm

Object detection is a fundamental task in computer vision and has many a...
research
07/28/2021

High-speed object detection with a single-photon time-of-flight image sensor

3D time-of-flight (ToF) imaging is used in a variety of applications suc...
research
12/15/2022

Backdoor Attack Detection in Computer Vision by Applying Matrix Factorization on the Weights of Deep Networks

The increasing importance of both deep neural networks (DNNs) and cloud ...
research
05/09/2023

High-throughput Cotton Phenotyping Big Data Pipeline Lambda Architecture Computer Vision Deep Neural Networks

In this study, we propose a big data pipeline for cotton bloom detection...
research
11/16/2018

Data-Efficient Graph Embedding Learning for PCB Component Detection

This paper presents a challenging computer vision task, namely the detec...

Please sign up or login with your details

Forgot password? Click here to reset