Deep Learning Stereo Vision at the edge

01/13/2020
by   Luca Puglia, et al.
2

We present an overview of the methodology used to build a new stereo vision solution that is suitable for System on Chip. This new solution was developed to bring computer vision capability to embedded devices that live in a power constrained environment. The solution is constructured as a hybrid between classical Stereo Vision techniques and deep learning approaches. The stereoscopic module is composed of two separate modules: one that accelerates the neural network we trained and one that accelerates the front-end part. The system is completely passive and does not require any structured light to obtain very compelling accuracy. With respect to the previous Stereo Vision solutions offered by the industries we offer a major improvement is robustness to noise. This is mainly possible due to the deep learning part of the chosen architecture. We submitted our result to Middlebury dataset challenge. It currently ranks as the best System on Chip solution. The system has been developed for low latency applications which require better than real time performance on high definition videos.

READ FULL TEXT

page 4

page 5

page 9

research
09/17/2022

Active-Passive SimStereo – Benchmarking the Cross-Generalization Capabilities of Deep Learning-based Stereo Methods

In stereo vision, self-similar or bland regions can make it difficult to...
research
09/18/2022

StereoVoxelNet: Real-Time Obstacle Detection Based on Occupancy Voxels from a Stereo Camera Using Deep Neural Networks

Obstacle detection is a safety-critical problem in robot navigation, whe...
research
07/17/2019

Real-Time Highly Accurate Dense Depth on a Power Budget using an FPGA-CPU Hybrid SoC

Obtaining highly accurate depth from stereo images in real time has many...
research
10/18/2021

Learning multiplane images from single views with self-supervision

Generating static novel views from an already captured image is a hard t...
research
08/02/2017

A Learning-based Framework for Hybrid Depth-from-Defocus and Stereo Matching

Depth from defocus (DfD) and stereo matching are two most studied passiv...
research
06/02/2021

Low-cost Stereovision system (disparity map) for few dollars

The paper presents an analysis of the latest developments in the field o...
research
11/01/2017

Widening siamese architectures for stereo matching

Computational stereo is one of the classical problems in computer vision...

Please sign up or login with your details

Forgot password? Click here to reset