FP-Stereo: Hardware-Efficient Stereo Vision for Embedded Applications

06/05/2020
by   Jieru Zhao, et al.
3

Fast and accurate depth estimation, or stereo matching, is essential in embedded stereo vision systems, requiring substantial design effort to achieve an appropriate balance among accuracy, speed and hardware cost. To reduce the design effort and achieve the right balance, we propose FP-Stereo for building high-performance stereo matching pipelines on FPGAs automatically. FP-Stereo consists of an open-source hardware-efficient library, allowing designers to obtain the desired implementation instantly. Diverse methods are supported in our library for each stage of the stereo matching pipeline and a series of techniques are developed to exploit the parallelism and reduce the resource overhead. To improve the usability, FP-Stereo can generate synthesizable C code of the FPGA accelerator with our optimized HLS templates automatically. To guide users for the right design choice meeting specific application requirements, detailed comparisons are performed on various configurations of our library to investigate the accuracy/speed/cost trade-off. Experimental results also show that FP-Stereo outperforms the state-of-the-art FPGA design from all aspects, including 6.08 resource usage and 40 FP-Stereo achieves the same accuracy at a competitive speed while consuming much less energy.

READ FULL TEXT

page 1

page 2

page 5

research
10/30/2018

R^3SGM: Real-time Raster-Respecting Semi-Global Matching for Power-Constrained Systems

Stereo depth estimation is used for many computer vision applications. T...
research
09/21/2018

Real-Time Stereo Vision on FPGAs with SceneScan

We present a flexible FPGA stereo vision implementation that is capable ...
research
03/04/2022

ACVNet: Attention Concatenation Volume for Accurate and Efficient Stereo Matching

Stereo matching is a fundamental building block for many vision and robo...
research
10/01/2019

Real-Time Semantic Stereo Matching

Scene understanding is paramount in robotics, self-navigation, augmented...
research
05/14/2020

Bi3D: Stereo Depth Estimation via Binary Classifications

Stereo-based depth estimation is a cornerstone of computer vision, with ...
research
12/06/2020

Computer Stereo Vision for Autonomous Driving

For a long time, autonomous cars were found only in science fiction movi...
research
02/20/2018

Real-Time Dense Stereo Matching With ELAS on FPGA Accelerated Embedded Devices

For many applications in low-power real-time robotics, stereo cameras ar...

Please sign up or login with your details

Forgot password? Click here to reset