An Integrated FPGA Accelerator for Deep Learning-based 2D/3D Path Planning

06/30/2023
by   Keisuke Sugiura, et al.
0

Path planning is a crucial component for realizing the autonomy of mobile robots. However, due to limited computational resources on mobile robots, it remains challenging to deploy state-of-the-art methods and achieve real-time performance. To address this, we propose P3Net (PointNet-based Path Planning Networks), a lightweight deep-learning-based method for 2D/3D path planning, and design an IP core (P3NetCore) targeting FPGA SoCs (Xilinx ZCU104). P3Net improves the algorithm and model architecture of the recently-proposed MPNet. P3Net employs an encoder with a PointNet backbone and a lightweight planning network in order to extract robust point cloud features and sample path points from a promising region. P3NetCore is comprised of the fully-pipelined point cloud encoder, batched bidirectional path planner, and parallel collision checker, to cover most part of the algorithm. On the 2D (3D) datasets, P3Net with the IP core runs 24.54-149.57x and 6.19-115.25x (10.03-59.47x and 3.38-28.76x) faster than ARM Cortex CPU and Nvidia Jetson while only consuming 0.255W (0.809W), and is up to 1049.42x (133.84x) power-efficient than the workstation. P3Net improves the success rate by up to 28.2 near-optimal path, leading to a significantly better tradeoff between computation and solution quality than MPNet and the state-of-the-art sampling-based methods.

READ FULL TEXT

page 2

page 14

page 19

research
03/11/2022

An Efficient Accelerator for Deep Learning-based Point Cloud Registration on FPGAs

Point cloud registration is the basis for many robotic applications such...
research
10/19/2021

Learning-based Fast Path Planning in Complex Environments

In this paper, we present a novel path planning algorithm to achieve fas...
research
11/01/2020

A Passive Navigation Planning Algorithm for Collision-free Control of Mobile Robots

Path planning and collision avoidance are challenging in complex and hig...
research
11/24/2020

Path Planning with Automatic Seam Extraction over Point Cloud Models for Robotic Arc Welding

This paper presents a point cloud based robotic system for arc welding. ...
research
03/31/2023

End-to-end deep learning-based framework for path planning and collision checking: bin picking application

Real-time and efficient path planning is critical for all robotic system...
research
07/20/2023

Lightweight Neural Path Planning

Learning-based path planning is becoming a promising robot navigation me...
research
09/16/2023

CppFlow: Generative Inverse Kinematics for Efficient and Robust Cartesian Path Planning

In this work we present CppFlow - a novel and performant planner for the...

Please sign up or login with your details

Forgot password? Click here to reset