Agile Reactive Navigation for A Non-Holonomic Mobile Robot Using A Pixel Processor Array

09/27/2020
by   Yanan Liu, et al.
0

This paper presents an agile reactive navigation strategy for driving a non-holonomic ground vehicle around a preset course of gates in a cluttered environment using a low-cost processor array sensor. This enables machine vision tasks to be performed directly upon the sensor's image plane, rather than using a separate general-purpose computer. We demonstrate a small ground vehicle running through or avoiding multiple gates at high speed using minimal computational resources. To achieve this, target tracking algorithms are developed for the Pixel Processing Array and captured images are then processed directly on the vision sensor acquiring target information for controlling the ground vehicle. The algorithm can run at up to 2000 fps outdoors and 200fps at indoor illumination levels. Conducting image processing at the sensor level avoids the bottleneck of image transfer encountered in conventional sensors. The real-time performance of on-board image processing and robustness is validated through experiments. Experimental results demonstrate that the algorithm's ability to enable a ground vehicle to navigate at an average speed of 2.20 m/s for passing through multiple gates and 3.88 m/s for a 'slalom' task in an environment featuring significant visual clutter.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
06/02/2020

AnalogNet: Convolutional Neural Network Inference on Analog Focal Plane Sensor Processors

We present a high-speed, energy-efficient Convolutional Neural Network (...
research
04/27/2020

Fully Embedding Fast Convolutional Networks on Pixel Processor Arrays

We present a novel method of CNN inference for pixel processor array (PP...
research
09/19/2022

Learning-based Uncertainty-aware Navigation in 3D Off-Road Terrains

This paper presents a safe, efficient, and agile ground vehicle navigati...
research
09/12/2019

A Camera That CNNs: Towards Embedded Neural Networks on Pixel Processor Arrays

We present a convolutional neural network implementation for pixel proce...
research
09/12/2019

A Camera That CNNs: Towards Embedded Neural Networks onPixel Processor Arrays

We present a convolutional neural network implementation for pixel proce...
research
11/02/2022

Deep Learning Computer Vision Algorithms for Real-time UAVs On-board Camera Image Processing

This paper describes how advanced deep learning based computer vision al...
research
09/12/2017

Constant Space Complexity Environment Representation for Vision-based Navigation

This paper presents a preliminary conceptual investigation into an envir...

Please sign up or login with your details

Forgot password? Click here to reset