DeepAI AI Chat
Log In Sign Up

Aggressive Perception-Aware Navigation using Deep Optical Flow Dynamics and PixelMPC

01/07/2020
by   Keuntaek Lee, et al.
Georgia Institute of Technology
6

Recently, vision-based control has gained traction by leveraging the power of machine learning. In this work, we couple a model predictive control (MPC) framework to a visual pipeline. We introduce deep optical flow (DOF) dynamics, which is a combination of optical flow and robot dynamics. Using the DOF dynamics, MPC explicitly incorporates the predicted movement of relevant pixels into the planned trajectory of a robot. Our implementation of DOF is memory-efficient, data-efficient, and computationally cheap so that it can be computed in real-time for use in an MPC framework. The suggested Pixel Model Predictive Control (PixelMPC) algorithm controls the robot to accomplish a high-speed racing task while maintaining visibility of the important features (gates). This improves the reliability of vision-based estimators for localization and can eventually lead to safe autonomous flight. The proposed algorithm is tested in a photorealistic simulation with a high-speed drone racing task.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 8

07/21/2022

Fusing Frame and Event Vision for High-speed Optical Flow for Edge Application

Optical flow computation with frame-based cameras provides high accuracy...
08/29/2022

Jacobian Methods for Dynamic Polarization Control in Optical Applications

Dynamic polarization control (DPC) is beneficial for many optical applic...
04/13/2022

Task-Driven Data Augmentation for Vision-Based Robotic Control

Today's robots often interface data-driven perception and planning model...
10/17/2017

Sistema de Navegação Autônomo Baseado em Visão Computacional

Autonomous robots are used as the tool to solve many kinds of problems, ...
09/22/2021

PCVPC: Perception Constrained Visual Predictive Control For Agile Quadrotors

We present a perception constrained visual predictive control (PCVPC) al...
09/14/2022

NanoFlowNet: Real-time Dense Optical Flow on a Nano Quadcopter

Nano quadcopters are small, agile, and cheap platforms that are well sui...
05/22/2023

FEDORA: Flying Event Dataset fOr Reactive behAvior

The ability of living organisms to perform complex high speed manoeuvers...