Certified Vision-based State Estimation for Autonomous Landing Systems using Reachability Analysis

09/10/2023
by   Ulices Santa Cruz Leal, et al.
0

This paper studies the problem of designing a certified vision-based state estimator for autonomous landing systems. In such a system, a neural network (NN) processes images from a camera to estimate the aircraft relative position with respect to the runway. We propose an algorithm to design such NNs with certified properties in terms of their ability to detect runways and provide accurate state estimation. At the heart of our approach is the use of geometric models of perspective cameras to obtain a mathematical model that captures the relation between the aircraft states and the inputs. We show that such geometric models enjoy mixed monotonicity properties that can be used to design state estimators with certifiable error bounds. We show the effectiveness of the proposed approach using an experimental testbed on data collected from event-based cameras.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

research
03/29/2022

NNLander-VeriF: A Neural Network Formal Verification Framework for Vision-Based Autonomous Aircraft Landing

In this paper, we consider the problem of formally verifying a Neural Ne...
research
02/26/2021

Autonomous Quadrotor Flight despite Rotor Failure with Onboard Vision Sensors: Frames vs. Events

Fault-tolerant control is crucial for safety-critical systems, such as q...
research
10/26/2022

Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing

Autonomous drones can operate in remote and unstructured environments, e...
research
12/12/2017

A vision based system for underwater docking

Autonomous underwater vehicles (AUVs) have been deployed for underwater ...
research
02/16/2023

Vision-Based Terrain Relative Navigation on High-Altitude Balloon and Sub-Orbital Rocket

We present an experimental analysis on the use of a camera-based approac...
research
11/04/2022

Discovering Closed-Loop Failures of Vision-Based Controllers via Reachability Analysis

Machine learning driven image-based controllers allow robotic systems to...
research
09/25/2022

Vision-based Perimeter Defense via Multiview Pose Estimation

Previous studies in the perimeter defense game have largely focused on t...

Please sign up or login with your details

Forgot password? Click here to reset