Assuring safety of vision-based swarm formation control

10/03/2022
by   Chiao Hsieh, et al.
0

Vision-based formation control systems recently have attracted attentions from both the research community and the industry for its applicability in GPS-denied environments. The safety assurance for such systems is challenging due to the lack of formal specifications for computer vision systems and the complex impact of imprecise estimations on distributed control. We propose a technique for safety assurance of vision-based formation control. Our technique combines (1) the construction of a piecewise approximation of the worst-case error of perception and (2) a classical Lyapunov-based safety analysis of the consensus control algorithm. The analysis provides the ultimate bound on the relative distance between drones. This ultimate bound can then be used to guarantee safe separation of all drones. We implement an instance of the vision-based control system on top of the photo-realistic AirSim simulator. We construct the piecewise approximation for varying perception error under different environments and weather conditions, and we are able to validate the safe separation provided by our analysis across the different weather conditions with AirSim simulation.

READ FULL TEXT

page 1

page 2

page 3

research
08/12/2021

Agile Formation Control of Drone Flocking Enhanced with Active Vision-based Relative Localization

Relative localization is a prerequisite for the cooperation of aerial sw...
research
07/04/2023

Falsification of a Vision-based Automatic Landing System

At smaller airports without an instrument approach or advanced equipment...
research
10/22/2021

Semantic Detection of Potential Wind-borne Debris in Construction Jobsites: Digital Twining for Hurricane Preparedness and Jobsite Safety

In the United States, hurricanes are the most devastating natural disast...
research
04/06/2023

Distributed formation-enforcing control for UAVs robust to observation noise in relative pose measurements

A technique that allows a formation-enforcing control (FEC) derived from...
research
06/19/2023

AVOIDDS: Aircraft Vision-based Intruder Detection Dataset and Simulator

Designing robust machine learning systems remains an open problem, and t...
research
01/10/2015

Simplified vision based automatic navigation for wheat harvesting in low income economies

Recent developments in the domain of agricultural robotics have resulted...
research
12/06/2022

ISAACS: Iterative Soft Adversarial Actor-Critic for Safety

The deployment of robots in uncontrolled environments requires them to o...

Please sign up or login with your details

Forgot password? Click here to reset