A 3D Game Theoretical Framework for the Evaluation of Unmanned Aircraft Systems Airspace Integration Concepts

by   Negin Musavi, et al.

Predicting the outcomes of integrating Unmanned Aerial Systems (UAS) into the National Airspace System (NAS) is a complex problem which is required to be addressed by simulation studies before allowing the routine access of UAS into the NAS. This paper focuses on providing a 3-dimensional (3D) simulation framework using a game theoretical methodology to evaluate integration concepts using scenarios where manned and unmanned air vehicles co-exist. In the proposed method, human pilot interactive decision making process is incorporated into airspace models which can fill the gap in the literature where the pilot behavior is generally assumed to be known a priori. The proposed human pilot behavior is modeled using dynamic level-k reasoning concept and approximate reinforcement learning. The level-k reasoning concept is a notion in game theory and is based on the assumption that humans have various levels of decision making. In the conventional "static" approach, each agent makes assumptions about his or her opponents and chooses his or her actions accordingly. On the other hand, in the dynamic level-k reasoning, agents can update their beliefs about their opponents and revise their level-k rule. In this study, Neural Fitted Q Iteration, which is an approximate reinforcement learning method, is used to model time-extended decisions of pilots with 3D maneuvers. An analysis of UAS integration is conducted using an example 3D scenario in the presence of manned aircraft and fully autonomous UAS equipped with sense and avoid algorithms.


page 7

page 9


A Game Theoretical Framework for the Evaluation of Unmanned Aircraft Systems Airspace Integration Concepts

Predicting the outcomes of integrating Unmanned Aerial Systems (UAS) int...

Act to Reason: A Dynamic Game Theoretical Model of Driving

The focus of this paper is to propose a driver model that incorporates h...

Modeling Cyber-Physical Human Systems via an Interplay Between Reinforcement Learning and Game Theory

Predicting the outcomes of cyber-physical systems with multiple human in...

Research on Autonomous Maneuvering Decision of UCAV based on Approximate Dynamic Programming

Unmanned aircraft systems can perform some more dangerous and difficult ...

A Way to Facilitate Decision Making in a Mixed Group of Manned and Unmanned Aerial Vehicles

A mixed group of manned and unmanned aerial vehicles is considered as a ...

UAS in the Airspace: A Review on Integration, Simulation, Optimization, and Open Challenges

Air transportation is essential for society, and it is increasing gradua...

A Pilot Evaluation of ChatGPT and DALL-E 2 on Decision Making and Spatial Reasoning

We conduct a pilot study selectively evaluating the cognitive abilities ...

Please sign up or login with your details

Forgot password? Click here to reset