Adaptive Synthetic Characters for Military Training

01/06/2021
by   Volkan Ustun, et al.
17

Behaviors of the synthetic characters in current military simulations are limited since they are generally generated by rule-based and reactive computational models with minimal intelligence. Such computational models cannot adapt to reflect the experience of the characters, resulting in brittle intelligence for even the most effective behavior models devised via costly and labor-intensive processes. Observation-based behavior model adaptation that leverages machine learning and the experience of synthetic entities in combination with appropriate prior knowledge can address the issues in the existing computational behavior models to create a better training experience in military training simulations. In this paper, we introduce a framework that aims to create autonomous synthetic characters that can perform coherent sequences of believable behavior while being aware of human trainees and their needs within a training simulation. This framework brings together three mutually complementary components. The first component is a Unity-based simulation environment - Rapid Integration and Development Environment (RIDE) - supporting One World Terrain (OWT) models and capable of running and supporting machine learning experiments. The second is Shiva, a novel multi-agent reinforcement and imitation learning framework that can interface with a variety of simulation environments, and that can additionally utilize a variety of learning algorithms. The final component is the Sigma Cognitive Architecture that will augment the behavior models with symbolic and probabilistic reasoning capabilities. We have successfully created proof-of-concept behavior models leveraging this framework on realistic terrain as an essential step towards bringing machine learning into military simulations.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 9

research
01/06/2021

Controlling Synthetic Characters in Simulations: A Case for Cognitive Architectures and Sigma

Simulations, along with other similar applications like virtual worlds a...
research
04/27/2023

Learning Environment for the Air Domain (LEAD)

A substantial part of fighter pilot training is simulation-based and inv...
research
06/03/2019

Towards Interactive Training of Non-Player Characters in Video Games

There is a high demand for high-quality Non-Player Characters (NPCs) in ...
research
01/05/2023

Character Simulation Using Imitation Learning With Game Engine Physics

Creating visual 3D sensing characters that interact with AI peers and vi...
research
01/24/2017

Imitating Driver Behavior with Generative Adversarial Networks

The ability to accurately predict and simulate human driving behavior is...
research
07/12/2021

SimDem A Multi-agent Simulation Environment to Model Persons with Dementia and their Assistance

Developing artificial intelligence based assistive systems to aid Person...

Please sign up or login with your details

Forgot password? Click here to reset