TanksWorld: A Multi-Agent Environment for AI Safety Research

by   Corban G. Rivera, et al.
Johns Hopkins University Applied Physics Laboratory

The ability to create artificial intelligence (AI) capable of performing complex tasks is rapidly outpacing our ability to ensure the safe and assured operation of AI-enabled systems. Fortunately, a landscape of AI safety research is emerging in response to this asymmetry and yet there is a long way to go. In particular, recent simulation environments created to illustrate AI safety risks are relatively simple or narrowly-focused on a particular issue. Hence, we see a critical need for AI safety research environments that abstract essential aspects of complex real-world applications. In this work, we introduce the AI safety TanksWorld as an environment for AI safety research with three essential aspects: competing performance objectives, human-machine teaming, and multi-agent competition. The AI safety TanksWorld aims to accelerate the advancement of safe multi-agent decision-making algorithms by providing a software framework to support competitions with both system performance and safety objectives. As a work in progress, this paper introduces our research objectives and learning environment with reference code and baseline performance metrics to follow in a future work.


page 2

page 4


Multi-Agent Safe Planning with Gaussian Processes

Multi-agent safe systems have become an increasingly important area of s...

Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges

Multi-agent reinforcement learning (MARL) is a widely used Artificial In...

Experiments with Detecting and Mitigating AI Deception

How to detect and mitigate deceptive AI systems is an open problem for t...

Toward Defining a Domain Complexity Measure Across Domains

Artificial Intelligence (AI) systems planned for deployment in real-worl...

Avoiding Negative Side Effects due to Incomplete Knowledge of AI Systems

Autonomous agents acting in the real-world often operate based on models...

Emergent Incident Response for Unmanned Warehouses with Multi-agent Systems*

Unmanned warehouses are an important part of logistics, and improving th...

Please sign up or login with your details

Forgot password? Click here to reset