Adaptive Shooting for Bots in First Person Shooter Games Using Reinforcement Learning

by   Frank G. Glavin, et al.

In current state-of-the-art commercial first person shooter games, computer controlled bots, also known as non player characters, can often be easily distinguishable from those controlled by humans. Tell-tale signs such as failed navigation, "sixth sense" knowledge of human players' whereabouts and deterministic, scripted behaviors are some of the causes of this. We propose, however, that one of the biggest indicators of non humanlike behavior in these games can be found in the weapon shooting capability of the bot. Consistently perfect accuracy and "locking on" to opponents in their visual field from any distance are indicative capabilities of bots that are not found in human players. Traditionally, the bot is handicapped in some way with either a timed reaction delay or a random perturbation to its aim, which doesn't adapt or improve its technique over time. We hypothesize that enabling the bot to learn the skill of shooting through trial and error, in the same way a human player learns, will lead to greater variation in game-play and produce less predictable non player characters. This paper describes a reinforcement learning shooting mechanism for adapting shooting over time based on a dynamic reward signal from the amount of damage caused to opponents.


page 3

page 4

page 11

page 12


Learning to Shoot in First Person Shooter Games by Stabilizing Actions and Clustering Rewards for Reinforcement Learning

While reinforcement learning (RL) has been applied to turn-based board g...

Skilled Experience Catalogue: A Skill-Balancing Mechanism for Non-Player Characters using Reinforcement Learning

In this paper, we introduce a skill-balancing mechanism for adversarial ...

DRE-Bot: A Hierarchical First Person Shooter Bot Using Multiple Sarsa(λ) Reinforcement Learners

This paper describes an architecture for controlling non-player characte...

Towards Interactive Training of Non-Player Characters in Video Games

There is a high demand for high-quality Non-Player Characters (NPCs) in ...

Design and Implementation of a Mobile Exergaming Platform

This paper describes the design, implementation, and initial testing of ...

Aim Low, Shoot High: Evading Aimbot Detectors by Mimicking User Behavior

Current schemes to detect cheating in online games often build on the as...

Implementing a Wall-In Building Placement in StarCraft with Declarative Programming

In real-time strategy games like StarCraft, skilled players often block ...

Please sign up or login with your details

Forgot password? Click here to reset