Asimovian Adaptive Agents

by   D. F. Gordon, et al.

The goal of this research is to develop agents that are adaptive and predictable and timely. At first blush, these three requirements seem contradictory. For example, adaptation risks introducing undesirable side effects, thereby making agents' behavior less predictable. Furthermore, although formal verification can assist in ensuring behavioral predictability, it is known to be time-consuming. Our solution to the challenge of satisfying all three requirements is the following. Agents have finite-state automaton plans, which are adapted online via evolutionary learning (perturbation) operators. To ensure that critical behavioral constraints are always satisfied, agents' plans are first formally verified. They are then reverified after every adaptation. If reverification concludes that constraints are violated, the plans are repaired. The main objective of this paper is to improve the efficiency of reverification after learning, so that agents have a sufficiently rapid response time. We present two solutions: positive results that certain learning operators are a priori guaranteed to preserve useful classes of behavioral assurance constraints (which implies that no reverification is needed for these operators), and efficient incremental reverification algorithms for those learning operators that have negative a priori results.



page 1

page 2

page 3

page 4


Alife Model of Evolutionary Emergence of Purposeful Adaptive Behavior

The process of evolutionary emergence of purposeful adaptive behavior is...

Collaborative Human-Agent Planning for Resilience

Intelligent agents powered by AI planning assist people in complex scena...

Enforcing Almost-Sure Reachability in POMDPs

Partially-Observable Markov Decision Processes (POMDPs) are a well-known...

Planning with Multiple Biases

Recent work has considered theoretical models for the behavior of agents...

Cursed yet Satisfied Agents

In real life auctions, a widely observed phenomenon is the winner's curs...

Efficiency Requires Adaptation

The majority of historical designs are a priori in nature, where a prior...

Incremental methods for checking real-time consistency

Requirements engineering is a key phase in the development process. Ensu...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.