Flexible and Approximate Computation through State-Space Reduction

01/30/2013
by   Weixiong Zhang, et al.
0

In the real world, insufficient information, limited computation resources, and complex problem structures often force an autonomous agent to make a decision in time less than that required to solve the problem at hand completely. Flexible and approximate computations are two approaches to decision making under limited computation resources. Flexible computation helps an agent to flexibly allocate limited computation resources so that the overall system utility is maximized. Approximate computation enables an agent to find the best satisfactory solution within a deadline. In this paper, we present two state-space reduction methods for flexible and approximate computation: quantitative reduction to deal with inaccurate heuristic information, and structural reduction to handle complex problem structures. These two methods can be applied successively to continuously improve solution quality if more computation is available. Our results show that these reduction methods are effective and efficient, finding better solutions with less computation than some existing well-known methods.

READ FULL TEXT

page 1

page 6

research
10/25/2017

State Space Reduction for Reachability Graph of CSM Automata

Classical CTL temporal logics are built over systems with interleaving m...
research
11/18/2017

Learning to select computations

Efficient use of limited computational resources is essential to intelli...
research
04/08/2019

Bounded rational decision-making from elementary computations that reduce uncertainty

In its most basic form, decision-making can be viewed as a computational...
research
04/19/2021

Approximate Multi-Agent Fitted Q Iteration

We formulate an efficient approximation for multi-agent batch reinforcem...
research
03/20/2023

Reflexion: an autonomous agent with dynamic memory and self-reflection

Recent advancements in decision-making large language model (LLM) agents...
research
09/15/2023

LASER: LLM Agent with State-Space Exploration for Web Navigation

Large language models (LLMs) have been successfully adapted for interact...
research
10/31/2019

Outsourcing Computation: the Minimal Refereed Mechanism

We consider a setting where a verifier with limited computation power de...

Please sign up or login with your details

Forgot password? Click here to reset