Fast Optimization of Wildfire Suppression Policies with SMAC

03/28/2017
by   Sean McGregor, et al.
0

Managers of US National Forests must decide what policy to apply for dealing with lightning-caused wildfires. Conflicts among stakeholders (e.g., timber companies, home owners, and wildlife biologists) have often led to spirited political debates and even violent eco-terrorism. One way to transform these conflicts into multi-stakeholder negotiations is to provide a high-fidelity simulation environment in which stakeholders can explore the space of alternative policies and understand the tradeoffs therein. Such an environment needs to support fast optimization of MDP policies so that users can adjust reward functions and analyze the resulting optimal policies. This paper assesses the suitability of SMAC---a black-box empirical function optimization algorithm---for rapid optimization of MDP policies. The paper describes five reward function components and four stakeholder constituencies. It then introduces a parameterized class of policies that can be easily understood by the stakeholders. SMAC is applied to find the optimal policy in this class for the reward functions of each of the stakeholder constituencies. The results confirm that SMAC is able to rapidly find good policies that make sense from the domain perspective. Because the full-fidelity forest fire simulator is far too expensive to support interactive optimization, SMAC is applied to a surrogate model constructed from a modest number of runs of the full-fidelity simulator. To check the quality of the SMAC-optimized policies, the policies are evaluated on the full-fidelity simulator. The results confirm that the surrogate values estimates are valid. This is the first successful optimization of wildfire management policies using a full-fidelity simulation. The same methodology should be applicable to other contentious natural resource management problems where high-fidelity simulation is extremely expensive.

READ FULL TEXT
research
04/23/2022

Use of Multifidelity Training Data and Transfer Learning for Efficient Construction of Subsurface Flow Surrogate Models

Data assimilation presents computational challenges because many high-fi...
research
12/28/2022

Falsification of Learning-Based Controllers through Multi-Fidelity Bayesian Optimization

Simulation-based falsification is a practical testing method to increase...
research
09/25/2021

Constructing Sub-scale Surrogate Model for Proppant Settling in Inclined Fractures from Simulation Data with Multi-fidelity Neural Network

Particle settling in inclined channels is an important phenomenon that o...
research
04/03/2023

Investigation of risk-aware MDP and POMDP contingency management autonomy for UAS

Unmanned aircraft systems (UAS) are being increasingly adopted for vario...
research
07/27/2021

Finding Failures in High-Fidelity Simulation using Adaptive Stress Testing and the Backward Algorithm

Validating the safety of autonomous systems generally requires the use o...
research
10/27/2019

Task-Informed Fidelity Management for Speeding Up Robotics Simulation

Simulators are an important tool in robotics that is used to develop rob...
research
10/12/2022

Development of a Simulation Environment for Evaluation of a Forward Looking Sonar System for Small AUVs

This paper describes a high-fidelity sonar model and a simulation enviro...

Please sign up or login with your details

Forgot password? Click here to reset