HJB and Fokker-Planck equations for river environmental management based on stochastic impulse control with discrete and random observation

09/01/2020
by   H. Yoshioka, et al.
0

We formulate a new two-variable river environmental restoration problem based on jump stochastic differential equations (SDEs) governing the sediment storage and nuisance benthic algae population dynamics in a dam-downstream river. Controlling the dynamics is carried out through impulsive sediment replenishment with discrete and random observation/intervention to avoid sediment depletion and thick algae growth. We consider a cost-efficient management problem of the SDEs to achieve the objectives whose resolution reduces to solving a Hamilton-Jacobi-Bellman (HJB) equation. We also consider a Fokker-Planck (FP) equation governing the probability density function of the controlled dynamics. The HJB equation has a discontinuous solution, while the FP equation has a Dirac's delta along boundaries. We show that the value function, the optimized objective function, is governed by the HJB equation in the simplified case and further that a threshold-type control is optimal. We demonstrate that simple numerical schemes can handle these equations. Finally, we numerically analyze the optimal controls and the resulting probability density functions.

READ FULL TEXT

page 23

page 24

page 25

research
04/09/2020

A random observation-based management model of population dynamics and its ecological application

A new stochastic control problem of population dynamics under partial ob...
research
12/28/2020

Analytical and numerical solutions to ergodic control problems arising in environmental management

Environmental management should be based on a long-run sustainable viewp...
research
07/20/2020

Mathematical and computational approaches for stochastic control of river environment and ecology: from fisheries viewpoint

We present a modern stochastic control framework for dynamic optimizatio...
research
01/04/2020

Regime-switching constrained viscosity solutions approach for controlling dam-reservoir systems

A new stochastic control problem of a dam-reservoir system installed in ...
research
07/11/2023

Reliable optimal controls for SEIR models in epidemiology

We present and compare two different optimal control approaches applied ...
research
07/18/2019

Discontinuous Galerkin methods for short pulse type equations via hodograph transformations

In the present paper, we consider the discontinuous Galerkin (DG) method...
research
03/20/2013

On Constructing the Value Function for Optimal Trajectory Problem and its Application to Image Processing

We proposed an algorithm for solving Hamilton-Jacobi equation associated...

Please sign up or login with your details

Forgot password? Click here to reset