EEE, Remediating the failure of machine learning models via a network-based optimization patch

04/22/2023
by   Ruiyuan Kang, et al.
0

A network-based optimization approach, EEE, is proposed for the purpose of providing validation-viable state estimations to remediate the failure of pretrained models. To improve optimization efficiency and convergence, the most important metrics in the context of this research, we follow a three-faceted approach based on the error from the validation process. Firstly, we improve the information content of the error by designing a validation module to acquire high-dimensional error information. Next, we reduce the uncertainty of error transfer by employing an ensemble of error estimators, which only learn implicit errors, and use Constrained Ensemble Exploration to collect high-value data. Finally, the effectiveness of error utilization is improved by using ensemble search to determine the most prosperous state. The benefits of the proposed framework are demonstrated on four real-world engineering problems with diverse state dimensions. It is shown that EEE is either as competitive or outperforms popular optimization methods, in terms of efficiency and convergence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2022

Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model

Ensembling is a popular method used to improve performance as a last res...
research
05/03/2023

Bayesian Safety Validation for Black-Box Systems

Accurately estimating the probability of failure for safety-critical sys...
research
04/29/2021

Adaptive Partitioning Strategy for High-Dimensional Discrete Simulation-based Optimization Problems

In this paper, we introduce a technique to enhance the computational eff...
research
11/07/2021

Hierarchical Segment-based Optimization for SLAM

This paper presents a hierarchical segment-based optimization method for...
research
02/04/2014

Sequential Model-Based Ensemble Optimization

One of the most tedious tasks in the application of machine learning is ...
research
09/23/2022

Ensemble-based gradient inference for particle methods in optimization and sampling

We propose an approach based on function evaluations and Bayesian infere...
research
03/03/2023

Error convergence and engineering-guided hyperparameter search of PINNs: towards optimized I-FENN performance

In this paper, we aim at enhancing the performance of our proposed I-FEN...

Please sign up or login with your details

Forgot password? Click here to reset