A Method for Controlling Extrapolation when Visualizing and Optimizing the Prediction Profiles of Statistical and Machine Learning Models

01/13/2022
by   Jeremy Ash, et al.
13

We present a novel method for controlling extrapolation in the prediction profiler in the JMP software. The prediction profiler is a graphical tool for exploring high dimensional prediction surfaces for statistical and machine learning models. The profiler contains interactive cross-sectional views, or profile traces, of the prediction surface of a model. Our method helps users avoid exploring predictions that should be considered extrapolation. It also performs optimization over a constrained factor region that avoids extrapolation using a genetic algorithm. In simulations and real world examples, we demonstrate how optimal factor settings without constraint in the profiler are frequently extrapolated, and how extrapolation control helps avoid these solutions with invalid factor settings that may not be useful to the user.

READ FULL TEXT

page 15

page 19

page 26

page 29

research
02/06/2023

Predicting Development of Chronic Obstructive Pulmonary Disease and its Risk Factor Analysis

Chronic Obstructive Pulmonary Disease (COPD) is an irreversible airway o...
research
11/11/2022

A monitoring framework for deployed machine learning models with supply chain examples

Actively monitoring machine learning models during production operations...
research
10/19/2019

Machine Learning for AC Optimal Power Flow

We explore machine learning methods for AC Optimal Powerflow (ACOPF) - t...
research
04/14/2021

To Trust or Not to Trust a Regressor: Estimating and Explaining Trustworthiness of Regression Predictions

In hybrid human-AI systems, users need to decide whether or not to trust...
research
12/30/2022

ComplAI: Theory of A Unified Framework for Multi-factor Assessment of Black-Box Supervised Machine Learning Models

The advances in Artificial Intelligence are creating new opportunities t...
research
08/13/2022

Locating disparities in machine learning

Machine learning was repeatedly proven to provide predictions with dispa...

Please sign up or login with your details

Forgot password? Click here to reset