Model Selection using Multi-Objective Optimization

10/25/2018
by   Perry Williams, et al.
0

Choices in scientific research and management require balancing multiple, often competing objectives.Multiple-objective optimization (MOO) provides a unifying framework for solving multiple objective problems. Model selection is a critical component to scientific inference and prediction and concerns balancing the competing objectives of model fit and model complexity. The tradeoff between model fit and model complexity provides a basis for describing the model-selection problem within the MOO framework. We discuss MOO and two strategies for solving the MOO problem; modeling preferences pre-optimization and post-optimization. Most model selection methods are consistent with solving MOO problems via specification of preferences pre-optimization. We reconcile these methods within the MOO framework. We also consider model selection using post-optimization specification of preferences. That is, by first identifying Pareto optimal solutions, and then selecting among them. We demonstrate concepts with an ecological application of model selection using avian species richness data in the continental United States.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/15/2018

Model Selection via the VC-Dimension

We derive an objective function that can be optimized to give an estimat...
research
05/15/2020

A Distributional View on Multi-Objective Policy Optimization

Many real-world problems require trading off multiple competing objectiv...
research
03/28/2012

A Multi-objective Exploratory Procedure for Regression Model Selection

Variable selection is recognized as one of the most critical steps in st...
research
01/12/2020

Stepwise Model Selection for Sequence Prediction via Deep Kernel Learning

An essential problem in automated machine learning (AutoML) is that of m...
research
03/07/2023

PanIC: consistent information criteria for general model selection problems

Model selection is a ubiquitous problem that arises in the application o...
research
05/23/2022

Model selection for component network meta-analysis in connected and disconnected networks: a simulation study

Network meta-analysis (NMA) is widely used in evidence synthesis to esti...

Please sign up or login with your details

Forgot password? Click here to reset