A generalized EMS algorithm for model selection with incomplete data

06/21/2021
by   Ping-Feng Xu, et al.
0

Recently, a so-called E-MS algorithm was developed for model selection in the presence of missing data. Specifically, it performs the Expectation step (E step) and Model Selection step (MS step) alternately to find the minimum point of the observed generalized information criteria (GIC). In practice, it could be numerically infeasible to perform the MS-step for high dimensional settings. In this paper, we propose a more simple and feasible generalized EMS (GEMS) algorithm which simply requires a decrease in the observed GIC in the MS-step and includes the original EMS algorithm as a special case. We obtain several numerical convergence results of the GEMS algorithm under mild conditions. We apply the proposed GEMS algorithm to Gaussian graphical model selection and variable selection in generalized linear models and compare it with existing competitors via numerical experiments. We illustrate its application with three real data sets.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

02/24/2022

From Model Selection to Model Averaging: A Comparison for Nested Linear Models

Model selection (MS) and model averaging (MA) are two popular approaches...
01/12/2019

Integrating multi-source block-wise missing data in model selection

For multi-source data, blocks of variable information from certain sourc...
10/21/2018

MS-BACO: A new Model Selection algorithm using Binary Ant Colony Optimization for neural complexity and error reduction

Stabilizing the complexity of Feedforward Neural Networks (FNNs) for the...
06/14/2017

The ratio of normalizing constants for Bayesian graphical Gaussian model selection

The ratio of normalizing constants for the G-Wishart distribution, for t...
12/02/2018

Model Selection and estimation of Multi Screen Penalty

We propose a multi-step method, called Multi Screen Penalty (MSP), to es...
12/23/2014

Model Selection in High-Dimensional Misspecified Models

Model selection is indispensable to high-dimensional sparse modeling in ...
10/19/2016

Robust and Parallel Bayesian Model Selection

Effective and accurate model selection is an important problem in modern...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.