Overlapping Indices for Dynamic Information Borrowing in Bayesian Hierarchical Modeling

05/27/2023
by   Xuetao Lu, et al.
0

Bayesian hierarchical model (BHM) has been widely used in synthesizing information across subgroups. Identifying heterogeneity in the data and determining proper strength of borrow have long been central goals pursued by researchers. Because these two goals are interconnected, we must consider them together. This joint consideration presents two fundamental challenges: (1) How can we balance the trade-off between homogeneity within the cluster and information gain through borrowing? (2) How can we determine the borrowing strength dynamically in different clusters? To tackle challenges, first, we develop a theoretical framework for heterogeneity identification and dynamic information borrowing in BHM. Then, we propose two novel overlapping indices: the overlapping clustering index (OCI) for identifying the optimal clustering result and the overlapping borrowing index (OBI) for assigning proper borrowing strength to clusters. By incorporating these indices, we develop a new method BHMOI (Bayesian hierarchical model with overlapping indices). BHMOI includes a novel weighted K-Means clustering algorithm by maximizing OCI to obtain optimal clustering results, and embedding OBI into BHM for dynamically borrowing within clusters. BHMOI can achieve efficient and robust information borrowing with desirable properties. Examples and simulation studies are provided to demonstrate the effectiveness of BHMOI in heterogeneity identification and dynamic information borrowing.

READ FULL TEXT

page 22

page 35

research
06/05/2018

A Visual Quality Index for Fuzzy C-Means

Cluster analysis is widely used in the areas of machine learning and dat...
research
05/18/2017

Discovering the Graph Structure in the Clustering Results

In a standard cluster analysis, such as k-means, in addition to clusters...
research
05/19/2020

A New Validity Index for Fuzzy-Possibilistic C-Means Clustering

In some complicated datasets, due to the presence of noisy data points a...
research
10/18/2019

Clustering by Optimizing the Average Silhouette Width

In this paper, we propose a unified clustering approach that can estimat...
research
08/15/2016

Consistency constraints for overlapping data clustering

We examine overlapping clustering schemes with functorial constraints, i...
research
01/10/2022

Knots and their effect on the tensile strength of lumber

When assessing the strength of sawn lumber for use in engineering applic...

Please sign up or login with your details

Forgot password? Click here to reset