Neural Networks for Latent Budget Analysis of Compositional Data

09/10/2021
by   Zhenwei Yang, et al.
0

Compositional data are non-negative data collected in a rectangular matrix with a constant row sum. Due to the non-negativity the focus is on conditional proportions that add up to 1 for each row. A row of conditional proportions is called an observed budget. Latent budget analysis (LBA) assumes a mixture of latent budgets that explains the observed budgets. LBA is usually fitted to a contingency table, where the rows are levels of one or more explanatory variables and the columns the levels of a response variable. In prospective studies, there is only knowledge about the explanatory variables of individuals and interest goes out to predicting the response variable. Thus, a form of LBA is needed that has the functionality of prediction. Previous studies proposed a constrained neural network (NN) extension of LBA that was hampered by an unsatisfying prediction ability. Here we propose LBA-NN, a feed forward NN model that yields a similar interpretation to LBA but equips LBA with a better ability of prediction. A stable and plausible interpretation of LBA-NN is obtained through the use of importance plots and table, that show the relative importance of all explanatory variables on the response variable. An LBA-NN-K- means approach that applies K-means clustering on the importance table is used to produce K clusters that are comparable to K latent budgets in LBA. Here we provide different experiments where LBA-NN is implemented and compared with LBA. In our analysis, LBA-NN outperforms LBA in prediction in terms of accuracy, specificity, recall and mean square error. We provide open-source software at GitHub.

READ FULL TEXT
research
02/12/2020

The α-k-NN regression for compositional data

Compositional data arise in many real-life applications and versatile me...
research
02/07/2023

LUT-NN: Towards Unified Neural Network Inference by Table Lookup

DNN inference requires huge effort of system development and resource co...
research
01/07/2014

Time series forecasting using neural networks

Recent studies have shown the classification and prediction power of the...
research
08/10/2022

Neural Networks for Scalar Input and Functional Output

The regression of a functional response on a set of scalar predictors ca...
research
01/13/2020

Identifying Table Structure in Documents using Conditional Generative Adversarial Networks

In many industries, as well as in academic research, information is prim...
research
02/20/2023

Compressing Tabular Data via Latent Variable Estimation

Data used for analytics and machine learning often take the form of tabl...
research
05/11/2022

Individual Fairness Guarantees for Neural Networks

We consider the problem of certifying the individual fairness (IF) of fe...

Please sign up or login with your details

Forgot password? Click here to reset