SUSTain: Scalable Unsupervised Scoring for Tensors and its Application to Phenotyping

03/14/2018
by   Ioakeim Perros, et al.
0

This paper presents a new method, which we call SUSTain, that extends real-valued matrix and tensor factorizations to data where values are integers. Such data are common when the values correspond to event counts or ordinal measures. The conventional approach is to treat integer data as real, and then apply real-valued factorizations. However, doing so fails to preserve important characteristics of the original data, thereby making it hard to interpret the results. Instead, our approach extracts factor values from integer datasets as scores that are constrained to take values from a small integer set. These scores are easy to interpret: a score of zero indicates no feature contribution and higher scores indicate distinct levels of feature importance. At its core, SUSTain relies on: a) a problem partitioning into integer-constrained subproblems, so that they can be optimally solved in an efficient manner; and b) organizing the order of the subproblems' solution, to promote reuse of shared intermediate results. We propose two variants, SUSTain_M and SUSTain_T, to handle both matrix and tensor inputs, respectively. We evaluate SUSTain against several state-of-the-art baselines on both synthetic and real Electronic Health Record (EHR) datasets. Comparing to those baselines, SUSTain shows either significantly better fit or orders of magnitude speedups that achieve a comparable fit (up to 425X faster). We apply SUSTain to EHR datasets to extract patient phenotypes (i.e., clinically meaningful patient clusters). Furthermore, 87 phenotypes related to heart failure by a cardiologist.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/13/2019

TASTE: Temporal and Static Tensor Factorization for Phenotyping Electronic Health Records

Phenotyping electronic health records (EHR) focuses on defining meaningf...
research
10/18/2022

Generalization Properties of Decision Trees on Real-valued and Categorical Features

We revisit binary decision trees from the perspective of partitions of t...
research
02/02/2019

Itemsets for Real-valued Datasets

Pattern mining is one of the most well-studied subfields in exploratory ...
research
10/16/2020

A Sampling Based Method for Tensor Ring Decomposition

We propose a sampling based method for computing the tensor ring (TR) de...
research
04/28/2022

Cumulative Stay-time Representation for Electronic Health Records in Medical Event Time Prediction

We address the problem of predicting when a disease will develop, i.e., ...
research
05/09/2018

Dealing with Categorical and Integer-valued Variables in Bayesian Optimization with Gaussian Processes

Bayesian Optimization (BO) methods are useful for optimizing functions t...
research
06/18/2020

Matrix Completion with Quantified Uncertainty through Low Rank Gaussian Copula

Modern large scale datasets are often plagued with missing entries; inde...

Please sign up or login with your details

Forgot password? Click here to reset