Automatic Unsupervised Tensor Mining with Quality Assessment

03/11/2015
by   Evangelos E. Papalexakis, et al.
0

A popular tool for unsupervised modelling and mining multi-aspect data is tensor decomposition. In an exploratory setting, where and no labels or ground truth are available how can we automatically decide how many components to extract? How can we assess the quality of our results, so that a domain expert can factor this quality measure in the interpretation of our results? In this paper, we introduce AutoTen, a novel automatic unsupervised tensor mining algorithm with minimal user intervention, which leverages and improves upon heuristics that assess the result quality. We extensively evaluate AutoTen's performance on synthetic data, outperforming existing baselines on this very hard problem. Finally, we apply AutoTen on a variety of real datasets, providing insights and discoveries. We view this work as a step towards a fully automated, unsupervised tensor mining tool that can be easily adopted by practitioners in academia and industry.

READ FULL TEXT
research
09/04/2017

Balancing Interpretability and Predictive Accuracy for Unsupervised Tensor Mining

The PARAFAC tensor decomposition has enjoyed an increasing success in ex...
research
09/05/2019

Tensor Oriented No-Reference Light Field Image Quality Assessment

Light field image (LFI) quality assessment is becoming more and more imp...
research
04/25/2018

Identifying and Alleviating Concept Drift in Streaming Tensor Decomposition

Tensor decompositions are used in various data mining applications from ...
research
12/19/2019

Adaptive Granularity in Tensors: A Quest for Interpretable Structure

Data collected at very frequent intervals is usually extremely sparse an...
research
11/14/2020

RecTen: A Recursive Hierarchical Low Rank Tensor Factorization Method to Discover Hierarchical Patterns in Multi-modal Data

How can we expand the tensor decomposition to reveal a hierarchical stru...
research
11/14/2020

TenFor: A Tensor-Based Tool to Extract Interesting Events from Security Forums

How can we get a security forum to "tell" us its activities and events o...
research
09/17/2023

Code quality assessment using transformers

Automatically evaluate the correctness of programming assignments is rat...

Please sign up or login with your details

Forgot password? Click here to reset