DeepAI
Log In Sign Up

Visual Pattern-Driven Exploration of Big Data

07/03/2018
by   Michael Behrisch, et al.
0

Pattern extraction algorithms are enabling insights into the ever-growing amount of today's datasets by translating reoccurring data properties into compact representations. Yet, a practical problem arises: With increasing data volumes and complexity also the number of patterns increases, leaving the analyst with a vast result space. Current algorithmic and especially visualization approaches often fail to answer central overview questions essential for a comprehensive understanding of pattern distributions and support, their quality, and relevance to the analysis task. To address these challenges, we contribute a visual analytics pipeline targeted on the pattern-driven exploration of result spaces in a semi-automatic fashion. Specifically, we combine image feature analysis and unsupervised learning to partition the pattern space into interpretable, coherent chunks, which should be given priority in a subsequent in-depth analysis. In our analysis scenarios, no ground-truth is given. Thus, we employ and evaluate novel quality metrics derived from the distance distributions of our image feature vectors and the derived cluster model to guide the feature selection process. We visualize our results interactively, allowing the user to drill down from overview to detail into the pattern space and demonstrate our techniques in a case study on biomedical genomic data.

READ FULL TEXT
07/29/2019

FDive: Learning Relevance Models using Pattern-based Similarity Measures

The detection of interesting patterns in large high-dimensional datasets...
10/12/2020

Characterizing the Quality of Insight by Interactions: A Case Study

Understanding the quality of insight has become increasingly important w...
08/15/2018

Vis4DD: A visualization system that supports Data Quality Visual Assessment

Data quality assessment process is essential to ensure reliable analytic...
12/01/2015

Labeling the Features Not the Samples: Efficient Video Classification with Minimal Supervision

Feature selection is essential for effective visual recognition. We prop...
07/09/2017

Visual Analytics of Movement Pattern Based on Time-Spatial Data: A Neural Net Approach

Time-Spatial data plays a crucial role for different fields such as traf...