FDive: Learning Relevance Models using Pattern-based Similarity Measures

07/29/2019
by   Frederik L. Dennig, et al.
4

The detection of interesting patterns in large high-dimensional datasets is difficult because of their dimensionality and pattern complexity. Therefore, analysts require automated support for the extraction of relevant patterns. In this paper, we present FDive, a visual active learning system that helps to create visually explorable relevance models, assisted by learning a pattern-based similarity. We use a small set of user-provided labels to rank similarity measures, consisting of feature descriptor and distance function combinations, by their ability to distinguish relevant from irrelevant data. Based on the best-ranked similarity measure, the system calculates an interactive Self-Organizing Map-based relevance model, which classifies data according to the cluster affiliation. It also automatically prompts further relevance feedback to improve its accuracy. Uncertain areas, especially near the decision boundaries, are highlighted and can be refined by the user. We evaluate our approach by comparison to state-of-the-art feature selection techniques and demonstrate the usefulness of our approach by a case study classifying electron microscopy images of brain cells. The results show that FDive enhances both the quality and understanding of relevance models and can thus lead to new insights for brain research.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 9

research
07/03/2018

Visual Pattern-Driven Exploration of Big Data

Pattern extraction algorithms are enabling insights into the ever-growin...
research
03/05/2022

Boosting the Learning for Ranking Patterns

Discovering relevant patterns for a particular user remains a challengin...
research
04/30/2021

PSEUDo: Interactive Pattern Search in Multivariate Time Series with Locality-Sensitive Hashing and Relevance Feedback

We present PSEUDo, an adaptive feature learning technique for exploring ...
research
02/12/2018

Fast Interactive Image Retrieval using large-scale unlabeled data

An interactive image retrieval system learns which images in the databas...
research
08/19/2019

Relevance Proximity Graphs for Fast Relevance Retrieval

In plenty of machine learning applications, the most relevant items for ...
research
12/22/2020

Latent Feature Representation via Unsupervised Learning for Pattern Discovery in Massive Electron Microscopy Image Volumes

We propose a method to facilitate exploration and analysis of new large ...
research
12/10/2019

Feature Relevance Determination for Ordinal Regression in the Context of Feature Redundancies and Privileged Information

Advances in machine learning technologies have led to increasingly power...

Please sign up or login with your details

Forgot password? Click here to reset