A Deep Generative Model for Interactive Data Annotation through Direct Manipulation in Latent Space

05/24/2023
by   Hannes Kath, et al.
0

The impact of machine learning (ML) in many fields of application is constrained by lack of annotated data. Among existing tools for ML-assisted data annotation, one little explored tool type relies on an analogy between the coordinates of a graphical user interface and the latent space of a neural network for interaction through direct manipulation. In the present work, we 1) expand the paradigm by proposing two new analogies: time and force as reflecting iterations and gradients of network training; 2) propose a network model for learning a compact graphical representation of the data that takes into account both its internal structure and user provided annotations; and 3) investigate the impact of model hyperparameters on the learned graphical representations of the data, identifying candidate model variants for a future user study.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2019

Investigating Direct Manipulation of Graphical Encodings as a Method for User Interaction

We investigate direct manipulation of graphical encodings as a method fo...
research
01/07/2022

Deep Generative Framework for Interactive 3D Terrain Authoring and Manipulation

Automated generation and (user) authoring of the realistic virtual terra...
research
11/08/2017

LatentPoison - Adversarial Attacks On The Latent Space

Robustness and security of machine learning (ML) systems are intertwined...
research
12/10/2018

Disentangled Dynamic Representations from Unordered Data

We present a deep generative model that learns disentangled static and d...
research
06/17/2021

Learning Perceptual Manifold of Fonts

Along the rapid development of deep learning techniques in generative mo...
research
10/11/2021

A Deep Generative Model for Matrix Reordering

Depending on the node ordering, an adjacency matrix can highlight distin...

Please sign up or login with your details

Forgot password? Click here to reset