A Virtual Reality Tool for Representing, Visualizing and Updating Deep Learning Models

05/24/2023
by   Hannes Kath, et al.
0

Deep learning is ubiquitous, but its lack of transparency limits its impact on several potential application areas. We demonstrate a virtual reality tool for automating the process of assigning data inputs to different categories. A dataset is represented as a cloud of points in virtual space. The user explores the cloud through movement and uses hand gestures to categorise portions of the cloud. This triggers gradual movements in the cloud: points of the same category are attracted to each other, different groups are pushed apart, while points are globally distributed in a way that utilises the entire space. The space, time, and forces observed in virtual reality can be mapped to well-defined machine learning concepts, namely the latent space, the training epochs and the backpropagation. Our tool illustrates how the inner workings of deep neural networks can be made tangible and transparent. We expect this approach to accelerate the autonomous development of deep learning applications by end users in novel areas.

READ FULL TEXT
research
10/01/2021

Deep Connection: Making Virtual Reality Artworks with Medical Scan Data

Deep Connection is an installation and virtual reality artwork made usin...
research
06/13/2019

Deep Learning Development Environment in Virtual Reality

Virtual reality (VR) offers immersive visualization and intuitive intera...
research
11/02/2018

Machine learning architectures to predict motion sickness using a Virtual Reality rollercoaster simulation tool

Virtual Reality (VR) can cause an unprecedented immersion and feeling of...
research
10/01/2021

DiVRsify: Break the Cycle and Develop VR for Everyone

Virtual reality technology is biased. It excludes approximately 95 world...
research
07/02/2019

RadVR: A 6DOF Virtual Reality Daylighting Analysis Tool

This work introduces RadVR, a virtual reality daylighiting analysis tool...
research
06/24/2019

Multisensory cues facilitate coordination of stepping movements with a virtual reality avatar

The effectiveness of simple sensory cues for retraining gait have been d...
research
02/21/2022

ReViVD: Exploration and Filtering of Trajectories in an Immersive Environment using 3D Shapes

We present ReViVD, a tool for exploring and filtering large trajectory-b...

Please sign up or login with your details

Forgot password? Click here to reset