Sharkzor: Interactive Deep Learning for Image Triage, Sort and Summary

02/14/2018
by   Meg Pirrung, et al.
0

Sharkzor is a web application for machine-learning assisted image sort and summary. Deep learning algorithms are leveraged to infer, augment, and automate the user's mental model. Initially, images uploaded by the user are spread out on a canvas. The user then interacts with the images to impute their mental model into the application's algorithmic underpinnings. Methods of interaction within Sharkzor's user interface and user experience support three primary user tasks; triage, organize and automate. The user triages the large pile of overlapping images by moving images of interest into proximity. The user then organizes said images into meaningful groups. After interacting with the images and groups, deep learning helps to automate the user's interactions. The loop of interaction, automation, and response by the user allows the system to quickly make sense of large amounts of data.

READ FULL TEXT

page 2

page 3

research
05/26/2023

DeepSI: Interactive Deep Learning for Semantic Interaction

In this paper, we design novel interactive deep learning methods to impr...
research
09/02/2020

Micro-entries: Encouraging Deeper Evaluation of Mental Models Over Time for Interactive Data Systems

Many interactive data systems combine visual representations of data wit...
research
07/19/2023

Amortised Experimental Design and Parameter Estimation for User Models of Pointing

User models play an important role in interaction design, supporting aut...
research
08/09/2021

Deep2Lead: A distributed deep learning application for small molecule lead optimization

Lead optimization is a key step in drug discovery to produce potent and ...
research
04/18/2021

A survey of image labelling for computer vision applications

Supervised machine learning methods for image analysis require large amo...
research
05/29/2015

Continuous Mental Effort Evaluation during 3D Object Manipulation Tasks based on Brain and Physiological Signals

Designing 3D User Interfaces (UI) requires adequate evaluation tools to ...
research
04/15/2020

Understanding Aesthetic Evaluation using Deep Learning

A bottleneck in any evolutionary art system is aesthetic evaluation. Man...

Please sign up or login with your details

Forgot password? Click here to reset