Balancing Appearance and Context in Sketch Interpretation

04/25/2016
by   Yale Song, et al.
0

We describe a sketch interpretation system that detects and classifies clock numerals created by subjects taking the Clock Drawing Test, a clinical tool widely used to screen for cognitive impairments (e.g., dementia). We describe how it balances appearance and context, and document its performance on some 2,000 drawings (about 24K clock numerals) produced by a wide spectrum of patients. We calibrate the utility of different forms of context, describing experiments with Conditional Random Fields trained and tested using a variety of features. We identify context that contributes to interpreting otherwise ambiguous or incomprehensible strokes. We describe ST-slices, a novel representation that enables "unpeeling" the layers of ink that result when people overwrite, which often produces ink impossible to analyze if only the final drawing is examined. We characterize when ST-slices work, calibrate their impact on performance, and consider their breadth of applicability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/23/2016

Interpretable Machine Learning Models for the Digital Clock Drawing Test

The Clock Drawing Test (CDT) is a rapid, inexpensive, and popular neurop...
research
12/16/2020

Sketch Generation with Drawing Process Guided by Vector Flow and Grayscale

We propose a novel image-to-pencil translation method that could not onl...
research
01/02/2018

Deep Learning for Identifying Potential Conceptual Shifts for Co-creative Drawing

We present a system for identifying conceptual shifts between visual cat...
research
06/13/2022

Prostate Cancer Malignancy Detection and localization from mpMRI using auto-Deep Learning: One Step Closer to Clinical Utilization

Automatic diagnosis of malignant prostate cancer patients from mpMRI has...
research
11/16/2022

Automated Analysis of Drawing Process for Detecting Prodromal and Clinical Dementia

Early diagnosis of dementia, particularly in the prodromal stage (i.e., ...
research
05/14/2017

Statistical Timing Analysis and Criticality Computation for Circuits with Post-Silicon Clock Tuning Elements

Post-silicon clock tuning elements are widely used in high-performance d...

Please sign up or login with your details

Forgot password? Click here to reset