HEIDL: Learning Linguistic Expressions with Deep Learning and Human-in-the-Loop

07/25/2019
by   Yiwei Yang, et al.
0

While the role of humans is increasingly recognized in machine learning community, representation of and interaction with models in current human-in-the-loop machine learning (HITL-ML) approaches are too low-level and far-removed from human's conceptual models. We demonstrate HEIDL, a prototype HITL-ML system that exposes the machine-learned model through high-level, explainable linguistic expressions formed of predicates representing semantic structure of text. In HEIDL, human's role is elevated from simply evaluating model predictions to interpreting and even updating the model logic directly by enabling interaction with rule predicates themselves. Raising the currency of interaction to such semantic levels calls for new interaction paradigms between humans and machines that result in improved productivity for text analytics model development process. Moreover, by involving humans in the process, the human-machine co-created models generalize better to unseen data as domain experts are able to instill their expertise by extrapolating from what has been learned by automated algorithms from few labelled data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/28/2021

Towards Model-informed Precision Dosing with Expert-in-the-loop Machine Learning

Machine Learning (ML) and its applications have been transforming our li...
research
07/01/2021

Quality Metrics for Transparent Machine Learning With and Without Humans In the Loop Are Not Correlated

The field explainable artificial intelligence (XAI) has brought about an...
research
04/27/2022

Human's Role in-the-Loop

Data integration has been recently challenged by the need to handle larg...
research
05/05/2021

Iterative Human and Automated Identification of Wildlife Images

Camera trapping is increasingly used to monitor wildlife, but this techn...
research
10/10/2019

Dialog on a canvas with a machine

We propose a new form of human-machine interaction. It is a pictorial ga...
research
06/05/2020

LGML: Logic Guided Machine Learning

We introduce Logic Guided Machine Learning (LGML), a novel approach that...
research
08/01/2019

Interpreting Social Respect: A Normative Lens for ML Models

Machine learning is often viewed as an inherently value-neutral process:...

Please sign up or login with your details

Forgot password? Click here to reset