Decision Rule Elicitation for Domain Adaptation

02/23/2021
by   Alexander Nikitin, et al.
0

Human-in-the-loop machine learning is widely used in artificial intelligence (AI) to elicit labels for data points from experts or to provide feedback on how close the predicted results are to the target. This simplifies away all the details of the decision-making process of the expert. In this work, we allow the experts to additionally produce decision rules describing their decision-making; the rules are expected to be imperfect but to give additional information. In particular, the rules can extend to new distributions, and hence enable significantly improving performance for cases where the training and testing distributions differ, such as in domain adaptation. We apply the proposed method to lifelong learning and domain adaptation problems and discuss applications in other branches of AI, such as knowledge acquisition problems in expert systems. In simulated and real-user studies, we show that decision rule elicitation improves domain adaptation of the algorithm and helps to propagate expert's knowledge to the AI model.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/13/2020

Artificial Artificial Intelligence: Measuring Influence of AI 'Assessments' on Moral Decision-Making

Given AI's growing role in modeling and improving decision-making, how a...
research
06/01/2022

Towards Responsible AI: A Design Space Exploration of Human-Centered Artificial Intelligence User Interfaces to Investigate Fairness

With Artificial intelligence (AI) to aid or automate decision-making adv...
research
10/19/2020

Unsupervised Expressive Rules Provide Explainability and Assist Human Experts Grasping New Domains

Approaching new data can be quite deterrent; you do not know how your ca...
research
04/22/2020

Moment-Based Domain Adaptation: Learning Bounds and Algorithms

This thesis contributes to the mathematical foundation of domain adaptat...
research
01/10/2023

Video Surveillance System Incorporating Expert Decision-making Process: A Case Study on Detecting Calving Signs in Cattle

Through a user study in the field of livestock farming, we verify the ef...
research
07/21/2023

IndigoVX: Where Human Intelligence Meets AI for Optimal Decision Making

This paper defines a new approach for augmenting human intelligence with...
research
05/05/2020

Heuristic-Based Weak Learning for Moral Decision-Making

As automation proliferates and algorithms become increasingly responsibl...

Please sign up or login with your details

Forgot password? Click here to reset