Discovering the Rationale of Decisions: Experiments on Aligning Learning and Reasoning

05/14/2021
by   Cor Steging, et al.
0

In AI and law, systems that are designed for decision support should be explainable when pursuing justice. In order for these systems to be fair and responsible, they should make correct decisions and make them using a sound and transparent rationale. In this paper, we introduce a knowledge-driven method for model-agnostic rationale evaluation using dedicated test cases, similar to unit-testing in professional software development. We apply this new method in a set of machine learning experiments aimed at extracting known knowledge structures from artificial datasets from fictional and non-fictional legal settings. We show that our method allows us to analyze the rationale of black-box machine learning systems by assessing which rationale elements are learned or not. Furthermore, we show that the rationale can be adjusted using tailor-made training data based on the results of the rationale evaluation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/25/2021

Using Issues to Explain Legal Decisions

The need to explain the output from Machine Learning systems designed to...
research
12/28/2017

What do we need to build explainable AI systems for the medical domain?

Artificial intelligence (AI) generally and machine learning (ML) specifi...
research
09/12/2020

Explainable Automated Reasoning in Law using Probabilistic Epistemic Argumentation

Applying automated reasoning tools for decision support and analysis in ...
research
11/01/2020

Transparent Interpretation with Knockouts

How can we find a subset of training samples that are most responsible f...
research
04/05/2022

A Set Membership Approach to Discovering Feature Relevance and Explaining Neural Classifier Decisions

Neural classifiers are non linear systems providing decisions on the cla...
research
12/30/2022

ComplAI: Theory of A Unified Framework for Multi-factor Assessment of Black-Box Supervised Machine Learning Models

The advances in Artificial Intelligence are creating new opportunities t...
research
03/20/2018

Enslaving the Algorithm: From a "Right to an Explanation" to a "Right to Better Decisions"?

As concerns about unfairness and discrimination in "black box" machine l...

Please sign up or login with your details

Forgot password? Click here to reset