Concise and interpretable multi-label rule sets

10/04/2022
by   Martino Ciaperoni, et al.
24

Multi-label classification is becoming increasingly ubiquitous, but not much attention has been paid to interpretability. In this paper, we develop a multi-label classifier that can be represented as a concise set of simple "if-then" rules, and thus, it offers better interpretability compared to black-box models. Notably, our method is able to find a small set of relevant patterns that lead to accurate multi-label classification, while existing rule-based classifiers are myopic and wasteful in searching rules,requiring a large number of rules to achieve high accuracy. In particular, we formulate the problem of choosing multi-label rules to maximize a target function, which considers not only discrimination ability with respect to labels, but also diversity. Accounting for diversity helps to avoid redundancy, and thus, to control the number of rules in the solution set. To tackle the said maximization problem we propose a 2-approximation algorithm, which relies on a novel technique to sample high-quality rules. In addition to our theoretical analysis, we provide a thorough experimental evaluation, which indicates that our approach offers a trade-off between predictive performance and interpretability that is unmatched in previous work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/30/2018

Learning Interpretable Rules for Multi-label Classification

Multi-label classification (MLC) is a supervised learning problem in whi...
research
08/19/2019

Efficient Discovery of Expressive Multi-label Rules using Relaxed Pruning

Being able to model correlations between labels is considered crucial in...
research
03/27/2020

Generation of Consistent Sets of Multi-Label Classification Rules with a Multi-Objective Evolutionary Algorithm

Multi-label classification consists in classifying an instance into two ...
research
06/22/2021

Gradient-based Label Binning in Multi-label Classification

In multi-label classification, where a single example may be associated ...
research
06/17/2020

Diverse Rule Sets

While machine-learning models are flourishing and transforming many aspe...
research
12/14/2018

Exploiting Anti-monotonicity of Multi-label Evaluation Measures for Inducing Multi-label Rules

Exploiting dependencies between labels is considered to be crucial for m...
research
03/20/2019

Distributed Maximization of "Submodular plus Diversity" Functions for Multi-label Feature Selection on Huge Datasets

There are many problems in machine learning and data mining which are eq...

Please sign up or login with your details

Forgot password? Click here to reset