Genetic Adversarial Training of Decision Trees

12/21/2020
by   Francesco Ranzato, et al.
0

We put forward a novel learning methodology for ensembles of decision trees based on a genetic algorithm which is able to train a decision tree for maximizing both its accuracy and its robustness to adversarial perturbations. This learning algorithm internally leverages a complete formal verification technique for robustness properties of decision trees based on abstract interpretation, a well known static program analysis technique. We implemented this genetic adversarial training algorithm in a tool called Meta-Silvae (MS) and we experimentally evaluated it on some reference datasets used in adversarial training. The experimental results show that MS is able to train robust models that compete with and often improve on the current state-of-the-art of adversarial training of decision trees while being much more compact and therefore interpretable and efficient tree models.

READ FULL TEXT
research
01/04/2021

Fair Training of Decision Tree Classifiers

We study the problem of formally verifying individual fairness of decisi...
research
06/10/2019

Robustness Verification of Tree-based Models

We study the robustness verification problem for tree-based models, incl...
research
07/06/2020

Certifying Decision Trees Against Evasion Attacks by Program Analysis

Machine learning has proved invaluable for a range of different tasks, y...
research
11/30/2006

Lossless fitness inheritance in genetic algorithms for decision trees

When genetic algorithms are used to evolve decision trees, key tree qual...
research
12/03/2019

Training Robust Tree Ensembles for Security

Tree ensemble models including random forests and gradient boosted decis...
research
04/23/2021

Decision Tree Learning in CEGIS-Based Termination Analysis

We present a novel decision tree-based synthesis algorithm of ranking fu...
research
03/03/2021

Combining Prediction and Interpretation in Decision Trees (PrInDT) – a Linguistic Example

In this paper, we show that conditional inference trees and ensembles ar...

Please sign up or login with your details

Forgot password? Click here to reset