A Survey of Neural Trees

09/07/2022
by   Haoling Li, et al.
0

Neural networks (NNs) and decision trees (DTs) are both popular models of machine learning, yet coming with mutually exclusive advantages and limitations. To bring the best of the two worlds, a variety of approaches are proposed to integrate NNs and DTs explicitly or implicitly. In this survey, these approaches are organized in a school which we term as neural trees (NTs). This survey aims to present a comprehensive review of NTs and attempts to identify how they enhance the model interpretability. We first propose a thorough taxonomy of NTs that expresses the gradual integration and co-evolution of NNs and DTs. Afterward, we analyze NTs in terms of their interpretability and performance, and suggest possible solutions to the remaining challenges. Finally, this survey concludes with a discussion about other considerations like conditional computation and promising directions towards this field. A list of papers reviewed in this survey, along with their corresponding codes, is available at: https://github.com/zju-vipa/awesome-neural-trees

READ FULL TEXT
research
04/01/2020

NBDT: Neural-Backed Decision Trees

Deep learning is being adopted in settings where accurate and justifiabl...
research
12/28/2020

A Survey on Neural Network Interpretability

Along with the great success of deep neural networks, there is also grow...
research
05/04/2023

When Do Neural Nets Outperform Boosted Trees on Tabular Data?

Tabular data is one of the most commonly used types of data in machine l...
research
02/14/2021

Connecting Interpretability and Robustness in Decision Trees through Separation

Recent research has recognized interpretability and robustness as essent...
research
06/08/2019

Provably Robust Boosted Decision Stumps and Trees against Adversarial Attacks

The problem of adversarial samples has been studied extensively for neur...
research
09/01/2022

The Neural Process Family: Survey, Applications and Perspectives

The standard approaches to neural network implementation yield powerful ...
research
11/11/2022

What's the Situation with Intelligent Mesh Generation: A Survey and Perspectives

Intelligent Mesh Generation (IMG) represents a novel and promising field...

Please sign up or login with your details

Forgot password? Click here to reset