DeepAI AI Chat
Log In Sign Up

A Survey of Neural Trees

by   Haoling Li, et al.

Neural networks (NNs) and decision trees (DTs) are both popular models of machine learning, yet coming with mutually exclusive advantages and limitations. To bring the best of the two worlds, a variety of approaches are proposed to integrate NNs and DTs explicitly or implicitly. In this survey, these approaches are organized in a school which we term as neural trees (NTs). This survey aims to present a comprehensive review of NTs and attempts to identify how they enhance the model interpretability. We first propose a thorough taxonomy of NTs that expresses the gradual integration and co-evolution of NNs and DTs. Afterward, we analyze NTs in terms of their interpretability and performance, and suggest possible solutions to the remaining challenges. Finally, this survey concludes with a discussion about other considerations like conditional computation and promising directions towards this field. A list of papers reviewed in this survey, along with their corresponding codes, is available at:


NBDT: Neural-Backed Decision Trees

Deep learning is being adopted in settings where accurate and justifiabl...

A Survey on Neural Network Interpretability

Along with the great success of deep neural networks, there is also grow...

Connecting Interpretability and Robustness in Decision Trees through Separation

Recent research has recognized interpretability and robustness as essent...

Provably Robust Boosted Decision Stumps and Trees against Adversarial Attacks

The problem of adversarial samples has been studied extensively for neur...

3D Brain and Heart Volume Generative Models: A Survey

Generative models such as generative adversarial networks and autoencode...

The Neural Process Family: Survey, Applications and Perspectives

The standard approaches to neural network implementation yield powerful ...

Code Repositories


Introduction, selected papers and possible corresponding codes in our review paper "A Survey of Neural Trees"

view repo