Simple Modifications to Improve Tabular Neural Networks

08/06/2021
by   James Fiedler, et al.
0

There is growing interest in neural network architectures for tabular data. Many general-purpose tabular deep learning models have been introduced recently, with performance sometimes rivaling gradient boosted decision trees (GBDTs). These recent models draw inspiration from various sources, including GBDTs, factorization machines, and neural networks from other application domains. Previous tabular neural networks are also drawn upon, but are possibly under-considered, especially models associated with specific tabular problems. This paper focuses on several such models, and proposes modifications for improving their performance. When modified, these models are shown to be competitive with leading general-purpose tabular models, including GBDTs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/26/2019

Deep Learning and Word Embeddings for Tweet Classification for Crisis Response

Tradition tweet classification models for crisis response focus on convo...
research
04/01/2020

NBDT: Neural-Backed Decision Trees

Deep learning is being adopted in settings where accurate and justifiabl...
research
08/04/2023

Towards Improving Harmonic Sensitivity and Prediction Stability for Singing Melody Extraction

In deep learning research, many melody extraction models rely on redesig...
research
05/31/2023

Optimal Decision Trees for Separable Objectives: Pushing the Limits of Dynamic Programming

Global optimization of decision trees has shown to be promising in terms...
research
11/25/2021

GPR1200: A Benchmark for General-Purpose Content-Based Image Retrieval

Even though it has extensively been shown that retrieval specific traini...
research
05/25/2022

Ultra-compact Binary Neural Networks for Human Activity Recognition on RISC-V Processors

Human Activity Recognition (HAR) is a relevant inference task in many mo...
research
10/20/2021

A Data-Centric Optimization Framework for Machine Learning

Rapid progress in deep learning is leading to a diverse set of quickly c...

Please sign up or login with your details

Forgot password? Click here to reset