Network On Network for Tabular Data Classification in Real-world Applications

05/20/2020
by   Yuanfei Luo, et al.
2

Tabular data is the most common data format adopted by our customers ranging from retail, finance to E-commerce, and tabular data classification plays an essential role to their businesses. In this paper, we present Network On Network (NON), a practical tabular data classification model based on deep neural network to provide accurate predictions. Various deep methods have been proposed and promising progress has been made. However, most of them use operations like neural network and factorization machines to fuse the embeddings of different features directly, and linearly combine the outputs of those operations to get the final prediction. As a result, the intra-field information and the non-linear interactions between those operations (e.g. neural network and factorization machines) are ignored. Intra-field information is the information that features inside each field belong to the same field. NON is proposed to take full advantage of intra-field information and non-linear interactions. It consists of three components: field-wise network at the bottom to capture the intra-field information, across field network in the middle to choose suitable operations data-drivenly, and operation fusion network on the top to fuse outputs of the chosen operations deeply. Extensive experiments on six real-world datasets demonstrate NON can outperform the state-of-the-art models significantly. Furthermore, both qualitative and quantitative study of the features in the embedding space show NON can capture intra-field information effectively.

READ FULL TEXT

page 8

page 9

research
09/13/2020

Field-Embedded Factorization Machines for Click-through rate prediction

Click-through rate (CTR) prediction models are common in many online app...
research
07/26/2021

ContextNet: A Click-Through Rate Prediction Framework Using Contextual information to Refine Feature Embedding

Click-through rate (CTR) estimation is a fundamental task in personalize...
research
07/06/2020

GateNet: Gating-Enhanced Deep Network for Click-Through Rate Prediction

Advertising and feed ranking are essential to many Internet companies su...
research
03/28/2019

Multimodal Deep Network Embedding with Integrated Structure and Attribute Information

Network embedding is the process of learning low-dimensional representat...
research
09/16/2018

Aesthetic-based Clothing Recommendation

Recently, product images have gained increasing attention in clothing re...
research
02/20/2021

FM^2: Field-matrixed Factorization Machines for Recommender Systems

Click-through rate (CTR) prediction plays a critical role in recommender...
research
06/17/2020

Multi-Subspace Neural Network for Image Recognition

In image classification task, feature extraction is always a big issue. ...

Please sign up or login with your details

Forgot password? Click here to reset