GraphFM: Graph Factorization Machines for Feature Interaction Modeling

05/25/2021
by   Zekun Li, et al.
7

Factorization machine (FM) is a prevalent approach to modeling pairwise (second-order) feature interactions when dealing with high-dimensional sparse data. However, on the one hand, FM fails to capture higher-order feature interactions suffering from combinatorial expansion, on the other hand, taking into account interaction between every pair of features may introduce noise and degrade prediction accuracy. To solve the problems, we propose a novel approach Graph Factorization Machine (GraphFM) by naturally representing features in the graph structure. In particular, a novel mechanism is designed to select the beneficial feature interactions and formulate them as edges between features. Then our proposed model which integrates the interaction function of FM into the feature aggregation strategy of Graph Neural Network (GNN), can model arbitrary-order feature interactions on the graph-structured features by stacking layers. Experimental results on several real-world datasets has demonstrated the rationality and effectiveness of our proposed approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2022

Explicit Feature Interaction-aware Graph Neural Networks

Graph neural networks are powerful methods to handle graph-structured da...
research
10/19/2020

Factorization Machines with Regularization for Sparse Feature Interactions

Factorization machines (FMs) are machine learning predictive models base...
research
09/07/2019

Adaptive Factorization Network: Learning Adaptive-Order Feature Interactions

Various factorization-based methods have been proposed to leverage secon...
research
02/26/2019

Interaction-aware Factorization Machines for Recommender Systems

Factorization Machine (FM) is a widely used supervised learning approach...
research
07/29/2020

Interactive Feature Generation via Learning Adjacency Tensor of Feature Graph

To automate the generation of interactive features, recent methods are p...
research
06/08/2021

Principled Hyperedge Prediction with Structural Spectral Features and Neural Networks

Hypergraph offers a framework to depict the multilateral relationships i...
research
12/25/2017

Strongly Hierarchical Factorization Machines and ANOVA Kernel Regression

High-order parametric models that include terms for feature interactions...

Please sign up or login with your details

Forgot password? Click here to reset