RaFM: Rank-Aware Factorization Machines

05/18/2019
by   Xiaoshuang Chen, et al.
0

Factorization machines (FM) are a popular model class to learn pairwise interactions by a low-rank approximation. Different from existing FM-based approaches which use a fixed rank for all features, this paper proposes a Rank-Aware FM (RaFM) model which adopts pairwise interactions from embeddings with different ranks. The proposed model achieves a better performance on real-world datasets where different features have significantly varying frequencies of occurrences. Moreover, we prove that the RaFM model can be stored, evaluated, and trained as efficiently as one single FM, and under some reasonable conditions it can be even significantly more efficient than FM. RaFM improves the performance of FMs in both regression tasks and classification tasks while incurring less computational burden, therefore also has attractive potential in industrial applications.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

04/17/2018

A Boosting Framework of Factorization Machine

Recently, Factorization Machines (FM) has become more and more popular f...
07/29/2016

Polynomial Networks and Factorization Machines: New Insights and Efficient Training Algorithms

Polynomial networks and factorization machines are two recently-proposed...
04/29/2020

DS-FACTO: Doubly Separable Factorization Machines

Factorization Machines (FM) are powerful class of models that incorporat...
08/17/2021

Memory-Efficient Factorization Machines via Binarizing both Data and Model Coefficients

Factorization Machines (FM), a general predictor that can efficiently mo...
12/31/2021

Neural Hierarchical Factorization Machines for User's Event Sequence Analysis

Many prediction tasks of real-world applications need to model multi-ord...
02/17/2016

Low-Rank Factorization of Determinantal Point Processes for Recommendation

Determinantal point processes (DPPs) have garnered attention as an elega...
05/22/2017

Multi-output Polynomial Networks and Factorization Machines

Factorization machines and polynomial networks are supervised polynomial...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.