Orthogonal Inductive Matrix Completion

04/03/2020
by   Antoine Ledent, et al.
0

We propose orthogonal inductive matrix completion (OMIC), an interpretable model composed of a sum of matrix completion terms, each with orthonormal side information. We can inject prior knowledge about the eigenvectors of the ground truth matrix, whilst maintaining the representation capability of the model. We present a provably converging algorithm that optimizes all components of the model simultaneously, using nuclear-norm regularisation. Our method is backed up by distribution-free learning guarantees that improve with the quality of the injected knowledge. As a special case of our general framework, we study a model consisting of a sum of user and item biases (generic behaviour), a non-inductive term (specific behaviour), and an inductive term using side information. Our theoretical analysis shows that ϵ-recovering the ground truth matrix requires at most O( n+m+(√(n)+√(m))mn √(r)C/ϵ^2) entries, where r is the rank of the ground truth matrix. We analyse the performance of OMIC on several synthetic and real datasets. On synthetic datasets with a sliding scale of user bias relevance, we show that OMIC better adapts to different regimes than other methods and can recover the ground truth. On real life datasets containing user/items recommendations and relevant side information, we find that OMIC surpasses the state of the art, with the added benefit of greater interpretability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/25/2021

Inductive Matrix Completion Using Graph Autoencoder

Recently, the graph neural network (GNN) has shown great power in matrix...
research
08/24/2022

Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion

The matrix completion problem seeks to recover a d× d ground truth matri...
research
04/27/2018

Sparse Group Inductive Matrix Completion

We consider the problem of inductive matrix completion under the assumpt...
research
01/31/2022

Inductive Matrix Completion: No Bad Local Minima and a Fast Algorithm

The inductive matrix completion (IMC) problem is to recover a low rank m...
research
12/16/2022

Generalization Bounds for Inductive Matrix Completion in Low-noise Settings

We study inductive matrix completion (matrix completion with side inform...
research
03/07/2022

Fast rates for noisy interpolation require rethinking the effects of inductive bias

Good generalization performance on high-dimensional data crucially hinge...
research
07/28/2020

Modeling Behaviour to Predict User State: Self-Reports as Ground Truth

Methods that detect user states such as emotions are useful for interact...

Please sign up or login with your details

Forgot password? Click here to reset