1 Introduction
In the recent years, recommender systems (RS) have attracted a lot of interest in both industry and academic research communities, mainly due to new challenges that the design of a decisive and efficient RS presents. Given a set of customers (or users), the goal of RS is to provide a personalized recommendation of products to users which would likely to be of their interest. Common examples of applications include the recommendation of movies (Netflix, Amazon Prime Video), music (Pandora), videos (YouTube), news content (Outbrain) or advertisements (Google). The development of an efficient RS is critical from both the company and the consumer perspective. On one hand, users usually face a very large number of options: for instance, Amazon proposes over 20,000 movies in its selection, and it is therefore important to help them to take the best possible decision by narrowing down the choices they have to make. On the other hand, major companies report significant increase of their traffic and sales coming from personalized recommendations: Amazon declares that of its sales is generated by recommendations, twothirds of the movies watched on Netflix are recommended and of ChoiceStream users said that they would buy more music, provided the fact that they meet their tastes and interests.^{1}^{1}1
Talk of Xavier Amatriain  Recommender Systems  Machine Learning Summer School 2014 @ CMU.
Two main approaches have been proposed to tackle this problem [1]. The first one, referred to as ContentBased recommendation technique [2] makes use of existing contextual information about the users (e.g. demographic information) or items (e.g. textual description) for recommendation. The second approach, referred to as collaborative filtering (CF) and undoubtedly the most popular one, relies on the past interactions and recommends items to users based on the feedback provided by other similar users. Feedback can be explicit, in the form of ratings; or implicit, which includes clicks, browsing over an item or listening to a song. Such implicit feedback is readily available in abundance but is more challenging to take into account as it does not clearly depict the preference of a user for an item. Explicit feedback, on the other hand, is very hard to get in abundance.
The adaptation of CF systems designed for another type of feedback has been shown to be suboptimal as the basic hypothesis of these systems inherently depends on the nature of the feedback [3]. Further, learning a suitable representation of users and items has been shown to be the bottleneck of these systems [4], mostly in the cases where contextual information over users and items which allow to have a richer representation is unavailable.
In this paper we are interested in the learning of user preferences mostly provided in the form of implicit feedback in RS. Our aim is twofold and concerns:

the development of a theoretical framework for learning user preference in recommender systems and its analysis in the worst case where all users provide a minimum of positive/negative feedback;

the design of a new neuralnetwork model based on this framework that learns the preference of users over pairs of items and their representations in an embedded space simultaneously without requiring any contextual information.
We extensively validate our proposed approach over standard benchmarks with implicit feedback by comparing it to state of the art models.
The remainder of this paper is organized as follows. In Section 2, we define the notations and the proposed framework, and analyze its theoretical properties. Then, Section 3 provides an overview of existing related methods. Section 4
is devoted to numerical experiments on four realworld benchmark data sets including binarized versions of MovieLens and Netflix, and one real data set on online advertising. We compare different versions of our model with stateoftheart methods showing the appropriateness of our contribution. Finally, we summarize the study and give possible future research perspectives in Section
5.2 User preference and embedding learning with Neural nets
We denote by (resp. ) the set of indexes over users (resp. the set of indexes over items). Further, for each user , we consider two subsets of items and such that;

and ,

for any pair of items ; has a preference, symbolized by . Hence implies that, user prefers item over item .
From this preference relation, a desired output is defined over each triplet as:
(1) 
2.1 Learning objective
The learning task we address is to find a scoring function from the class of functions that minimizes the ranking loss:
(2) 
where measures the cardinality of sets and is the indicator function which is equal to , if the predicate is true, and otherwise. Here we suppose that there exists a mapping function that projects a pair of user and item indices into a feature space of dimension , and a function such that each function can be decomposed as:
(3) 
In the next section we will present a NeuralNetwork model that learns the mapping function and outputs the function
based on a nonlinear transformation of the useritem feature representation, defining the function
.The previous loss (2) is a pairwise ranking loss and it is related to the Area under the ROC curve [5]. The learning objective is, hence, to find a function from the class of functions with a small expected risk, by minimizing the empirical error over a training set
constituted over users, , and their respective preferences over items, and is given by:
(4) 
However this minimization problem involves dependent random variables as for each user and item ; all comparisons involved in the empirical error (4) share the same observation . Different studies proposed generalization error bounds for learning with interdependent data [6]. Among the prominent works that address this problem are a series of contributions based on the idea of graph coloring introduced in [7], and which consists in dividing a graph that links dependent variables represented by its nodes into sets of independent variables, called the exact proper fractional cover of and defined as:
Definition 1 (Exact proper fractional cover of , [7])
Let be a graph. , for some positive integer , with and is an exact proper fractional cover of , if: i) it is proper: is an independent set, i.e., there is no connections between vertices in ; ii) it is an exact fractional cover of : .
The weight of is given by: and the minimum weight over the set of all exact proper fractional covers of is the fractional chromatic number of .
Figure 1 depicts an exact proper fractional cover corresponding to the problem we consider for a toy problem with user , and items preferred over other ones. In this case, the nodes of the dependency graph correspond to pairs constituted by; pairs of the user and each of the preferred items, with the pairs constituted by the user and each of the no preferred items, involved in the empirical loss (4). Among all the sets containing independent pairs of examples, the one shown in Figure 1, is the exact proper fractional cover of the and the fractional chromatic number is in this case .
By mixing the idea of graph coloring with the Laplace transform, Hoeffding like concentration inequalities for the sum of dependent random variables are proposed by [7]. In [8] this result is extended to provide a generalization of the bounded differences inequality of [9] to the case of interdependent random variables. This extension then paved the way for the definition of the fractional Rademacher complexity that generalizes the idea of Rademacher complexity and allows one to derive generalization bounds for scenarios where the training data are made of dependent data.
In the worst case scenario where all users provide the lowest interactions over the items, which constitutes the bottleneck of all recommendation systems:
the empirical loss (4) is upperbounded by:
(5) 
Following [10, Proposition 4]
, a generalization error bound can be derived for the second term of the inequality above based on local Rademacher Complexities that implies secondorder (i.e. variance) information inducing faster convergence rates.
For sake of presentation and in order to be in line with the learning representations of users and items in an embedded space introduced in Section 2.2, let us consider kernelbased hypotheses with a positive semidefinite (PSD) kernel and its associated feature mapping function. Further we consider linear functions in the feature space with bounded norm:
(6) 
where
is the weight vector defining the kernelbased hypotheses and
denotes the dot product. We further define the following associated function class:and the parameterized family which, for , is defined as:
where denotes the variance. The fractional Rademacher complexity introduced in [8] entails our analysis:
where is the total number of triplets in the training set and is a sequence of independent Rademacher variables verifying .
Theorem 1
Let be a set of independent users, such that each user prefers items over ones in a predefined set of items. Let be the associated training set, then for any the following generalization bound holds for all
with probability at least
:where , and
The proof is given in Appendix. This result suggests that :

in the case where the feature space is of finite dimension; lower values of involves lower kernel estimation and hence lower complexity term which implies a tighter generalization bound.
2.2 A Neural Network model to learn user preference
Some studies proposed to find the dyadic representation of users and items in an embedded space, using neighborhood similarity information [12] or the Bayesian Personalized Ranking (BPR) [13]
. In this section we propose a feedforward Neural Network, denoted as
RecNet, to learn jointly the embedding representation, , as well as the scoring function, , defined previously. The input of the network is a triplet composed by the indexes of an item , a user and a second item ; such that the user has a preference over the pair of items expressed by the desired output , defined with respect to the preference relation (Eq. 1). Each index in the triplet is then transformed to a corresponding binary indicator vector and having all its characteristics equal to except the one that indicates the position of the user or the items in its respective set, which is equal to . Hence, the following onehot vector corresponds to the binary vector representation of user :The network entails then three successive layers, namely Embedding (SG), Mapping and Dense hidden layers depicted in Figure 2.

The Embedding layer transforms the sparse binary representations of the user and each of the items to a denser realvalued vectors. We denote by and the transformed vectors of user and item ; and and the corresponding matrices. Note that as the binary indicator vectors of users and items contain one single nonnull characteristic, each entry of the corresponding dense vector in the SG layer is connected by only one weight to that characteristic.

The Mapping layer is composed of two groups of units each being obtained from the elementwise product between the user representation vector of a user and a corresponding item representation vector of an item inducing the feature representation of the pair .

Each of these units are also fully connected to the units of a Dense layer composed of successive hidden layers (see Section 4
for more details related to the number of hidden units and the activation function used in this layer) .
The model is trained such that the output of each of the dense layers reflects the relationship between the corresponding item and the user and is mathematically defined by a multivariate realvalued function . Hence, for an input , the output of each of the dense layers is a realvalue score that reflects a preference associated to the corresponding pair or (i.e. or ). Finally the prediction given by RecNet for an input is:
(7) 
2.3 Algorithmic implementation
We decompose the ranking loss as a linear combination of two logistic surrogates:
(8) 
where the first term reflects the ability of the nonlinear transformation of user and item feature representations, , to respect the relative ordering of items with respect to users’ preferences:
(9) 
The second term focuses on the quality of the compact dense vector representations of items and users that have to be found, as measured by the ability of the dotproduct in the resulting embedded vector space to respect the relative ordering of preferred items by users:
(10) 
where is a regularization parameter for the user and items norms. Finally, one can also consider a version in which both losses are assigned different weights:
(11) 
where is a realvalued parameter to balance between ranking prediction ability and expressiveness of the learned item and user representations. Both options will be discussed in the experimental section.
Training phase
The training of the RecNet is done by backpropagating [14] the errorgradients from the output to both the deep and embedding parts of the model using minibatch stochastic optimization (Algorithm 1).
During training, the input layer takes a random set of size of interactions by building triplets based on this set, and generating a sparse representation from id’s vector corresponding to the picked user and the pair of items. The binary vectors of the examples in are then propagated throughout the network, and the ranking error (Eq. 8) is backpropagated.
Model Testing
As for the prediction phase, shown in Algorithm 2, a ranked list of the preferred items for each user in the test set is maintained while retrieving the set . Given the latent representations of the triplets, and the weights learned; the two first items in are placed in in a way which ensures that preferred one, , is in the first position. Then, the algorithm retrieves the next item, by comparing it to . This step is simply carried out by comparing the model’s output over the concatenated binary indicator vectors of and .
Hence, if , which from Equation 7 is equivalent to , then is predicted to be preferred over ; ; and it is put at the first place instead of in . Here we assume that the predicted preference relation is transitive, which then ensures that the predicted order in the list is respected. Otherwise, if is predicted to be preferred over , then is compared to the second preferred item in the list, using the model’ prediction as before, and so on. The new item, , is inserted in in the case if it is found to be preferred over another item in .
By repeating the process until the end of , we obtain a ranked list of the most preferred items for the user . Algorithm 2 does not require an ordering of the whole set of items, as also in most cases we are just interested in the relevancy of the top ranked items for assessing the quality of a model. Further, its complexity is at most which is convenient in the case where . The merits of a similar algorithm have been discussed by [15] but, as pointed out above, the basic assumption for inserting a new item in the ranked list is that the predicted preference relation induced by the model should be transitive, which may not hold in general.
In our experiments, we also tested a more conventional inference algorithm, which for a given user , consists in the ordering of items in with respect to the output given by the function , and we did not find any substantial difference in the performance of RecNet, as presented in the following section.
3 (Un)related work
This section provides an overview of the stateoftheart approaches that are the most similar to ours.
3.1 Neural Language Models
Neural language models have proven themselves to be successful in many natural language processing tasks including speech recognition, information retrieval and sentiment analysis. These models are based on a distributional hypothesis stating that words, occurring in the same context with the same frequency, are similar. In order to capture such similarities, these approaches propose to embed the word distribution into a lowdimensional continuous space using Neural Networks, leading to the development of several powerful and highly scalable language models such as the word2Vec SkipGram (SG) model
[16, 17].The recent work of [18] has shown new opportunities to extend the word representation learning to characterize more complicated pieces of information. In fact, this paper established the equivalence between SG model with negative sampling, and implicitly factorizing a pointwise mutual information (PMI) matrix. Further, they demonstrated that word embedding can be applied to different types of data, provided that it is possible to design an appropriate context matrix for them. This idea has been successfully applied to recommendation systems where different approaches attempted to learn representations of items and users in an embedded space in order to meet the problem of recommendation more efficiently [19, 20, 21].
In [22], the authors used a bagofword vector representation of items and users, from which the latent representations of latter are learned through word2vec. [20] proposed a model that relies on the intuitive idea that the pairs of items which are scored in the same way by different users are similar. The approach reduces to finding both the latent representations of users and items, with the traditional Matrix Factorization (MF) approach, and simultaneously learning item embeddings using a cooccurrence shifted positive PMI (SPPMI) matrix defined by items and their context. The latter is used as a regularization term in the traditional objective function of MF. Similarly, in [21] the authors proposed Prod2Vec, which embeds items using a NeuralNetwork language model applied to a time series of user purchases. This model was further extended in [23] who, by defining appropriate context matrices, proposed a new model called MetaProd2Vec. Their approach learns a representation for both items and side information available in the system. The embedding of additional information is further used to regularize the item embedding. Inspired by the concept of sequence of words; the approach proposed by [19] defined the consumption of items by users as trajectories. Then, the embedding of items is learned using the SG model and the users’ embeddings are further used to predict the next item in the trajectory. In these approaches, the learning of item and user representations are employed to make prediction with predefined or fixed similarity functions (such as dotproducts) in the embedded space.
3.2 LearningtoRank with Neural Networks
Motivated by automatically tuning the parameters involved in the combination of different scoring functions, LearningtoRank approaches were originally developed for Information Retrieval (IR) tasks and are grouped into three main categories: pointwise, listwise and pairwise [24].
assume that each queried document pair has an ordinal score. Ranking is then formulated as a regression problem, in which the rank value of each document is estimated as an absolute quantity. In the case where relevance judgments are given as pairwise preferences (rather than relevance degrees), it is usually not straightforward to apply these algorithms for learning. Moreover, pointwise techniques do not consider the interdependency among documents, so that the position of documents in the final ranked list is missing in the regressionlike loss functions used for parameter tuning. On the other hand, listwise approaches
[27, 28, 29] take the entire ranked list of documents for each query as a training instance. As a direct consequence, these approaches are able to differentiate documents from different queries, and consider their position in the output ranked list at the training stage. Listwise techniques aim to directly optimize a ranking measure, so they generally face a complex optimization problem dealing with nonconvex, nondifferentiable and discontinuous functions. Finally, in pairwise approaches [30, 31, 32, 33]the ranked list is decomposed into a set of document pairs. Ranking is therefore considered as the classification of pairs of documents, such that a classifier is trained by minimizing the number of misorderings in ranking. In the test phase, the classifier assigns a positive or negative class label to a document pair that indicates which of the documents in the pair should be better ranked than the other one.
Perhaps the first Neural Network model for ranking is RankProp, originally proposed by [34]. RankProp is a pointwise approach that alternates between two phases of learning the desired real outputs by minimizing a Mean Squared Error (MSE) objective, and a modification of the desired values themselves to reflect the current ranking given by the net. Later on [35] proposed RankNet, a pairwise approach, that learns a preference function by minimizing a cross entropy cost over the pairs of relevant and irrelevant examples. SortNet proposed by [36, 37] also learns a preference function by minimizing a ranking loss over the pairs of examples that are selected iteratively with the overall aim of maximizing the quality of the ranking. The three approaches above consider the problem of LearningtoRank for IR and without learning an embedding.
4 Experimental Results
We conducted a number of experiments aimed at evaluating how the simultaneous learning of user and item representations, as well as the preferences of users over items can be efficiently handled with RecNet. To this end, we considered four realworld benchmarks commonly used for collaborative filtering. We validated our approach with respect to different hyperparameters that impact the accuracy of the model and compare it with competitive stateoftheart approaches.
We run all experiments on a cluster of five 32 core Intel Xeon @ 2.6Ghz CPU (with 20MB cache per core) systems with 256 Giga RAM running Debian GNU/Linux 8.6 (wheezy) operating system. All subsequently discussed components were implemented in Python3 using the TensorFlow library with version 1.4.0.
^{2}^{2}2https://www.tensorflow.org/. ^{3}^{3}3For research purpose we will make available all the codes implementing Algorithms 1 and 2 that we used in our experiments and all the preprocessed datasets.4.1 Datasets
We report results obtained on three publicly available movie datasets, for the task of personalized topN recommendation: MovieLens^{4}^{4}4https://movielens.org/ 100K (ML100K), MovieLens 1M (ML1M) [38], Netflix^{5}^{5}5http://academictorrents.com/details/9b13183dc4d60676b773c9e2cd6de5e5542cee9a, and one clicks dataset, KasandrGermany ^{6}^{6}6https://archive.ics.uci.edu/ml/datasets/KASANDR [39], a recently released data set for online advertising.

ML100K, ML1M and Netflix consists of usermovie ratings, on a scale of one to five, collected from a movie recommendation service and the Netflix company. The latter was released to support the Netlfix Prize competition^{7}^{7}7B. James and L. Stan, The Netflix Prize (2007).. For all three datasets, we only keep users who have rated at least five movies and remove users who gave the same rating for all movies. In addition, for Netflix, we take a subset of the original data and randomly sample of the users and of the items. In the following experiments, as we only compare with approaches developed for the ranking purposes and our model is designed to handle implicit feedback, these three data sets are made binary such that a rating higher or equal to 4 is set to 1 and to 0 otherwise.

The original Kasandr dataset contains the interactions and clicks done by the users of Kelkoo, an online advertising platform, across twenty Europeans countries. In this article, we used a subset of Kasandr that only considers interactions from Germany. It gathers 17,764,280 interactions from 521,685 users on 2,299,713 offers belonging to 272 categories and spanning across 801 merchants. For Kasandr, we remove users who gave the same rating for all offers. This implies that all the users who never clicked or always clicked on each and every offer shown to them were removed.
Table I provides the basic statistics on these collections after preprocessing, as discussed above.
# of users  # of items  # of interactions  Sparsity  

ML100K  943  1,682  100,000  93.685% 
ML1M  6,040  3,706  1,000,209  95.530% 
Netflix  90,137  3,560  4,188,098  98.700% 
Kasandr  25,848  1,513,038  9,489,273  99.976% 
4.2 Experimental setup
Compared baselines
In order to validate the framework defined in the previous section, we propose to compare the following approaches.

BPRMF [13]
provides an optimization criterion based on implicit feedback; which is the maximum posterior estimator derived from a Bayesian analysis of the pairwise ranking problem, and proposes an algorithm based on Stochastic Gradient Descent to optimize it. The model can further be extended to the explicit feedback case.

CoFactor [20], developed for implicit feedback, constraints the objective of matrix factorization to use jointly item representations with a factorized shifted positive pointwise mutual information matrix of item cooccurrence counts. The model was found to outperform WMF [40] also proposed for implicit feedback.

LightFM [41] was first proposed to deal with the problem of coldstart using meta information. As with our approach, it relies on learning the embedding of users and items with the Skipgram model and optimizes the crossentropy loss.

RecNet focuses on the quality of the latent representation of users and items by learning the preference and the representation through the ranking loss (Eq. 10).

RecNet focuses on the accuracy of the score obtained at the output of the framework and therefore learns the preference and the representation through the ranking loss (Eq. 9).

RecNet uses a linear combination of and as the objective function, with . We study the two situations presented before (w.r.t. the presence/absence of a supplementary weighting hyperparameter).
ML100K  ML1M  Netflix  Kasandr  

RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  
# units 
ML100K  ML1M  Netflix  Kasandr  

RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  RecNet  
# units 
Evaluation protocol
For each dataset, we sort the interactions according to time, and take 80% for training the model and the remaining 20% for testing it. In addition, we remove all users and offers which do not occur during the training phase. We study two different scenarios for the prediction phase: (1) for a given user, the prediction is done only on the items that were shown to him or her; (2) the prediction is done over the set of all items, regardless of any knowledge about previous interactions. In the context of movie recommendation, a shown item is defined as a movie for which the given user provided a rating. For Kasandr, the definition is quite straightforward as the data were collected from an online advertising platform, where the items are displayed to the users, who can either click or ignore them.
The first setting is arguably the most common in academic research, but is abstracted from the realworld problem as at the time of making the recommendation, the notion of shown items is not available, therefore forcing the RS to consider the set of all items as potential candidates. As a result, in this setting, for ML100K, ML1M, Kasandr and Netflix, we only consider in average 25, 72, 6 and 8 items for prediction per user. The goal of the second setting is to reflect this realworld scenario, and we can expect lower results than in the first setting as the size of the search space of items increases considerably. To summarize, predicting only among the items that were shown to user evaluates the model’s capability of retrieving highly rated items among the shown ones, while predicting among all items measures the performance of the model on the basis of its ability to recommend offers which user would like to engage in.
All comparisons are done based on a common ranking metric, namely the Mean Average Precision (MAP). First, let us recall that the Average Precision (AP) is defined over the precision, (fraction of recommended items clicked by the user), at rank .
where the relevance judgments, , are binary (i.e. equal to when the item is clicked or preferred, and 0 otherwise). Then, the mean of these AP’s across all users is the MAP. In the following results, we report MAP at different rank and .
Hyperparameters tuning
First, we provide a detailed study of the impact of the different hyperparameters involved in the proposed framework . For all datasets, hyperparameters tuning is done on a separate validation set.

The size of the embedding is chosen among . The impact of on the performance is presented in Figure 7.

We use regularization on the embeddings and choose .

We run RecNet
with 1 hidden layer with relu activation functions, where the number of hidden units is chosen in
. 
Finally, we fix the number of epochs to be in advance and the size of minibatches to .

One can see that all three versions of RecNet perform the best with a quite small number of hidden units, only one hidden layer and a low dimension for the representation. As a consequence, they involve a few number of parameters to tune while training.

In terms of the ability to recover a relevant ranked list of items for each user, we also tune the hyperparameter (Eq. 11) which balances the weight given to the two terms in . These results are shown in Figure 12, where the values of are taken in the interval . While it seems to play a significant role on ML100K and Kasandr, we can see that for ML1M the results in terms of MAP are stable, regardless the value of .
From Figure 7, when prediction is done on the interacted offers, it is clear that best MAP@1 results are generally obtained with small sizes of item and user embedded vector spaces . These empirical results support our theoretical analysis where we found that small induces smaller generalization bounds. This observation on the dimension of embedding is also in agreement with the conclusion of [41], which uses the same technique for representation learning. For instance, one can see that on ML1M, the highest MAP is achieved with a dimension of embedding equals to . Since in the interacted offers setting, the prediction is done among the very few shown offers, RecNet makes nonpersonalized recommendations. This is due to the fact that having means that the recommendations for a given user with a positive (negative) value is done by sorting the positive (negative) items according to their learned embeddings, and in some sense, can therefore be seen as a bipolar popularity model. This means that in such cases popularity and nonpersonalized based approaches are perhaps the best way to make recommendations. For reproducibility purpose, we report the best combination of parameters for each variant of RecNet in Table II and Table III.
ML100K  ML1M  Netflix  Kasandr  

MAP@1  MAP@10  MAP@1  MAP@10  MAP@1  MAP@10  MAP@1  MAP@10  
BPRMF  0.909  
LightFM  
CoFactor  
RecNet  0.894  0.848  0.847  
RecNet  0.839  
RecNet  0.884  0.839  0.847  0.973 
ML100K  ML1M  Netflix  Kasandr  
MAP@1  MAP@10  MAP@1  MAP@10  MAP@1  MAP@10  MAP@1  MAP@10  
BPRMF  0.261  
LightFM  
CoFactor  
RecNet  
RecNet  0.239  0.209  0.220  0.080  0.089  
RecNet  0.269  0.284 
4.3 Results
Hereafter, we compare and summarize the performance of RecNet with the baseline methods on various data sets. Empirically, we observed that the version of where both and have an equal weight while training gives better results on average, and we decided to only report these results later.
Tables IV and V report all results. In addition, in each case, we statistically compare the performance of each algorithm, and we use bold face to indicate the highest performance, and the symbol indicates that performance is significantly worst than the best result, according to a Wilcoxon rank sum test used at a pvalue threshold of [43].
Setting 1 : interacted items
When the prediction is done over offers which user interacted with (Table IV), the RecNet architecture, regardless the weight given to , beats all the other algorithms on Kasandr, ML100K and ML1M. However, on Netflix, BPRMF outperforms our approach in terms of MAP@1. This may be owing to the fact that the binarized Netflix movie data set is strongly biased towards the popular movies and usually, the majority of users have watched one or the other popular movies in such data sets and rated them well. In Netflix, around of the users have given ratings greater to 4 to the top10 movies. We believe that this phenomenon adversely affects the performance of RecNet. However, on Kasandr, which is the only true implicit dataset RecNet significantly outperforms all other approaches.
Setting 2 : all items
When the prediction is done over all offers (Table V), we can make two observations. First, all the algorithms encounters an extreme drop of their performance in terms of MAP. Second, RecNet framework significantly outperforms all other algorithms on all datasets, and this difference is all the more important on Kasandr, where for instance RecNet is in average 15 times more efficient. We believe, that our model is a fresh departure from the models which learn pairwise ranking function without the knowledge of embeddings or which learn embeddings without learning any pairwise ranking function. While learning pairwise ranking function, our model is aware of the learned embeddings so far and viceversa. We demonstrate that the simultaneous learning of two ranking functions helps in learning hidden features of implicit data and improves the performance of RecNet.
Comparison between RecNet versions
One can note that while optimizing ranking losses by Eq. 8 or Eq. 9 or Eq. 10, we simultaneously learn representation and preference function; the main difference is the amount of emphasis we put in learning one or another. The results presented in both tables tend to demonstrate that, in almost all cases, optimizing the linear combination of the pairwiseranking loss and the embedding loss (RecNet) indeed increases the quality of overall recommendations than optimizing standalone losses to learn embeddings and pairwise preference function. For instance, when the prediction is done over offers which user interacted with (Table IV), (RecNet) outperforms (RecNet) and (RecNet) on ML1M, Kasandr and Netflix. When prediction is done on all offers (Table V), (RecNet) outperforms (RecNet) and (RecNet) on Kasandr. Thus, in case of interacted offers setting, optimizing ranking and embedding loss simultaneously boosts performance on all datasets. However, in the setting of all offers, optimizing both losses simultaneously is beneficial in case of true implicit feedback datasets such as Kasandr(recall that all other datasets were synthetically made implicit).
5 Conclusion
We presented and analyzed a learning to rank framework for recommender systems which consists of learning user preferences over items. We showed that the minimization of pairwise ranking loss over user preferences involves dependent random variables and provided a theoretical analysis by proving the consistency of the empirical risk minimization in the worst case where all users choose a minimal number of positive and negative items. From this analysis we then proposed RecNet, a new neuralnetwork based model for learning the user preference, where both the user’s and item’s representations and the function modeling the user’s preference over pairs of items are learned simultaneously. The learning phase is guided using a ranking objective that can capture the ranking ability of the prediction function as well as the expressiveness of the learned embedded space, where the preference of users over items is respected by the dot product function defined over that space. The training of RecNet is carried out using the backpropagation algorithm in minibatches defined over a useritem matrix containing implicit information in the form of subsets of preferred and nonpreferred items. The learning capability of the model over both prediction and representation problems show their interconnection and also that the proposed double ranking objective allows to conjugate them well. We assessed and validated the proposed approach through extensive experiments, using four popular collections proposed for the task of recommendation. Furthermore, we propose to study two different settings for the prediction phase and demonstrate that the performance of each approach is strongly impacted by the set of items considered for making the prediction.
For future work, we would like to extend RecNet in order to take into account additional contextual information regarding users and/or items. More specifically, we are interested in the integration of data of different natures, such as text or demographic information. We believe that this information can be taken into account without much effort and by doing so, it is possible to improve the performance of our approach and tackle the problem of providing recommendation for new users/items at the same time, also known as the coldstart problem. The second important extension will be the development of an online version of the proposed algorithm in order to make the approach suitable for realtime applications and online advertising. Finally, we have shown that choosing a suitable , which controls the the tradeoff between ranking and embedding loss, greatly impact the performance of the proposed framework, and we believe that an interesting extension will be to learn automatically this hyperparameter, and to make it adaptive during the training phase.
Acknowledgements
This work was partly done under the Calypso project supported by the FEDER program from the Région AuvergneRhôneAlpes. The research of Yury Maximov at LANL was supported by Center of Non Linear Studies (CNLS).
References
 [1] F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor, Recommender Systems Handbook, 1st ed. New York, NY, USA: SpringerVerlag New York, Inc., 2010.
 [2] P. Lops, M. de Gemmis, and G. Semeraro, “Contentbased recommender systems: State of the art and trends.” in Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor, Eds. Springer, 2011, pp. 73–105.
 [3] R. White, J. M. Jose, and I. Ruthven, “Comparing explicit and implicit feedback techniques for web retrieval: TREC10 interactive track report,” in Proceedings of TREC, 2001.

[4]
H. Wang, N. Wang, and D. Yeung, “Collaborative deep learning for recommender systems,” in
Proceedings of SIGKDD, 2015, pp. 1235–1244.  [5] N. Usunier, M. Amini, and P. Gallinari, “A datadependent generalisation error bound for the AUC,” in ICML’05 workshop on ROC Analysis in Machine Learning, Bonn, Germany, 2005.
 [6] M.R. Amini and N. Usunier, Learning with Partially Labeled and Interdependent Data. New York, NY, USA: Springer, 2015.
 [7] S. Janson, “Large Deviations for Sums of Partly Dependent Random Variables,” Random Structures and Algorithms, vol. 24, no. 3, pp. 234–248, 2004.
 [8] N. Usunier, M.R. Amini, and P. Gallinari, “Generalization error bounds for classifiers trained with interdependent data,” in Proceedings of NIPS, 2006, pp. 1369–1376.
 [9] C. McDiarmid, “On the method of bounded differences,” Survey in Combinatorics, pp. 148–188, 1989.
 [10] L. Ralaivola and M. Amini, “Entropybased concentration inequalities for dependent variables,” 2015, pp. 2436–2444.

[11]
V. Vapnik,
The nature of statistical learning theory
. Springer Science & Business Media, 2000.  [12] M. Volkovs and G. W. Yu, “Effective latent models for binary feedback in recommender systems,” in Proceedings of SIGIR, 2015, pp. 313–322.
 [13] S. Rendle, C. Freudenthaler, Z. Gantner, and L. SchmidtThieme, “BPR: bayesian personalized ranking from implicit feedback,” in Proceedings of UAI, 2009, pp. 452–461.
 [14] L. Bottou, “Stochastic gradient descent tricks,” in Neural Networks: Tricks of the Trade  Second Edition, 2012, pp. 421–436.
 [15] N. Ailon and M. Mohri, “An efficient reduction of ranking to classification,” in Proceedings of COLT, (2008), pp. 87–98.
 [16] T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” CoRR, vol. abs/1301.3781, 2013.

[17]
T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, “Distributed representations of words and phrases and their compositionality,” in
Proceedings of NIPS, 2013, pp. 3111–3119.  [18] O. Levy and Y. Goldberg, “Neural word embedding as implicit matrix factorization,” in Proceedings of NIPS, 2014, pp. 2177–2185.
 [19] É. GuàrdiaSebaoun, V. Guigue, and P. Gallinari, “Latent trajectory modeling: A light and efficient way to introduce time in recommender systems,” in Proceedings of RecSys, 2015, pp. 281–284.
 [20] D. Liang, J. Altosaar, L. Charlin, and D. M. Blei, “Factorization meets the item embedding: Regularizing matrix factorization with item cooccurrence,” in Proceedings of RecSys, 2016, pp. 59–66.
 [21] M. Grbovic, V. Radosavljevic, N. Djuric, N. Bhamidipati, J. Savla, V. Bhagwan, and D. Sharp, “Ecommerce in your inbox: Product recommendations at scale,” in Proceedings of SIGKDD, 2015, pp. 1809–1818.
 [22] X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T. Chua, “Neural collaborative filtering,” in Proceedings of WWW, 2017, pp. 173–182.
 [23] F. Vasile, E. Smirnova, and A. Conneau, “Metaprod2vec: Product embeddings using sideinformation for recommendation,” in Proceedings of RecSys, 2016, pp. 225–232.
 [24] T. Liu, “Learning to rank for information retrieval,” Foundations and Trends in Information Retrieval, vol. 3, no. 3, pp. 225–331, 2009.
 [25] K. Crammer and Y. Singer, “Pranking with ranking,” in Proceedings of NIPS, 2001, pp. 641–647.

[26]
P. Li, C. J. C. Burges, and Q. Wu, “Mcrank: Learning to rank using multiple classification and gradient boosting,” in
Proceedings of NIPS, 2007, pp. 897–904.  [27] Y. Shi, M. Larson, and A. Hanjalic, “Listwise learning to rank with matrix factorization for collaborative filtering,” in Proceedings of RecSys, 2010, pp. 269–272.
 [28] J. Xu and H. Li, “Adarank: a boosting algorithm for information retrieval,” in Proceedings of SIGIR, 2007, pp. 391–398.
 [29] J. Xu, T. Liu, M. Lu, H. Li, and W. Ma, “Directly optimizing evaluation measures in learning to rank,” in Proceedings of SIGIR, 2008, pp. 107–114.
 [30] W. W. Cohen, R. E. Schapire, and Y. Singer, “Learning to order things,” J. Artif. Intell. Res. (JAIR), vol. 10, pp. 243–270, 1999.
 [31] Y. Freund, R. D. Iyer, R. E. Schapire, and Y. Singer, “An efficient boosting algorithm for combining preferences,” Journal of Machine Learning Research, vol. 4, pp. 933–969, 2003.
 [32] T. Joachims, “Optimizing search engines using clickthrough data,” in Proceedings of SIGKDD, 2002, pp. 133–142.
 [33] J. Pessiot, T. Truong, N. Usunier, M. Amini, and P. Gallinari, “Learning to rank for collaborative filtering,” in Proceedings of ICEIS, 2007, pp. 145–151.
 [34] R. Caruana, S. Baluja, and T. M. Mitchell, “Using the future to sort out the present: Rankprop and multitask learning for medical risk evaluation,” in Proceedings of NIPS, 1995, pp. 959–965.
 [35] C. J. C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, and G. N. Hullender, “Learning to rank using gradient descent,” in Proceedings of ICML, 2005, pp. 89–96.
 [36] L. Rigutini, T. Papini, M. Maggini, and M. Bianchini, “A neural network approach for learning object ranking,” in Proceedings of ICANN, 2008, pp. 899–908.
 [37] L. Rigutini, T. Papini, M. Maggini, and F. Scarselli, “Sortnet: Learning to rank by a neural preference function,” IEEE Trans. Neural Networks, vol. 22, no. 9, pp. 1368–1380, 2011.
 [38] F. M. Harper and J. A. Konstan, “The movielens datasets: History and context,” ACM Trans. Interact. Intell. Syst., vol. 5, no. 4, pp. 19:1–19:19, Dec. 2015.
 [39] S. Sidana, C. Laclau, M.R. Amini, G. Vandelle, and A. BoisCrettez, “Kasandr: A largescale dataset with implicit feedback for recommendation,” in Proceedings of SIGIR, 2017.
 [40] Y. Hu, Y. Koren, and C. Volinsky, “Collaborative filtering for implicit feedback datasets,” in Proceedings of ICDM, 2008, pp. 263–272.
 [41] M. Kula, “Metadata embeddings for user and item coldstart recommendations,” in Proceedings of the 2nd Workshop on New Trends on ContentBased Recommender Systems colocated with RecSys., 2015, pp. 14–21.
 [42] D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” CoRR, vol. abs/1412.6980, 2014.
 [43] E. Lehmann and H. D’Abrera, Nonparametrics: statistical methods based on ranks. Springer, 2006.