MARS-Gym: A Gym framework to model, train, and evaluate Recommender Systems for Marketplaces

09/30/2020
by   Marlesson R. O. Santana, et al.
0

Recommender Systems are especially challenging for marketplaces since they must maximize user satisfaction while maintaining the healthiness and fairness of such ecosystems. In this context, we observed a lack of resources to design, train, and evaluate agents that learn by interacting within these environments. For this matter, we propose MARS-Gym, an open-source framework to empower researchers and engineers to quickly build and evaluate Reinforcement Learning agents for recommendations in marketplaces. MARS-Gym addresses the whole development pipeline: data processing, model design and optimization, and multi-sided evaluation. We also provide the implementation of a diverse set of baseline agents, with a metrics-driven analysis of them in the Trivago marketplace dataset, to illustrate how to conduct a holistic assessment using the available metrics of recommendation, off-policy estimation, and fairness. With MARS-Gym, we expect to bridge the gap between academic research and production systems, as well as to facilitate the design of new algorithms and applications.

READ FULL TEXT
research
03/16/2021

Fairness and Transparency in Recommendation: The Users' Perspective

Though recommender systems are defined by personalization, recent work h...
research
09/05/2021

Recommendation Fairness: From Static to Dynamic

Driven by the need to capture users' evolving interests and optimize the...
research
07/30/2019

Multi-stakeholder Recommendation and its Connection to Multi-sided Fairness

There is growing research interest in recommendation as a multi-stakehol...
research
09/07/2023

VideolandGPT: A User Study on a Conversational Recommender System

This paper investigates how large language models (LLMs) can enhance rec...
research
03/03/2021

Elliot: a Comprehensive and Rigorous Framework for Reproducible Recommender Systems Evaluation

Recommender Systems have shown to be an effective way to alleviate the o...
research
06/23/2020

A Framework for Fairness in Two-Sided Marketplaces

Many interesting problems in the Internet industry can be framed as a tw...
research
07/15/2021

You Do Not Need a Bigger Boat: Recommendations at Reasonable Scale in a (Mostly) Serverless and Open Stack

We argue that immature data pipelines are preventing a large portion of ...

Please sign up or login with your details

Forgot password? Click here to reset