On the Fairness of Randomized Trials for Recommendation With Heterogeneous Demographics and Beyond

01/25/2020
by   Zifeng Wang, et al.
1

Observed events in recommendation are consequence of the decisions made by a policy, thus they are usually selectively labeled, namely the data are Missing Not At Random (MNAR), which often causes large bias to the estimate of true outcomes risk. A general approach to correct MNAR bias is performing small Randomized Controlled Trials (RCTs), where an additional uniform policy is employed to randomly assign items to each user. In this work, we concentrate on the fairness of RCTs under both homogeneous and heterogeneous demographics, especially analyzing the bias for the least favorable group on the latter setting. Considering RCTs' limitations, we propose a novel Counterfactual Robust Risk Minimization (CRRM) framework, which is totally free of expensive RCTs, and derive its theoretical generalization error bound. At last, empirical experiments are performed on synthetic tasks and real-world data sets, substantiating our method's superiority both in fairness and generalization.

READ FULL TEXT
research
09/06/2020

Information Theoretic Counterfactual Learning from Missing-Not-At-Random Feedback

Counterfactual learning for dealing with missing-not-at-random data (MNA...
research
04/22/2020

Alleviating the recommendation bias via rank aggregation

The primary goal of a recommender system is often known as "helping user...
research
09/05/2023

Fairness of Exposure in Dynamic Recommendation

Exposure bias is a well-known issue in recommender systems where the exp...
research
05/10/2022

Selective Fairness in Recommendation via Prompts

Recommendation fairness has attracted great attention recently. In real-...
research
07/10/2023

Counterfactual Explanation for Fairness in Recommendation

Fairness-aware recommendation eliminates discrimination issues to build ...
research
05/12/2023

A Causal Roadmap for Hybrid Randomized and Real-World Data Designs: Case Study of Semaglutide and Cardiovascular Outcomes

Introduction: Increasing interest in real-world evidence has fueled the ...
research
06/13/2023

Learning under Selective Labels with Data from Heterogeneous Decision-makers: An Instrumental Variable Approach

We study the problem of learning with selectively labeled data, which ar...

Please sign up or login with your details

Forgot password? Click here to reset