Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed

On the Fairness of Randomized Trials for Recommendation With Heterogeneous Demographics and Beyond

Jan 25, 2020
Zifeng Wang, Xi Chen, Rui Wen, Shao-Lun Huang



Observed events in recommendation are consequence of the decisions made by a policy, thus they are usually \emph{selectively} labeled, namely the data are \emph{Missing Not At Random} (MNAR), which often causes large bias to the estimate of true outcomes risk. A general approach to correct MNAR bias is performing small \emph{Randomized Controlled Trials} (RCTs), where an additional \emph{uniform policy} is employed to randomly assign items to each user. In this work, we concentrate on the fairness of RCTs under both homogeneous and heterogeneous demographics, especially analyzing the bias for the least favorable group on the latter setting. Considering RCTs' limitations, we propose a novel \emph{Counterfactual Robust Risk Minimization} (CRRM) framework, which is totally free of expensive RCTs, and derive its theoretical generalization error bound. At last, empirical experiments are performed on synthetic tasks and real-world data sets, substantiating our method's superiority both in fairness and generalization.



Share this with someone who'll enjoy it:

   Access Paper Source



Share this with someone who'll enjoy it: