Rank-Based Multi-task Learning for Fair Regression

by   Chen Zhao, et al.

In this work, we develop a novel fairness learning approach for multi-task regression models based on a biased training dataset, using a popular rank-based non-parametric independence test, i.e., Mann Whitney U statistic, for measuring the dependency between target variable and protected variables. To solve this learning problem efficiently, we first reformulate the problem as a new non-convex optimization problem, in which a non-convex constraint is defined based on group-wise ranking functions of individual objects. We then develop an efficient model-training algorithm based on the framework of non-convex alternating direction method of multipliers (NC-ADMM), in which one of the main challenges is to implement an efficient projection oracle to the preceding non-convex set defined based on ranking functions. Through the extensive experiments on both synthetic and real-world datasets, we validated the out-performance of our new approach against several state-of-the-art competitive methods on several popular metrics relevant to fairness learning.


Variable Selection and Task Grouping for Multi-Task Learning

We consider multi-task learning, which simultaneously learns related pre...

Multi-Stage Multi-Task Feature Learning

Multi-task sparse feature learning aims to improve the generalization pe...

Efficient and Scalable Multi-task Regression on Massive Number of Tasks

Many real-world large-scale regression problems can be formulated as Mul...

Unfairness Discovery and Prevention For Few-Shot Regression

We study fairness in supervised few-shot meta-learning models that are s...

Multi-output Polynomial Networks and Factorization Machines

Factorization machines and polynomial networks are supervised polynomial...

Multi-task Learning with High-Dimensional Noisy Images

Recent medical imaging studies have given rise to distinct but inter-rel...

A Novel Euler's Elastica based Segmentation Approach for Noisy Images via using the Progressive Hedging Algorithm

Euler's Elastica based unsupervised segmentation models have strong capa...