Better Hit the Nail on the Head than Beat around the Bush: Removing Protected Attributes with a Single Projection

12/08/2022
by   Pantea Haghighatkhah, et al.
0

Bias elimination and recent probing studies attempt to remove specific information from embedding spaces. Here it is important to remove as much of the target information as possible, while preserving any other information present. INLP is a popular recent method which removes specific information through iterative nullspace projections. Multiple iterations, however, increase the risk that information other than the target is negatively affected. We introduce two methods that find a single targeted projection: Mean Projection (MP, more efficient) and Tukey Median Projection (TMP, with theoretical guarantees). Our comparison between MP and INLP shows that (1) one MP projection removes linear separability based on the target and (2) MP has less impact on the overall space. Further analysis shows that applying random projections after MP leads to the same overall effects on the embedding space as the multiple projections of INLP. Applying one targeted (MP) projection hence is methodologically cleaner than applying multiple (INLP) projections that introduce random effects.

READ FULL TEXT
research
07/10/2014

Numerical investigation of lensless zoomable holographic multiple projections to tilted planes

This paper numerically investigates the feasibility of lensless zoomable...
research
04/16/2020

Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection

The ability to control for the kinds of information encoded in neural re...
research
05/11/2017

Sketching Word Vectors Through Hashing

We propose a new fast word embedding technique using hash functions. The...
research
12/01/2021

Invariance principle of random projection for the norm

Johnson-Lindenstrauss guarantees certain topological structure is preser...
research
08/27/2015

A biologically constrained model of the whole basal ganglia addressing the paradoxes of connections and selection

The basal ganglia nuclei form a complex network of nuclei often assumed ...
research
07/21/2021

Formal method of synthesis of optimal topologies of computing systems based on projective description of graphs

A deterministic method for synthesizing the interconnect topologies opti...
research
10/14/2021

Talking Detection In Collaborative Learning Environments

We study the problem of detecting talking activities in collaborative le...

Please sign up or login with your details

Forgot password? Click here to reset