Feedback Detection for Live Predictors

10/10/2013
by   Stefan Wager, et al.
0

A predictor that is deployed in a live production system may perturb the features it uses to make predictions. Such a feedback loop can occur, for example, when a model that predicts a certain type of behavior ends up causing the behavior it predicts, thus creating a self-fulfilling prophecy. In this paper we analyze predictor feedback detection as a causal inference problem, and introduce a local randomization scheme that can be used to detect non-linear feedback in real-world problems. We conduct a pilot study for our proposed methodology using a predictive system currently deployed as a part of a search engine.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/29/2017

Runaway Feedback Loops in Predictive Policing

Predictive policing systems are increasingly used to determine how to al...
research
10/26/2022

Asymmetric predictability in causal discovery: an information theoretic approach

Causal investigations in observational studies pose a great challenge in...
research
09/15/2020

Competing AI: How does competition feedback affect machine learning?

This papers studies how competition affects machine learning (ML) predic...
research
09/05/2011

ShareBoost: Efficient Multiclass Learning with Feature Sharing

Multiclass prediction is the problem of classifying an object into a rel...
research
02/13/2019

Distributed Online Linear Regression

We study online linear regression problems in a distributed setting, whe...
research
12/07/2021

Estimating Quality of Transmission in a Live Production Network using Machine Learning

We demonstrate QoT estimation in a live network utilizing neural network...
research
12/06/2021

Tele-EvalNet: A Low-cost, Teleconsultation System for Home based Rehabilitation of Stroke Survivors using Multiscale CNN-LSTM Architecture

Technology has an important role to play in the field of Rehabilitation,...

Please sign up or login with your details

Forgot password? Click here to reset