A Loss-Function for Causal Machine-Learning

01/02/2020
by   I-Sheng Yang, et al.
82

Causal machine-learning is about predicting the net-effect (true-lift) of treatments. Given the data of a treatment group and a control group, it is similar to a standard supervised-learning problem. Unfortunately, there is no similarly well-defined loss function due to the lack of point-wise true values in the data. Many advances in modern machine-learning are not directly applicable due to the absence of such loss function. We propose a novel method to define a loss function in this context, which is equal to mean-square-error (MSE) in a standard regression problem. Our loss function is universally applicable, thus providing a general standard to evaluate the quality of any model/strategy that predicts the true-lift. We demonstrate that despite its novel definition, one can still perform gradient descent directly on this loss function to find the best fit. This leads to a new way to train any parameter-based model, such as deep neural networks, to solve causal machine-learning problems without going through the meta-learner strategy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/25/2018

MSCE: An edge preserving robust loss function for improving super-resolution algorithms

With the recent advancement in the deep learning technologies such as CN...
research
10/22/2021

The Causal Loss: Driving Correlation to Imply Causation

Most algorithms in classical and contemporary machine learning focus on ...
research
06/07/2021

Error Loss Networks

A novel model called error loss network (ELN) is proposed to build an er...
research
10/25/2019

Components of Machine Learning: Binding Bits and FLOPS

Many machine learning problems and methods are combinations of three com...
research
01/20/2021

Component Tree Loss Function: Definition and Optimization

In this article, we propose a method to design loss functions based on c...
research
05/15/2023

The Effectiveness of a Dynamic Loss Function in Neural Network Based Automated Essay Scoring

Neural networks and in particular the attention mechanism have brought s...
research
03/28/2019

PAL: A fast DNN optimization method based on curvature information

We present a novel optimizer for deep neural networks that combines the ...

Please sign up or login with your details

Forgot password? Click here to reset