Causal Discovery and Injection for Feed-Forward Neural Networks

05/19/2022
by   Fabrizio Russo, et al.
0

Neural networks have proven to be effective at solving a wide range of problems but it is often unclear whether they learn any meaningful causal relationship: this poses a problem for the robustness of neural network models and their use for high-stakes decisions. We propose a novel method overcoming this issue by injecting knowledge in the form of (possibly partial) causal graphs into feed-forward neural networks, so that the learnt model is guaranteed to conform to the graph, hence adhering to expert knowledge. This knowledge may be given up-front or during the learning process, to improve the model through human-AI collaboration. We apply our method to synthetic and real (tabular) data showing that it is robust against noise and can improve causal discovery and prediction performance in low data regimes.

READ FULL TEXT

page 7

page 11

research
11/18/2022

Global quantitative robustness of regression feed-forward neural networks

Neural networks are an indispensable model class for many complex learni...
research
03/28/2018

Feed-forward Uncertainty Propagation in Belief and Neural Networks

We propose a feed-forward inference method applicable to belief and neur...
research
05/12/2016

Direct Method for Training Feed-forward Neural Networks using Batch Extended Kalman Filter for Multi-Step-Ahead Predictions

This paper is dedicated to the long-term, or multi-step-ahead, time seri...
research
03/23/2021

Contrastive Reasoning in Neural Networks

Neural networks represent data as projections on trained weights in a hi...
research
05/07/2020

Lifted Regression/Reconstruction Networks

In this work we propose lifted regression/reconstruction networks (LRRNs...
research
12/10/2020

Interpreting Neural Networks as Gradual Argumentation Frameworks (Including Proof Appendix)

We show that an interesting class of feed-forward neural networks can be...
research
03/16/2023

Causal Temporal Graph Convolutional Neural Networks (CTGCN)

Many large-scale applications can be elegantly represented using graph s...

Please sign up or login with your details

Forgot password? Click here to reset