Three-quarter Sibling Regression for Denoising Observational Data

by   Shiv Shankar, et al.

Many ecological studies and conservation policies are based on field observations of species, which can be affected by systematic variability introduced by the observation process. A recently introduced causal modeling technique called 'half-sibling regression' can detect and correct for systematic errors in measurements of multiple independent random variables. However, it will remove intrinsic variability if the variables are dependent, and therefore does not apply to many situations, including modeling of species counts that are controlled by common causes. We present a technique called 'three-quarter sibling regression' to partially overcome this limitation. It can filter the effect of systematic noise when the latent variables have observed common causes. We provide theoretical justification of this approach, demonstrate its effectiveness on synthetic data, and show that it reduces systematic detection variability due to moon brightness in moth surveys.


page 1

page 2

page 3

page 4


Sibling Regression for Generalized Linear Models

Field observations form the basis of many scientific studies, especially...

Removing systematic errors for exoplanet search via latent causes

We describe a method for removing the effect of confounders in order to ...

Learning Functional Causal Models with Generative Neural Networks

We introduce a new approach to functional causal modeling from observati...

Leveraging directed causal discovery to detect latent common causes

The discovery of causal relationships is a fundamental problem in scienc...

StatEcoNet: Statistical Ecology Neural Networks for Species Distribution Modeling

This paper focuses on a core task in computational sustainability and st...

Neural Processes Mixed-Effect Models for Deep Normative Modeling of Clinical Neuroimaging Data

Normative modeling has recently been introduced as a promising approach ...

Multimodal Latent Variable Analysis

Consider a set of multiple, multimodal sensors capturing a complex syste...