Removal of Batch Effects using Distribution-Matching Residual Networks

10/13/2016
by   Uri Shaham, et al.
0

Sources of variability in experimentally derived data include measurement error in addition to the physical phenomena of interest. This measurement error is a combination of systematic components, originating from the measuring instrument, and random measurement errors. Several novel biological technologies, such as mass cytometry and single-cell RNA-seq, are plagued with systematic errors that may severely affect statistical analysis if the data is not properly calibrated. We propose a novel deep learning approach for removing systematic batch effects. Our method is based on a residual network, trained to minimize the Maximum Mean Discrepancy (MMD) between the multivariate distributions of two replicates, measured in different batches. We apply our method to mass cytometry and single-cell RNA-seq datasets, and demonstrate that it effectively attenuates batch effects.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2020

The effect of measurement error on clustering algorithms

Clustering consists of a popular set of techniques used to separate data...
research
11/15/2019

Batch correction of high-dimensional data

Biomedical research often produces high-dimensional data confounded by b...
research
01/20/2019

Removal of Batch Effects using Generative Adversarial Networks

Many biological data analysis processes like Cytometry or Next Generatio...
research
06/07/2023

Uncovering solutions from data corrupted by systematic errors: A physics-constrained convolutional neural network approach

Information on natural phenomena and engineering systems is typically co...
research
06/26/2021

A general, simple, robust method to account for measurement error when analyzing data with an internal validation subsample

Background: Measurement errors in terms of quantification or classificat...
research
07/03/2021

Sibling Regression for Generalized Linear Models

Field observations form the basis of many scientific studies, especially...
research
12/17/2020

SRoll3: A neural network approach to reduce large-scale systematic effects in the Planck High Frequency Instrument maps

In the present work, we propose a neural network based data inversion ap...

Please sign up or login with your details

Forgot password? Click here to reset