Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy

06/15/2023
by   Wolfgang M. Pernice, et al.
0

Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal replicate structure of two novel single-cell fluorescent microscopy datasets, we propose generally applicable tests to assess the extent to which models learn causal representations across increasingly challenging levels of OOD-generalization. We show that despite seemingly strong performance, as assessed by other established metrics, both naive and contemporary baselines designed to ward against confounding, collapse on these tests. We introduce a new method, Interventional Style Transfer (IST), that substantially improves OOD generalization by generating interventional training distributions in which spurious correlations between biological causes and nuisances are mitigated. We publish our code and datasets.

READ FULL TEXT

page 3

page 6

page 12

page 13

research
10/12/2020

Reformulating Unsupervised Style Transfer as Paraphrase Generation

Modern NLP defines the task of style transfer as modifying the style of ...
research
06/09/2023

Adaptive Contextual Perception: How to Generalize to New Backgrounds and Ambiguous Objects

Biological vision systems make adaptive use of context to recognize obje...
research
11/23/2021

Multi-Modality Microscopy Image Style Transfer for Nuclei Segmentation

Annotating microscopy images for nuclei segmentation is laborious and ti...
research
03/17/2018

Dear Sir or Madam, May I introduce the YAFC Corpus: Corpus, Benchmarks and Metrics for Formality Style Transfer

Style transfer is the task of automatically transforming a piece of text...
research
02/10/2021

Self-Supervised VQ-VAE For One-Shot Music Style Transfer

Neural style transfer, allowing to apply the artistic style of one image...
research
12/22/2020

Generative Interventions for Causal Learning

We introduce a framework for learning robust visual representations that...
research
11/29/2021

Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective

Learning behavioral patterns from observational data has been a de-facto...

Please sign up or login with your details

Forgot password? Click here to reset