Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations: a COVID-19 case-study

07/16/2021
by   Alessio Mascolini, et al.
11

Computer-aided analysis of biological images typically requires extensive training on large-scale annotated datasets, which is not viable in many situations. In this paper we present GAN-DL, a Discriminator Learner based on the StyleGAN2 architecture, which we employ for self-supervised image representation learning in the case of fluorescent biological images. We show that Wasserstein Generative Adversarial Networks combined with linear Support Vector Machines enable high-throughput compound screening based on raw images. We demonstrate this by classifying active and inactive compounds tested for the inhibition of SARS-CoV-2 infection in VERO and HRCE cell lines. In contrast to previous methods, our deep learning based approach does not require any annotation besides the one that is normally collected during the sample preparation process. We test our technique on the RxRx19a Sars-CoV-2 image collection. The dataset consists of fluorescent images that were generated to assess the ability of regulatory-approved or in late-stage clinical trials compound to modulate the in vitro infection from SARS-CoV-2 in both VERO and HRCE cell lines. We show that our technique can be exploited not only for classification tasks, but also to effectively derive a dose response curve for the tested treatments, in a self-supervised manner. Lastly, we demonstrate its generalization capabilities by successfully addressing a zero-shot learning task, consisting in the categorization of four different cell types of the RxRx1 fluorescent images collection.

READ FULL TEXT

page 3

page 4

page 6

page 8

research
06/17/2019

Boosting Supervision with Self-Supervision for Few-shot Learning

We present a technique to improve the transferability of deep representa...
research
08/12/2022

CCRL: Contrastive Cell Representation Learning

Cell identification within the H E slides is an essential prerequisite...
research
03/08/2023

VOLTA: an Environment-Aware Contrastive Cell Representation Learning for Histopathology

In clinical practice, many diagnosis tasks rely on the identification of...
research
12/07/2020

Self-supervised Deep Learning for Reading Activity Classification

Reading analysis can give important information about a user's confidenc...
research
03/07/2022

Comparing representations of biological data learned with different AI paradigms, augmenting and cropping strategies

Recent advances in computer vision and robotics enabled automated large-...
research
06/23/2020

Gaining insight into SARS-CoV-2 infection and COVID-19 severity using self-supervised edge features and Graph Neural Networks

Graph Neural Networks (GNN) have been extensively used to extract meanin...

Please sign up or login with your details

Forgot password? Click here to reset