CLAWS: Contrastive Learning with hard Attention and Weak Supervision

12/01/2021
by   Jansel Herrera-Gerena, et al.
0

Learning effective visual representations without human supervision is a long-standing problem in computer vision. Recent advances in self-supervised learning algorithms have utilized contrastive learning, with methods such as SimCLR, which applies a composition of augmentations to an image, and minimizes a contrastive loss between the two augmented images. In this paper, we present CLAWS, an annotation-efficient learning framework, addressing the problem of manually labeling large-scale agricultural datasets along with potential applications such as anomaly detection and plant growth analytics. CLAWS uses a network backbone inspired by SimCLR and weak supervision to investigate the effect of contrastive learning within class clusters. In addition, we inject a hard attention mask to the cropped input image before maximizing agreement between the image pairs using a contrastive loss function. This mask forces the network to focus on pertinent object features and ignore background features. We compare results between a supervised SimCLR and CLAWS using an agricultural dataset with 227,060 samples consisting of 11 different crop classes. Our experiments and extensive evaluations show that CLAWS achieves a competitive NMI score of 0.7325. Furthermore, CLAWS engenders the creation of low dimensional representations of very large datasets with minimal parameter tuning and forming well-defined clusters, which lends themselves to using efficient, transparent, and highly interpretable clustering methods such as Gaussian Mixture Models.

READ FULL TEXT
research
05/18/2021

Masked Contrastive Learning for Anomaly Detection

Detecting anomalies is one fundamental aspect of a safety-critical softw...
research
08/12/2022

Contrastive Learning for Object Detection

Contrastive learning is commonly used as a method of self-supervised lea...
research
08/12/2022

Contrastive Learning for OOD in Object detection

Contrastive learning is commonly applied to self-supervised learning, an...
research
11/04/2021

MixSiam: A Mixture-based Approach to Self-supervised Representation Learning

Recently contrastive learning has shown significant progress in learning...
research
10/02/2020

Hard Negative Mixing for Contrastive Learning

Contrastive learning has become a key component of self-supervised learn...
research
07/27/2022

Time to augment contrastive learning

Biological vision systems are unparalleled in their ability to learn vis...
research
09/02/2022

Artifact-Tolerant Clustering-Guided Contrastive Embedding Learning for Ophthalmic Images

Ophthalmic images and derivatives such as the retinal nerve fiber layer ...

Please sign up or login with your details

Forgot password? Click here to reset