research
∙
11/15/2022
Mechanistic Mode Connectivity
Neural networks are known to be biased towards learning mechanisms that ...
share
research
∙
10/02/2022
What shapes the loss landscape of self-supervised learning?
Prevention of complete and dimensional collapse of representations has r...
research
∙
05/23/2022
Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering
Federated learning is generally used in tasks where labels are readily a...
research
∙
11/05/2021
Augmentations in Graph Contrastive Learning: Current Methodological Flaws Towards Better Practices
Graph classification has applications in bioinformatics, social sciences...
research
∙
06/10/2021
Beyond BatchNorm: Towards a General Understanding of Normalization in Deep Learning
Inspired by BatchNorm, there has been an explosion of normalization laye...
research
∙
02/04/2021
Rethinking Quadratic Regularizers: Explicit Movement Regularization for Continual Learning
Quadratic regularizers are often used for mitigating catastrophic forget...
research
∙
09/24/2020
A Gradient Flow Framework For Analyzing Network Pruning
Recent network pruning methods focus on pruning models early-on in train...
research
∙
09/10/2020