research
∙
04/18/2023
Think Before You Act: Unified Policy for Interleaving Language Reasoning with Actions
The success of transformer models trained with a language modeling objec...
share
research
∙
04/14/2023
Sub-meter resolution canopy height maps using self-supervised learning and a vision transformer trained on Aerial and GEDI Lidar
Vegetation structure mapping is critical for understanding the global ca...
research
∙
04/14/2023
DINOv2: Learning Robust Visual Features without Supervision
The recent breakthroughs in natural language processing for model pretra...
research
∙
01/19/2023
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
This paper demonstrates an approach for learning highly semantic image r...
research
∙
01/05/2023
Learning Goal-Conditioned Policies Offline with Self-Supervised Reward Shaping
Developing agents that can execute multiple skills by learning from pre-...
research
∙
12/09/2022
Co-training 2^L Submodels for Visual Recognition
We introduce submodel co-training, a regularization method related to co...
research
∙
10/13/2022
The Hidden Uniform Cluster Prior in Self-Supervised Learning
A successful paradigm in representation learning is to perform self-supe...
research
∙
06/23/2022
Walk the Random Walk: Learning to Discover and Reach Goals Without Supervision
Learning a diverse set of skills by interacting with an environment with...
research
∙
04/14/2022
Masked Siamese Networks for Label-Efficient Learning
We propose Masked Siamese Networks (MSN), a self-supervised learning fra...
research
∙
02/16/2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision
Discriminative self-supervised learning allows training models on any ra...
research
∙
12/27/2021
Augmenting Convolutional networks with attention-based aggregation
We show how to augment any convolutional network with an attention-based...
research
∙
12/16/2021
Towards Unsupervised Dense Information Retrieval with Contrastive Learning
Information retrieval is an important component in natural language proc...
research
∙
06/17/2021
XCiT: Cross-Covariance Image Transformers
Following their success in natural language processing, transformers hav...
research
∙
05/07/2021
ResMLP: Feedforward networks for image classification with data-efficient training
We present ResMLP, an architecture built entirely upon multi-layer perce...
research
∙
04/29/2021
Emerging Properties in Self-Supervised Vision Transformers
In this paper, we question if self-supervised learning provides new prop...
research
∙
04/28/2021
Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samples
This paper proposes a novel method of learning by predicting view assign...
research
∙
03/02/2021
Self-supervised Pretraining of Visual Features in the Wild
Recently, self-supervised learning methods like MoCo, SimCLR, BYOL and S...
research
∙
01/13/2021
Memory-Augmented Reinforcement Learning for Image-Goal Navigation
In this work, we address the problem of image-goal navigation in the con...
research
∙
06/17/2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Unsupervised image representations have significantly reduced the gap wi...
research
∙
04/10/2020
Learning to Visually Navigate in Photorealistic Environments Without any Supervision
Learning to navigate in a realistic setting where an agent must rely sol...
research
∙
01/10/2020
Pruning Convolutional Neural Networks with Self-Supervision
Convolutional neural networks trained without supervision come close to ...
research
∙
10/14/2019
Updating Pre-trained Word Vectors and Text Classifiers using Monolingual Alignment
In this paper, we focus on the problem of adapting word vector-based mod...
research
∙
05/23/2019
Misspelling Oblivious Word Embeddings
In this paper we present a method to learn word embeddings that are resi...
research
∙
05/19/2019
Adaptive Attention Span in Transformers
We propose a novel self-attention mechanism that can learn its optimal a...
research
∙
05/03/2019
Leveraging Large-Scale Uncurated Data for Unsupervised Pre-training of Visual Features
Pre-training general-purpose visual features with convolutional neural n...
research
∙
07/15/2018
Deep Clustering for Unsupervised Learning of Visual Features
Clustering is a class of unsupervised learning methods that has been ext...
research
∙
04/20/2018
Improving Supervised Bilingual Mapping of Word Embeddings
Continuous word representations, learned on different languages, can be ...
research
∙
03/29/2018
Colorless green recurrent networks dream hierarchically
Recurrent neural networks (RNNs) have achieved impressive results in a v...
research
∙
02/19/2018
Learning Word Vectors for 157 Languages
Distributed word representations, or word vectors, have recently been ap...
research
∙
12/26/2017
Advances in Pre-Training Distributed Word Representations
Many Natural Language Processing applications nowadays rely on pre-train...
research
∙
10/30/2017
Fast Linear Model for Knowledge Graph Embeddings
This paper shows that a simple baseline based on a Bag-of-Words (BoW) re...
research
∙
07/27/2017
Learning from Video and Text via Large-Scale Discriminative Clustering
Discriminative clustering has been successfully applied to a number of w...
research
∙
07/18/2017
Optimizing the Latent Space of Generative Networks
Generative Adversarial Networks (GANs) have been shown to be able to sam...
research
∙
04/28/2017
Parseval Networks: Improving Robustness to Adversarial Examples
We introduce Parseval networks, a form of deep neural networks in which ...
research
∙
04/18/2017
Unsupervised Learning by Predicting Noise
Convolutional neural networks provide visual features that perform remar...
research
∙
12/12/2016
FastText.zip: Compressing text classification models
We consider the problem of producing compact architectures for text clas...
research
∙
07/15/2016
Enriching Word Vectors with Subword Information
Continuous word representations, trained on large unlabeled corpora are ...
research
∙
07/06/2016
Bag of Tricks for Efficient Text Classification
This paper explores a simple and efficient baseline for text classificat...
research
∙
11/19/2015
Alternative structures for character-level RNNs
Recurrent neural networks are convenient and efficient models for langua...
research
∙
06/30/2015
Unsupervised Learning from Narrated Instruction Videos
We address the problem of automatically learning the main steps to compl...
research
∙
07/04/2014