research
∙
02/27/2023
LLaMA: Open and Efficient Foundation Language Models
We introduce LLaMA, a collection of foundation language models ranging f...
share
research
∙
02/22/2023
Deep Generative Symbolic Regression with Monte-Carlo-Tree-Search
Symbolic regression (SR) is the problem of learning a symbolic expressio...
research
∙
10/21/2022
Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs
The formalization of existing mathematical proofs is a notoriously diffi...
research
∙
05/23/2022
HyperTree Proof Search for Neural Theorem Proving
We propose an online training procedure for a transformer-based automate...
research
∙
04/22/2022
End-to-end symbolic regression with transformers
Symbolic regression, the task of predicting the mathematical expression ...
research
∙
01/12/2022
Deep Symbolic Regression for Recurrent Sequences
Symbolic regression, i.e. predicting a function from the observation of ...
research
∙
10/13/2021
Leveraging Automated Unit Tests for Unsupervised Code Translation
With little to no parallel data available for programming languages, uns...
research
∙
02/15/2021
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages
Recent advances in self-supervised learning have dramatically improved t...
research
∙
09/21/2020
Target Conditioning for One-to-Many Generation
Neural Machine Translation (NMT) models often lack diversity in their ge...
research
∙
06/11/2020
Deep Differential System Stability – Learning advanced computations from examples
Can advanced mathematical computations be learned from examples? Using t...
research
∙
06/05/2020
Unsupervised Translation of Programming Languages
A transcompiler, also known as source-to-source translator, is a system ...
research
∙
12/02/2019
Deep Learning for Symbolic Mathematics
Neural networks have a reputation for being better at solving statistica...
research
∙
07/10/2019
Large Memory Layers with Product Keys
This paper introduces a structured memory which can be easily integrated...
research
∙
07/02/2019
Augmenting Self-attention with Persistent Memory
Transformer networks have lead to important progress in language modelin...
research
∙
02/04/2019
Two New Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English
The vast majority of language pairs in the world are low-resource becaus...
research
∙
01/22/2019
Cross-lingual Language Model Pretraining
Recent studies have demonstrated the efficiency of generative pretrainin...
research
∙
11/01/2018
Multiple-Attribute Text Style Transfer
The dominant approach to unsupervised "style transfer" in text is based ...
research
∙
09/13/2018
XNLI: Evaluating Cross-lingual Sentence Representations
State-of-the-art natural language processing systems rely on supervision...
research
∙
05/03/2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties
Although much effort has recently been devoted to training high-quality ...
research
∙
04/20/2018
Phrase-Based & Neural Unsupervised Machine Translation
Machine translation systems achieve near human-level performance on some...
research
∙
10/31/2017
Unsupervised Machine Translation Using Monolingual Corpora Only
Machine translation has recently achieved impressive performance thanks ...
research
∙
10/11/2017
Word Translation Without Parallel Data
State-of-the-art methods for learning cross-lingual word embeddings have...
research
∙
06/01/2017
Fader Networks: Manipulating Images by Sliding Attributes
This paper introduces a new encoder-decoder architecture that is trained...
research
∙
09/18/2016
Playing FPS Games with Deep Reinforcement Learning
Advances in deep reinforcement learning have allowed autonomous agents t...
research
∙
05/12/2016
Polyglot Neural Language Models: A Case Study in Cross-Lingual Phonetic Representation Learning
We introduce polyglot language models, recurrent neural network models t...
research
∙
03/04/2016
Neural Architectures for Named Entity Recognition
State-of-the-art named entity recognition systems rely heavily on hand-c...
research
∙
02/05/2016