research
∙
06/16/2022
Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models
Large language models produce human-like text that drive a growing numbe...
share
research
∙
03/29/2022
Training Compute-Optimal Large Language Models
We investigate the optimal model size and number of tokens for training ...
research
∙
02/08/2022
Competition-Level Code Generation with AlphaCode
Programming is a powerful and ubiquitous problem-solving tool. Developin...
research
∙
09/15/2021
Challenges in Detoxifying Language Models
Large language models (LM) generate remarkably fluent text and can be ef...
research
∙
07/09/2020
Evaluating the Apperception Engine
The Apperception Engine is an unsupervised learning system. Given a sequ...
research
∙
02/15/2020
Undersensitivity in Neural Reading Comprehension
Current reading comprehension models generalise well to in-distribution ...
research
∙
02/02/2020
Beat the AI: Investigating Adversarial Human Annotations for Reading Comprehension
Innovations in annotation methodology have been a propellant for Reading...
research
∙
11/08/2019
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
Recent improvements in large-scale language models have driven progress ...
research
∙
10/05/2019
Making sense of sensory input
This paper attempts to answer a central question in unsupervised learnin...
research
∙
09/03/2019
Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation
Neural networks are part of many contemporary NLP systems, yet their emp...
research
∙
06/20/2018
Jack the Reader - A Machine Reading Framework
Many Machine Reading and Natural Language Understanding tasks require re...
research
∙
10/17/2017
Constructing Datasets for Multi-hop Reading Comprehension Across Documents
Most Reading Comprehension methods limit themselves to queries which can...
research
∙
07/19/2017
Crowdsourcing Multiple Choice Science Questions
We present a novel method for obtaining high-quality, domain-targeted mu...
research
∙
02/22/2017
Knowledge Graph Completion via Complex Tensor Factorization
In statistical relational learning, knowledge graph completion deals wit...
research
∙
02/15/2017
Frustratingly Short Attention Spans in Neural Language Modeling
Neural language models predict the next token using a latent representat...
research
∙
06/20/2016
Complex Embeddings for Simple Link Prediction
In statistical relational learning, the link prediction problem is key t...
research
∙
04/25/2016
Neural Random Forests
Given an ensemble of randomized regression trees, it is possible to rest...
research
∙
04/20/2016