research
∙
07/13/2023
Generating Benchmarks for Factuality Evaluation of Language Models
Before deploying a language model (LM) within a given domain, it is impo...
share
research
∙
05/31/2023
Human or Not? A Gamified Approach to the Turing Test
We present "Human or Not?", an online game inspired by the Turing test, ...
research
∙
01/31/2023
In-Context Retrieval-Augmented Language Models
Retrieval-Augmented Language Modeling (RALM) methods, that condition a l...
research
∙
12/21/2022
Parallel Context Windows Improve In-Context Learning of Large Language Models
For applications that require processing large amounts of text at infere...
research
∙
05/02/2022
The AI Index 2022 Annual Report
Welcome to the fifth edition of the AI Index Report! The latest edition ...
research
∙
05/01/2022
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
Huge language models (LMs) have ushered in a new era for AI, serving as ...
research
∙
03/09/2021
The AI Index 2021 Annual Report
Welcome to the fourth edition of the AI Index Report. This year we signi...
research
∙
10/05/2020
PMI-Masking: Principled masking of correlated spans
Masking tokens uniformly at random constitutes a common flaw in the pret...
research
∙
04/19/2020
The Cost of Training NLP Models: A Concise Overview
We review the cost of training large-scale language models, and the driv...
research
∙
08/15/2019
SenseBERT: Driving Some Sense into BERT
Self-supervision techniques have allowed neural language models to advan...
research
∙
02/06/2013
Conditional Utility, Utility Independence, and Utility Networks
We introduce a new interpretation of two related notions - conditional u...
research
∙
01/23/2013