research
∙
06/02/2023
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Language models (LMs) often exhibit undesirable text generation behavior...
share
research
∙
05/24/2023
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
Language models (LMs) often struggle to pay enough attention to the inpu...
research
∙
05/24/2023
Mixture of Prompt Experts for Generalizable and Interpretable Question Answering
One of the ultimate quests of question answering (QA) is to deploy a sys...
research
∙
05/17/2023
CooK: Empowering General-Purpose Language Models with Modular and Collaborative Knowledge
Large language models (LLMs) are increasingly adopted for knowledge-inte...
research
∙
03/24/2023
Scaling Expert Language Models with Unsupervised Domain Discovery
Large language models are typically trained densely: all parameters are ...
research
∙
02/21/2023
kNN-Adapter: Efficient Domain Adaptation for Black-Box Language Models
Fine-tuning a language model on a new domain is standard practice for do...
research
∙
01/30/2023
REPLUG: Retrieval-Augmented Black-Box Language Models
We introduce REPLUG, a retrieval-augmented language modeling framework t...
research
∙
12/20/2022
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?
Large language models can perform new tasks in a zero-shot fashion, give...
research
∙
12/02/2022
Nonparametric Masked Language Modeling
Existing language models (LMs) predict tokens with a softmax over a fini...
research
∙
11/22/2022
Retrieval-Augmented Multimodal Language Modeling
Recent multimodal models such as DALL-E and CM3 have achieved remarkable...
research
∙
11/15/2022
PromptCap: Prompt-Guided Task-Aware Image Captioning
Image captioning aims to describe an image with a natural language sente...
research
∙
10/25/2022
RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering
We introduce RoMQA, the first benchmark for robust, multi-evidence, mult...
research
∙
05/27/2022
Nearest Neighbor Zero-Shot Inference
We introduce kNN-Prompt, a simple and effective technique to use k-neare...
research
∙
06/09/2021
DESCGEN: A Distantly Supervised Dataset for Generating Abstractive Entity Descriptions
Short textual descriptions of entities provide summaries of their key at...
research
∙
05/02/2020
Design Challenges for Low-resource Cross-lingual Entity Linking
Cross-lingual Entity Linking (XEL) grounds mentions of entities that app...
research
∙
05/01/2020
Cross-lingual Entity Alignment for Knowledge Graphs with Incidental Supervision from Free Text
Much research effort has been put to multilingual knowledge graph (KG) e...
research
∙
04/05/2020
On Tractable Representations of Binary Neural Networks
We consider the compilation of a binary neural network's decision functi...
research
∙
09/12/2019
Retrofitting Contextualized Word Embeddings with Paraphrases
Contextualized word embedding models, such as ELMo, generate meaningful ...
research
∙
09/05/2019
Examining Gender Bias in Languages with Grammatical Gender
Recent studies have shown that word embeddings exhibit gender bias inher...
research
∙
06/21/2019
Learning Bilingual Word Embeddings Using Lexical Definitions
Bilingual word embeddings, which representlexicons of different language...
research
∙
11/26/2018