research
∙
08/01/2023
Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Bias
Recent studies show that instruction tuning and learning from human feed...
share
research
∙
07/13/2023
Generating Benchmarks for Factuality Evaluation of Language Models
Before deploying a language model (LM) within a given domain, it is impo...
research
∙
05/24/2023
Understanding Arithmetic Reasoning in Language Models using Causal Mediation Analysis
Mathematical reasoning in large language models (LLMs) has garnered atte...
research
∙
05/22/2023
Interpreting Transformer's Attention Dynamic Memory and Visualizing the Semantic Information Flow of GPT
Recent advances in interpretability suggest we can project weights and h...
research
∙
05/17/2023
Shielded Representations: Protecting Sensitive Attributes Through Iterative Gradient-Based Projection
Natural language processing models tend to learn and encode social biase...
research
∙
03/29/2023
ContraSim – A Similarity Measure Based on Contrastive Learning
Recent work has compared neural network representations via similarity-b...
research
∙
12/21/2022
Parallel Context Windows Improve In-Context Learning of Large Language Models
For applications that require processing large amounts of text at infere...
research
∙
07/28/2022
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions
Large amounts of training data are one of the major reasons for the high...
research
∙
05/01/2022
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
Huge language models (LMs) have ushered in a new era for AI, serving as ...
research
∙
02/10/2022
Locating and Editing Factual Knowledge in GPT
We investigate the mechanisms underlying factual knowledge recall in aut...
research
∙
04/16/2021
