research
∙
06/06/2023
Large Language Models of Code Fail at Completing Code with Potential Bugs
Large language models of code (Code-LLMs) have recently brought tremendo...
share
research
∙
12/20/2022
ReCode: Robustness Evaluation of Code Generation Models
Code generation models have achieved impressive performance. However, th...
research
∙
09/23/2022
Whodunit? Learning to Contrast for Authorship Attribution
Authorship attribution is the task of identifying the author of a given ...
research
∙
05/04/2022
Data Governance in the Age of Large-Scale Data-Driven Language Technology
The recent emergence and adoption of Machine Learning technology, and sp...
research
∙
04/21/2022
The Risks of Machine Learning Systems
The speed and scale at which machine learning (ML) systems are deployed ...
research
∙
12/20/2021
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP
What are the units of text that we want to model? From bytes to multi-wo...
research
∙
11/21/2021
TraVLR: Now You See It, Now You Don't! Evaluating Cross-Modal Transfer of Visio-Linguistic Reasoning
Numerous visio-linguistic (V+L) representation learning methods have bee...
research
∙
10/14/2021
Causally Estimating the Sensitivity of Neural NLP Models to Spurious Features
Recent work finds modern natural language processing (NLP) models relyin...
research
∙
05/06/2021
Reliability Testing for Natural Language Processing Systems
Questions of fairness, robustness, and transparency are paramount to add...
research
∙
03/17/2021
Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots
Multilingual models have demonstrated impressive cross-lingual transfer ...
research
∙
01/13/2021
Robustness Gym: Unifying the NLP Evaluation Landscape
Despite impressive performance on standard benchmarks, deep neural netwo...
research
∙
05/09/2020
It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations
Training on only perfect Standard English corpora predisposes pre-traine...
research
∙
04/30/2020