b'Xiang Ren'

research

∙ 07/02/2022

FRAME: Evaluating Simulatability Metrics for Free-Text Rationales

Free-text rationales aim to explain neural language model (LM) behavior ...

Aaron Chan, et al. ∙

research

∙ 06/14/2022

NewsEdits: A News Article Revision Dataset and a Document-Level Reasoning Challenge

News article revision histories provide clues to narrative and factual e...

Alexander Spangher, et al. ∙

research

∙ 05/25/2022

Eliciting Transferability in Multi-task Learning with Task-level Mixture-of-Experts

Recent work suggests that transformer models are capable of multi-task l...

Qinyuan Ye, et al. ∙

research

∙ 05/25/2022

Textual Backdoor Attacks with Iterative Trigger Injection

The backdoor attack has become an emerging threat for Natural Language P...

Jun Yan, et al. ∙

research

∙ 05/25/2022

RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning

Transformers have been shown to be able to perform deductive reasoning o...

Soumya Sanyal, et al. ∙

research

∙ 05/25/2022

ER-TEST: Evaluating Explanation Regularization Methods for NLP Models

Neural language models' (NLMs') reasoning processes are notoriously hard...

Brihi Joshi, et al. ∙

research

∙ 05/25/2022

Machine Translation Robustness to Natural Asemantic Variation

We introduce and formalize an under-studied linguistic phenomenon we cal...

Jacob Bremerman, et al. ∙

research

∙ 05/23/2022

Cross-lingual Lifelong Learning

The longstanding goal of multi-lingual learning has been to develop a un...

Meryem M'hamdi, et al. ∙

research

∙ 05/21/2022

NS3: Neuro-Symbolic Semantic Code Search

Semantic code search is the task of retrieving a code snippet given a te...

Shushan Arakelyan, et al. ∙

research

∙ 03/19/2022

FaiRR: Faithful and Robust Deductive Reasoning over Natural Language

Transformers have been shown to be able to perform deductive reasoning o...

Soumya Sanyal, et al. ∙

research

∙ 03/14/2022

Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer

Pre-trained language models are still far from human performance in task...

Woojeong Jin, et al. ∙

research

∙ 12/16/2021

UniREx: A Unified Learning Framework for Language Model Rationale Extraction

An extractive rationale explains a language model's (LM's) prediction on...

Aaron Chan, et al. ∙

research

∙ 12/12/2021

Contextualized Scene Imagination for Generative Commonsense Reasoning

Humans use natural language to compose common concepts from their enviro...

Peifeng Wang, et al. ∙

research

∙ 10/16/2021

Sparse Distillation: Speeding Up Text Classification by Using Bigger Models

Distilling state-of-the-art transformer models into lightweight student ...

Qinyuan Ye, et al. ∙

research

∙ 10/16/2021

Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora

Pretrained language models (PTLMs) are typically learned over a large, s...

Xisen Jin, et al. ∙

research

∙ 10/16/2021

A Good Prompt Is Worth Millions of Parameters? Low-resource Prompt-based Learning for Vision-Language Models

Large pretrained vision-language (VL) models can learn a new task with a...

Woojeong Jin, et al. ∙

research

∙ 10/16/2021

Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER

Recent advances in prompt-based learning have shown impressive results o...

Dong-Ho Lee, et al. ∙

research

∙ 10/08/2021

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

Current Open-Domain Question Answering (ODQA) model paradigm often conta...

Donghan Yu, et al. ∙

research

∙ 08/31/2021

Discretized Integrated Gradients for Explaining Language Models

As a prominent attribution-based explanation algorithm, Integrated Gradi...

Soumya Sanyal, et al. ∙

research

∙ 08/03/2021

Improving Counterfactual Generation for Fair Hate Speech Detection

Bias mitigation approaches reduce models' dependence on sensitive featur...

Aida Mostafazadeh Davani, et al. ∙

research

∙ 06/22/2021

Do Language Models Perform Generalizable Commonsense Inference?

Inspired by evidence that pretrained language models (LMs) encode common...

Peifeng Wang, et al. ∙

research

∙ 06/04/2021

AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding

Automatic extraction of product attribute values is an important enablin...

Jun Yan, et al. ∙

research

∙ 04/20/2021

X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering

Multilingual models, such as M-BERT and XLM-R, have gained increasing po...

Meryem M'hamdi, et al. ∙

research

∙ 04/18/2021

On the Influence of Masking Policies in Intermediate Pre-training

Current NLP models are predominantly trained through a pretrain-then-fin...

Qinyuan Ye, et al. ∙

research

∙ 04/18/2021

Lifelong Learning of Few-shot Learners across NLP Tasks

Recent advances in large pre-trained language models have greatly improv...

Xisen Jin, et al. ∙

research

∙ 04/18/2021

SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning

Augmenting pre-trained language models with knowledge graphs (KGs) has a...

Aaron Chan, et al. ∙

research

∙ 04/18/2021

On the Strengths of Cross-Attention in Pretrained Transformers for Machine Translation

We study the power of cross-attention in the Transformer architecture wi...

Mozhdeh Gheini, et al. ∙

research

∙ 04/18/2021

Extract, Denoise, and Enforce: Evaluating and Predicting Lexical Constraints for Conditional Text Generation

Recently, pre-trained language models (PLMs) have dominated conditional ...

Yuning Mao, et al. ∙

research

∙ 03/18/2021

Refining Neural Networks with Compositional Explanations

Neural networks are prone to learning spurious correlations from biased ...

Huihan Yao, et al. ∙

research

∙ 01/06/2021

Modality-specific Distillation

Large neural networks are impractical to deploy on mobile devices due to...

Woojeong Jin, et al. ∙

research

∙ 01/02/2021

Zero-shot Learning by Generating Task-specific Adapters

Pre-trained text-to-text transformers achieve impressive performance acr...

Qinyuan Ye, et al. ∙

research

∙ 12/31/2020

Studying Strategically: Learning to Mask for Closed-book QA

Closed-book question-answering (QA) is a challenging task that requires ...

Qinyuan Ye, et al. ∙

research

∙ 12/30/2020

DEER: A Data Efficient Language Model for Event Temporal Reasoning

Pretrained language models (LMs) such as BERT, RoBERTa, and ELECTRA are ...

Rujun Han, et al. ∙

research

∙ 10/24/2020

Learning Contextualized Knowledge Structures for Commonsense Reasoning

Recently, neural-symbolic architectures have achieved success on commons...

Jun Yan, et al. ∙

research

∙ 10/24/2020

Learning to Deceive Knowledge Graph Augmented Models via Targeted Perturbation

Symbolic knowledge (e.g., entities, relations, and facts in a knowledge ...

Mrigank Raman, et al. ∙

research

∙ 10/24/2020

Efficiently Mitigating Classification Bias via Transfer Learning

Prediction bias in machine learning models refers to unintended model be...

Xisen Jin, et al. ∙

research

∙ 10/24/2020

Fair Hate Speech Detection through Evaluation of Social Group Counterfactuals

Approaches for mitigating bias in supervised models are designed to redu...

Aida Mostafazadeh Davani, et al. ∙

research

∙ 10/24/2020

Constrained Abstractive Summarization: Preserving Factual Consistency with Constrained Generation

Summaries generated by abstractive summarization are supposed to only co...

Yuning Mao, et al. ∙

research

∙ 10/13/2020

Will This Idea Spread Beyond Academia? Understanding Knowledge Transfer of Scientific Concepts across Text Corpora

What kind of basic research ideas are more likely to get applied in prac...

Hancheng Cao, et al. ∙

research

∙ 10/09/2020

Semi-Automated Protocol Disambiguation and Code Generation

For decades, Internet protocols have been specified using natural langua...

Jane Yen, et al. ∙

research

∙ 09/30/2020

Multi-document Summarization with Maximal Marginal Relevance-guided Reinforcement Learning

While neural sequence learning methods have made significant progress in...

Yuning Mao, et al. ∙

research

∙ 08/28/2020

Two Step Joint Model for Drug Drug Interaction Extraction

When patients need to take medicine, particularly taking more than one k...

Siliang Tang, et al. ∙

research

∙ 06/27/2020

Gradient Based Memory Editing for Task-Free Continual Learning

Prior work on continual learning often operate in a "task-aware" manner,...

Xisen Jin, et al. ∙

research

∙ 05/13/2020

Screenplay Quality Assessment: Can We Predict Who Gets Nominated?

Deciding which scripts to turn into movies is a costly and time-consumin...

Ming-Chang Chiu, et al. ∙

research

∙ 05/05/2020

Contextualizing Hate Speech Classifiers with Post-hoc Explanation

Hate speech classifiers trained on imbalanced datasets struggle to deter...

Brendan Kennedy, et al. ∙

research

∙ 05/02/2020

Teaching Machine Comprehension with Compositional Explanations

Advances in extractive machine reading comprehension (MRC) rely heavily ...

Qinyuan Ye, et al. ∙

research

∙ 05/02/2020

ForecastQA: Machine Comprehension of Temporal Text for Answering Forecasting Questions

Textual data are often accompanied by time information (e.g., dates in n...

Woojeong Jin, et al. ∙

research

∙ 05/02/2020

Visually Grounded Continual Learning of Compositional Semantics

Children's language acquisition from the visual world is a real-world ex...

Xisen Jin, et al. ∙

research

∙ 05/02/2020

Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering

Commonsense question answering (QA) requires the modeling of general bac...

Peifeng Wang, et al. ∙

research

∙ 05/01/2020

Learning Collaborative Agents with Rule Guidance for Knowledge Graph Reasoning

Walk-based models have shown their unique advantages in knowledge graph ...

Deren Lei, et al. ∙

Xiang Ren

Featured Co-authors