research
∙
06/04/2023
Probing Physical Reasoning with Counter-Commonsense Context
In this study, we create a CConS (Counter-commonsense Contextual Size co...
share
research
∙
05/24/2023
On Degrees of Freedom in Defining and Testing Natural Language Understanding
Natural language understanding (NLU) studies often exaggerate or underes...
research
∙
02/12/2023
Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering
To explain the predicted answers and evaluate the reasoning abilities of...
research
∙
12/14/2022
Cross-Modal Similarity-Based Curriculum Learning for Image Captioning
Image captioning models require the high-level generalization ability to...
research
∙
11/29/2022
Which Shortcut Solution Do Question Answering Models Prefer to Learn?
Question answering (QA) models for reading comprehension tend to learn s...
research
∙
11/29/2022
Penalizing Confident Predictions on Largely Perturbed Inputs Does Not Improve Out-of-Distribution Generalization in Question Answering
Question answering (QA) models are shown to be insensitive to large pert...
research
∙
10/28/2022
Debiasing Masks: A New Framework for Shortcut Mitigation in NLU
Debiasing language models from unwanted behaviors in Natural Language Un...
research
∙
10/26/2022
Look to the Right: Mitigating Relative Position Bias in Extractive Question Answering
Extractive question answering (QA) models tend to exploit spurious corre...
research
∙
10/11/2022
How Well Do Multi-hop Reading Comprehension Models Understand Date Information?
Several multi-hop reading comprehension datasets have been proposed to r...
research
∙
09/16/2022
Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios
The possible consequences for the same context may vary depending on the...
research
∙
09/05/2022
A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension
The issue of shortcut learning is widely known in NLP and has been an im...
research
∙
03/12/2022
What Makes Reading Comprehension Questions Difficult?
For a natural language understanding benchmark to be useful in research,...
research
∙
09/23/2021
Can Question Generation Debias Question Answering Models? A Case Study on Question-Context Lexical Overlap
Question answering (QA) models for reading comprehension have been demon...
research
∙
06/06/2021
Embracing Ambiguity: Shifting the Training Target of NLI Models
Natural Language Inference (NLI) datasets contain examples with highly a...
research
∙
06/01/2021
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
Crowdsourcing is widely used to create data for common natural language ...
research
∙
11/02/2020
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps
A multi-hop question answering (QA) dataset aims to test reasoning and i...
research
∙
04/04/2020
Prerequisites for Explainable Machine Reading Comprehension: A Position Paper
Machine reading comprehension (MRC) has received considerable attention ...
research
∙
11/21/2019
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets
Existing analysis work in machine reading comprehension (MRC) is largely...
research
∙
08/28/2018