research
∙
09/08/2023
Can NLP Models 'Identify', 'Distinguish', and 'Justify' Questions that Don't have a Definitive Answer?
Though state-of-the-art (SOTA) NLP systems have achieved remarkable perf...
share
research
∙
09/01/2023
Language-Conditioned Change-point Detection to Identify Sub-Tasks in Robotics Domains
In this work, we present an approach to identify sub-tasks within a demo...
research
∙
08/16/2023
MDDial: A Multi-turn Differential Diagnosis Dialogue Dataset with Reliability Evaluation
Dialogue systems for Automatic Differential Diagnosis (ADD) have a wide ...
research
∙
06/07/2023
ConceptBed: Evaluating Concept Learning Abilities of Text-to-Image Diffusion Models
The ability to understand visual concepts and replicate and compose thes...
research
∙
06/01/2023
End-to-end Knowledge Retrieval with Multi-modal Queries
We investigate knowledge retrieval with multi-modal queries, i.e. querie...
research
∙
05/23/2023
Dr.ICL: Demonstration-Retrieved In-context Learning
In-context learning (ICL), teaching a large language model (LLM) to perf...
research
∙
05/20/2023
Can NLP Models Correctly Reason Over Contexts that Break the Common Assumptions?
Pre-training on large corpora of text enables the language models to acq...
research
∙
05/02/2023
Post-Abstention: Towards Reliably Re-Attempting the Abstained Instances in QA
Despite remarkable progress made in natural language processing, even th...
research
∙
03/05/2023
Prompt-Based Learning for Thread Structure Prediction in Cybersecurity Forums
With recent trends indicating cyber crimes increasing in both frequency ...
research
∙
02/28/2023
Methods and Mechanisms for Interactive Novelty Handling in Adversarial Environments
Learning to detect, characterize and accommodate novelties is a challeng...
research
∙
02/20/2023
Exploring the Limits of Transfer Learning with Unified Model in the Cybersecurity Domain
With the increase in cybersecurity vulnerabilities of software systems, ...
research
∙
02/09/2023
Real-Time Visual Feedback to Guide Benchmark Creation: A Human-and-Metric-in-the-Loop Workflow
Recent research has shown that language models exploit `artifacts' in be...
research
∙
11/23/2022
Can Open-Domain QA Reader Utilize External Knowledge Efficiently like Humans?
Recent state-of-the-art open-domain QA models are typically based on a t...
research
∙
11/07/2022
CRIPP-VQA: Counterfactual Reasoning about Implicit Physical Properties via Video Question Answering
Videos often capture objects, their visible properties, their motion, an...
research
∙
10/31/2022
Lila: A Unified Benchmark for Mathematical Reasoning
Mathematical reasoning skills are essential for general-purpose intellig...
research
∙
10/14/2022
Pretrained Transformers Do not Always Improve Robustness
Pretrained Transformers (PT) have been shown to improve Out of Distribut...
research
∙
10/14/2022
Hardness of Samples Need to be Quantified for a Reliable Evaluation System: Exploring Potential Opportunities with a New Task
Evaluation of models on benchmarks is unreliable without knowing the deg...
research
∙
10/14/2022
A Survey of Parameters Associated with the Quality of Benchmarks in NLP
Several benchmarks have been built with heavy investment in resources to...
research
∙
10/11/2022
Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systems
Do all instances need inference through the big models for a correct pre...
research
∙
10/10/2022
Investigating the Failure Modes of the AUC metric and Exploring Alternatives for Evaluating Systems in Safety Critical Applications
With the increasing importance of safety requirements associated with th...
research
∙
10/04/2022
A Study on the Efficiency and Generalization of Light Hybrid Retrievers
Existing hybrid retrievers which integrate sparse and dense retrievers, ...
research
∙
07/15/2022
Reasoning about Actions over Visual and Linguistic Modalities: A Survey
'Actions' play a vital role in how humans interact with the world and en...
research
∙
07/06/2022
BioTABQA: Instruction Learning for Biomedical Table Question Answering
Table Question Answering (TQA) is an important but under-explored task. ...
research
∙
05/25/2022
Is a Question Decomposition Unit All We Need?
Large Language Models (LMs) have achieved state-of-the-art performance o...
research
∙
05/19/2022
Let the Model Decide its Curriculum for Multitask Learning
Curriculum learning strategies in prior multi-task learning approaches a...
research
∙
05/01/2022
Don't Blame the Annotator: Bias Already Starts in the Annotation Instructions
In recent years, progress in NLU has been driven by benchmarks. These be...
research
∙
04/15/2022
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning
Single-task models have proven pivotal in solving specific tasks; howeve...
research
∙
04/12/2022
NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks
Given the ubiquitous nature of numbers in text, reasoning with numbers t...
research
∙
03/17/2022
How Many Data Samples is an Additional Instruction Worth?
Recently introduced instruction-paradigm empowers non-expert users to le...
research
∙
03/16/2022
Less is More: Summary of Long Instructions is Better for Program Synthesis
Despite the success of large pre-trained language models (LMs) such as C...
research
∙
03/15/2022
Generalized but not Robust? Comparing the Effects of Data Modification Methods on Out-of-Domain Generalization and Adversarial Robustness
Data modification, either via additional training datasets, data augment...
research
∙
03/14/2022
Choose Your QA Model Wisely: A Systematic Study of Generative and Extractive Readers for Question Answering
While both extractive and generative readers have been successfully appl...
research
∙
03/07/2022
ILDAE: Instance-Level Difficulty Analysis of Evaluation Data
Knowledge of questions' difficulty level helps a teacher in several ways...
research
∙
03/01/2022
Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settings
In order to equip NLP systems with selective prediction capability, seve...
research
∙
01/19/2022
Improving Biomedical Information Retrieval with Neural Retrievers
Information retrieval (IR) is essential in search engines and dialogue s...
research
∙
10/15/2021
A Bayesian Approach for Medical Inquiry and Disease Inference in Automated Differential Diagnosis
We propose a Bayesian approach for both medical inquiry and disease infe...
research
∙
09/22/2021
A Simple Approach to Jointly Rank Passages and Select Relevant Sentences in the OBQA Context
In the open question answering (OBQA) task, how to select the relevant i...
research
∙
09/16/2021
Reframing Instructional Prompts to GPTk's Language
How can model designers turn task instructions into effective prompts fo...
research
∙
09/10/2021
Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model
The transformer-based pre-trained language models have been tremendously...
research
∙
07/01/2021
Interviewer-Candidate Role Play: Towards Developing Real-World NLP Systems
Standard NLP tasks do not incorporate several common real-world scenario...
research
∙
05/29/2021
Constructing Flow Graphs from Procedural Cybersecurity Texts
Following procedural texts written in natural languages is challenging. ...
research
∙
05/26/2021
Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction
In this work, we propose Masked Noun-Phrase Prediction (MNPP), a pre-tra...
research
∙
04/18/2021
Natural Instructions: Benchmarking Generalization to New Tasks from Natural Language Instructions
Can we enable NLP models to appropriately respond to instructional promp...
research
∙
04/13/2021
CLEVR_HYP: A Challenge Dataset and Baselines for Visual Question Answering with Hypothetical Actions over Images
Most existing research on visual question answering (VQA) is limited to ...
research
∙
03/28/2021
'Just because you are right, doesn't mean I am wrong': Overcoming a Bottleneck in the Development and Evaluation of Open-Ended Visual Question Answering (VQA) Tasks
GQA (Hudson and Manning, 2019) is a dataset for real-world visual reason...
research
∙
03/23/2021
Variable Name Recovery in Decompiled Binary Code using Constrained Masked Language Modeling
Decompilation is the procedure of transforming binary programs into a hi...
research
∙
03/20/2021
Self-Supervised Test-Time Learning for Reading Comprehension
Recent work on unsupervised question answering has shown that models can...
research
∙
12/17/2020
Can Transformers Reason About Effects of Actions?
A recent work has shown that transformers are able to "reason" with fact...
research
∙
12/04/2020
Self-Supervised VQA: Answering Visual Questions using Images and Captions
Methodologies for training VQA models assume the availability of dataset...
research
∙
10/22/2020