BioTABQA: Instruction Learning for Biomedical Table Question Answering

07/06/2022
by   Man Luo, et al.
14

Table Question Answering (TQA) is an important but under-explored task. Most of the existing QA datasets are in unstructured text format and only few of them use tables as the context. To the best of our knowledge, none of TQA datasets exist in the biomedical domain where tables are frequently used to present information. In this paper, we first curate a table question answering dataset, BioTABQA, using 22 templates and the context from a biomedical textbook on differential diagnosis. BioTABQA can not only be used to teach a model how to answer questions from tables but also evaluate how a model generalizes to unseen questions, an important scenario for biomedical applications. To achieve the generalization evaluation, we divide the templates into 17 training and 5 cross-task evaluations. Then, we develop two baselines using single and multi-tasks learning on BioTABQA. Furthermore, we explore instructional learning, a recent technique showing impressive generalizing performance. Experimental results show that our instruction-tuned model outperforms single and multi-task baselines on an average by  23 across various evaluation settings, and more importantly, instruction-tuned model outperforms baselines by  5

READ FULL TEXT

page 7

page 8

research
05/22/2023

MultiTabQA: Generating Tabular Answers for Multi-Table Question Answering

Recent advances in tabular question answering (QA) with large language m...
research
04/15/2022

In-BoXBART: Get Instructions into Biomedical Multi-Task Learning

Single-task models have proven pivotal in solving specific tasks; howeve...
research
05/03/2022

DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related Queries

This paper develops the first question answering dataset (DrugEHRQA) con...
research
09/09/2023

MMHQA-ICL: Multimodal In-context Learning for Hybrid Question Answering over Text, Tables and Images

In the real world, knowledge often exists in a multimodal and heterogene...
research
06/08/2019

Deep Contextualized Biomedical Abbreviation Expansion

Automatic identification and expansion of ambiguous abbreviations are es...
research
08/09/2021

Multi-modal Retrieval of Tables and Texts Using Tri-encoder Models

Open-domain extractive question answering works well on textual data by ...
research
06/28/2021

Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering

Advancing the state-of-the-art in large-scale biomedical semantic indexi...

Please sign up or login with your details

Forgot password? Click here to reset