Careful Selection of Knowledge to solve Open Book Question Answering

07/24/2019
by   Pratyay Banerjee, et al.
0

Open book question answering is a type of natural language based QA (NLQA) where questions are expected to be answered with respect to a given set of open book facts, and common knowledge about a topic. Recently a challenge involving such QA, OpenBookQA, has been proposed. Unlike most other NLQA tasks that focus on linguistic understanding, OpenBookQA requires deeper reasoning involving linguistic understanding as well as reasoning with common knowledge. In this paper we address QA with respect to the OpenBookQA dataset and combine state of the art language models with abductive information retrieval (IR), information gain based re-ranking, passage selection and weighted scoring to achieve 72.0 accuracy, an 11.6

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/08/2018

Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering

We present a new kind of question answering dataset, OpenBookQA, modeled...
research
11/22/2021

Zero-Shot Open-Book Question Answering

Open book question answering is a subset of question answering tasks whe...
research
06/15/2023

Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Models

Reasoning about time is of fundamental importance. Many facts are time-d...
research
05/18/2023

Writing your own book: A method for going from closed to open book QA to improve robustness and performance of smaller LLMs

We introduce two novel methods, Tree-Search and Self-contextualizing QA,...
research
05/25/2023

The Dangers of trusting Stochastic Parrots: Faithfulness and Trust in Open-domain Conversational Question Answering

Large language models are known to produce output which sounds fluent an...
research
06/07/2021

Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study

Recent advancements in open-domain question answering (ODQA), i.e., find...
research
08/06/2020

Interpretable Multi-Step Reasoning with Knowledge Extraction on Complex Healthcare Question Answering

Healthcare question answering assistance aims to provide customer health...

Please sign up or login with your details

Forgot password? Click here to reset