Training IBM Watson using Automatically Generated Question-Answer Pairs

11/12/2016
by   Jangho Lee, et al.
0

IBM Watson is a cognitive computing system capable of question answering in natural languages. It is believed that IBM Watson can understand large corpora and answer relevant questions more effectively than any other question-answering system currently available. To unleash the full power of Watson, however, we need to train its instance with a large number of well-prepared question-answer pairs. Obviously, manually generating such pairs in a large quantity is prohibitively time consuming and significantly limits the efficiency of Watson's training. Recently, a large-scale dataset of over 30 million question-answer pairs was reported. Under the assumption that using such an automatically generated dataset could relieve the burden of manual question-answer generation, we tried to use this dataset to train an instance of Watson and checked the training efficiency and accuracy. According to our experiments, using this auto-generated dataset was effective for training Watson, complementing manually crafted question-answer pairs. To the best of the authors' knowledge, this work is the first attempt to use a large-scale dataset of automatically generated question-answer pairs for training IBM Watson. We anticipate that the insights and lessons obtained from our experiments will be useful for researchers who want to expedite Watson training leveraged by automatically generated question-answer pairs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/09/2023

MAUPQA: Massive Automatically-created Polish Question Answering Dataset

Recently, open-domain question answering systems have begun to rely heav...
research
03/23/2023

DBLP-QuAD: A Question Answering Dataset over the DBLP Scholarly Knowledge Graph

In this work we create a question answering dataset over the DBLP schola...
research
05/20/2021

ASQ: Automatically Generating Question-Answer Pairs using AMRs

In this work, we introduce ASQ, a tool to automatically mine questions a...
research
05/19/2022

Automated Crossword Solving

We present the Berkeley Crossword Solver, a state-of-the-art approach fo...
research
03/22/2016

Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus

Over the past decade, large-scale supervised learning corpora have enabl...
research
11/15/2015

Word Embedding based Correlation Model for Question/Answer Matching

With the development of community based question answering (Q&A) service...
research
03/30/2023

QUADRo: Dataset and Models for QUestion-Answer Database Retrieval

An effective paradigm for building Automated Question Answering systems ...

Please sign up or login with your details

Forgot password? Click here to reset