DeepAI
Log In Sign Up

A Novel Approach for Automatic Bengali Question Answering System using Semantic Similarity Analysis

10/23/2019
by   Arijit Das, et al.
0

Finding the semantically accurate answer is one of the key challenges in advanced searching. In contrast to keyword-based searching, the meaning of a question or query is important here and answers are ranked according to relevance. It is very natural that there is almost no common word between the question sentence and the answer sentence. In this paper, an approach is described to find out the semantically relevant answers in the Bengali dataset. In the first part of the algorithm, a set of statistical parameters like frequency, index, part-of-speech (POS), etc. is matched between a question and the probable answers. In the second phase, entropy and similarity are calculated in different modules. Finally, a sense score is generated to rank the answers. The algorithm is tested on a repository containing a total of 275000 sentences. This Bengali repository is a product of Technology Development for Indian Languages (TDIL) project sponsored by Govt. of India and provided by the Language Research Unit of Indian Statistical Institute, Kolkata. The shallow parser, developed by the LTRC group of IIIT Hyderabad is used for POS tagging. The actual answer is ranked as 1st in 82.3 actual answer is ranked within 1st to 5th in 90.0 system is coming as 97.32 using confusion matrix. The challenges and pitfalls of the work are reported at last in this paper.

READ FULL TEXT

page 12

page 13

11/23/2019

Unsupervised Keyword Extraction for Full-sentence VQA

In existing studies on Visual Question Answering (VQA), which aims to tr...
11/18/2020

Diverse and Non-redundant Answer Set Extraction on Community QA based on DPPs

In community-based question answering (CQA) platforms, it takes time for...
05/24/2021

VANiLLa : Verbalized Answers in Natural Language at Large Scale

In the last years, there have been significant developments in the area ...
11/19/2021

Building a Question Answering System for the Manufacturing Domain

The design or simulation analysis of special equipment products must fol...
12/04/2014

Deep Learning for Answer Sentence Selection

Answer sentence selection is the task of identifying sentences that cont...
09/20/2013

Saying What You're Looking For: Linguistics Meets Video Search

We present an approach to searching large video corpora for video clips ...