Less is More: Rejecting Unreliable Reviews for Product Question Answering

07/09/2020
by   Shiwei Zhang, et al.
0

Promptly and accurately answering questions on products is important for e-commerce applications. Manually answering product questions (e.g. on community question answering platforms) results in slow response and does not scale. Recent studies show that product reviews are a good source for real-time, automatic product question answering (PQA). In the literature, PQA is formulated as a retrieval problem with the goal to search for the most relevant reviews to answer a given product question. In this paper, we focus on the issue of answerability and answer reliability for PQA using reviews. Our investigation is based on the intuition that many questions may not be answerable with a finite set of reviews. When a question is not answerable, a system should return nil answers rather than providing a list of irrelevant reviews, which can have significant negative impact on user experience. Moreover, for answerable questions, only the most relevant reviews that answer the question should be included in the result. We propose a conformal prediction based framework to improve the reliability of PQA systems, where we reject unreliable answers so that the returned results are more concise and accurate at answering the product question, including returning nil answers for unanswerable questions. Experiments on a widely used Amazon dataset show encouraging results of our proposed framework. More broadly, our results demonstrate a novel and effective application of conformal methods to a retrieval task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/12/2019

AmazonQA: A Review-Based Question Answering Task

Every day, thousands of customers post questions on Amazon product pages...
research
01/08/2019

Supervised Transfer Learning for Product Information Question Answering

Popular e-commerce websites such as Amazon offer community question answ...
research
05/19/2021

Answering Product-Questions by Utilizing Questions from Other Contextually Similar Products

Predicting the answer to a product-related question is an emerging field...
research
09/14/2023

Feature Engineering in Learning-to-Rank for Community Question Answering Task

Community question answering (CQA) forums are Internet-based platforms w...
research
07/06/2022

Ask Me What You Need: Product Retrieval using Knowledge from GPT-3

As online merchandise become more common, many studies focus on embeddin...
research
04/21/2020

Word Embedding-based Text Processing for Comprehensive Summarization and Distinct Information Extraction

In this paper, we propose two automated text processing frameworks speci...
research
11/27/2021

Answer Generation for Questions With Multiple Information Sources in E-Commerce

Automatic question answering is an important yet challenging task in E-c...

Please sign up or login with your details

Forgot password? Click here to reset