Predicting Subjective Features from Questions on QA Websites using BERT

02/24/2020
by   Issa Annamoradnejad, et al.
1

Modern Question-Answering websites, such as StackOverflow and Quora, have specific user rules to maintain their content quality. These systems rely on user reports for accessing new contents, which has serious problems including the slow handling of violations, the loss of normal and experienced users' time, the low quality of some reports, and discouraging feedback to new users. Therefore, with the overall goal of providing solutions for automating moderation actions in Q A websites, we aim to provide a model to predict 20 quality or subjective aspects of questions in QA websites. To this end, we used data gathered by the CrowdSource team at Google Research in 2019 and fine-tuned pre-trained BERT model on our problem. Model achieves 95.4 epochs of training and did not improve substantially in the next ones. Results confirm that by simple fine-tuning, we can achieve accurate models, in little time, and on less amount of data.

READ FULL TEXT

page 3

page 5

research
09/12/2019

Measuring Domain Portability and ErrorPropagation in Biomedical QA

In this work we present Google's submission to the BioASQ 7 biomedical q...
research
10/25/2016

Modeling Ambiguity, Subjectivity, and Diverging Viewpoints in Opinion Question Answering Systems

Product review websites provide an incredible lens into the wide variety...
research
10/17/2019

Universal Text Representation from BERT: An Empirical Study

We present a systematic investigation of layer-wise BERT activations for...
research
05/17/2020

Support-BERT: Predicting Quality of Question-Answer Pairs in MSDN using Deep Bidirectional Transformer

Quality of questions and answers from community support websites (e.g. M...
research
06/14/2021

Exploiting Sentence-Level Representations for Passage Ranking

Recently, pre-trained contextual models, such as BERT, have shown to per...
research
07/05/2023

Won't Get Fooled Again: Answering Questions with False Premises

Pre-trained language models (PLMs) have shown unprecedented potential in...
research
03/31/2020

Towards Productionizing Subjective Search Systems

Existing e-commerce search engines typically support search only over ob...

Please sign up or login with your details

Forgot password? Click here to reset