SemEval-2016 Task 3: Community Question Answering

by   Preslav Nakov, et al.

This paper describes the SemEval–2016 Task 3 on Community Question Answering, which we offered in English and Arabic. For English, we had three subtasks: Question–Comment Similarity (subtask A), Question–Question Similarity (B), and Question–External Comment Similarity (C). For Arabic, we had another subtask: Rerank the correct answers for a new question (D). Eighteen teams participated in the task, submitting a total of 95 runs (38 primary and 57 contrastive) for the four subtasks. A variety of approaches and features were used by the participating systems to address the different subtasks, which are summarized in this paper. The best systems achieved an official score (MAP) of 79.19, 76.70, 55.41, and 45.83 in subtasks A, B, C, and D, respectively. These scores are significantly better than those for the baselines that we provided. For subtask A, the best system improved over the 2015 winner by 3 points absolute in terms of Accuracy.



There are no comments yet.


page 1

page 2

page 3

page 4


SemEval-2017 Task 3: Community Question Answering

We describe SemEval-2017 Task 3 on Community Question Answering. This ye...

SemEval-2015 Task 3: Answer Selection in Community Question Answering

Community Question Answering (cQA) provides new interesting research dir...

Addressing Community Question Answering in English and Arabic

This paper studies the impact of different types of features applied to ...

FAQ-based Question Answering via Word Alignment

In this paper, we propose a novel word-alignment-based method to solve t...

The Inception Team at NSURL-2019 Task 8: Semantic Question Similarity in Arabic

This paper describes our method for the task of Semantic Question Simila...

Multi-Field Structural Decomposition for Question Answering

This paper presents a precursory yet novel approach to the question answ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.