<script type="text/javascript">
<!--
document.write('<div id="oa_widget"></div>');
document.write('<script type="text/javascript" src="https://www.openaire.eu/index.php?option=com_openaire&view=widget&format=raw&projectId=undefined&type=result"></script>');
-->
</script>

COPY SCRIPT

For further information contact us at helpdesk@openaire.eu

SemEval-2017 Task 3: Community Question Answering

descriptionPublicationkeyboard_double_arrow_right Article , Preprint , Conference object 01 Jan 2017Embargo end date: 01 Jan 2019 Italy Publisher:Association for Computational Linguistics (ACL)Journal:Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017)

Authors: Preslav Nakov; Doris Hoogeveen; Llu'is M`arquez; Alessandro Moschitti; Hamdy Mubarak; Timothy Baldwin; Karin Verspoor;

doi: 10.18653/v1/s17-2003 , 10.48550/arxiv.1912.00730

arXiv: http://arxiv.org/abs/1912.00730

handle: 11572/252028

SemEval-2017 Task 3: Community Question Answering

- Summary
- Subjects
- Related research
  (2)
- Metrics

Abstract

We describe SemEval-2017 Task 3 on Community Question Answering. This year, we reran the four subtasks from SemEval-2016:(A) Question-Comment Similarity,(B) Question-Question Similarity,(C) Question-External Comment Similarity, and (D) Rerank the correct answers for a new question in Arabic, providing all the data from 2015 and 2016 for training, and fresh data for testing. Additionally, we added a new subtask E in order to enable experimentation with Multi-domain Question Duplicate Detection in a larger-scale scenario, using StackExchange subforums. A total of 23 teams participated in the task, and submitted a total of 85 runs (36 primary and 49 contrastive) for subtasks A-D. Unfortunately, no teams participated in subtask E. A variety of approaches and features were used by the participating systems to address the different subtasks. The best systems achieved an official score (MAP) of 88.43, 47.22, 15.46, and 61.16 in subtasks A, B, C, and D, respectively. These scores are better than the baselines, especially for subtasks A-C.

community question answering, question-question similarity, question-comment similarity, answer reranking, Multi-domain Question Duplicate Detection, StackExchange, English, Arabic

Country

Italy

Related Organizations

Qatar Foundation
Qatar
University of Trento
Italy
Qatar Computing Research Institute
Qatar
University of Melbourne
Australia

Keywords

FOS: Computer and information sciences, Computer Science - Machine Learning, Computer Science - Computation and Language, Computer Science - Artificial Intelligence, I.2.7, 68T50, Computer Science - Information Retrieval, Machine Learning (cs.LG), Artificial Intelligence (cs.AI), Computation and Language (cs.CL), Information Retrieval (cs.IR)

2 Research products, page 1 of 1

Multitask Learning with Deep Neural Networks for Community Question Answering
2017IsAmongTopNSimilarDocuments
ECNU at SemEval-2017 Task 3: Using Traditional and Deep Learning Methods to Address Community Question Answering Task
2017IsAmongTopNSimilarDocuments

Impact byBIP!

	citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).	145
	popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.	Top 1%
	influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).	Top 1%
	impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.	Top 1%