Powered by OpenAIRE graph
Found an issue? Give us feedback
addClaim

SemEval-2021 Task 11 Shared Task Dataset

Authors: Pedersen, Jennifer D'Souza and S��ren Auer and Ted;

SemEval-2021 Task 11 Shared Task Dataset

Abstract

## NLPContributionGraph - Structuring Scholarly NLP Contributions in the Open Research Knowledge Graph ### Background [__NLPContributionGraph__](https://ncg-task.github.io/) was introduced as Task 11 at [SemEval 2021](https://semeval.github.io/SemEval2021/tasks) for the first time. The task is defined on a dataset of Natural Language Processing (NLP) scholarly articles with their contributions structured to be integrable within Knowledge Graph infrastructures such as the [Open Research Knowledge Graph](https://www.orkg.org/). The structured contribution annotations are provided as (1) __Contribution sentences__ : a set of sentences about the contribution in the article; (2) __Scientific terms and relations__: a set of scientific terms and relational cue phrases extracted from the contribution sentences; and (3) __Triples__: semantic statements that pair scientific terms with a relation, modeled toward subject-predicate-object RDF statements for KG building. The Triples are organized under three (mandatory) or more of twelve total information units (viz., _ResearchProblem_, _Approach_, _Model_, _Code_, _Dataset_, _ExperimentalSetup_, _Hyperparameters_, _Baselines_, _Results_, _Tasks_, _Experiments_, and _AblationAnalysis_). ### The Shared Task As a complete submission for the Shared Task, given NLP scholarly articles in plaintext format, systems had to automatically extract the following information: * contribution sentences; * scientific term and predicate phrases from the sentences; and * (subject,predicate,object) triple statements toward KG building organized under three or more of twelve total information units.

Country
Germany
Related Organizations
Keywords

language resource, dataset, shared task, semeval, natural language processing, scholarly knowledge graphs, open research knowledge graph

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
Related to Research communities