An automated benchmark dataset for (Named Entity Recognition) NER and (Named Entity Linking) NEL tools, based on Greek Wikipedia events pages. Note: This data includes data from the following sources: - Wikipedia el.wikipedia.org Description The dataset is provided in the form of three JSON-formatted subsets i.e., train, validation and test in an analogy of 70-20-10. The current version of the dataset contains 18,617 events annotated with 40,798 entity mentions and 36,189 links to elWikipedia (and wikidata ids). The dataset contains annotations belonging to 8 entity types: person, organization, location, gpe, event, facility, product and work of art. Overall dataset statistics Docs Tokens Sentences Surface Mentions Valid Links Red Links Train 13,031 332,077 16,927 28,593 25,365 3,228 Validation 3,722 94,746 4,844 8,168 7,240 928 Test 1,862 47,450 2,427 4,037 3,584 453 Total 18,617 474,361 24,200 40,798 36,189 4,609 Example A record example is given below. { "json_file": "February 2012_39_0 events", "text": "Sudan and South Sudan sign non-aggression pact.", "ground_truth_mentions": [ {"start": 0, "end": 4, "surface_mention": "Sudan", "mention_type": "GPE"}, {"start": 10, "end": 20, "surface_mention": "South Sudan", "mention_type": "GPE"} ], "ground_truth_links": [ {"enwiki": "Sudan","wikidata": "Q1049"}, {"enwiki": "South_Sudan", "wikidata": "Q958"} ] } Code https://gitlab.isl.ics.forth.gr/debatelab/elwiki_events_benchmark Acknowledgments This work has received funding from the Hellenic Foundation for Research and Innovation (HFRI) and the General Secretariat for Research and Technology (GSRT), under grant agreement No 4195.