Actions
  • shareshare
  • link
  • cite
  • add
add
auto_awesome_motion View all 2 versions
Research data . Dataset . 2022

OcWikiDisc: a Corpus of Wikipedia Talk Pages in Occitan

Miletić, Aleksandra; Scherrer, Yves;
Open Access
Occitan (post 1500); Provençal
Published: 14 Sep 2022
Publisher: Zenodo
Abstract

OcWikiDisc is a freely available corpus in Occitan, extracted from the talk pages associated with the Occitan Wikipedia. The corpus contains messages posted by users in direct user-to-user interactions as part of the discussions about the content and the editing policies on Wikipedia. The messages are associated with metadata, such as the username, the date and time of the posting, the discussion title, etc. The corpus has also been annotated with tools for automatic language identification, allowing to filter out content in languages other than Occitan. Using different filtering strategies, four versions of the corpus are published (see documentation for more details). The version with the most restrictive filtering contains 8,000 messages for a total of 618,000 tokens, produced by 520 different users.

{"references": ["Aleksandra Mileti\u0107 and Yves Scherrer. 2022. OcWikiDisc: a Corpus of Wikipedia Talk Pages in Occitan. In Proceedings of VarDial - Ninth Workshop on NLP for Similar Languages, Varieties and Dialects. (forthcoming)"]}

Subjects

Occitan, Wikipedia talk pages, corpus, low-resourced language, language identification

moresidebar