Normalization of Arabic Dialects into Modern Standard Arabic using BERT and GPT-2
Copyright policy )Normalization of Arabic Dialects into Modern Standard Arabic using BERT and GPT-2
We present an encoder-decored based model for normalization of Arabic dialects using both BERT and GPT-2 based models. Arabic is a language of many dialects that not only differ from the Modern Standard Arabic (MSA) in terms of pronunciation but also in terms of morphology, grammar and lexical choice. This diversity can be troublesome even to a native Arabic speaker let alone a computer. Several NLP tools work well for MSA and in some of the main dialects but fail to cover Arabic language as a whole. Based on our manual evaluation, our model normalizes sentences entirely correctly 46\% of the time and almost correctly 26\% of the time.
Normalization, normalization, Arabic, arabic, AZ20-999, History of scholarship and learning. The humanities, dialect, Dialect, Bibliography. Library science. Information resources, Z
Normalization, normalization, Arabic, arabic, AZ20-999, History of scholarship and learning. The humanities, dialect, Dialect, Bibliography. Library science. Information resources, Z
selected citations These citations are derived from selected sources.This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).4 popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.Top 10% influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).Average impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.Average
Citations provided by BIP!Popularity provided by BIP!