Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Report
Data sources: ZENODO
addClaim

Cross-lingual Transfer Performance of mT5 on XTREME-R with Intermediate Tasks from Different Linguistic Typologies

Authors: Assignee Research;

Cross-lingual Transfer Performance of mT5 on XTREME-R with Intermediate Tasks from Different Linguistic Typologies

Abstract

Multilingual BERT (mBERT) has demonstrated considerable cross-lingual syntactic ability, whereby it enables effective zero-shot cross-lingual transfer of syntactic knowledge. The transfer is more successful between some languages, but it is not well understood what leads to this variation and whether it fairly reflects difference between languages. In this work, we investigate the distributions of grammatical relations induced from mBERT in the context of 24 typologically different languages. We demonstrate that the distance between the distributions of different languages is highly consistentResearch goal: Does the zero-shot cross-lingual transfer performance of mT5 on XTREME-R vary when using intermediate tasks from different linguistic typologies (e.g., SVO vs. SOV languages), as measured by accuracy differences across target languages with distinct syntactic structures?Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.1/10.

Powered by OpenAIRE graph
Found an issue? Give us feedback