Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ https://doi.org/10.3...arrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
https://doi.org/10.31224/4536...
Article . 2025 . Peer-reviewed
License: CC BY
Data sources: Crossref
addClaim

Cross-Lingual Transfer with Typological Constraints: A Case Study in Low-Resource NLP

Authors: Raul Mateo Jimenez;

Cross-Lingual Transfer with Typological Constraints: A Case Study in Low-Resource NLP

Abstract

Cross-lingual transfer learning has become a cornerstone of multilingual NLP, yet performance disparities persist for low-resource languages, particularly those with typologically divergent features from high-resource source languages. This paper investigates how explicit typological constraints— derived from databases like the World Atlas of Language Structures (WALS) Dryer and Haspelmath [2013]—can guide parameter sharing and alignment in multilingual models. Building on recent work in typologically informed neural architectures Ponti et al. [2020], Bjerva and Augenstein [2021], we propose a novel adapter-based framework that conditions layer-wise transformations on syntactic and morphological features. Our experiments on three low-resource languages (Arapaho, Uyghur, and Tsez) demonstrate that typological guidance reduces negative interference and improves transfer accuracy by up to 12% compared to unconstrained baselines. We further analyze the interplay between feature granularity and model performance, drawing on insights from linguistic typology Bickel and Nichols [2017] and low-resource NLP Joshi et al. [2020].

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
hybrid