Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ ZENODOarrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Project deliverable . 2019
License: CC BY
Data sources: Datacite
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Other literature type . 2019
License: CC BY
Data sources: ZENODO
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
ZENODO
Project deliverable . 2019
License: CC BY
Data sources: Datacite
versions View all 2 versions
addClaim

D4.2 Report on Discourse-Aware Machine Translation for Audiovisual Data

Authors: Hirvonen, Maija; Koponen, Maarit; Sulubacak, Umut; Tiedemann, Jörg;

D4.2 Report on Discourse-Aware Machine Translation for Audiovisual Data

Abstract

Machine translation is conventionally based on processing isolated textual sentences, disregarding the broader context around them, as well as any cues that are not explicit in text. This formulation is unable to reliably determine referential discourse phenomena such as anaphora and connectives, which creates a barrier to the production of cohesive and coherent language. While exploiting the audio and visual modalities provide a window into the context, machine translation must also venture beyond the sentence, and become aware of the discourse in the entire document. There has been a surge of research in discourse-aware machine translation in the last two decades, primarily focusing on the design and evaluation of document-level machine translation systems, and expanding the textual context in machine translation architectures without compromising computational efficiency. Following the recent advances, we have likewise put substantial effort into the development of discourse-aware machine translation systems, albeit to no considerable improvement. In this deliverable, we start by breaking down the most salient phenomena to explain their relevance, and presenting a brief survey of successful approaches to discourse-aware machine translation, followed by descriptions of the models we have developed within the WP4 of the MeMAD project. We dedicate the rest of the report to our analysis of user evaluation data collected in an experiment where professional translators tested post-editing of machine translation for subtitling. Finally, we conclude our report with discussions of future directions in utilising dedicated subtitle translation systems, speaker and dialogue information, and end-to-end speech translation models in the last year of the project.

Related Organizations
Keywords

discourse-aware, multimodal, machine translation

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
    OpenAIRE UsageCounts
    Usage byUsageCounts
    visibility views 3
    download downloads 9
  • 3
    views
    9
    downloads
    Powered byOpenAIRE UsageCounts
Powered by OpenAIRE graph
Found an issue? Give us feedback
visibility
download
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
views
OpenAIRE UsageCountsViews provided by UsageCounts
downloads
OpenAIRE UsageCountsDownloads provided by UsageCounts
0
Average
Average
Average
3
9
Green