Downloads provided by UsageCounts
Multimodal machine translation involves drawing information from more than one modality (text, audio, and visuals), and is an emerging subject within the machine translation community. In MeMAD, multimodal translation is of particular interest in facilitating cross-lingual multimodal content retrieval, and is one of the main focuses of WP4. Though multimodal machine translation efforts have been emerging since the early 1990s, there has not been research on a large scale until the last decade. Especially prominent are the multimodal tasks of spoken language translation and image caption translation, exploiting audio and visual modalities respectively. Both of these tasks are championed by evaluation campaigns, acting as competitions to stimulate research and to serve as a regulated platform investigating evaluation methodologies. So far, one multimodal machine translation system has been developed within WP4 of the MeMAD project for either task, and especially the image caption translation system had great success. In this deliverable, we present a survey of the state of the art in machine translation with an emphasis on multimodal tasks and systems. Later, we describe our own multimodal machine translation efforts carried out in WP4 within the first year of MeMAD. Finally, to conclude our report, we discuss our plans of tackling video subtitle and audio description translations as the next steps in WP4.
multimodal, machine translation
multimodal, machine translation
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
| views | 2 | |
| downloads | 12 |

Views provided by UsageCounts
Downloads provided by UsageCounts