publication . Preprint . 2018

Recursive Neural Network Based Preordering for English-to-Japanese Machine Translation

Kawara, Yuki; Chu, Chenhui; Arase, Yuki;
Open Access English
  • Published: 25 May 2018
Abstract
The word order between source and target languages significantly influences the translation quality in machine translation. Preordering can effectively address this problem. Previous preordering methods require a manual feature design, making language dependent design costly. In this paper, we propose a preordering method with a recursive neural network that learns features from raw inputs. Experiments show that the proposed method achieves comparable gain in translation quality to the state-of-the-art method but without a manual feature design.
Subjects
free text keywords: Computer Science - Computation and Language
Download from
29 references, page 1 of 2

Jan A. Botha, Emily Pitler, Ji Ma, Anton Bakalov, Alex Salcianu, David Weiss, Ryan McDonald, and Slav Petrov. 2017. Natural language processing with small feed-forward networks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2879-2885, Copenhagen, Denmark. [OpenAIRE]

Dmitriy Genzel. 2010. Automatically learning sourceside reordering rules for large scale machine translation. In Proceedings of the International Conference on Computational Linguistics (COLING), pages 376-384, Beijing, China.

Adria` de Gispert, Gonzalo Iglesias, and Bill Byrne. 2015. Fast and accurate preordering for SMT using neural networks. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), pages 1012- 1017, Denver, Colorado. [OpenAIRE]

Anita Gojun and Alexander Fraser. 2012. Determining the placement of German verbs in English-toGerman SMT. In Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 726-735, Avignon, France.

Isao Goto, Masao Utiyama, and Eiichiro Sumita. 2012. Post-ordering by parsing for Japanese-English statistical machine translation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-316, Jeju Island, Korea.

Isao Goto, Masao Utiyama, and Eiichiro Sumita. 2013. Post-ordering by parsing with ITG for JapaneseEnglish statistical machine translation. ACM Transactions on Asian Language Information Processing, 12(4):17:1-17:22.

Katsuhiko Hayashi, Katsuhito Sudoh, Hajime Tsukada, Jun Suzuki, and Masaaki Nagata. 2013. Shiftreduce word reordering for machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1382-1386, Seattle, Washington, USA.

Sho Hoshino, Yusuke Miyao, Katsuhito Sudoh, Katsuhiko Hayashi, and Masaaki Nagata. 2015. Discriminative preordering meets Kendall's maximization. In Proceedings of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP), pages 139-144, Beijing, China.

Hideki Isozaki, Tsutomu Hirao, Kevin Duh, Katsuhito Sudoh, and Hajime Tsukada. 2010a. Automatic evaluation of translation quality for distant language pairs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 944-952, Cambridge, USA.

Hideki Isozaki, Katsuhito Sudoh, Hajime Tsukada, and Kevin Duh. 2010b. Head finalization: A simple reordering rule for SOV languages. In Proceedings of the Workshop on Statistical Machine Translation and MetricsMATR, pages 244-251, Uppsala, Sweden.

Laura Jehl, Adria` de Gispert, Mark Hopkins, and Bill Byrne. 2014. Source-side preordering for translation using logistic regression and depth-first branchand-bound search. In Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 239-248, Gothenburg, Sweden.

M. G. Kendall. 1938. A new measure of rank correlation. Biometrika, 30(1/2):81-93. [OpenAIRE]

Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference for Learning Representations (ICLR), San Diego, USA.

Philipp Koehn. 2004. Statistical significance tests for machine translation evaluation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 388-395, Barcelona, Spain.

Philipp Koehn, Amittai Axelrod, Alexandra BirchMayne, Chris Callison-Burch, Miles Osborne, and David Talbot. 2005. Edinburgh system description for the 2005 IWSLT speech translation evaluation. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT), pages 68- 75, Pittsburgh, USA. [OpenAIRE]

29 references, page 1 of 2
Abstract
The word order between source and target languages significantly influences the translation quality in machine translation. Preordering can effectively address this problem. Previous preordering methods require a manual feature design, making language dependent design costly. In this paper, we propose a preordering method with a recursive neural network that learns features from raw inputs. Experiments show that the proposed method achieves comparable gain in translation quality to the state-of-the-art method but without a manual feature design.
Subjects
free text keywords: Computer Science - Computation and Language
Download from
29 references, page 1 of 2

Jan A. Botha, Emily Pitler, Ji Ma, Anton Bakalov, Alex Salcianu, David Weiss, Ryan McDonald, and Slav Petrov. 2017. Natural language processing with small feed-forward networks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2879-2885, Copenhagen, Denmark. [OpenAIRE]

Dmitriy Genzel. 2010. Automatically learning sourceside reordering rules for large scale machine translation. In Proceedings of the International Conference on Computational Linguistics (COLING), pages 376-384, Beijing, China.

Adria` de Gispert, Gonzalo Iglesias, and Bill Byrne. 2015. Fast and accurate preordering for SMT using neural networks. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), pages 1012- 1017, Denver, Colorado. [OpenAIRE]

Anita Gojun and Alexander Fraser. 2012. Determining the placement of German verbs in English-toGerman SMT. In Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 726-735, Avignon, France.

Isao Goto, Masao Utiyama, and Eiichiro Sumita. 2012. Post-ordering by parsing for Japanese-English statistical machine translation. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 311-316, Jeju Island, Korea.

Isao Goto, Masao Utiyama, and Eiichiro Sumita. 2013. Post-ordering by parsing with ITG for JapaneseEnglish statistical machine translation. ACM Transactions on Asian Language Information Processing, 12(4):17:1-17:22.

Katsuhiko Hayashi, Katsuhito Sudoh, Hajime Tsukada, Jun Suzuki, and Masaaki Nagata. 2013. Shiftreduce word reordering for machine translation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1382-1386, Seattle, Washington, USA.

Sho Hoshino, Yusuke Miyao, Katsuhito Sudoh, Katsuhiko Hayashi, and Masaaki Nagata. 2015. Discriminative preordering meets Kendall's maximization. In Proceedings of the Annual Meeting of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP), pages 139-144, Beijing, China.

Hideki Isozaki, Tsutomu Hirao, Kevin Duh, Katsuhito Sudoh, and Hajime Tsukada. 2010a. Automatic evaluation of translation quality for distant language pairs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 944-952, Cambridge, USA.

Hideki Isozaki, Katsuhito Sudoh, Hajime Tsukada, and Kevin Duh. 2010b. Head finalization: A simple reordering rule for SOV languages. In Proceedings of the Workshop on Statistical Machine Translation and MetricsMATR, pages 244-251, Uppsala, Sweden.

Laura Jehl, Adria` de Gispert, Mark Hopkins, and Bill Byrne. 2014. Source-side preordering for translation using logistic regression and depth-first branchand-bound search. In Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 239-248, Gothenburg, Sweden.

M. G. Kendall. 1938. A new measure of rank correlation. Biometrika, 30(1/2):81-93. [OpenAIRE]

Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference for Learning Representations (ICLR), San Diego, USA.

Philipp Koehn. 2004. Statistical significance tests for machine translation evaluation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 388-395, Barcelona, Spain.

Philipp Koehn, Amittai Axelrod, Alexandra BirchMayne, Chris Callison-Burch, Miles Osborne, and David Talbot. 2005. Edinburgh system description for the 2005 IWSLT speech translation evaluation. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT), pages 68- 75, Pittsburgh, USA. [OpenAIRE]

29 references, page 1 of 2
Powered by OpenAIRE Open Research Graph
Any information missing or wrong?Report an Issue