JUST System for WMT20 Chat Translation Task

Roweida Mohammed; Mahmoud Al-Ayyoub; Malak Abdullah

JUST System for WMT20 Chat Translation Task

Roweida Mohammed
, Mahmoud Al-Ayyoub
, Malak Abdullah

Jordan University of Science and Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Scopus citations

Abstract

Machine Translation (MT) is a sub-field of Artificial Intelligence and Natural Language Processing that investigates and studies the ways of automatically translating a text from one language to another. In this paper, we present the details of our submission to the WMT20 Chat Translation Task, which consists of two language directions, English→German and German→English. The major feature of our system is applying a pre-trained BERT embedding with a bidirectional recurrent neural network. Our system ensembles three models, each with different hyperparameters. Despite being trained on a very small corpus, our model produces surprisingly good results.

Original language	English
Title of host publication	5th Conference on Machine Translation, WMT 2020 - Proceedings
Editors	Loic Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-Jussa, Christian Federmann, Mark Fishel, Alexander Fraser, Yvette Graham, Paco Guzman, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Andre Martins, Makoto Morishita, Christof Monz, Masaaki Nagata, Toshiaki Nakazawa, Matteo Negri
Publisher	Association for Computational Linguistics (ACL)
Pages	479-482
Number of pages	4
ISBN (Electronic)	9781948087810
State	Published - 2020
Externally published	Yes
Event	5th Conference on Machine Translation, WMT 2020 - Virtual, Online Duration: 19 Nov 2020 → 20 Nov 2020

Publication series

Name	5th Conference on Machine Translation, WMT 2020 - Proceedings

Conference

Conference	5th Conference on Machine Translation, WMT 2020
City	Virtual, Online
Period	19/11/20 → 20/11/20

Cite this

Mohammed, R., Al-Ayyoub, M., & Abdullah, M. (2020). JUST System for WMT20 Chat Translation Task. In L. Barrault, O. Bojar, F. Bougares, R. Chatterjee, M. R. Costa-Jussa, C. Federmann, M. Fishel, A. Fraser, Y. Graham, P. Guzman, B. Haddow, M. Huck, A. J. Yepes, P. Koehn, A. Martins, M. Morishita, C. Monz, M. Nagata, T. Nakazawa, & M. Negri (Eds.), 5th Conference on Machine Translation, WMT 2020 - Proceedings (pp. 479-482). (5th Conference on Machine Translation, WMT 2020 - Proceedings). Association for Computational Linguistics (ACL).

Mohammed, Roweida ; Al-Ayyoub, Mahmoud ; Abdullah, Malak. / JUST System for WMT20 Chat Translation Task. 5th Conference on Machine Translation, WMT 2020 - Proceedings. editor / Loic Barrault ; Ondrej Bojar ; Fethi Bougares ; Rajen Chatterjee ; Marta R. Costa-Jussa ; Christian Federmann ; Mark Fishel ; Alexander Fraser ; Yvette Graham ; Paco Guzman ; Barry Haddow ; Matthias Huck ; Antonio Jimeno Yepes ; Philipp Koehn ; Andre Martins ; Makoto Morishita ; Christof Monz ; Masaaki Nagata ; Toshiaki Nakazawa ; Matteo Negri. Association for Computational Linguistics (ACL), 2020. pp. 479-482 (5th Conference on Machine Translation, WMT 2020 - Proceedings).

@inproceedings{123c3a7c01e64b1684702da35f15e6fd,

title = "JUST System for WMT20 Chat Translation Task",

abstract = "Machine Translation (MT) is a sub-field of Artificial Intelligence and Natural Language Processing that investigates and studies the ways of automatically translating a text from one language to another. In this paper, we present the details of our submission to the WMT20 Chat Translation Task, which consists of two language directions, English→German and German→English. The major feature of our system is applying a pre-trained BERT embedding with a bidirectional recurrent neural network. Our system ensembles three models, each with different hyperparameters. Despite being trained on a very small corpus, our model produces surprisingly good results.",

author = "Roweida Mohammed and Mahmoud Al-Ayyoub and Malak Abdullah",

note = "Publisher Copyright: {\textcopyright} 2020 Association for Computational Linguistics; 5th Conference on Machine Translation, WMT 2020 ; Conference date: 19-11-2020 Through 20-11-2020",

year = "2020",

language = "English",

series = "5th Conference on Machine Translation, WMT 2020 - Proceedings",

publisher = "Association for Computational Linguistics (ACL)",

pages = "479--482",

editor = "Loic Barrault and Ondrej Bojar and Fethi Bougares and Rajen Chatterjee and Costa-Jussa, \{Marta R.\} and Christian Federmann and Mark Fishel and Alexander Fraser and Yvette Graham and Paco Guzman and Barry Haddow and Matthias Huck and Yepes, \{Antonio Jimeno\} and Philipp Koehn and Andre Martins and Makoto Morishita and Christof Monz and Masaaki Nagata and Toshiaki Nakazawa and Matteo Negri",

booktitle = "5th Conference on Machine Translation, WMT 2020 - Proceedings",

address = "Australia",

}

Mohammed, R, Al-Ayyoub, M & Abdullah, M 2020, JUST System for WMT20 Chat Translation Task. in L Barrault, O Bojar, F Bougares, R Chatterjee, MR Costa-Jussa, C Federmann, M Fishel, A Fraser, Y Graham, P Guzman, B Haddow, M Huck, AJ Yepes, P Koehn, A Martins, M Morishita, C Monz, M Nagata, T Nakazawa & M Negri (eds), 5th Conference on Machine Translation, WMT 2020 - Proceedings. 5th Conference on Machine Translation, WMT 2020 - Proceedings, Association for Computational Linguistics (ACL), pp. 479-482, 5th Conference on Machine Translation, WMT 2020, Virtual, Online, 19/11/20.

JUST System for WMT20 Chat Translation Task. / Mohammed, Roweida; Al-Ayyoub, Mahmoud; Abdullah, Malak.
5th Conference on Machine Translation, WMT 2020 - Proceedings. ed. / Loic Barrault; Ondrej Bojar; Fethi Bougares; Rajen Chatterjee; Marta R. Costa-Jussa; Christian Federmann; Mark Fishel; Alexander Fraser; Yvette Graham; Paco Guzman; Barry Haddow; Matthias Huck; Antonio Jimeno Yepes; Philipp Koehn; Andre Martins; Makoto Morishita; Christof Monz; Masaaki Nagata; Toshiaki Nakazawa; Matteo Negri. Association for Computational Linguistics (ACL), 2020. p. 479-482 (5th Conference on Machine Translation, WMT 2020 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - JUST System for WMT20 Chat Translation Task

AU - Mohammed, Roweida

AU - Al-Ayyoub, Mahmoud

AU - Abdullah, Malak

PY - 2020

Y1 - 2020

N2 - Machine Translation (MT) is a sub-field of Artificial Intelligence and Natural Language Processing that investigates and studies the ways of automatically translating a text from one language to another. In this paper, we present the details of our submission to the WMT20 Chat Translation Task, which consists of two language directions, English→German and German→English. The major feature of our system is applying a pre-trained BERT embedding with a bidirectional recurrent neural network. Our system ensembles three models, each with different hyperparameters. Despite being trained on a very small corpus, our model produces surprisingly good results.

AB - Machine Translation (MT) is a sub-field of Artificial Intelligence and Natural Language Processing that investigates and studies the ways of automatically translating a text from one language to another. In this paper, we present the details of our submission to the WMT20 Chat Translation Task, which consists of two language directions, English→German and German→English. The major feature of our system is applying a pre-trained BERT embedding with a bidirectional recurrent neural network. Our system ensembles three models, each with different hyperparameters. Despite being trained on a very small corpus, our model produces surprisingly good results.

UR - https://www.scopus.com/pages/publications/85112103417

M3 - Conference contribution

AN - SCOPUS:85112103417

T3 - 5th Conference on Machine Translation, WMT 2020 - Proceedings

SP - 479

EP - 482

BT - 5th Conference on Machine Translation, WMT 2020 - Proceedings

A2 - Barrault, Loic

A2 - Bojar, Ondrej

A2 - Bougares, Fethi

A2 - Chatterjee, Rajen

A2 - Costa-Jussa, Marta R.

A2 - Federmann, Christian

A2 - Fishel, Mark

A2 - Fraser, Alexander

A2 - Graham, Yvette

A2 - Guzman, Paco

A2 - Haddow, Barry

A2 - Huck, Matthias

A2 - Yepes, Antonio Jimeno

A2 - Koehn, Philipp

A2 - Martins, Andre

A2 - Morishita, Makoto

A2 - Monz, Christof

A2 - Nagata, Masaaki

A2 - Nakazawa, Toshiaki

A2 - Negri, Matteo

PB - Association for Computational Linguistics (ACL)

T2 - 5th Conference on Machine Translation, WMT 2020

Y2 - 19 November 2020 through 20 November 2020

ER -

Mohammed R, Al-Ayyoub M, Abdullah M. JUST System for WMT20 Chat Translation Task. In Barrault L, Bojar O, Bougares F, Chatterjee R, Costa-Jussa MR, Federmann C, Fishel M, Fraser A, Graham Y, Guzman P, Haddow B, Huck M, Yepes AJ, Koehn P, Martins A, Morishita M, Monz C, Nagata M, Nakazawa T, Negri M, editors, 5th Conference on Machine Translation, WMT 2020 - Proceedings. Association for Computational Linguistics (ACL). 2020. p. 479-482. (5th Conference on Machine Translation, WMT 2020 - Proceedings).

JUST System for WMT20 Chat Translation Task

Abstract

Publication series

Conference

Other files and links

Fingerprint

Cite this