2020
pdf
bib
abs
To Case or not to case: Evaluating Casing Methods for Neural Machine Translation
Thierry Etchegoyhen
|
Harritxu Gete
Proceedings of The 12th Language Resources and Evaluation Conference
We present a comparative evaluation of casing methods for Neural Machine Translation, to help establish an optimal pre- and post-processing methodology. We trained and compared system variants on data prepared with the main casing methods available, namely translation of raw data without case normalisation, lowercasing with recasing, truecasing, case factors and inline casing. Machine translation models were prepared on WMT 2017 English-German and English-Turkish datasets, for all translation directions, and the evaluation includes reference metric results as well as a targeted analysis of case preservation accuracy. Inline casing, where case information is marked along lowercased words in the training data, proved to be the optimal approach overall in these experiments.
pdf
bib
abs
Handle with Care: A Case Study in Comparable Corpora Exploitation for Neural Machine Translation
Thierry Etchegoyhen
|
Harritxu Gete
Proceedings of The 12th Language Resources and Evaluation Conference
We present the results of a case study in the exploitation of comparable corpora for Neural Machine Translation. A large comparable corpus for Basque-Spanish was prepared, on the basis of independently-produced news by the Basque public broadcaster EiTB, and we discuss the impact of various techniques to exploit the original data in order to determine optimal variants of the corpus. In particular, we show that filtering in terms of alignment thresholds and length-difference outliers has a significant impact on translation quality. The impact of tags identifying comparable data in the training datasets is also evaluated, with results indicating that this technique might be useful to help the models discriminate noisy information, in the form of informational imbalance between aligned sentences. The final corpus was prepared according to the experimental results and is made available to the scientific community for research purposes.
pdf
bib
abs
ELRI: A Decentralised Network of National Relay Stations to Collect, Prepare and Share Language Resources
Thierry Etchegoyhen
|
Borja Anza Porras
|
Andoni Azpeitia
|
Eva Martínez Garcia
|
José Luis Fonseca
|
Patricia Fonseca
|
Paulo Vale
|
Jane Dunne
|
Federico Gaspari
|
Teresa Lynn
|
Helen McHugh
|
Andy Way
|
Victoria Arranz
|
Khalid Choukri
|
Hervé Pusset
|
Alexandre Sicard
|
Rui Neto
|
Maite Melero
|
David Perez
|
António Branco
|
Ruben Branco
|
Luís Gomes
Proceedings of the 1st International Workshop on Language Technology Platforms
We describe the European Language Resource Infrastructure (ELRI), a decentralised network to help collect, prepare and share language resources. The infrastructure was developed within a project co-funded by the Connecting Europe Facility Programme of the European Union, and has been deployed in the four Member States participating in the project, namely France, Ireland, Portugal and Spain. ELRI provides sustainable and flexible means to collect and share language resources via National Relay Stations, to which members of public institutions can freely subscribe. The infrastructure includes fully automated data processing engines to facilitate the preparation, sharing and wider reuse of useful language resources that can help optimise human and automated translation services in the European Union.