Evaluating the English-Turkish parallel treebank for machine translation
Yükleniyor...
Dosyalar
Tarih
2022-01-19
Yazarlar
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
TÜBİTAK
Erişim Hakkı
info:eu-repo/semantics/closedAccess
Özet
This study extends our initial efforts in building an English-Turkish parallel treebank corpus for statistical machine translation tasks. We manually generated parallel trees for about 17K sentences selected from the Penn Treebank corpus. English sentences vary in length: 15 to 50 tokens including punctuation. We constrained the translation of trees by (i) reordering of leaf nodes based on suffixation rules in Turkish, and (ii) gloss replacement. We aim to mimic human annotator's behavior in real translation task. In order to fill the morphological and syntactic gap between languages, we do morphological annotation and disambiguation. We also apply our heuristics by creating Nokia English-Turkish Treebank (NTB) to address technical document translation tasks. NTB also includes 8.3K sentences in varying lengths. We validate the corpus both extrinsically and intrinsically, and report our evaluation results regarding perplexity analysis and translation task results. Results prove that our heuristics yield promising results in terms of perplexity and are suitable for translation tasks in terms of BLEU scores.
Açıklama
Anahtar Kelimeler
English, Parallel corpora, Parallel treebank, Syntax-based, Turkish, Computational linguistics, Computer aided language translation, Forestry, Machine translation, English sentences, In-buildings, Machine translations, Statistical machine translation, Treebanks
Kaynak
Turkish Journal Of Electrical Engineering And Computer Sciences
WoS Q Değeri
Q4
Scopus Q Değeri
Q3
Cilt
30
Sayı
1
Künye
Görgün, O. & Yıldız, O. T. (2022). Evaluating the English-Turkish parallel treebank for machine translation. Turkish Journal Of Electrical Engineering And Computer Sciences, 30(1), 184-199. doi:10.3906/elk-2102-57
