dc.contributor.author | Ercan, Gökhan | en_US |
dc.contributor.author | Yıldız, Olcay Taner | en_US |
dc.date.accessioned | 2024-01-16T22:22:52Z | |
dc.date.available | 2024-01-16T22:22:52Z | |
dc.date.issued | 2018-08-26 | |
dc.identifier.citation | Ercan, G. & Yıldız, O. T. (2018). AnlamVer: Semantic model evaluation dataset for Turkish - word similarity and relatedness. Paper presented at the COLING 2018 - 27th International Conference on Computational Linguistics, Proceedings, 3819 - 3836. | en_US |
dc.identifier.isbn | 9781948087506 | |
dc.identifier.uri | https://hdl.handle.net/11729/5886 | |
dc.description.abstract | In this paper, we present AnlamVer, which is a semantic model evaluation dataset for Turkish designed to evaluate word similarity and word relatedness tasks while discriminating those two relations from each other. Our dataset consists of 500 word-pairs annotated by 12 human subjects, and each pair has two distinct scores for similarity and relatedness. Word-pairs are selected to enable the evaluation of distributional semantic models by multiple attributes of words and word-pair relations such as frequency, morphology, concreteness and relation types (e.g., synonymy, antonymy). Our aim is to provide insights to semantic model researchers by evaluating models in multiple attributes. We balance dataset word-pairs by their frequencies to evaluate the robustness of semantic models concerning out-of-vocabulary and rare words problems, which are caused by the rich derivational and inflectional morphology of the Turkish language. | en_US |
dc.language.iso | en | en_US |
dc.publisher | Association for Computational Linguistics (ACL) | en_US |
dc.rights | info:eu-repo/semantics/closedAccess | en_US |
dc.subject | Computational linguistics | en_US |
dc.subject | Semantics | en_US |
dc.subject | Distributional semantics | en_US |
dc.subject | Evaluating models | en_US |
dc.subject | Human subjects | en_US |
dc.subject | Model evaluation | en_US |
dc.subject | Multiple attributes | en_US |
dc.subject | Semantic modelling | en_US |
dc.subject | Turkishs | en_US |
dc.subject | Word problem | en_US |
dc.subject | Word similarity | en_US |
dc.subject | Word-pairs | en_US |
dc.subject | Morphology | en_US |
dc.title | AnlamVer: Semantic model evaluation dataset for Turkish - word similarity and relatedness | en_US |
dc.type | Conference Object | en_US |
dc.description.version | Publisher's Version | en_US |
dc.department | Işık Üniversitesi, Mühendislik Fakültesi, Bilgisayar Mühendisliği Bölümü | en_US |
dc.department | Işık University, Faculty of Engineering, Department of Computer Engineering | en_US |
dc.authorid | 0000-0002-2782-8217 | |
dc.authorid | 0000-0001-5838-4615 | |
dc.authorid | 0000-0002-2782-8217 | en_US |
dc.authorid | 0000-0001-5838-4615 | en_US |
dc.identifier.startpage | 3819 | |
dc.identifier.endpage | 3836 | |
dc.peerreviewed | Yes | en_US |
dc.publicationstatus | Published | en_US |
dc.relation.publicationcategory | Konferans Öğesi - Uluslararası - Kurum Öğretim Elemanı | en_US |
dc.institutionauthor | Ercan, Gökhan | en_US |
dc.institutionauthor | Yıldız, Olcay Taner | en_US |
dc.indekslendigikaynak | Scopus | en_US |
dc.identifier.scopus | 2-s2.0-85071979333 | en_US |
dc.identifier.scopusquality | N/A | en_US |