Leveraging transformer-based language models for enhanced service insight in tourism

Abstract

Customer feedback is a valuable resource for enhancing customer experience and identifying areas that require improvement. Utilizing user insights allows a tourism company to identify and address problematic points in its service delivery, provide feedback to partner companies regarding their product offerings, and even reconsider agreements by incorporating these opinions when curating their product portfolio. Setur implemented a systematic approach to collecting customer feedback by distributing "after-stay surveys'' to its customers via email following the completion of the agency services provided. Guest answers to open-ended questions that gather opinions about travel experience are analyzed by four tasks: user intention for answering, the sentiment of the review, subjects touched upon, and whom it concerned. For these tasks, transformer-based natural language processing (NLP) models BERT, DistilBERT, RoBERTa, and Electra are fine-Tuned to classify customer reviews. Based on the test results, it is observed that best practices could be gathered using Bert. In addition, we showed that different insights can be obtained from text comments made for two hotels in Aydin, Turkiye. Some users made complaints using neutral sentences. In some cases, people gave high scores to the numerical rating questions, but their open-ended questions could have a negative meaning.