Seeing the Unseen? Opportunities and Challenges in Understanding Tourist Behaviors from UGC using Large Language Models (LLMs)
DOI:
https://doi.org/10.34010/injiiscom.v8i1.19447Keywords:
Opportunities Challenges, Tourist Behaviours, User-Generated Content (UGC), Large Language Models (LLMs), Big DataAbstract
The digital tourism era generates vast User-Generated Content (UGC), offering critical yet underutilized insights into traveler behavior. This study explores the opportunities and challenges of utilizing Large Language Models (LLMs) to analyze unstructured UGC. Drawing data from TripAdvisor, we examined over 13,000 reviews across 15 cultural heritage sites in Yogyakarta, Indonesia. Through a Python-integrated OpenAI API, a Natural Language Processing (NLP) framework was deployed to evaluate tourist motivations, experiences, and satisfaction. The methodology encompasses web scraping, text pre-processing, theory-driven classification, prompt engineering, and lexicon mapping. This paper bridges classical tourism theories with advanced AI, contributing to the emerging discourse on computational behavior analysis in digital tourism research.
References
Albtsoh, L., & Omar, M. (2025). Textguard: Identifying and neutralizing adversarial threats in textual data. International Journal of Informatics, Information System and Computer Engineering (INJIISCOM), 6(2), 212-224.
Chen, J., Shoval, N., & Stantic, B. (2024). Tracking tourist mobility in the big data era: Insights from data, theory, and future directions. Tourism Geographies, 26(8), 1381-1411.
Fuchs, M., Höpken, W., & Lexhagen, M. (2014). Big data analytics for knowledge generation in tourism destinations–A case from Sweden. Journal of destination marketing & management, 3(4), 198-209.
Girardin, F., Calabrese, F., Dal Fiore, F., Ratti, C., & Blat, J. (2008). Digital footprinting: Uncovering tourists with user-generated content. IEEE Pervasive computing, 7(4), 36-43.
Golder, S. A., & Macy, M. W. (2014). Digital footprints: Opportunities and challenges for online social research. Annual review of sociology, 40(1), 129-152.
Kang, Y., Cai, Z., Tan, C. W., Huang, Q., & Liu, H. (2020). Natural language processing (NLP) in management research: A literature review. Journal of Management Analytics, 7(2), 139-172.
Miah, S. J., Vu, H., & Gammack, J. (2019). A big-data analytics method for capturing visitor activities and flows: The case of an island country. Information Technology and Management, 20(4), 203-221.
Mou, N., Wang, Y., Zheng, Y., Zhang, L., Makkonen, T., Jiang, Q., & Yang, T. (2023). Understanding tourists' travel behavior before, during, and after the trip with data from social media platforms. Transactions in GIS, 27(4), 1043-1067.
Salas-Olmedo, M. H., Moya-Gómez, B., García-Palomares, J. C., & Gutiérrez, J. (2018). Tourists' digital footprint in cities: Comparing Big Data sources. Tourism Management, 66, 13-25.
Santos, M. L. B. D. (2022). The “so-called” UGC: an updated definition of user-generated content in the age of social media. Online Information Review, 46(1), 95-113.
Schoedel, R., Au, Q., Völkel, S. T., Lehmann, F., Becker, D., Bühner, M., ... & Stachl, C. (2019). Digital footprints of sensation seeking. Zeitschrift für Psychologie.
Sivarajkumar, S., Kelley, M., Samolyk-Mazzanti, A., Visweswaran, S., & Wang, Y. (2024). An empirical evaluation of prompting strategies for large language models in zero-shot clinical natural language processing: algorithm development and validation study. JMIR Medical Informatics, 12, e55318.
Sondakh, D. E., Kom, S., Taju, S. W., Yuune, J. K. T., Kaminang, A. F., & Wagey, S. G. (2024). Research Project Topic Recommender System Using Generative Language Model. CogITo Smart Journal, 10(1), 233-245.
TripAdvisor. (2023). Tripadvisor’s Review Transparency Report Highlights Fight Against Fake Reviews and Strong Growth in User-Generated Content. Tripadvisor.Mediaroom.Com. https://tripadvisor.mediaroom.com/review-transparency-report-2023-ANZ
Wang, L., Guo, Z., Zhang, G. Y., & Xu, X. A. (2022). Effective destination user-generated advertising: Matching effect between goal framing and self-esteem. Tourism Management, 92, 104557.
Weaver, A. (2021). Tourism, big data, and a crisis of analysis. Annals of Tourism Research, 88, 103158.
Zhang, Z., Li, C., & Zhang, H. (2026). Digital confusion: Comprehending the impact mechanisms of artificial intelligence-generated content and user-generated content on tourism decision making. Tourism Management, 112, 105269.
Zheng, S., Zhang, Y., Zhu, Y., Xi, C., Gao, P., Xun, Z., & Chang, K. (2024). Gpt-fathom: Benchmarking large language models to decipher the evolutionary path towards gpt-4 and beyond. In Findings of the Association for Computational Linguistics: NAACL 2024 (pp. 1363-1382).















