Aspect-Based Sentiment Analysis using Adaptive Aspect on Tourist Reviews in Jakarta

Ade Rifqy Setyawan, Lya Hulliyatus Suadaa, Budi Yuniarto

Abstract


Tourism is one of the business fields affected by the Covid-19 pandemic. The decline in the number of tourists, both domestic and foreign, has resulted in the contribution of the tourism business sector to Indonesia's GDP decreasing. The government is now preparing plans to restore and improve tourism in tourist destination areas, one of which is DKI Jakarta in order to increase visits by domestic and foreign tourists. In achieving these goals, this study propose to utilize reviews about tourist attractions in DKI Jakarta from Google Maps and extract public opinion by conducting aspect-based sentiment analysis. Multi-label classification is a common method that is often used in aspect-based sentiment analysis. However, the multi-label approach has limited flexibility in the aspects used. One alternative method that can be used is an adaptive aspect classification method which is more flexible if there are additional new aspects used. This research aims to automate sentiment classification of tourist reviews for each aspect by developing an aspect level sentiment analysis model with an adaptive aspect classification method which will be compared with multi-label classification as a baseline method. The models used in both methods are transfer learning IndoBERT. The adaptive aspect classification method with aspect level sentiment analysis has better performance in comparison to baseline method multi-label classification with accuracy values and F1-score respectively 0.90394 and 0.71504.

Full Text:

PDF

References


I. G. A. D. Hendriyani, “Siaran Pers: Menparekraf Paparkan Penyerapan Pagu Anggaran Tahun 2022 di Hadapan Komisi X DPR RI,” Kementerian Pariwisata dan Ekonomi Kreatif/Badan Pariwisata dan Ekonomi Kreatif. Accessed: Oct. 27, 2023. [Online]. Available: https://kemenparekraf.go.id/berita/siaran-pers-menparekraf-paparkan-penyerapan-pagu-anggaran-tahun-2022-di-hadapan-komisi-x-dpr-ri

BAPPEDA Jakarta, Rencana Pembangunan Jangka Menengah Daerah 2023-2026. BAPPEDA Jakarta, 2022.

D. Arianto and I. Budi, “Aspect-based Sentiment Analysis on Indonesia’s Tourism Destinations Based on Google Maps User Code-Mixed Reviews (Study Case: Borobudur and Prambanan Temples),” Proceedings of the 34th Pacific Asia Conference on Language, Information and Computation, vol. 2019, no. May 2021, 2020.

Munawir, M. D. Koerniawan, and B. J. Dewancker, “Visitor perceptions and effectiveness of place branding strategies in thematic parks in Bandung City using text mining based on google maps user reviews,” Sustainability (Switzerland), vol. 11, no. 7, 2019, doi: 10.3390/SU11072123.

M. Pontiki, D. Galanis, J. Pavlopoulos, H. Papageorgiou, I. Androutsopoulos, and S. Manandhar, “SemEval-2014 Task 4: Aspect Based Sentiment Analysis,” in 8th International Workshop on Semantic Evaluation, SemEval 2014 - co-located with the 25th International Conference on Computational Linguistics, COLING 2014, Proceedings, 2014. doi: 10.3115/v1/s14-2004.

S. Li and J. Ou, “Multi-Label Classification of Research Papers Using Multi-Label K-Nearest Neighbour Algorithm,” in Journal of Physics: Conference Series, 2021. doi: 10.1088/1742-6596/1994/1/012031.

L. Zhu, M. Xu, Y. Bao, Y. Xu, and X. Kong, “Deep learning for aspect-based sentiment analysis: a review,” PeerJ Comput Sci, vol. 8, 2022, doi: 10.7717/PEERJ-CS.1044.

I. L. Laily, I. Budi, A. B. Santoso, and P. K. Putra, “Mining Indonesia Tourism’s Reviews to Evaluate the Services through Multilabel Classification and LDA,” in Proceedings of the International Conference on Electrical Engineering and Informatics, 2020. doi: 10.1109/ICELTICs50595.2020.9315392.

M. Afzaal, M. Usman, A. C. M. Fong, and S. Fong, “Multiaspect-based opinion classification model for tourist reviews,” Expert Syst, vol. 36, no. 2, 2019, doi: 10.1111/exsy.12371.

N. Liu and J. Zhao, “A BERT-Based Aspect-Level Sentiment Analysis Algorithm for Cross-Domain Text,” Comput Intell Neurosci, vol. 2022, pp. 1–11, Jun. 2022, doi: 10.1155/2022/8726621.

J. Liu, Z. Teng, L. Cui, H. Liu, and Y. Zhang, “Solving Aspect Category Sentiment Analysis as a Text Generation Task,” in EMNLP 2021 - 2021 Conference on Empirical Methods in Natural Language Processing, Proceedings, 2021. doi: 10.18653/v1/2021.emnlp-main.361.

B. Wilie et al., “IndoNLU: Benchmark and resources for evaluating Indonesian natural language understanding,” arXiv preprint arXiv:2009.05387, 2020.

H. Jayadianti, W. Kaswidjanti, A. T. Utomo, S. Saifullah, F. A. Dwiyanto, and R. Drezewski, “Sentiment analysis of Indonesian reviews using fine-tuning IndoBERT and R-CNN,” ILKOM Jurnal Ilmiah, vol. 14, no. 3, pp. 348–354, Dec. 2022, doi: 10.33096/ilkom.v14i3.1505.348-354.

C. A. Bahri and L. H. Suadaa, “Aspect-Based Sentiment Analysis in Bromo Tengger Semeru National Park Indonesia Based on Google Maps User Reviews,” IJCCS (Indonesian Journal of Computing and Cybernetics Systems), vol. 17, no. 1, 2023, doi: 10.22146/ijccs.77354.

I. G. N. Suwena, I Ketut dan Widyatmaja, Pengetahuan Dasar Ilmu Pariwisata. Denpasar. 2017.

K. Krippendorff and R. Craggs, “The Reliability of Multi-Valued Coding of Data,” Commun Methods Meas, vol. 10, no. 4, pp. 181–198, Oct. 2016, doi: 10.1080/19312458.2016.1228863.

L. Liu and M. T. Ozsu, Encyclopedia of Database Systems. Boston, MA: Springer US, 2009. doi: 10.1007/978-0-387-39940-9.

D. Setiawan, N. Umar, and M. A. Nur, “Feature Extraction Optimization to Improve Naïve Bayes Accuracy in Sentiment Analysis of Bulukumba Tourism Objects,” Sistemasi: Jurnal Sistem Informasi, vol. 13, no. 5, pp. 2209–2221, 2024.

S. Prusty, S. Patnaik, and S. K. Dash, “SKCV: Stratified K-fold cross-validation on ML classifiers for predicting cervical cancer,” Frontiers in Nanotechnology, vol. 4, 2022, doi: 10.3389/fnano.2022.972421.

S. Pramana, B. Yuniarto, S. Mariyah, I. Santoso, and R. Nooraeni, Data mining dengan R konsep serta implementasi. 2018.




DOI: https://doi.org/10.32520/stmsi.v13i6.4585

Article Metrics

Abstract view : 289 times
PDF - 89 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.