Sentiment Analysis of Banking Application Reviews on Google Play Store using Support Vector Machine Algorithm

Martinus Juan Prasetyo, I Made Artha Agastya

Abstract


Banking applications are increasingly important in facilitating daily financial transactions. However, to ensure service quality, developers need to understand user feedback. Reviews on the Google Play Store provide important insights related to satisfaction, complaints, and suggestions. Therefore, this study aims to develop the Sentiment Analysis Model for Banking Application Reviews Using Support Vector Machine (SVM). Data collected from three popular banks in Indonesia is used to train and test models. This research also contributes to providing multi -bank dataset which can be a benchmark. Various scenarios of the distribution of training and test data are explored, and repeated tests are carried out with different random state values to get stable results. The results showed that the SVM model was able to achieve good accuracy, with BRI Mobile dataset reaching the highest accuracy of 92.97%, followed by a combined dataset of 90.05%, BCA Mobile 89.73%, and Livin Mandiri 87.46%. Negative reviews are dominated by technical complaints, while positive reviews highlight the ease and reliability of the application. This study shows that the approach used has succeeded in producing competitive performance, and application developers are advised to focus on improving technical aspects, such as fixing login, verification, and transaction problems, in order to increase user satisfaction.

Full Text:

PDF

References


H. A. Alnemer, “Determinants of digital banking adoption in the Kingdom of Saudi Arabia: A technology acceptance model approach,” Digital Business, vol. 2, no. 2, Jan. 2022, doi: 10.1016/j.digbus.2022.100037.

F. Mi Alnaser, S. Rahi, M. Alghizzawi, and A. H. Ngah, “Does artificial intelligence (AI) boost digital banking user satisfaction? Integration of expectation confirmation model and antecedents of artificial intelligence enabled digital banking,” Heliyon, vol. 9, no. 8, Aug. 2023, doi: 10.1016/j.heliyon.2023.e18930.

S. J and K. U, “Sentiment analysis of amazon user reviews using a hybrid approach,” Measurement: Sensors, vol. 27, Jun. 2023, doi: 10.1016/j.measen.2023.100790.

A. A. Ilham, A. Bustamin, and E. Wahyudiarto, “Customer Satisfaction Assessment System on Transactions E-commerce Product Purchases Using Sentiment Analysis,” International Journal on Advanced Science Engineering Information Technology, vol. 13, no. 3, 2023.

O. Alsemaree, A. S. Alam, S. S. Gill, and S. Uhlig, “Sentiment analysis of Arabic social media texts: A machine learning approach to deciphering customer perceptions,” Heliyon, vol. 10, no. 9, May 2024, doi: 10.1016/j.heliyon.2024.e27863.

J. S. Pimentel, R. Ospina, and A. Ara, “A novel fusion Support Vector Machine integrating weak and sphere models for classification challenges with massive data,” Decision Analytics Journal, vol. 11, Jun. 2024, doi: 10.1016/j.dajour.2024.100457.

A. Wahyu Nugroho and N. Norhikmah, “Sentiment Analysis using the Support Vector Machine Algorithm on Covid_19,” SISTEMASI: Jurnal Sistem Informasi, vol. 13, no. 4, pp. 1758–1772, 2024, doi: https://doi.org/10.32520/stmsi.v13i4.3778.

Z. A. Diekson, M. R. B. Prakoso, M. S. Q. Putra, M. S. A. F. Syaputra, S. Achmad, and R. Sutoyo, “Sentiment analysis for customer review: Case study of Traveloka,” in Procedia Computer Science, Elsevier B.V., 2022, pp. 682–690. doi: 10.1016/j.procs.2022.12.184.

N. Leelawat et al., “Twitter data sentiment analysis of tourism in Thailand during the COVID-19 pandemic using machine learning,” Heliyon, vol. 8, no. 10, Oct. 2022, doi: 10.1016/j.heliyon.2022.e10894.

A. Perera and P. Fernando, “Cyberbullying Detection System on Social Media Using Supervised Machine Learning,” Procedia Comput Sci, vol. 239, pp. 506–516, 2024, doi: 10.1016/j.procs.2024.06.200.

L. Gunawan, M. S. Anggreainy, L. Wihan, Santy, G. Y. Lesmana, and S. Yusuf, “Support vector machine based emotional analysis of restaurant reviews,” in Procedia Computer Science, Elsevier B.V., 2022, pp. 479–484. doi: 10.1016/j.procs.2022.12.160.

H. Cam, A. V. Cam, U. Demirel, and S. Ahmed, “Sentiment analysis of financial Twitter posts on Twitter with the machine learning classifiers,” Heliyon, vol. 10, no. 1, Jan. 2024, doi: 10.1016/j.heliyon.2023.e23784.

M. Demircan, A. Seller, F. Abut, and M. F. Akay, “Developing Turkish sentiment analysis models using machine learning and e-commerce data,” International Journal of Cognitive Computing in Engineering, vol. 2, pp. 202–207, Jun. 2021, doi: 10.1016/j.ijcce.2021.11.003.

A. A. Syed, F. L. Gaol, A. Boediman, and W. Budiharto, “Airline reviews processing: Abstractive summarization and rating-based sentiment classification using deep transfer learning,” International Journal of Information Management Data Insights, vol. 4, no. 2, p. 100238, Nov. 2024, doi: 10.1016/j.jjimei.2024.100238.

D. Chicco, L. Oneto, and E. Tavazzi, “Eleven quick tips for data cleaning and feature engineering,” PLoS Comput Biol, vol. 18, no. 12, Dec. 2022, doi: 10.1371/journal.pcbi.1010718.

H. Mustafidah, S. Suwarsito, and T. Pinandita, “Natural Language Processing for Mapping Exam Questions to the Cognitive Process Dimension,” International Journal of Emerging Technologies in Learning, vol. 17, no. 13, pp. 4–16, 2022, doi: 10.3991/ijet.v17i13.29095.

S. Choo and W. Kim, “A study on the evaluation of tokenizer performance in natural language processing,” Applied Artificial Intelligence, vol. 37, no. 1, 2023, doi: 10.1080/08839514.2023.2175112.

T. H. J. Hidayat, Y. Ruldeviyani, A. R. Aditama, G. R. Madya, A. W. Nugraha, and M. W. Adisaputra, “Sentiment analysis of twitter data related to Rinca Island development using Doc2Vec and SVM and logistic regression as classifier,” in Procedia Computer Science, Elsevier B.V., 2021, pp. 660–667. doi: 10.1016/j.procs.2021.12.187.

W. N. Ibrahem Al-Obaydy, H. A. Hashim, Y. AbdulKhaleq Najm, and A. A. Jalal, “Document classification using term frequency-inverse document frequency and K-means clustering,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 27, no. 3, pp. 1517–1524, Sep. 2022, doi: 10.11591/ijeecs.v27.i3.pp1517-1524.

D. Valero-Carreras, J. Alcaraz, and M. Landete, “Comparing two SVM models through different metrics based on the confusion matrix,” Comput Oper Res, vol. 152, Apr. 2023, doi: 10.1016/j.cor.2022.106131.

H. Yun, “Prediction model of algal blooms using logistic regression and confusion matrix,” International Journal of Electrical and Computer Engineering, vol. 11, no. 3, pp. 2407–2413, Jun. 2021, doi: 10.11591/ijece.v11i3.pp2407-2413.




DOI: https://doi.org/10.32520/stmsi.v13i6.4536

Article Metrics

Abstract view : 42 times
PDF - 36 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.