Sentiment Analysis of User Perceptions Toward the Gemini Application using the Naïve Bayes Algorithm

Cynthia Hayat

Abstract


Sentiment analysis, a pivotal technique in Natural Language Processing (NLP), facilitates the classification of textual data into positive or negative sentiment categories. This study applies a Naïve Bayes classification model to analyse 1,000 user reviews of the Gemini application, an AI-powered assistant developed by Google AI, collected from the Google Play Store. The research adopts the Knowledge Discovery in Database (KDD) methodology, encompassing data selection, preprocessing, transformation, data mining, and evaluation stages. Reviews were pre-processed using text normalization techniques and transformed into numerical vectors using Term Frequency–Inverse Document Frequency (TF-IDF). The sentiment classifier achieved a high accuracy of 94.57%, with a precision of 95.7% and an F1-score of 96.7%, indicating effective classification performance. The results revealed a predominance of positive sentiment, with frequently occurring terms such as “assist,” “good,” and “application.” Conversely, negative sentiments were often associated with issues regarding language support and system limitations. These findings provide actionable insights into user satisfaction and areas for improvement in the Gemini application. While the Naïve Bayes algorithm proved efficient and interpretable, limitations include difficulty handling nuanced linguistic features such as sarcasm or ambiguity. Future research may enhance sentiment classification performance by incorporating larger datasets and advanced models such as BERT or deep neural networks. Overall, this study demonstrates the practical utility of machine learning-based sentiment analysis in guiding user-centric application development.

Keywords


gemini application; naïve bayes; sentiment analysis; text classification

Full Text:

PDF

References


W. Medhat, A. Hassan, and H. Korashy, “Sentiment Analysis Algorithms and Applications: A Survey,” Ain Shams Eng. J., Vol. 5, No. 4, 2014, DOI: 10.1016/j.asej.2014.04.011.

M. Wankhade, A. C. S. Rao, and C. Kulkarni, “A Survey on Sentiment Analysis Methods, Applications, and Challenges,” Artif. Intell. Rev., Vol. 55, No. 7, 2022, DOI: 10.1007/s10462-022-10144-1.

D. M. E. D. M. Hussein, “A Survey on Sentiment Analysis Challenges,” J. King Saud Univ. - Eng. Sci., Vol. 30, No. 4, 2018, DOI: 10.1016/j.jksues.2016.04.002.

C. Villavicencio, J. J. Macrohon, X. A. Inbaraj, J. H. Jeng, and J. G. Hsieh, “Twitter Sentiment Analysis Towards Covid-19 Vaccines in the Philippines using Naïve Bayes,” Inf., Vol. 12, No. 5, 2021, DOI: 10.3390/info12050204.

A. Ligthart, C. Catal, and B. Tekinerdogan, “Systematic Reviews in Sentiment Analysis: A Tertiary Study,” Artif. Intell. Rev., Vol. 54, No. 7, 2021, DOI: 10.1007/s10462-021-09973-3.

C. Burlăcioiu, C. Boboc, B. Mirea, and I. Dragne, “Text Mining in Business. A Study of Romanian Client’s Perception with Respect to using Telecommunication and Energy Apps,” Econ. Comput. Econ. Cybern. Stud. Res., Vol. 57, No. 1, 2023, DOI: 10.24818/18423264/57.1.23.14.

H. Uǧuz, “Detection of Carotid Artery Disease by using Learning Vector Quantization Neural Network,” J. Med. Syst., Vol. 36, No. 2, 2012, DOI: 10.1007/s10916-010-9498-8.

Z. Li, R. Li, and G. Jin, “Sentiment Analysis of Danmaku Videos based on Naïve Bayes and Sentiment Dictionary,” IEEE Access, Vol. 8, 2020, DOI: 10.1109/ACCESS.2020.2986582.

M. B. Ressan and R. F. Hassan, “Naïve-Bayes Family for Sentiment Analysis during COVID-19 Pandemic and Classification Tweets,” Indones. J. Electr. Eng. Comput. SCI., Vol. 28, No. 1, 2022, DOI: 10.11591/ijeecs.v28.i1.pp375-383.

N. Rane, S. Choudhary, and J. Rane, “Gemini Versus ChatGPT: Applications, Performance, Architecture, Capabilities, and Implementation,” SSRN Electron. J., 2024, DOI: 10.2139/ssrn.4723687.

D. Nurwahidah, G. Dwilestari, N. Dienwati Nuris, and R. Narasati, “Analisis Sentimen Data Ulasan Pengguna Aplikasi Google Kelas pada Google Play Store menggunakan Algoritma Naïve Bayes,” JATI (Jurnal Mhs. Tek. Inform., Vol. 7, No. 6, 2024, DOI: 10.36040/jati.v7i6.8245.

K. Kevin, M. Enjeli, and A. Wijaya, “Analisis Sentimen Pengunaaan Aplikasi Kinemaster menggunakan Metode Naive Bayes,” J. Ilm. Comput. SCI., Vol. 2, No. 2, 2024, DOI: 10.58602/jics.v2i2.24.

M. K. K. Insan, U. Hayati, and O. Nurdiawan, “Analisis Sentimen Aplikasi Brimo pada Ulasan Pengguna di Google Play menggunakan Algoritma Naive Bayes,” JATI (Jurnal Mhs. Tek. Inform., Vol. 7, No. 1, 2023, DOI: 10.36040/jati.v7i1.6373.

K. D. Indarwati and H. Februariyanti, “Analisis Sentimen Terhadap Kualitas Pelayanan Aplikasi Gojek menggunakan Metode Naive Bayes Classifier,” JATISI (Jurnal Tek. Inform. dan Sist. Informasi), Vol. 10, No. 1, 2023, DOI: 10.35957/jatisi.v10i1.2643.

A. P. Pimpalkar and R. J. Retna Raj, “Influence of Pre-Processing Strategies on the Performance of ML Classifiers Exploiting TF-IDF and BOW Features,” ADCAIJ Adv. Distrib. Comput. Artif. Intell. J., Vol. 9, No. 2, 2020, DOI: 10.14201/adcaij2020924968.

I. F. Rozi, E. N. Hamdana, M. Balya, and I. Alfahmi, “Pengembangan Aplikasi Analisis Sentimen Twitter ( Studi Kasus Samsat Kota Malang ),” Inform. Polinema, Vol. 1, No. 1, 2018.

S. Jiang, G. Pang, M. Wu, and L. Kuang, “An Improved K-Nearest-Neighbor Algorithm for Text Categorization,” Expert Syst. Appl., Vol. 39, No. 1, 2012, DOI: 10.1016/j.eswa.2011.08.040.

K. Nigam, A. K. Mccallum, S. Thrun, and T. Mitchell, “Text Classification from Labeled and Unlabeled Documents using EM,” Mach. Learn., Vol. 39, No. 2, 2000, DOI: 10.1023/a:1007692713085.

F. Ahmad, X. W. Tang, J. N. Qiu, P. Wróblewski, M. Ahmad, and I. Jamil, “Prediction of Slope Stability using Tree Augmented Naive-Bayes classifier: Modeling and Performance Evaluation,” Math. Biosci. Eng., Vol. 19, No. 5, 2022, DOI: 10.3934/mbe.2022209.

S. Głowania, J. Kozak, and P. Juszczuk, “Knowledge Discovery in Databases for a Football Match Result,” Electron., Vol. 12, No. 12, 2023, DOI: 10.3390/electronics12122712.

A. M. Abdulkadium, R. A. A. Shekan, and H. A. Hussain, “Application of Data Mining and Knowledge Discovery in Medical Databases,” Webology, Vol. 19, No. 1, 2022, DOI: 10.14704/web/v19i1/web19329.




DOI: https://doi.org/10.32520/stmsi.v15i7.5846

Article Metrics

Abstract view : 9 times
PDF - 2 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.