Optimized Weight Evolutionary-based Support Vector Machine (SVM) Optimization for Comment Sentiment

Mulyana Mulyana, Wahyu Utomo

Abstract


Comments in questionnaire feedback carry sentiment meanings, such as positive, negative, or neutral. Each review comment on training services requires prompt and accurate follow-up to improve service quality. However, sentiment classification often demands significant time and effort to determine sentiments accurately. This study aims to enhance efficiency and accuracy in sentiment classification for training questionnaires. A comparative analysis was conducted using three algorithms: Naïve Bayes, K-Nearest Neighbors (KNN), and Support Vector Machine (SVM). The results indicate that SVM is the fastest and most accurate algorithm, with a training time of 3.067 seconds, 100 milliseconds faster than Naïve Bayes and 45.8 seconds faster than KNN. SVM achieved an accuracy of 60.81%, with an average sensitivity of 61%, specificity of 80%, and precision of 63%. Subsequently, this study integrated the Optimized Weight Evolutionary method to enhance SVM's accuracy and address attribute selection. Testing results showed a 2.16% improvement in SVM accuracy, bringing it to 63.10%. The training process was conducted on a dataset of 1,153 comments, with 90% of the data used for algorithm training. The combination of SVM and Optimized Weight Evolutionary proved effective in achieving more accurate sentiment classification. This study provides new insights into the application of sentiment classification, particularly for training feedback. Optimizing the algorithm can help training companies respond more effectively to comments and improve overall service quality.

Keywords


text classification, sentiment analysis, Support Vector Machine, feature selection, SVM

Full Text:

PDF

References


D. Henderson, S. Earley, and L. Sebastian-Coleman, Eds., DAMA DMBOK: Data Management Body of Knowledge. New Jersey: Technics Publications, 2017.

V. Kotu, Predictive Analytics and Data Mining. 2015. [Online]. Available: http://library1.nida.ac.th/termpaper6/sd/2554/19755.pdf

S. N. Fadhilah and F. S. Utomo, “Algoritma Naïve Bayes untuk Analisis Sentiment Review Blibli.com di Google Play Store,” SISTEMASI: Jurnal Sistem Informasi, vol. 13, no. 2, pp. 834–4, Mar. 2024, [Online]. Available: http://sistemasi.ftik.unisi.ac.id

K. Okoye, S. D. N. Daruich, J. F. E. De La O, R. Castano, J. Escamilla, and S. Hosseini, “A Text Mining and Statistical Approach for Assessment of Pedagogical Impact of Students’ Evaluation of Teaching and Learning Outcome in Education,” IEEE Access, vol. 11, pp. 9577–9596, 2023, doi: 10.1109/ACCESS.2023.3239779.

D. Tao, P. Yang, and H. Feng, “Utilization of Text Mining as a Big Data Analysis Tool for Food Science and Nutrition,” Mar. 01, 2020, Blackwell Publishing Inc. doi: 10.1111/1541-4337.12540.

B. Agarwal and N. Mittal, “Text Classification using Machine Learning Methods,” in Advances in Intelligent Systems and Computing, Springer Verlag, 2014, pp. 701–709. doi: 10.1007/978-81-322-1602-5_75.

Y. Chen and Z. Yuling, “Research on Text Sentiment Analysis Based on CNNs and SVM,” 2018.

C. Wan, Y. Wang, Y. Liu, J. Ji, and G. Feng, “Composite Feature Extraction and Selection for Text Classification,” IEEE Access, vol. 7, pp. 35208–35219, 2019, doi: 10.1109/ACCESS.2019.2904602.

K. Korovkinas, P. Danenas, and G. Garšva, “SVM and K-Means Hybrid Method for Textual Data Sentiment Analysis,” Baltic Journal of Modern Computing, vol. 7, no. 1, pp. 47–60, 2019, doi: 10.22364/bjmc.2019.7.1.04.

S. Kumar, A. K. Kar, and P. V. Ilavarasan, “Applications of Text Mining in Services Management: A Systematic Literature Review,” Apr. 01, 2021, Elsevier Ltd. doi: 10.1016/j.jjimei.2021.100008.

R. E. Krider and D. S. Putler, Customer and Business Analytics. Chapman and Hall/CRC, 2012.

B. Liu, Sentiment Analysis Mining Opinions, Sentiments, and Emotions, Second Edition. Cambridge: University Printing House, 2020.

C. D. Manning, P. Raghavan, and H. Schütze, An Introduction to Information Retrieval. Cambridge University Press, 2009.

R. Feldman and J. Sanger, The Text Mining Handbook : Advanced Approaches in Analyzing Unstructured Data. Cambridge University Press, 2007.

C. C. Aggarwal, Data Mining The Text Book. Cham: Springer International Publishing, 2015. doi: 10.1007/978-3-319-14142-8.

M. Jordan, J. Kleinberg, and B. Schölkopf, Pattern Recognition and Machine Learning. Springer, 2006.

Nuryadi, T. D. Astuti, E. S. Utami, and M. Budiantara, Dasar-dasar Statistik Penelitian. Yogyakarta: Sibuku Media, 2017. [Online]. Available: www.sibuku.com

H. Haibo and M. Yunqian, Eds., Imbalanced Learning, Foundations, Algorithms, and Applications. Hoboken: John Wiley & Sons, 2013.




DOI: https://doi.org/10.32520/stmsi.v14i1.4762

Article Metrics

Abstract view : 29 times
PDF - 16 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.