Comparison of the Performance of the VADER and RoBERTa Algorithms on Twitter

Dita Nurmadewi; Zakul Fahmi Jailani; Ni Kadek Sri Manik

doi:10.32520/stmsi.v13i4.4198

Comparison of the Performance of the VADER and RoBERTa Algorithms on Twitter

Dita Nurmadewi, Zakul Fahmi Jailani, Ni Kadek Sri Manik

Abstract

This research compares the performance of two sentiment analysis algorithms, namely VADER (Valence Aware Dictionary and Entiment Reasoner) and RoBERTa (Robustly Optimized BERT Pretraining Approach), using a dataset of public opinions regarding climate change on twitter. Analysis is carried out to determine the sentiment distribution of the tweets described, whether they are positive, negative or neutral. In addition, this research identifies the keywords that appear most frequently from the collection of tweets that have been analyzed. Time series analysis was also carried out to see the distribution of sentiment over 12 months. The relationship between the two models was evaluated using matrix scatter plot analysis for tweets per two months, to assess the correlation and consistency of sentiment results between VADER and RoBERTa. The results show that VADER is more effective in situations that require rapid responses to changes in public sentiment, while RoBERTa is superior in in-depth analysis of more complex and ambiguous content.

Full Text:

PDF

References

A. Susilo dan A. Wahab, “Penerapan Metode Clustering Dalam Pengelompokkan Data Curah Hujan Dengan Algoritma K-Means,” Jurnal Teknologi Pelita Bangsa, vol. 14, no. 4, pp. 212-215, 2023.

K. Setiawan dan F. Ramdhani, “Application of Data Mining for Customer Prediction at PT. XYZUsingLinear Regression Algorithm,” Indonesian Journal ofMachine Learningand Computer Science, vol. 4, no. 2, pp. 490-497, 2024.

N. M. Zawad, “Application of Data Mining in Healthcare of Bangladesh,” International Journal of Information System and Computer Science, vol. 7, no. 2, pp. 89-103, 2023.

Sumiyatun, Y. Cahyadi dan E. Iskandar, “Data Mining Untuk Memprediksi Status Kelulusan Mahasiswa,” Jurnal Teknologi dan Ilmu Komputer, vol. 21, no. 3, pp. 11-19, 2023.

I. K. J. Arta, G. Indrawan dan G. R. Dantes, “Data Mining Rekomendasi Calon Mahasiswa Berprestasi di STMIK Denpasar Menggunakan Metode Technique for Others Reference by Similarity to Ideal Solution,” Jurnal Ilmu Komputer Indonesia, vol. 4, no. 1, pp. 11-21, 2019.

Z. Aziz dan R. Bestak, “Insight into Anomaly Detection and Prediction and Mobile Network Security Enhancement Leveraging K-Means Clustering on Call Detail Records,” Sensors, vol. 24, no. 6, pp. 1-18, 2024.

R. Hakiki, A. Pambudi dan Asriyanik, “Classification of Public Sentiment Toward 2024 Presidential Candidates on Social Media Platform X Using Naïve Bayes Algorithm,” Journal of Artificial Intelligence and Engineering Applications, vol. 3, no. 2, pp. 551-556, 2024.

L. A. Akbar, E. Haerani, F. Syafria, A. Nazir dan E. Budianita, “Klasifikasi Sentimen Presepsi Masyarakat di Instagram Terhadap Paslon Pilpres 2024 Menggunakan Naïve Bayes Classifier (NBC),” Jurnal Komputasi dan Informatika, vol. 8, no. 1, pp. 102-112, 2024.

K. Barik dan S. Misra, “Analysis of customer reviews with an improved VADER lexicon classifier,” Journal of Big Data, vol. 11, no. 10, pp. 1-29, 2024.

Y. Wiciaputra, J. Young dan A. Rusli, “Bilingual Text Classification in English and Indonesian via Transfer Learning using XLM-RoBERTa,” International Journal of Advances in Soft Computing and its Applications, vol. 13, no. 3, pp. 73-87, 2021.

H. Dmour, R. Masa'deh, A. Salman dan M. Y. Abubhashesh, “Influence of Social Media Platforms on Public Health Protection Against the COVID-19 Pandemic via the Mediating Effects of Public Health Awareness and Behavioral Changes: Integrated Model,” Journal of Medical Internet Research, vol. 22, no. 8, pp. 1-15, 2020.

F. Solihin, S. Awaliyah dan A. M. A. Shofa, “Pemanfaatan Twitter Sebagai Media Penyebaran Informasi Oleh Dinas Komunikasi dan Informatika,” Jurnal Pendidikan Ilmu Pengetahuan Sosial, vol. 13, no. 1, pp. 52-58, 2021.

D. Nurmadewi, S. Yuniati, M. Amaliah, H. Hanifah, U. B. Purwanti, M. S. Arum dan N. W. Kusuma, “Sentiment Analysis of Jokowi’s Candidate Discourse in Three Periods using the Naïve Bayes Method,” Jurnal Sistem Informasi, vol. 12, no. 11, pp. 166-177, 2023.

D. Nurmadewi, C. P. Gusti, E. C. Hernanto, F. Ananda, M. A. Hutagalung dan N. Hikmah, “Analisis Sentimen untuk Melihat Respon Masyarakat Terhadap Vaksin Pfizer,” Journal of Technology and Informatics , vol. 4, no. 2, pp. 77-80, 2023.

L. Mutawalli, M. T. A. Zaen dan W. Bogye, “Klasifikasi Teks Sosial Media Twitter menggunakan Support Vector Machine (Studi Kasus Penusukan Wiranto),” Jurnal Informatika dan Rekayasa Elektronika, vol. 2, no. 2, pp. 43-51, 2019.

P. Bintoro, T. H. Andika, A. F. Yulia dan P. Widiandana, “Sentiment Analysis on Twitter Using Machine Learning Approach,” International Journal of Software Engineering and Informatics, vol. 1, no. 1, pp. 33-39, 2023.

Juleha, J. Yuniar dan N. R. Marsuki, “Peran Media Sosial Dalam Dinamika Opini Publik dan Partisipasi Politik Era Digital,” Journal of Social Humanities and Education, vol. 3, no. 1, pp. 38-45, 2024.

F. Z. Abraham, F. Solihin, S. Awaliyah dan A. M. A. Shofa, “Pemanfaatan Twitter Sebagai Media Penyebaran Informasi Oleh Dinas Komunikasi dan Informatika,” Jurnal Pendidikan Ilmu Pengetahuan Sosial, vol. 13, no. 1, pp. 52-58, 2021.

F. Illia, M. P. Eugenia dan S. A. Rutba, “Sentiment Analysis on PeduliLindungi Application Using TextBlob and VADER Library,” dalam The 1st International Conference on Data Science and Official Statistics, Jakarta, 2021.

V. Nurcahyawati dan Z. Mustaffa, “Vader Lexicon and Support Vector Machine Algorithm to Detect Customer Sentiment Orientation,” Journal of Information Systems Engineering and Business Intelligence, vol. 9, no. 1, pp. 109-119, 2023.

V. Nurcahyawati dan Z. Mustaffa, “Vader Lexicon and Support Vector Machine Algorithm to Detect Customer Sentiment Orientation,” Journal ofInformation Systems Engineeringand Business Intelligence, vol. 9, no. 1, pp. 109-119, 2023.

A. N. Sutranggono, R. Sarno dan I. Ghozali, “Multi-Class Multi-Level Classification of Mental Health Disorders Based on Textual Data from Social Media,” Journal of Information and Communication Technology, vol. 23, no. 1, pp. 77-104, 2024.

A. Jaya, “Analisis Sentimen pandangan public terhadap profesi PNS (Pegawai Negeri Sipil) dari Twiter menerapkan Indonesian Roberta Base Sentiment Classifier,” Indonesian Journal of Data and Science, vol. 4, no. 1, pp. 38-44, 2023.

H. Tohari, Analisis Serta Perancangan Sistem Informasi Melalui Pendekatan UML, Yogyakarta: Penerbit Andi, 2014.

Kusrini dan A. Kristanto, Tuntunan Praktis Membangun Sistem Informasi Akuntansi dengan Visual Basic dan SQL Server, Yogyakarta: Penerbit Andi, 2009.

A. Kadir, Pengenalan Sistem Informasi Edisi Revisi, Yogyakarta: Penerbit Andi, 2013.

F. Ilmiajayanti dan D. I. K. Dewi, “Persepsi Pengguna Taman Tematik Kota Bandung Terhadap Aksesibilitas Dan Pemanfaatannya,” RUANG, Volume 1, Nomor 1, 2015 ISSN: 2356-0088, p. 23, 2015.

A. B. M. Alkatiri, Z. Nadiah dan A. N. S. Nasution, “Opini Publik Terhadap Penerapan New Normal di Media Sosial Twitter.,” Journal of Strategic Communication, vol. 11, no. 1, pp. 199-26, 2020.

A. A. Septiadi dan M. M. Yasa, “Kekuatan Mengikat Paris Agreement Kepada Negara-Negara Anggotanya,” Jurnal Kertha Desa, vol. 9, no. 8, pp. 13-21, 2021.

N. Puspita dan A. Hervino, “Implementasi Ratifikasi Paris Agreement oleh Indonesia dan Pengaruhnya Terhadap Kebijakan Perekonomian Indonesia.,” Jurnal Komunikasi Hukum, vol. 9, no. 1, pp. 704-728, 2023.

S. Manandhar, W. Pratoomchai, K. Ono, S. Kazama dan d. D. Komori, “Local people’s perceptions of climate change and related hazards in mountainous areas of northern Thailand,” 2018.

D. Nurhayati, Y. Dhokhikahb dan M. Mandala, “Persepsi dan Strategi Adaptasi Masyarakat Terhadap Perubahan Iklim di Kawasan Asia Tenggara.,” Jurnal Proteksi: Jurnal Lingkungan Berkelanjutan, vol. 1, no. 1, 2020.

L. Malihah, “Tantangan dalam Upaya Mengatasi Dampak Perubahan Iklim dan Mendukung Pembangunan Ekonomi Berkelanjutan: sebuah tinjauan.,” Jurnal Kebijakan Pembangunan, vol. 17, no. 2, pp. 219-232, 2022.

D. Nurhayati, Y. Dhokhikahb dan M. Mandala., “Persepsi dan Strategi Adaptasi Masyarakat Terhadap Perubahan Iklim di Kawasan Asia Tenggara,” Jurnal Proteksi: Jurnal Lingkungan Berkelanjutan, vol. 1, no. 1, 2020.

Bappenas, “Kaji Ulang Rencana Aksi Nasional Adaptasi Perubahan Iklim (RAN API),” Kajian Basis Ilmiah Bahaya Perubahan Iklim., 2018.

IRID, “Public Opinion and Twentieth-Century Diplomacy: A Global Perspective,” London: Bloomsbury Academic, 2022.

L. Malihah, “Tantangan dalam Upaya Mengatasi Dampak Perubahan Iklim dan Mendukung Pembangunan Ekonomi Berkelanjutan: sebuah tinjauan,” Jurnal Kebijakan Pembangunan , vol. 17, no. 2, pp. 219-232, 2022.

Nurbaya, Siti dan et.al., “Trilogi Indonesia Menghadapi Perubahan Iklim: Urgensi, Politik Dan Tata Kelola Perubahan Iklim.,” Jakarta : PT. Kompas Media Nusantara., 2019.

H. Tsaqib dan et.al., “Studi Komparatif Tingkat Pengetahuan Perubahan Iklim pada Mahasiswa Rumpun Sosial-Humaniora dan Rumpun Sains-Teknologi di Universitas Indonesia.,” Jurnal KSM Eka Prasetya UI, vol. 2, no. 2, 2020.

M. Taddicken, A. Reif dan I. Hoppe, “What do people know about climate change - and how confident are they? On measurements and analyses of science related knowledge.,” Journal of Science Communication, vol. 17, no. 3, pp. 1-26, 2018.

I. Syahputra, “Opini Publik,” (Bandung : Simbiosa Rekatama Media), 2018.

D. Hucker, “Public Opinion and Twentieth-Century Diplomacy: A Global Perspective.,” London: Bloomsbury Academic, 2020.

A. B. M. Alkatiri, Z. Nadiah dan A. N. S. Nasution, “Opini Publik Terhadap Penerapan New Normal di Media Sosial Twitter.,” Journal of Strategic Communication, vol. 11, no. 1, pp. 199-26, 2020.

F. Sultan dan S. Purwanti, “Pembentukan opini publik pada akun twitter pribadi novel baswedan,” eJournal Ilmu Komunikasi, vol. 10, no. 4, pp. 155-164, 2022.

DOI: https://doi.org/10.32520/stmsi.v13i4.4198

Article Metrics

Abstract view : 155 times
PDF - 59 times

Refbacks

There are currently no refbacks.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Username
Password
Remember me