Comparison of k-Nearest Neighbor and Support Vector Machine using Binary Dragonfly Algorithm Optimization

Andi Nugroho; Muhammad Imam Khomeini; Rifan Heraldi

doi:10.32520/stmsi.v13i1.2953

Comparison of k-Nearest Neighbor and Support Vector Machine using Binary Dragonfly Algorithm Optimization

Andi Nugroho, Muhammad Imam Khomeini, Rifan Heraldi

Abstract

BDA is an adaptation of Dragonfly Algorithm (DA) that optimizes computation for single-objective, discrete, and multi-objective problems. Combining BDA optimization algorithm with KNN and SVM classification algorithms aims to improve the performance of the prediction model. This research compares and tests accuracy of KNN and SVM algorithms on the diabetes dataset used in research to find out the best algorithm in predicting diabetes. This research uses the BDA optimization algorithm to select the best features in the dataset, then the KNN and SVM classification algorithms, in classifying data, predicting, and comparing the accuracy of the accuracy of the two algorithms on the diabetes dataset. Medical record data from people with diabetes is processed using the KNN and SVM algorithms, which will then produce an accuracy level that can be used in predicting diabetes. Previous research has conducted a comparison between classification algorithms in predicting diabetes. In the previous research above, no one has combined BDA with classification algorithms, because BDA itself is a relatively new method and has not been widely studied, so researchers use this optimization algorithm. The results of the research conducted obtained the highest accuracy results in the BDA + KNN algorithm with a Precision value of 96.10%, Recall 79.36%, F-1 Score 86.93% and Accuracy 85.55%.

Full Text:

PDF

References

D. Sisodia and D. S. Sisodia, “Prediction of Diabetes using Classification Algorithms,” Procedia Comput. Sci., vol. 132, no. Iccids, pp. 1578–1585, 2018, doi: 10.1016/j.procs.2018.05.122.

J. J. Khanam and S. Y. Foo, “A comparison of machine learning algorithms for diabetes prediction,” ICT Express, vol. 7, no. 4, pp. 432–439, 2021, doi: 10.1016/j.icte.2021.02.004.

H. M. Deberneh and I. Kim, “Prediction of type 2 diabetes based on machine learning algorithm,” Int. J. Environ. Res. Public Health, vol. 18, no. 6, pp. 9–11, 2021, doi: 10.3390/ijerph18063317.

H. Kaur and V. Kumari, “Predictive modelling and analytics for diabetes using a machine learning approach,” Appl. Comput. Informatics, vol. 18, no. 1–2, pp. 90–100, 2022, doi: 10.1016/j.aci.2018.12.004.

R. Rafique, S. M. R. Islam, and J. U. Kazi, “Machine learning in the prediction of cancer therapy,” Comput. Struct. Biotechnol. J., vol. 19, pp. 4003–4017, 2021, doi: 10.1016/j.csbj.2021.07.003.

A. C. Lyngdoh, N. A. Choudhury, and S. Moulik, “Diabetes Disease Prediction Using Machine Learning Algorithms,” Proc. - 2020 IEEE EMBS Conf. Biomed. Eng. Sci. IECBES 2020, pp. 517–521, 2021, doi: 10.1109/IECBES48179.2021.9398759.

http://sistemasi.ftik.unisi.ac.id

Sistemasi: Jurnal Sistem Informasi ISSN:2302-8149 Volume ?, Nomor ?,bulan ?: halaman ? diisi editor e-ISSN:2540-9719

M. E. Febrian, F. X. Ferdinan, G. P. Sendani, K. M. Suryanigrum, and R. Yunanda, “Diabetes prediction using supervised machine learning,” Procedia Comput. Sci., vol. 216, no. 2022, pp. 21–30, 2023, doi: 10.1016/j.procs.2022.12.107.

A. Salam, Sri Suryani Prasetiyowati, and Yuliant Sibaroni, “Prediction Vulnerability Level of Dengue Fever Using KNN and Random Forest,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 4, no. 3, pp. 531–536, 2020, doi: 10.29207/resti.v4i3.1926.

M. T. Viega, “Heart Disease Prediction System using Data Mining Classification Techniques: Naïve Bayes, KNN, and Decision Tree,” Int. J. Adv. Trends Comput. Sci. Eng., vol. 9, no. 3, pp. 3028–3035, 2020, doi: 10.30534/ijatcse/2020/82932020.

A. G. M. Sari, A. M. Putri, Z. Rustam, and J. Pandelaki, “Preprocessing Unbalanced Data using Support Vector Machine with Method K-Nearest Neighbors for Cerebral Infarction Classification,” J. Phys. Conf. Ser., vol. 1752, no. 1, 2021, doi: 10.1088/1742- 6596/1752/1/012037.

K. Devendran, S. K. Thangarasu, P. Keerthika, R. Manjula Devi, and B. K. Ponnarasee, “Effective prediction on music therapy using hybrid SVM-ANN approach,” ITM Web Conf., vol. 37, p. 01014, 2021, doi: 10.1051/itmconf/20213701014.

L. Abuomar and K. Al-Aubidy, “Cooperative search and rescue with swarm of robots using binary dragonfly algoritlnn,” 2018 15th Int. Multi-Conference Syst. Signals Devices, SSD 2018, pp. 653–659, 2018, doi: 10.1109/SSD.2018.8570410.

J. Too and S. Mirjalili, “A Hyper Learning Binary Dragonfly Algorithm for Feature Selection: A COVID-19 Case Study,” Knowledge-Based Syst., vol. 212, p. 106553, 2021, doi: 10.1016/j.knosys.2020.106553.

A. Jakka and J. Vakula Rani, “Performance evaluation of machine learning models for diabetes prediction,” Int. J. Innov. Technol. Explor. Eng., vol. 8, no. 11, pp. 1976–1980, 2019, doi: 10.35940/ijitee.K2155.0981119.

R. S. Raj, D. S. Sanjay, M. Kusuma, and S. Sampath, “Comparison of Support Vector Machine and Naïve Bayes Classifiers for Predicting Diabetes,” 1st Int. Conf. Adv. Technol. Intell. Control. Environ. Comput. Commun. Eng. ICATIECE 2019, pp. 41–45, 2019, doi: 10.1109/ICATIECE45860.2019.9063792.

R. Katarya and S. Jain, “Comparison of different machine learning models for diabetes detection,” Proc. 2020 IEEE Int. Conf. Adv. Dev. Electr. Electron. Eng. ICADEE 2020, no. Icadee, pp. 0–4, 2020, doi: 10.1109/ICADEE51157.2020.9368899.

A. Nugroho, H. L. H. S. Warnars, S. M. Isa, and W. Budiharto, “Comparison of Binary Particle Swarm Optimization And Binary Dragonfly Algorithm for Choosing the Feature Selection,” Proc. - Int. Conf. Informatics Comput. Sci., vol. 2021-Novem, no. October 2022, pp. 24–28, 2021, doi: 10.1109/ICICoS53627.2021.9651779.

C. D. Patel, P. Bhayani, and B. Wankawala, “Multi-objective optimal PMU placement using binary dragonfly algorithm,” Proc. 2021 1st Int. Conf. Adv. Electr. Comput. Commun. Sustain. Technol. ICAECT 2021, 2021, doi: 10.1109/ICAECT49130.2021.9392420.

S. Behera, N. B. Dev Choudhury, D. Tripathy, R. Panda, and S. K. Bhagat, “Performance Improvement for Optimum Positioning of PMUs using Binary Dragonfly Algorithm and Loss Minimization of Transmission Network,” Proc. 2020 Int. Conf. Renew. Energy Integr. into Smart Grids A Multidiscip. Approach to Technol. Model. Simulation, ICREISG 2020, pp. 254– 257, 2020, doi: 10.1109/ICREISG49226.2020.9174442.

H. Chantar, M. Tubishat, M. Essgaer, and S. Mirjalili, “Hybrid Binary Dragonfly Algorithm with Simulated Annealing for Feature Selection,” SN Comput. Sci., vol. 2, no. 4, pp. 1–11, 2021, doi: 10.1007/s42979-021-00687-5.

Y. Zhang, Y. Huang, H. Chen, X. Na, Z. Chen, and Y. Liu, “Driving behavior oriented torque demand regulation for electric vehicles with single pedal driving,” Energy, vol. 228, p. 120568, 2021, doi: 10.1016/j.energy.2021.120568.

S. Karan, E. N. Meese, Y. Yang, H. G. Yeh, C. G. Lowe, and W. Zhang, “Classification of Shark Behaviors using K-Nearest Neighbors,” 2019 IEEE Green Energy Smart Syst. Conf. IGESSC 2019, pp. 1–6, 2019, doi: 10.1109/IGESSC47875.2019.9042395.

R. Puspadini, H. Mawengkang, and S. Efendi, “Feature Selection on K-Nearest Neighbor Algorithm Using Similarity Measure,” Mecn. 2020 - Int. Conf. Mech. Electron. Comput. Ind. http://sistemasi.ftik.unisi.ac.id

Sistemasi: Jurnal Sistem Informasi ISSN:2302-8149 Volume ?, Nomor ?,bulan ?: halaman ? diisi editor e-ISSN:2540-9719

Technol., pp. 226–231, 2020, doi: 10.1109/MECnIT48290.2020.9166612.

B. Priambodo et al., “Predicting GDP of Indonesia Using K-Nearest Neighbour Regression,”

J. Phys. Conf. Ser., vol. 1339, no. 1, 2019, doi: 10.1088/1742-6596/1339/1/012040.

Vibha and A. P. Singh, “Analysis of Variants of KNN Algorithm based on Preprocessing Techniques,” Proc. - IEEE 2018 Int. Conf. Adv. Comput. Commun. Control Networking,

ICACCCN 2018, pp. 186–191, 2018, doi: 10.1109/ICACCCN.2018.8748429.

D. A. Ragab, M. Sharkas, S. Marshall, and J. Ren, “Breast cancer detection using deep convolutional neural networks and support vector machines,” PeerJ, vol. 2019, no. 1, pp. 1–

, 2019, doi: 10.7717/peerj.6201.

C. Aroef, Y. Rivan, and Z. Rustam, “Comparing random forest and support vector machines

for breast cancer classification,” Telkomnika (Telecommunication Comput. Electron. Control.,

vol. 18, no. 2, pp. 815–821, 2020, doi: 10.12928/TELKOMNIKA.V18I2.14785.

D. Tanouz, R. R. Subramanian, D. Eswar, G. V. P. Reddy, A. R. Kumar, and C. H. V. N. M. Praneeth, “Credit card fraud detection using machine learning,” Proc. - 5th Int. Conf. Intell. Comput. Control Syst. ICICCS 2021, no. Iciccs, pp. 967–972, 2021, doi:

1109/ICICCS51141.2021.9432308.

C. S. Eke, E. Jammeh, X. Li, C. Carroll, S. Pearson, and E. Ifeachor, “Early Detection of

Alzheimer’s Disease with Blood Plasma Proteins Using Support Vector Machines,” IEEE J.

Biomed. Heal. Informatics, vol. 25, no. 1, pp. 218–226, 2021, doi: 10.1109/JBHI.2020.2984355.

R. Arian, A. Hariri, A. Mehridehnavi, A. Fassihi, and F. Ghasemi, “Protein kinase inhibitors’ classification using K-Nearest neighbor algorithm,” Comput. Biol. Chem., vol. 86, no. March, p. 107269, 2020, doi: 10.1016/j.compbiolchem.2020.107269.

S. Ravikumar and P. Saraf, “Prediction of stock prices using machine learning (regression, classification) Algorithms,” 2020 Int. Conf. Emerg. Technol. INCET 2020, pp. 1–5, 2020, doi: 10.1109/INCET49848.2020.9154061.

Z. Faraji, “A Review of Machine Learning Applications for Credit Card Fraud Detection with A Case study,” SEISENSE J. Manag., vol. 5, no. 1, pp. 49–59, 2022, doi: 10.33215/sjom.v5i1.770.

DOI: https://doi.org/10.32520/stmsi.v13i1.2953

Article Metrics

Abstract view : 107 times
PDF - 32 times

Refbacks

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Username
Password
Remember me