Comparison of Decision Trees, Naïve Bayes and Random Forest in Detecting Heart Disease

Erni Erni, Rabiatus Sa'adah

Abstract


The leading cause of human death is heart disease (HD) worldwide which generally occurs when the heart is unable to push enough fresh, oxidized blood to the rest of the body. This disease makes it more difficult for the heart muscle to pump blood efficiently and causes chest pain, chest pressure, shortness of breath, pain in the neck and jaw. The aim of this research is to compare and obtain the best accuracy results from the three methods used, namely Random Forest, Extra Trees Classifier and Naïve Bayes. The results of this research prove that the Extra Trees Classifier method with an accuracy of 86.93% has higher results compared to the Naïve Bayes method with an accuracy of 84.21%, and the Random Forest Classifier method with an accuracy of 84.21%. Meanwhile, the AUC results obtained by the Extra Trees Classifier method are higher than other methods with an AUC of 93.81%.

Full Text:

PDF

References


A. U. L. H. et Al, “Identifying the Predictive Capability of Machine Learning Classifiers for Designing Heart Disease Detection System,” Int. Comput. Conf. Wavelet Act. Media Technol. Inf. Process, pp. 130–138, 2019, doi: 10.1109/ICCWAMTIP47768.2019.9067519.

Raju C, Philipsy E, Chacko S, Suresh LP, S DR. A Survey on Predicting Heart Disease using Data Mining Techniques. 2018 Conf Emerg Devices Smart Syst. 2018;(March):253-255

R. Jane et al., “Prediction of Cardiac Disease using Supervised Machine Learning Algorithms Arun Raj Lakshminarayanan,” no. Iciccs, pp. 570–575, 2020.

Vineet S, Akhtar R, Gauray H. Prediction of heart disease using DNN. Int Conf Inven Res Comput Appl. 2020;8(2 Special Issue 6):486-489. doi:10.35940/ijrte.B1092.0782S619.

Saw, Montu et al. 2020. “Estimation of Prediction for Getting Heart Disease Using Logistic Regression Model of Machine Learning.” 2020 International Conference on Computer Communication and Informatics, ICCCI 2020: 20–25.

Gandhi, Monika, and Shailendra Narayan Singh. 2015. “Predictions in Heart Disease Using Techniques of Data Mining.” 2015 1st International Conference on Futuristic Trends in Computational Analysis and Knowledge Management, ABLAZE 2015: 520–25.

Guo, Y., Zhou, Y., Hu, X., & Cheng, W. (2019). Research on recommendation of insurance products based on random forest. Proceedings - 2019 International Conference on Machine Learning, Big Data and Business Intelligence, MLBDBI 2019, 308–311. https://doi.org/10.1109/MLBDBI48998.2019.00069.

Fattah, A., Mashat., M., S., P., & F., T. (2012). A Decision Tree Classification Model for University Admission System. International Journal of Advanced Computer Science and Applications, 3(10), 17–21. https://doi.org/10.14569/ijacsa.2012.031003

L. Abhishek, “Optical character recognition using ensemble of SVM, MLP and extra trees classifier,” 2020 Int. Conf. Emerg. Technol. INCET 2020, pp. 7–10, 2020, doi: 10.1109/INCET49848.2020.9154050.

S. Liu, H. Li, Y. Zhang, B. Zou, and J. Zhao, “Random forest-based track initiation method,” J. Eng., vol. 2019, no. 19, pp. 6175–6179, 2019, doi: 10.1049/joe.2019.0180

E. K. Ampomah, Z. Qin, and G. Nyame, “Evaluation of tree-based ensemble machine learning models in predicting stock price direction of movement,” Inf., vol. 11, no. 6, 2020, doi: 10.3390/info11060332.

Heliyanti Susana, “Penerapan Model Klasifikasi Metode Naive Bayes Terhadap Penggunaan Akses Internet,” J. Ris. Sist. Inf. dan Teknol. Inf., vol. 4, no. 1, pp. 1–8, 2022, doi: 10.52005/jursistekni.v4i1.96.

Naomi Chatrina Siregar, Riki Ruli A. Siregar, and M. Yoga Distra Sudirman, “Implementasi Metode Naive Bayes Classifier (NBC) Pada Komentar Warga Sekolah Mengenai Pelaksanaan Pembelajaran Jarak Jauh (PJJ),” J. Teknol., vol. 3, no. 1, pp. 102–110, 2020.

Marimuthu, M. et al. 2018. “A Review on Heart Disease Prediction Using Machine Learning and Data Analytics Approach.” International Journal of Computer Applications 181(18): 20–25.

P. Motarwar, A. Duraphe, G. Suganya, and M. Premalatha, “Cognitive Approach for Heart Disease Prediction using Machine Learning,” Int. Conf. Emerg. Trends Inf. Technol. Eng. ic-ETITE 2020, 2020, doi: 10.1109/ic-ETITE47903.2020.242.

Hamdaoui, Halima El, Said Boujraf, Nour El Houda Chaoui, and Mustapha Maaroufi. 2020. “A Clinical Support System for Prediction of Heart Disease Using Machine Learning Techniques.” 2020 International Conference on Advanced Technologies for Signal and Image Processing, ATSIP 2020




DOI: https://doi.org/10.32520/stmsi.v13i4.4163

Article Metrics

Abstract view : 181 times
PDF - 106 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.