Predict the thyroid abnormality particular disease likelihood of the symptoms’ certainty factor value and its confidence level: A regression model analysis

Rosyid Ridlo Al-Hakim; Yanuar Zulardiansyah Arief; Agung Pangestu; Hexa Apriliana Hidayah; Aditia Putra Hamid; Aviasenna Andriand; Nur Fauzi Soelaiman; Machnun Arif; Mahmmoud Hussein Abdel Alrahman

doi:10.32520/stmsi.v12i2.2542

Predict the thyroid abnormality particular disease likelihood of the symptoms’ certainty factor value and its confidence level: A regression model analysis

Rosyid Ridlo Al-Hakim, Yanuar Zulardiansyah Arief, Agung Pangestu, Hexa Apriliana Hidayah, Aditia Putra Hamid, Aviasenna Andriand, Nur Fauzi Soelaiman, Machnun Arif, Mahmmoud Hussein Abdel Alrahman

Abstract

The traditional expert system (TES) in the medical field commonly uses a certainty factor (CF) rule-based algorithm that can be calculated several symptoms to determine the inference solutions. The main issue for this TES included a prediction for some particular disease likelihood in the cases of new patients. CF is calculated based on symptoms related to clinical signs in patients’ diagnoses. For some reason, this TES probably won’t predict uncertain things, such as particular disease likelihood of some diseases. So, supervised learning, such as linear regression, can solve this problem. We tried to analyse the existing TES for thyroid disorders due to modelling the regression equation to predict the thyroid abnormality particular disease likelihood, based on the symptoms’ CF value and its confidence level. We used multiple linear regression (MLR) and multiple polynomial regression (MPR) to analyse the best regression model to solve the problem. The results show that the MPR model indicates the best regression model for predicting particular disease likelihood of thyroid abnormality, supported by R-squared 94.7%, R-squared adjusted 94.4%, F-value 265.925, and p-value < 0.05, which are higher than MLR model. Our study proposed a foundation for expert system development by focusing more on machine learning expert system (MLES) analysis approaches than TES.

Full Text:

PDF

References

Azamris, Buku Ajar Kelainan Tiroid. Yogyakarta (ID): Deepublish Publisher, 2020.

A. Fukao et al., ‘Graves’ disease and mental disorders’, Journal of Clinical and Translational Endocrinology, vol. 19. Elsevier, p. 100207, Mar. 01, 2020. doi: 10.1016/j.jcte.2019.100207.

L. L. Altshuler et al., ‘Does thyroid supplementation accelerate tricyclic antidepressant response? A review and meta-analysis of the literature’, Am. J. Psychiatry, vol. 158, no. 10, pp. 1617–1622, 2001, doi: 10.1176/appi.ajp.158.10.1617.

M. Bauer, T. Goetz, T. Glenn, and P. C. Whybrow, ‘The thyroid-brain interaction in thyroid disorders and mood disorders’, J. Neuroendocrinol., vol. 20, no. 10, pp. 1101–1114, 2008, doi: 10.1111/J.1365-2826.2008.01774.X.

R. R. Al-Hakim et al., ‘Sistem Pakar untuk Diagnosis Penyakit Tiroid dengan Gejala Psikologis Beserta Pengobatan Etnobotaninya’, J. Teknol. Inf. dan Ilmu Komput., vol. 9, no. 7, 2022, doi: 10.25126/jtiik.2022976763.

A. K. Meena and S. Kumar, ‘Study and Analysis of MYCIN expert system’, Int. J. Eng. Comput. Sci., vol. 4, no. 10, pp. 14861–14865, Oct. 2015, doi: 10.18535/ijecs/v4i10.41.

W. Wiriyasuttiwong and W. Narkbuakaew, ‘Medical Knowledge-Based System for Diagnosis from Symptoms and Signs’, Int. J. Appl. Biomed. Eng., vol. 2, no. 1, pp. 54–59, 2009.

R. R. Al Hakim, E. Rusdi, and M. A. Setiawan, ‘Android Based Expert System Application for Diagnose COVID-19 Disease: Cases Study of Banyumas Regency’, J. Intell. Comput. Heal. Informatics, vol. 1, no. 2, pp. 1–13, 2020, doi: 10.26714/jichi.v1i2.5958.

M. R. Mufid, A. Basofi, S. Mawaddah, K. Khotimah, and N. Fuad, ‘Risk diagnosis and mitigation system of covid-19 using expert system and web scraping’, in 2020 International Electronics Symposium (IES), Sep. 2020, pp. 577–583. doi: 10.1109/IES50839.2020.9231619.

Y. Sha, T. Feng, X. Xiong, and T. Yang, ‘Designing Online Psychological Consultation Expert System Using Human-Computer Interaction’, Mob. Inf. Syst., vol. 2021, Jun. 2021, doi: 10.1155/2021/6458924.

A. A. Al-Hajji, F. M. AlSuhaibani, and N. S. AlHarbi, ‘An Online Expert System for Psychiatric Diagnosis’, Int. J. Artif. Intell. Appl., vol. 10, no. 2, pp. 59–76, 2019, doi: 10.5121/ijaia.2019.10206.

I. A. Alshawwa, M. Elkahlout, H. Q. El-Mashharawi, and S. S. Abu-Naser, ‘An Expert System for Depression Diagnosis’, Int. J. Acad. Heal. Med. Res., vol. 3, no. 4, pp. 20–27, 2019.

N. K. Ariasih, ‘Expert System to Diagnose Diseases of Mental Health with Forward Chaining and Certainty Factor’, Wahana Mat. dan Sains J. Mat. Sains, dan Pembelajarannya, vol. 14, no. 1, pp. 28–41, Apr. 2020, doi: 10.23887/WMS.V14I1.24267.

M. Melina, E. K. Putra, W. Witanti, S. Sukrido, and V. A. Kusumaningtyas, ‘Design and Implementation of Multi Knowledge Base Expert System Using the SQL Inference Mechanism for Herbal Medicine’, J. Phys. Conf. Ser., vol. 1477, p. 22007, 2020, doi: 10.1088/1742-6596/1477/2/022007.

R. R. Al Hakim, H. A. Hidayah, A. Pangestu, D. Nugraha, S. Faizah, and E. R. C. Putri, ‘Sistem Pakar Forward-Chaining Dengan Certainty Factor Dalam Pemanfaatan Tumbuhan Obat, Studi Kasus: Etnobotani Di Kabupaten Banyumas, Jawa Tengah’, in E-Prosiding Seminar Nasional Inovasi Teknologi Pertanian Berkelanjutan (INOPTAN), 2022, vol. 1, no. 1, pp. 106–113. [Online]. Available: https://jurnal.unikastpaulus.ac.id/index.php/inoptan/article/view/1412

M. Abdar, M. Zomorodi-Moghadam, R. Das, and I. H. Ting, ‘Performance analysis of classification algorithms on early detection of liver disease’, Expert Syst. Appl., vol. 67, pp. 239–251, 2017, doi: 10.1016/j.eswa.2016.08.065.

I. Z. Jibril, J. Agajo, L. A. Ajao, J. G. Kolo, and O. C. Inalegwu, ‘Development of a Medical Expert System for Hypertensive Patients Diagnosis: A Knowledge-Based Rules’, Adv. Electr. Telecommun. Eng., vol. 1, no. 1, pp. 39–47, 2018.

G. Yu, Z. Chen, J. Wu, and Y. Tan, ‘Medical decision support system for cancer treatment in precision medicine in developing countries’, Expert Syst. Appl., vol. 186, p. 115725, Dec. 2021, doi: 10.1016/J.ESWA.2021.115725.

R. Islam, S. Imran, M. Ashikuzzaman, and M. M. A. Khan, ‘Detection and Classification of Brain Tumor Based on Multilevel Segmentation with Convolutional Neural Network’, J. Biomed. Sci. Eng., vol. 13, no. 04, pp. 45–53, 2020, doi: 10.4236/jbise.2020.134004.

V. V. Vadhiraj, A. Simpkin, J. O’Connell, N. S. Ospina, S. Maraka, and D. T. O’Keeffe, ‘Ultrasound Image Classification of Thyroid Nodules Using Machine Learning Techniques’, Medicina (Kaunas)., vol. 57, no. 6, 2021, doi: 10.3390/medicina57060527.

F. L. D. Cahyanti, W. Gata, and F. Sarasati, ‘Implementasi Algoritma Naïve Bayes dan K-Nearest Neighbor Dalam Menentukan Tingkat Keberhasilan Immunotherapy Untuk Pengobatan Penyakit Kanker Kulit’, J. Ilm. Univ. Batanghari Jambi, vol. 21, no. 1, pp. 259–262, Feb. 2021, doi: 10.33087/JIUBJ.V21I1.1189.

E. Rich and K. Knight, Artificial Intelligence, 2nd ed. New York: McGraw-Hill Education, 1991.

E. Hariadha, D. Nugraha, R. R. Al Hakim, A. Pangestu, M. Yusro, and M. H. Satria, ‘Using Certainty Factor for Symptoms Diagnosis of Thyroid Disorders’, in 2022 International Conference on ICT for Smart Society (ICISS), 2022, pp. 01–05. doi: 10.1109/ICISS55894.2022.9915219.

M. I. Pramanik, R. Y. K. Lau, M. A. K. Azad, M. S. Hossain, M. K. H. Chowdhury, and B. K. Karmaker, ‘Healthcare informatics and analytics in big data’, Expert Syst. Appl., vol. 152, Aug. 2020.

O. C. Ungureanu et al., ‘Telemedicine Software Application’, Int. J. Comput. Sci. Netw. Secur., vol. 21, no. 2, pp. 171–180, 2021, doi: 10.22937/IJCSNS.2021.21.2.1.19.

X. SUN, H. LIU, G. WU, and Y. ZHOU, ‘Training effectiveness evaluation of helicopter emergency relief based on virtual simulation’, Chinese J. Aeronaut., vol. 31, no. 10, pp. 2000–2012, Oct. 2018.

R. R. Al Hakim et al., ‘Design and Development Smart-iMbulance for Efficiency of Road Emergency Priorities’, J. Innov. Res. Knowl., vol. 1, no. 2, pp. 167–172, 2021, doi: 10.53625/jirk.v1i2.

L. Salekhova, A. Nurgaliev, R. Zaripova, and N. Khakimullina, ‘The Principles of Designing an Expert System in Teaching Mathematics’, Univers. J. Educ. Res., vol. 1, no. 2, pp. 42–47, Aug. 2013, doi: 10.13189/UJER.2013.010202.

S. Supriyadi and D. Wiliyanto, ‘Prototype Expert System Application to Identify Specific Children Learning Disabilities in Inclusion Schools’, IJDS Indones. J. Disabil. Stud., vol. 8, no. 01, pp. 117–127, Jan. 2021, doi: 10.21776/ub.ijds.2021.008.01.09.

R. Eskrootchi, M. Zavari, and M. Alibeyk, ‘Developing a fuzzy expert system to determine the levels of students’ eHealth literacy’, Libr. Philos. Pract., vol. 2021, pp. 1–26, Jan. 2021.

M. F. Azis, Belajar Sendiri Pemrograman Sistem Pakar. Jakarta (ID): Elex Media Komputindo, 1994.

H. S. Suryadi, Pengantar Sistem Pakar. Depok: Universitas Gunadarma, 1994.

E. I. H. Rahayu, S. Suhardoyo, and I. Iwan, ‘Umpan Balik Sistem Pakar Sebagai Penilaian Kinerja Karyawan Pada PT. Multistrada Arah Sarana, Tbk’, BMAJ Bus. Manag. Anal. J., vol. 2, no. 1, pp. 52–67, Apr. 2019, doi: 10.24176/bmaj.v2i1.3211.

Y. L. Lai and A. Ishizaka, ‘The application of multi-criteria decision analysis methods into talent identification process: A social psychological perspective’, J. Bus. Res., vol. 109, pp. 637–647, Mar. 2020, doi: 10.1016/J.JBUSRES.2019.08.027.

A. P. Hamid, R. R. Al Hakim, A. Sungkowo, T. Trikolas, H. Purnawan, and A. Jaenul, ‘Talent Management Employee Development by Using Certainty Factor Method of Expert System’, ARRUS J. Eng. Technol., vol. 1, no. 1, pp. 33–39, 2021, doi: 10.35877/jetech568.

R. R. Al Hakim, G. E. Setyowisnu, and A. Pangestu, ‘An Expert System Dataset for Checking the Potential for Administering a Covid-19 Vaccine in Indonesia: Forward- Chaining Inference Machine Approach’, J. Glob. Eng. Res. Sci., vol. 1, no. 1, pp. 1–4, 2022, doi: 10.56904/jgers.v1i1.3.

A. Farizi, ‘Sistem Pakar Untuk Mendiagnosa Kerusakan Komputer Dengan Menggunakan Metode Forward Chaining’, Edu Komputika J., vol. 1, no. 2, pp. 21–32, 2014.

M. M. Arifin and Y. B. Utomo, ‘Sistem Pakar Untuk Diagnosa Kerusakan Hardware Komputer Menggunakan Jaringan Syaraf Tiruan’, Dec. 2021. Accessed: Apr. 28, 2021. [Online]. Available: https://ejournal.uniska-kediri.ac.id/index.php/JTECS/article/view/715

A. Eresen, N. Imamoǧlu, and M. Önder Efe, ‘Autonomous quadrotor flight with vision-based obstacle avoidance in virtual environment’, Expert Syst. Appl., vol. 39, no. 1, pp. 894–905, Jan. 2012, doi: 10.1016/J.ESWA.2011.07.087.

E. Sudaryanto and A. Suryanto, ‘SISTEM PAKAR DIAGNOSA HAMA DAN PENYAKIT TANAMAN DURIAN DENGAN METODE NAIVE BAYES’, Teodolita Media Komunkasi Ilm. di Bid. Tek., vol. 21, no. 1, Jun. 2020, doi: 10.53810/JT.V21I1.339.

M. H. Ramadhan, G. Dewantoro, and F. D. Setiaji, ‘Rancang Bangun Sistem Pakar Pemantau Kualitas Air Berbasis IoT Menggunakan Fuzzy Classifier’, J. Tek. Elektro, vol. 12, no. 2, pp. 47–56, Dec. 2020, doi: 10.15294/jte.v12i2.25351.

R. Hariyanto and K. Sa’diyah, ‘Sistem Pakar Diagnosis Penyakit dan Hama Pada Tanaman Tebu Menggunakan Metode Certainty Factor’, JOINTECS (Journal Inf. Technol. Comput. Sci., vol. 3, no. 1, pp. 1–4, 2018, doi: 10.31328/jointecs.v3i1.500.

S. H. Al Ikhsan, ‘Pengembangan Sistem Pakar Agribisnis Cabai (Capsicum Annuum L.) Berbasis Android’, Institut Pertanian Bogor, 2012.

Y. -, F. Marisa, and D. Purnomo, ‘Sistem Rekomendasi Distribusi Tetes Tebu Di UD. Lancar Menggunakan Metode Fuzzy Sugeno Berbasis Web’, JOINTECS (Journal Inf. Technol. Comput. Sci., vol. 1, no. 1, pp. 6–9, 2016, doi: 10.31328/jointecs.v1i1.401.

Z. Zhao, F. Hong, H. Huang, C. Liu, Y. Feng, and Z. Guo, ‘Short-term prediction of fishing effort distributions by discovering fishing chronology among trawlers based on VMS dataset’, Expert Syst. Appl., vol. 184, 2021, doi: 10.1016/j.eswa.2021.115512.

P. Karuniawan, I. N. Farida, and J. Suhertian, ‘IMPLEMENTASI METODE CERTAINTY FACTOR UNTUK MENGIDENTIFIKASI PENYAKIT TANAMAN KEDELAI DAN PADI’, Nusant. Eng., vol. 4, no. 1, p. 9, Apr. 2021, doi: 10.29407/NOE.V4I1.15902.

B. A. Crawford, J. C. Maerz, and C. T. Moore, ‘Expert-informed habitat suitability analysis for at-risk species assessment and conservation planning’, J. Fish Wildl. Manag., vol. 11, no. 1, pp. 130–150, Jun. 2020, doi: 10.3996/092019-JFWM-075.

M. Di Febbraro et al., ‘Expert-based and correlative models to map habitat quality: Which gives better support to conservation planning?’, Glob. Ecol. Conserv., vol. 16, Oct. 2018, doi: 10.1016/J.GECCO.2018.E00513.

Y. Darnita and R. Toyib, ‘Klasifikasi Penentuan Manfaat Tanaman Obat Herbal Berbasis Rule Based Reasoning’, SISTEMASI, vol. 10, no. 1, pp. 82–95, Jan. 2021, doi: 10.32520/STMSI.V10I1.1090.

K. Sturk-Andreaggi, M. A. Peck, C. Boysen, P. Dekker, T. P. McMahon, and C. K. Marshall, ‘AQME: A forensic mitochondrial DNA analysis tool for next-generation sequencing data’, Forensic Sci. Int. Genet., vol. 31, pp. 189–197, 2017, doi: 10.1016/J.FSIGEN.2017.09.010.

J. Mortera, A. P. Dawid, and S. L. Lauritzen, ‘Probabilistic expert systems for DNA mixture profiling’, Theor. Popul. Biol., vol. 63, no. 3, pp. 191–205, 2003, doi: 10.1016/S0040-5809(03)00006-6.

R. R. Al Hakim, A. Pangestu, and A. Jaenul, ‘Penerapan Metode Certainty Factor dengan Tingkat Kepercayaan pada Sistem Pakar dalam Mendiagnosis Parasit pada Ikan’, Djtechno J. Inf. Technol. Res., vol. 2, no. 1, pp. 29–37, 2021, doi: 10.46576/djtechno.v2i1.1254.

Suharjito, Diana, Yulyanto, and A. Nugroho, ‘Mobile Expert System Using Fuzzy Tsukamoto for Diagnosing Cattle Disease’, Procedia Comput. Sci., vol. 116, pp. 27–36, 2017.

R. Stefani, ‘SISTEM PAKAR DIAGNOSA PENYAKIT PADA IKAN KOI MENGGUNAKAN METODE BACKWARD CHAINING’, J. Ris. RUMPUN ILMU HEWANI, vol. 1, no. 2, pp. 16–30, Oct. 2022, Accessed: Nov. 22, 2022. [Online]. Available: https://prin.or.id/index.php/JURRIH/article/view/526

Z. Hakim and R. Rizky, ‘Sistem Pakar Diagnosis Penyakit Ikan Mas Menggunakan Metode Certainty Factor Di UPT Balai Budidaya Ikan Air Tawar Dan Hias Kabupaten Pandeglang Banten’, J. Tek. Inform. Unis, vol. 7, no. 2, pp. 164–169, 2020, doi: 10.33592/jutis.v7i2.399.

R. Sharda, D. Delen, and E. Turban, Analytics, data science, & artificial intelligence: systems for decision support, 11th ed. Hoboken, New Jersey (US): Pearson Education, 2020.

Suyanto, Artificial Intelligence: Searching, Reasoning, Planning, dan Learning. Bandung: Informatika, 2014.

M. I. Fale and Y. G. Abdulsalam, ‘Dr. Flynxz – A First Aid Mamdani-Sugeno-type fuzzy expert system for differential symptoms-based diagnosis’, J. King Saud Univ. - Comput. Inf. Sci., vol. 34, no. 4, pp. 1138–1149, 2022, doi: 10.1016/j.jksuci.2020.04.016.

A. S. Yanuar, E. G. Wahyuni, and D. T. Wiyanti, ‘Certainty Factor Method for Neurological Disease Diagnosis Based on Symptoms’, in ICCSET, 2018, pp. 851–856. doi: 10.4108/eai.24-10-2018.2280500.

L. Safira, B. Irawan, and C. Setiningsih, ‘Implementation of the Certainty Factor Method for Early Detection of Cirrhosis Based on Android’, J. Phys. Conf. Ser., vol. 1201, no. 1, p. 12053, 2019, doi: 10.1088/1742-6596/1201/1/012053.

C. Slamet, B. Firmanda, M. A. Ramdhani, W. Darmalaksana, E. Enjang, and F. M. Kaffah, ‘Android-based expert system design for drug selection using certainty factor’, J. Phys. Conf. Ser., vol. 1280, p. 22018, 2019, doi: 10.1088/1742-6596/1280/2/022018.

D. Sudrajat et al., ‘Expert system application for identifying formalin and borax in foods using the certainty factor method’, Eurasian J. Anal. Chem., vol. 13, no. 6, pp. 321–325, 2018.

Sumiati, H. Saragih, T. K. A. Rahman, and A. Triayudi, ‘Expert system for heart disease based on electrocardiogram data using certainty factor with multiple rule’, IAES Int. J. Artif. Intell., vol. 10, no. 1, pp. 43–50, Mar. 2021, doi: 10.11591/ijai.v10.i1.pp43-50.

X. Huang et al., ‘A Generic Knowledge Based Medical Diagnosis Expert System’, in The 23rd International Conference on Information Integration and Web Intelligence (iiWAS2021), 2021, pp. 1–7. doi: 10.1145/3487664.3487728.

N. Farsad Layegh, R. Darvishzadeh, A. K. Skidmore, C. Persello, and N. Krüger, ‘Integrating Semi-Supervised Learning with an Expert System for Vegetation Cover Classification Using Sentinel-2 and RapidEye Data’, Remote Sens., vol. 14, no. 15, p. 3605, Jul. 2022, doi: 10.3390/RS14153605.

E. Lasso, T. T. Thamada, C. A. A. Meira, and J. C. Corrales, ‘Expert system for coffee rust detection based on supervised learning and graph pattern matching’, Int. J. Metadata, Semant. Ontol., vol. 12, no. 1, pp. 19–27, 2017, doi: 10.1504/IJMSO.2017.087641.

R. Board and L. Pitt, ‘Semi-supervised learning’, Mach. Learn., vol. 4, pp. 41–65, Oct. 1989, doi: 10.1007/BF00114803.

R. Primartha, Algoritma Machine Learning. Bandung (ID): Informatika, 2021.

D. D. Lewis and J. Catlett, ‘Heterogeneous Uncertainty Sampling for Supervised Learning’, in Machine Learning Proceedings 1994, W. W. Cohen and H. Hirsh, Eds. New Brunswick (NJ): Morgan Kaufmann, 1994, pp. 148–156. doi: 10.1016/B978-1-55860-335-6.50026-X.

E. B. Baum and F. Wilczek, ‘Supervised Learning of Probability Distributions by Neural Networks’, Neural Inf. Process. Syst., pp. 52–61, 1988.

A. I. Hajamydeen and R. A. A. Helmi, ‘Performance of Supervised Learning Algorithms on Multi-Variate Datasets’, in Machine Learning and Big Data: Concepts, Algorithms, Tools and Applications, wiley, 2020, pp. 209–232. doi: 10.1002/9781119654834.CH8.

F. K. Lembang, ‘Analisis Regresi Berganda dengan Metode Stepwise pada Data Hbat’, J. Barekeng, vol. 5, no. 1, pp. 15–20, 2011.

S. Borzouei, H. Mahjub, N. Sajadi, and M. Farhadian, ‘Diagnosing thyroid disorders: Comparison of logistic regression and neural network models’, J. Fam. Med. Prim. Care, vol. 9, no. 3, p. 1476, 2020, doi: 10.4103/JFMPC.JFMPC_910_19.

R. R. Al Hakim, M. H. Satria, Y. Z. Arief, A. D. Setiawan, A. Pangestu, and H. A. Hidayah, ‘Artificial Intelligence for Thyroid Disorders: A Systematic Review’, Sci. Inf. Technol. Lett., vol. 2, no. 2, Nov. 2021, doi: 10.31763/sitech.v2i2.694.

R. Kohavi, ‘The power of decision tables’, Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 912, pp. 174–189, 1995, doi: 10.1007/3-540-59286-5_57.

R Core Team, ‘R: A language and environment for statistical computing [Computer software manual]’, 2016

J. S. Malensang, H. Komalig, and D. Hatidja, ‘PENGEMBANGAN MODEL REGRESI POLINOMIAL BERGANDA PADA KASUS DATA PEMASARAN’, J. Ilm. Sains, vol. 12, no. 2, pp. 149–152, Jan. 2013, doi: 10.35799/JIS.12.2.2012.740.

D. S. Moore, W. I. Notz, and M. A. Flinger, The basic practice of statistics, 6th ed. New York (US): W.H. Freeman and Company, 2013.

R. R. Al-Hakim and A. Andriand, “Diagnosis Leptospirosis Menggunakan Sistem Pakar Metode Faktor Kepastian Beserta Prediksi Regresi Linear,” Pros. SAINTEK Sains dan Teknol., vol. 2, no. 1, pp. 256–261, 2023, [Online]. Available: https://www.jurnal.pelitabangsa.ac.id/index.php/SAINTEK/article/view/2165

DOI: https://doi.org/10.32520/stmsi.v12i2.2542

Article Metrics

Abstract view : 325 times
PDF - 89 times

Refbacks

There are currently no refbacks.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Username
Password
Remember me