Usability Analysis of an Electronic Immunization Monitoring and Logistics System using PIECES and SUS

Citra Yustitya Gobel, Misrawati Aprilyana Puspa, Syarifah Fitrah Ramadhani, Siti Andini Utiarahman, Sinta Suleman

Abstract


The Electronic Immunization Monitoring and Logistics System (SMILE) is an information system designed to support the integrated management of immunization records and healthcare logistics. The successful implementation of such a system depends not only on its functionality but also on its usability, which significantly influences user satisfaction and acceptance. This study aims to evaluate the usability of the SMILE application using the PIECES framework—covering Performance, Information, Economy, Control, Efficiency, and Service—and the System Usability Scale (SUS). A descriptive quantitative approach was employed, with data collected through observations, a literature review, and questionnaire surveys administered to 56 users of the SMILE application at the Gorontalo Provincial Health Office. The results of the PIECES analysis indicate that all evaluation dimensions achieved the "Satisfied" category, with mean scores of 3.68 for Performance, 4.28 for Information, 4.36 for Economy, 4.26 for Control, 4.25 for Efficiency, and 4.25 for Service. The usability assessment using the SUS yielded an average score of 53, which falls within the "OK" adjective rating (score range: 51–67) and the "Marginal" acceptability category. According to the SUS grading scale, this score corresponds to Grade D, indicating that the application's overall usability requires improvement. Although users expressed satisfaction with the system's performance and service quality, the findings suggest that enhancements are still needed, particularly in terms of ease of use, navigation, and overall user experience. The findings of this study provide valuable insights and practical recommendations for developers to improve the quality and usability of the SMILE application, thereby supporting more effective adoption and use in healthcare services.

Keywords


information systems analysis; electronic immunization and logistics monitoring system; system usability scale

Full Text:

PDF

References


N. A. Putri, “Evaluasi Pemanfaatan Sistem Informasi Kesehatan dalam meningkatkan Ketepatan dan Perencanaan Program di Fasilitas Kesehatan di Indonesia,” Res. Gate, 2025. DOI: https://doi.org/10.51998/jti.v8i1.470

A. P. Pratama and M. Rosmiati, “Enhancing Patient Satisfaction and System Efficiency Through the SMILE Platform for Dental Clinics in Pangandaran,” Presented at the 2025 International Conference on Computing and Applied Informatics (ICCAI), IEEE, 2025, pp. 1–6. DOI: 10.1109/ICCAI65301.2025.11278927

S. Sahril, R. Ardiansyah, W. Wirdayanti, D. S. Angreni, and Y. Yudhaswana, “Penggabungan Metode System Usability Scale dan User Experience Questionnaire untuk Evaluasi Usability Sistem Informasi MBKM Universitas Tadulako dengan Pendekatan User Experience,” JIPI J. Ilm. Penelit. dan Pembelajaran Inform., Vol. 9, No. 4, pp. 2373–2385, 2024. DOI: https://doi.org/10.29100/jipi.v9i4.5548

I. Firmansyah and S. Suparni, “Penerapan Metode PIECES Framework untuk menganalisa Kepuasan Pengguna Aplikasi M. Tix,” JATI J. Mhs. Tek. Inform., Vol. 8, No. 6, pp. 12735–12741, 2024. DOI: https://doi.org/10.36040/jati.v8i6.11769

V. Y. P. Ardhana, “Mengukur Tingkat Kepuasan Pengguna SIGESIT Kabupaten Bima menggunakan System Usability Scale dan Pieces Framework,” JURIKOM J. Ris. Komput., Vol. 9, No. 5, pp. 1479–1486, 2022. DOI 10.30865/jurikom.v9i5.4955

A. P. Rachmawati, “Evaluasi Usability Sistem Informasi menggunakan Metode User Experience Questionnaire,” J. Sist. Inf., Vol. 1, No. 1, pp. 9–15, 2025. DOI: 10.33395/jmp.v13i2.14403

I. Oktaviani and S. Sumarlinda, “Penerapan Metode PIECES pada Analisis Sistem Informasi Manajemen Apotek,” Infokes J. Ilm. Rekam Medis dan Inform. Kesehat., Vol. 11, No. 1, pp. 54–58, 2021.

F. R. Sudirman, Z. Sulaiman, and S. Said, “Analisis Sistem Informasi Rekam Medis Elektronik dengan Pendekatan PIECES di UPT Puskesmas Rappang,” J. PETISI Pendidik. Teknol. Inf., Vol. 6, No. 2, pp. 203–216, 2025. DOI: https://doi.org/10.36232/jurnalpetisi.v6i2.2015

M. Y. Fahmi and U. Indahyanti, “Sistem Informasi Perekrutan Karyawan di Rumah Sakit menggunakan Metode Analisis PIECES,” J. Internet Softw. Eng. Vol, Vol. 1, No. 1, pp. 1–23, 2024. DOI: https://doi.org/10.47134/pjise.v1i1.2246

R. Perwirani and W. R. Sukmaningsih, “Analisis Sistem Informasi Manajemen Rumah Sakit Bagian Pendaftaran menggunakan Metode PIECES di RSUP Surakarta,” J. Health Inf. Manag. Indones. JHIMI, Vol. 3, No. 3, pp. 174–180, 2024. . DOI: https://doi.org/10.36040/jati.v8i6.11769

R. A. Djamro, T. Husain, M. Mudarsep, I. Irmawati, A. Akhriana, and H. Hasriani, “Analisis Komprehensif Tingkat Kepuasan Pengguna BRImo Menggunakan PIECES dan SUS,” REMIK Ris. Dan E-J. Manaj. Inform. Komput., vol. 10, no. 1, pp. 168–177, 2026. DOI: https://doi.org/10.35870/jti k.v6i4.611

A. F. Nazya, R. G. Guntara, and B. M. Purwaamijaya, “Analisis Penggunaan iHLD pada Divisi Drafter dan Divisi SDI di PT Telkom Akses Witel Tasikmalaya menggunakan Metode SUS dan PIECES,” J. Minfo Polgan, Vol. 13, No. 2, pp. 2144–2156, 2024. DOI: 10.33395/jmp.v13i2.14403

V. Y. P. Ardhana, “Analisis Usability Testing pada SITIDES menggunakan System Usability Scale dan PIECES Framework,” Bull. Inform. Data SCI., Vol. 1, No. 2, pp. 89–97, 2022. DOI: http://dx.doi.org/10.61944/bids.v1i2.41

E. Riana, M. E. S. Sulistyawati, and A. Sebayang, “Analisis Uji Komparasi Customer Satisfaction Survey dalam Penggunaan Google Cloud Platform (GCP) menggunakan Metode PIECES dan System Usability Scale,” Inform. Educ. Prof. J. Inform., Vol. 7, No. 2, pp. 174–185, 2023. DOI: https://doi.org/10.51211/itbi.v8i1.2276

M. F. Niam et al., “Metode Penelitian Kualitatif,” CV Widina Media Utama Tahun 2024.




DOI: https://doi.org/10.32520/stmsi.v15i6.6507

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.