User Experience Evaluation of the Internal Quality Assurance Information System (E-AMI) using the User Experience Questionnaire Plus (UEQ+)

Ni Putu Anik Mentayani, I Made Candiasa, I Made Gede Sunarya

Abstract


This study evaluates the user experience (UX) of the E-AMI system at Primakara University, an academic quality assurance system managed by the Quality Assurance Institution (LPM). A sequential explanatory mixed-method design was employed, combining quantitative measurement using the User Experience Questionnaire Plus (UEQ+) across 15 scales with qualitative data collected through observations and semi-structured interviews. A total of 41 respondents participated, consisting of administrators, auditors, and auditees actively involved in the Internal Quality Audit (AMI) process. UEQ+ scores range from -3 (very negative) to +3 (very positive), with scores above 1.0 generally classified as good. The quantitative results yielded an average KPI score of 2.10, indicating good user experience quality, with the highest scores recorded in usefulness (M = 2.51), efficiency (M = 2.26), and perspicuity (M = 2.38). These findings were corroborated by qualitative data confirming the system's effectiveness in supporting core AMI processes. However, both quantitative and qualitative findings converged on several persistent UX weaknesses: Importance-Performance Analysis (IPA) identified visual aesthetics (M = 1.41), novelty (M = 1.90), attractiveness (M = 1.91), stimulation (M = 1.95), and value (M = 1.98) as priority improvement dimensions, consistent with qualitative findings of unintuitive navigation, insufficient system feedback, interface inconsistencies, and incomplete feature support. It is concluded that while the E-AMI system performs well in functional dimensions, further development in visual, experiential, and feature dimensions is required to achieve optimal UX quality, with future improvements recommended to adopt a user-centered design approach.

Keywords


academic quality assurance; E-AMI; importance-performance analysis; UEQ+; user experience

Full Text:

PDF

References


G. Indrawan, “User Experience Testing on Smart Human Capital Dashboard (SHUCADA) from PT Studio Kami Mandiri using User Experience Questionnaire (UEQ),” Matrix: Jurnal Manajemen Teknologi dan Informatika, Vol. 16, pp. 39–48, 2026, DOI: 10.31940/matrix.v16i1.39-48.

I. G. S. Mulyawan, I. M. Candiasa, D. Gede, H. Divayana, and S. Journal, “Evaluasi Sistem Informasi Manajemen Daerah – Barang Milik Daerah menggunakan Framework ITIL pada Area Service Operation dengan Pendekatan Framework CMMI-SVC,” SINTECH JOURNAL, Vol. 5, No. 1, pp. 103–113, 2022, DOI: https://doi.org/10.31598.

I. G. Made, S. Dwipayana, I. M. Candiasa, L. Joni, and E. Dewi, “Usability Evaluation of Lecturer Information System using CTA, Performance Measurement and SUS,” Sinkron : Jurnal dan Penelitian Teknik Informatika, Vol. 9, No. 1, pp. 149–159, 2025, DOI: https://doi.org/10.33395/sinkron.v9i1.14315 e-ISSN.

N. P. A. Mentayani, I. P. Satwika, I. G. A. Pramesti Dwi Putri, A. A. I. I. Paramitha, and T. Tiawan, “Analisis dan Perancangan User Interface Sistem Informasi Pembayaran Mahasiswa STMIK Primakara berbasis Web,” Technomedia Journal, Vol. 7, No. 1, pp. 78–89, 2022, DOI: 10.33050/tmj.v7i1.1850.

A. Ardinata, I. Paramitha, N. Luh, N. Septyarini, and P. Astawa, “Evaluasi User Experience dan Perancangan Ulang Interface pada Website Thai.Com menggunakan Metode Heuristik dan User Experience Questionnaire (UEQ),” 2023.

I. Putu, E. Widyantara, I. Made, and G. Sunarya, “Evaluation of the Success of TPP Information System Implementation using the Hot-Fit Method,” Eduvest-Journal of Universal Studies, Vol. 5, 2025, [Online]. Available: http://eduvest.greenvest.co.id

I. G. P. A. A. Putra, I. M. Candiasa, and I. N. Sukajaya, “Usability Evaluation of the Undiksha Letter Management System Website using Performance Measurement, Think Aloud, And Mouse Tracking Methods,” Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), Vol. 14, No. 3, pp. 616–624, Dec. 2025, DOI: 10.23887/janapati.v14i3.100659.

N. Putu et al., “Evaluasi Usability dengan Pendekatan System Usability Scale (SUS) pada Aplikasi TMHub,” Jan. 2024. DOI: 10.56327/jtksi.v7i1.1600.

P. W. S. Dewi, D. G.R, and I. G, “User Experience Evaluation of e-Report Application using Cognitive Walkthrough ( CW ), Heuristic Evaluation ( HE ) and User Experience Questionnaire User Experience Evaluation of e-Report Application using Cognitive Walkthrough ( CW ), Heuristic Evaluatio,” 2024, DOI: 10.1088/1742-6596/1516/1/012024.

I. K. A. I. Diatmika, I. M. G. Sunarya, and I. G. A. Gunadi, “Evaluasi Layanan Pengaduan Masyarakat Pro Denpasar sebagai Platform E-Government menggunakan Webqual 4.0, E-Govqual dan Importance Performance Analysis,” Jurnal Pendidikan Teknologi dan Kejuruan, Vol. 22, No. 2, 2025, [Online]. Available: https://pengaduan.denpasarkota.go.id/.

J. Kollmorgen, A. Hinderks, and J. Thomaschewski, “Selecting the Appropriate User Experience Questionnaire and Guidance for Interpretation: the UEQ Family,” International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 9, No. 4, pp. 126–139, 2025, DOI: 10.9781/ijimai.2024.08.005.

H. B. Santoso, M. Schrepp, L. M. Hasani, R. Fitriansyah, and A. Setyanto, “Heliyon the use of User Experience Questionnaire Plus ( UEQ þ ) for Cross-Cultural UX Research : Evaluating Zoom and Learn Quran Tajwid as Online Learning Tools,” Heliyon, Vol. 8, No. 11, pp. 1–12, 2022, DOI: 10.1016/j.heliyon.2022.e11748.

A. L. Meiners, M. Schrepp, A. Hinderks, and J. Thomaschewski, “A Benchmark for the UEQ+ Framework: Construction of a Simple Tool to Quickly Interpret UEQ+ KPIs,” International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 9, No. 1, pp. 104–111, 2024, DOI: 10.9781/IJIMAI.2023.05.003.

N. D. Priandani et al., “Jurnal Teknologi dan Manajemen Informatika User Experience Evaluation of Botani Mobile Application using User Experience Questionnaire,” Vol. 9, No. 1, pp. 12–19, 2023, [Online]. Available: http://http://jurnal.unmer.ac.id/index.php/jtmi

M. Schrepp et al., “On the Importance of UX Quality Aspects for Different Product Categories,” International Journal of Interactive Multimedia and Artificial Intelligence, Vol. 8, No. 2, pp. 232–246, 2023, DOI: 10.9781/IJIMAI.2023.03.001.

A. A. Lasawali, A. Susilo, Y. Irawan, R. Mayasari, and B. Nugraha, “User Experience Analysis with User Experience Questionnaire (UEQ) in Academic Information Systems,” 2022.

I. K. Parwata, I. M. Candiasa, and D. G. Hendra Divayana, “Evaluasi Sistem Informasi Perpustakaan Universitas Pendidikan Ganesha pada Aspek Usability dengan Metode User Experience Questionnaire, Heuristic Evaluation dan Think Aloud,” Jurnal Pendidikan Teknologi dan Kejuruan, Vol. 21, No. 1, 2024, DOI: 10.23887/jptkundiksha.v21i1.66978.

M. Yuda Sadewa, M. Agus Panji Sujaya, I. M. Agus Oka Gunawan, and G. Indrawan, “Evaluasi Pengalaman Pengguna Website PPID UNDIKSHA dengan Metode User Experience Questionnaire (UEQ),” No. 5, Jun. 2024, DOI: https://doi.org/10.23887/insert.v5i1.70383.

A. Hinderks, A. L. Meiners, F. J. Domínguez-Mayo, and J. Thomaschewski, “Applying Importance-Performance Analysis (IPA) to Interpret the Results of the User Experience Questionnaire (UEQ),” Journal of Web Engineering, Vol. 19, No. 2, pp. 243–266, Jun. 2020, DOI: 10.13052/jwe1540-9589.1926.

W. F. Setiawan, A. Amirullah, and S. Rochimah, “Enhancing User Experience through UI Redesign using the UEQ+ Method,” 2025. DOI: 10.62527/joiv.9.6.

A. S. S. Ariyanto, “Analisis User Experience pada Aplikasi Voting berbasis Flutter: Studi Evaluasi menggunakan UEQ+,” METHOMIKA Jurnal Manajemen Informatika dan Komputerisasi Akuntansi, Vol. 8, No. 1, pp. 72–78, 2024, DOI: https://doi.org/10.46880/jmika.Vol8No1.pp72-78.

Z. Salsabila, F. Halim, A. F. F. P. Lumban gaol, and A. A. Hutauruk, “Penggunaan User Experience Questionnaire Plus (UEQ+) untuk mengevaluasi Pengalaman Pengguna Aplikasi Mypertamina,” REMIK: Riset dan E-Jurnal Manajemen Informatika Komputer, Vol. 7, No. 4, pp. 1856–1867, 2023, DOI: http://doi.org/10.33395/remik.v7i4.13052.

N. Putu Intan Karunia Dewi, A. Istri Ita Paramitha, I. Gst Agung Pramesti Dwi Putri, J. Tukad Badung No, D. Selatan, and K. Denpasar, “Evaluasi Pengalaman Pengguna Website ASTIKOM menggunakan Metode User Experience Questionnaire Plus (UEQ+),” 2026.

M. A. S. Toyon, “Explanatory Sequential Design of Mixed Methods Research: Phases and Challenges,” International Journal of Research in Business and Social Science (2147- 4478), Vol. 10, No. 5, pp. 253–260, Aug. 2021, DOI: 10.20525/ijrbs.v10i5.1262.

N. P. Pradani et al., “Pengaruh Kompensasi Non Finansial, Disiplin Kerja, dan Lingkungan Kerja terhadap Kinerja Karyawan PT. Inter Buana Mandiri,” 2025.

Devi Amitha Shofiani, Hotimah Khusnul, A Ramadhan Sakha, Karimullah Achmad, and Anshori M. Isa, “Mewawancarai Kandidat: Strategi untuk Meningkatkan Efisiensi dan Efektivitas,” MASMAN : Master Manajemen, Vol. 2, No. 2, pp. 66–78, 2024, DOI: 10.59603/masman.v2i2.387.

“Usability Starter Kit – Digital.gov.” Accessed: Jan. 12, 2026. [Online]. Available: https://digital.gov/resources/digitalgov-user-experience-resources/digitalgov-user-experience-program-usability-starter-kit

G. Aditama, B. Soedijono, and A. H. Muhammad, “Pengukuran User Experience Penggunaan Krapyak-U menggunakan Framework User Experience Questionaire Plus,” JATI (Jurnal Mahasiswa Teknik Informatika), Vol. 7, No. 2, pp. 1284–1290, 2023, DOI: 10.36040/jati.v7i2.6725.

M. Schrepp and J. Thomaschewski, “Handbook for the Modular Extension of the User Experience Questionnaire,” 2023. [Online]. Available: www.ueq-online.org




DOI: https://doi.org/10.32520/stmsi.v15i6.6483

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.