Integration of the Extended TAM and Operational Quality Indicators in the Evaluation of Web-based Information Systems: Systematic Literature Review

Jumadi Simangunsong, Faizal Asrul Pasaribu, Erna Susiyanti

Abstract


Web-based information systems are increasingly becoming integral to organizational operations, making the evaluation of system quality and user acceptance essential. This study aims to identify and synthesize approaches for integrating the Extended Technology Acceptance Model (TAM) with operational quality indicators in the evaluation of web-based information systems through a systematic literature review. The study employed a Systematic Literature Review (SLR) following the PRISMA 2020 protocol, covering 15 scientific articles published between 2019 and 2026 and retrieved from Google Scholar, Scopus, and IEEE Xplore. The selected articles focused on studies applying the TAM or Extended TAM with at least one operational quality indicator. The review findings show that the constructs of perceived usefulness (PU) and perceived ease of use (PEOU), along with external variables such as system quality, information quality, and service quality, consistently have significant effects on system acceptance and use. Integrating the Extended TAM with the DeLone and McLean model and the ISO/IEC 25010 standard provides a more comprehensive evaluation framework than using a single model. Three integration patterns were identified: sequential, parallel, and holistic. These findings suggest the development of an integrated evaluation instrument that incorporates both user acceptance dimensions and operational quality indicators to enhance the effectiveness of web-based information system evaluation.

Keywords


Evaluation; Information Systems; Operational Quality; Technology Acceptance Model; Web

Full Text:

PDF

References


Y. Wahyudin and D. N. Rahayu, “Analisis Metode Pengembangan Sistem Informasi berbasis Website: A Literatur Review,” J. Interkom J. Publ. Ilm. Bid. Teknol. Inf. Dan Komun., Vol. 15, No. 3, pp. 26–40, Oct. 2020, DOI: 10.35969/interkom.v15i3.74.

R. Darmadi, B. Panjaitan, I. Sumadikarta, R. S. Sitorus, and J. Simangunsong, “Penguatan Tata Kelola Perguruan Tinggi melalui Pengembangan Sistem Informasi Penjaminan Mutu Internal berbasis Web di Universitas Asa Indonesia,” J. Pengabdi. Masy. Bhinneka, Vol. 4, No. 4, pp. 5475–5484, Jul. 2026, DOI: 10.58266/jpmb.v4i4.1461.

F. D. Davis, “Perceived Usefulness, Perceived Ease of use, and User Acceptance of Information Technology,” MIS Q., Vol. 13, No. 3, pp. 319–340, Sep. 1989, DOI: 10.2307/249008.

V. Venkatesh and F. D. Davis, “A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies,” Manag. SCI., Vol. 46, No. 2, pp. 186–204, Feb. 2000, DOI: 10.1287/mnsc.46.2.186.11926.

F. A. Pasaribu, J. Simangunsong, and N. Hutagaol, “Implementation of a Reporting Application for the Testing Process and Results of Furniture Product at XYZ Company,” SISTEMASI, Vol. 14, No. 2, p. 942, Mar. 2025, DOI: 10.32520/stmsi.v14i2.5095.

J. Simangunsong, N. Hutagaol, and F. A. Pasaribu, “Implementasi Aplikasi Internal Service Order (ISO) berbasis Web pada Perusahaan Manufaktur Furniture,” J. Inform. J. Pengemb. IT, Vol. 9, No. 2, pp. 151–163, Aug. 2024, DOI: 10.30591/jpit.v9i2.6813.

“The DeLone and McLean Model of Information Systems Success: A Ten-Year Update,” J. Manag. Inf. Syst., Vol. 19, No. 4, pp. 9–30, Apr. 2003, DOI: 10.1080/07421222.2003.11045748.

“International Organization for Standardization.”

N. Hutagaol, F. A. Pasaribu, and J. Simangunsong, “ISO Technology Analysis with Extended TAM : A Case Study in PT Ebako Nusantara,” J. Sisfokom Sist. Inf. Dan Komput., Vol. 14, No. 1, pp. 92–100, Jan. 2025, DOI: 10.32736/sisfokom.v14i1.2371.

Y. K. Dwivedi, N. P. Rana, A. Jeyaraj, M. Clement, and M. D. Williams, “Re-Examining the Unified Theory of Acceptance and Use of Technology (UTAUT): Towards a Revised Theoretical Model,” Inf. Syst. Front., Vol. 21, No. 3, pp. 719–734, Jun. 2019, DOI: 10.1007/s10796-017-9774-y.

C. Gupta, V. Gupta, and A. Stachowiak, “Adoption of ICT-based Teaching in Engineering: An Extended Technology Acceptance Model Perspective,” IEEE Access, Vol. 9, pp. 58652–58666, 2021, DOI: 10.1109/ACCESS.2021.3072580.

F. A. Pasaribu, J. Simangunsong, and K. P. Arianty, “Evaluation of a Furniture Product Testing Process and Results Reporting Application using the Extended Technology Acceptance Model (TAM) at XYZ Company,” SISTEMASI, Vol. 15, No. 3, p. 1095, Mar. 2026, DOI: 10.32520/stmsi.v15i3.6198.

M. A. Kofahi, H. Hassan, and R. Mohamad, “DeLone and McLean Information Systems Success Model: A Literature Review,” Int. J. Bus. Inf. Syst., Vol. 48, No. 4, pp. 452–481, 2025, DOI: 10.1504/IJBIS.2025.145551.

M. D. Mulyawan, I. N. S. Kumara, I. B. A. Swamardika, and K. O. Saputra, “Kualitas Sistem Informasi berdasarkan ISO/IEC 25010: Literature Review,” Maj. Ilm. Teknol. Elektro, Vol. 20, No. 1, p. 15, Mar. 2021, DOI: 10.24843/MITE.2021.v20i01.P02.

U. U. Sufandi and D. A. Aprijani, “Pengukuran Usability Aplikasi Web menggunakan Metode Pssuq (Study Kasus: Aplikasi Sitta Universitas Terbuka),” JST J. Sains dan Teknol., Vol. 11, No. 2, pp. 249–256, Aug. 2022, DOI: 10.23887/jstundiksha.v11i2.43534.

N. Hutagaol, F. A. Pasaribu, and J. Simangunsong, “ISO Technology Analysis with Extended TAM : A Case Study in PT Ebako Nusantara,” J. Sisfokom Sist. Inf. Dan Komput., Vol. 14, No. 1, pp. 92–100, Jan. 2025, DOI: 10.32736/sisfokom.v14i1.2371.

A. Vatresia and T. Pasaribu, “Analisis Kesuksesan Sistem Informasi Manajemen Daerah (SIMDA) dengan Metode Delone dan Mclean Success Model dan Technology Acceptance Model (TAM),” J Sist. Info Bisnis, Vol. 13, No. 1, pp. 70–77, Aug. 2023, DOI: 10.21456/vol13iss1pp70-77.

T. Puspitasari, A. Kusumawati, and S. Sujarwoto, “Aplikasi Model DeLone and McLean untuk mengukur Keberhasilan Sistem Informasi Penelitian dan Pengabdian Masyarakat di Universitas Brawijaya,” J. Sist. Inf. BISNIS, Vol. 10, No. 1, pp. 94–104, Jun. 2020, DOI: 10.21456/vol10iss1pp94-104.

Y. Riady, M. Sofwan, M. Mailizar, T. M. Alqahtani, L. N. Yaqin, and A. Habibi, “How can We Assess the Success of Information Technologies in Digital Libraries? Empirical Evidence from Indonesia,” Int. J. Inf. Manag. Data Insights, Vol. 3, No. 2, p. 100192, Nov. 2023, DOI: 10.1016/j.jjimei.2023.100192.

M. J. Page et al., “The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews,” BMJ 2021372n71, pp. 1–9, 2021, DOI: https://doi.org/10.1136/bmj.n71.

Q. Zheng, C. Li, and S. Bai, “Evaluating the Couriers’ Experiences of Logistics Platform: The Extension of Expectation Confirmation Model and Technology Acceptance Model,” Front. Psychol., Vol. 13, p. 998482, Sep. 2022, DOI: 10.3389/fpsyg.2022.998482.

A. A. B. D. P. Dewangga, D. Ariyanto, M. G. Wirakusuma, and I. K. Sujana, “Integrasi Model DeLone & McLean, UTAUT, dan HOT-Fit untuk menilai Keberhasilan dan Keberterimaan Aplikasi LPD Mobile di Bali,” J. Sist. Inf. Bisnis, Vol. 15, No. 1, pp. 34–44, Feb. 2025, DOI: 10.14710/vol15iss1pp34-44.




DOI: https://doi.org/10.32520/stmsi.v15i9.6920

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.