Evaluation of the Implementation of a Learning Management System (LMS) in Health Higher Education Institutions

Ewin Suciana; Al-Bahra Al-Bahra; Siti Madinah Ladjamuddin

doi:10.46749/jiko.v10i2.223

Evaluation of the Implementation of a Learning Management System (LMS) in Health Higher Education Institutions

Ewin Suciana, Al-Bahra Al-Bahra, Siti Madinah Ladjamuddin

Abstract

This study aims to evaluate the implementation of a Learning Management System (LMS) in a health sciences higher education institution by analyzing system quality, information quality, service quality, LMS usage, user satisfaction, learning engagement, and learning outcomes. A quantitative approach was employed, utilizing a survey design involving students and lecturers as LMS users. The evaluation was developed based on the DeLone and McLean information systems success model, extended to include the constructs of learning engagement and learning outcomes. The results indicate that the overall implementation of the LMS falls into the "effective" category, with an average score of 4.00 on a 5-point scale. Information quality received the highest score (4.12), followed by system quality (4.08), user satisfaction (4.06), LMS usage (4.01), learning engagement (3.94), and learning outcomes (3.91). Analysis of the relationships between variables reveals that system quality, information quality, and service quality positively influence LMS usage and user satisfaction. Furthermore, LMS usage contributes to user satisfaction, while satisfaction is positively associated with learning engagement. Learning engagement emerged as the strongest predictor of learning outcomes. These findings demonstrate that LMS success is determined not only by technological quality but also by content quality, service support, usage intensity, satisfaction, and active student engagement. The study recommends strengthening infrastructure, content quality, technical support, and interactive learning, as well as utilizing learning analytics to enhance LMS effectiveness in health sciences higher education.

Keywords

Learning Management System; Health Sciences Higher Education; System Quality; Information Quality; Learning Outcomes

Full Text:

PDF

References

Rohwer, A., Motaze, N. V., Rehfuess, E., & Young, T. (2017). E-learning of evidence-based health care (EBHC) to increase EBHC competencies in healthcare professionals: A systematic review. Campbell Systematic Reviews. https://doi.org/10.4073/csr.2017.4

Richmond, H., Copsey, B., Hall, A. M., Davies, D., & Lamb, S. E. (2017). A systematic review and meta-analysis of online versus alternative methods for training licensed health care professionals to deliver clinical interventions. BMC Medical Education, 17, 227. https://doi.org/10.1186/s12909-017-1047-4

Nicoll, P., MacRury, S., van Woerden, H. C., & Smyth, K. (2018). Evaluation of technology-enhanced learning programs for health care professionals: Systematic review. Journal of Medical Internet Research, 20(4), e131. https://doi.org/10.2196/jmir.9085

Moreau, K. A., Eady, K., Sikora, L., & Horsley, T. (2018). Digital storytelling in health professions education: A systematic review. BMC Medical Education, 18, 208. https://doi.org/10.1186/s12909-018-1320-1

Fontaine, G., Cossette, S., Maheu-Cadotte, M.-A., et al. (2019). Efficacy of adaptive e-learning for health professionals and students: A systematic review and meta-analysis. BMJ Open, 9(8), e025252. https://doi.org/10.1136/bmjopen-2018-025252

Cabero-Almenara, J., Arancibia, M. L., & Del Prete, A. (2019). Technical and didactic knowledge of the Moodle LMS in higher education: Beyond functional use. Journal of New Approaches in Educational Research, 8, 25–33. https://doi.org/10.7821/naer.2019.1.327

Tagoe, M. A., & Cole, Y. (2020). Using the Sakai Learning Management System to change the way distance education nursing students learn: Are we getting it right? Open Learning, 35(3), 201–221. https://doi.org/10.1080/02680513.2019.1704232

Kite, J., Schlub, T. E., Zhang, Y., Choi, S., Craske, S., & Dickson, M. (2020). Exploring lecturer and student perceptions and use of a learning management system in a postgraduate public health environment. Journal of Learning Analytics, 7(1). https://doi.org/10.1177/2042753020909217

Yawson, D. E., & Yamoah, F. A. (2020). Understanding satisfaction essentials of e-learning in higher education: A multi-generational cohort perspective. Heliyon, 6(11), e05519. https://doi.org/10.1016/j.heliyon.2020.e05519

Alzahrani, L., & Seth, K. P. (2021). Factors influencing students’ satisfaction with continuous use of learning management systems during the COVID-19 pandemic: An empirical study. Education and Information Technologies, 26, 6787–6805. https://doi.org/10.1007/s10639-021-10492-5

Nkomo, L. M., Daniel, B. K., & Butson, R. J. (2021). Synthesis of student engagement with digital technologies: A systematic review of the literature. International Journal of Educational Technology in Higher Education, 18, 34. https://doi.org/10.1186/s41239-021-00270-1

Thepwongsa, I., Sripa, P., Muthukumar, R., et al. (2021). The effects of a newly established online learning management system: The perspectives of Thai medical students in a public medical school. Heliyon, 7(10), e08182. https://doi.org/10.1016/j.heliyon.2021.e08182

Teng, Y., & Wang, X. (2021). The effect of two educational technology tools on student engagement in Chinese EFL courses. International Journal of Educational Technology in Higher Education, 18, 27. https://doi.org/10.1186/s41239-021-00263-0

Prosen, M., Karnjuš, I., & Ličen, S. (2022). Evaluation of e-learning experience among health and allied health professions students during the COVID-19 pandemic in Slovenia: An instrument development and validation study. International Journal of Environmental Research and Public Health, 19(8), 4777. https://doi.org/10.3390/ijerph19084777

Wahab, S., & Dubrowski, A. (2022). Adapting the Gamified Educational Networking (GEN) Learning Management System to deliver a virtual simulation training module to determine the enhancement of learning and performance outcomes. Cureus, 14(6), e26332. https://doi.org/10.7759/cureus.26332

Naeem, N.-i.-K., Yusoff, M. S. B., Hadie, S. N. H., & Ismail, I. M. (2023). Understanding the functional components of technology-enhanced learning environment in medical education: A scoping review. Medical Science Educator, 33, 595–609. https://doi.org/10.1007/s40670-023-01747-6

Chugh, R., Turnbull, D., & Cowling, M. A. (2023). Implementing educational technology in higher education institutions: A review of technologies, stakeholder perceptions, frameworks and metrics. Education and Information Technologies, 28, 16403–16429. https://doi.org/10.1007/s10639-023-11846-x

Simona, P., Jiang, J., & Fryer, L. K. (2024). Measurement of higher education students’ and teachers’ experiences in learning management systems: A scoping review. Assessment & Evaluation in Higher Education, 49(4), 441–452. https://doi.org/10.1080/02602938.2023.2266154

Hussan, F., Er, H. M., & Nadarajah, V. D. (2024). Health professions students’ acceptance and readiness for learning analytics: Lessons for educators. BMC Medical Education, 24, 1347. https://doi.org/10.1186/s12909-024-06284-3

Herniawati, A., Holifah, L., & Syakur, A. (2025). The effectiveness of Learning Management System (LMS) use in higher education. International Journal Corner of Educational Research, 4(1), 20–29. https://doi.org/10.54012/ijcer.v4i1.625

Atukunda, P., Khabusi, S. P., & Othieno, J. (2024). Analysis of user satisfaction of e-learning systems in Uganda using DeLone and McLean model. Discover Education, 3, 194. https://doi.org/10.1007/s44217-024-00304-6

Efendif, Y., & Karyan, A. (2024). Investigating the influence of the updated DeLone and McLean information system (IS) success model on the effectiveness of learning management system (LMS) implementation. https://doi.org/10.1080/2331186X.2024.2365611

Kamath, S. G., Nayak, K. R., Nayak, V., & Verma, S. (2025). Leveraging learning management systems in medical education: A scoping review of use, outcomes, and improvement pathways. Medical Education Online, 30(1), 2603805. https://doi.org/10.1080/10872981.2025.2603805

Muruthy, A. E., & Mat Yamin, F. (2017). The perception and effectiveness of learning management system (LMS) usage among the higher education students. Journal of Technology and Operations Management, 12(1), 86–98. https://doi.org/10.32890/jtom2017.12.1.10

Rucker, R. D., & Frass, L. R. (2017). Migrating learning management systems in higher education: Faculty members’ perceptions of system usage and training when transitioning from Blackboard Vista to Desire2Learn. Journal of Educational Technology Systems, 46(2). https://doi.org/10.1177/0047239517711954

Kitcharoen, S. (2018). User satisfaction with learning management system (LMS): A case of Assumption University. AU-GSB e-Journal, 11(2).

Ohliati, J., & Abbas, B. S. (2019). Measuring students satisfaction in using learning management system. International Journal of Emerging Technologies in Learning, 14(4), 180–189. https://doi.org/10.3991/ijet.v14i04.9427

Yuen, A. H. K., Cheng, M., & Chan, F. H. F. (2019). Student satisfaction with learning management systems: A growth model of belief and use. British Journal of Educational Technology, 50(5), 2520–2535. https://doi.org/10.1111/bjet.12830

Bervell, B., & Arkorful, V. (2020). LMS-enabled blended learning utilization in distance tertiary education: Establishing the relationships among facilitating conditions, voluntariness of use and use behaviour. International Journal of Educational Technology in Higher Education, 17, 6. https://doi.org/10.1186/s41239-020-0183-9

Fearnley, M. R., & Amora, J. T. (2020). Learning management system adoption in higher education using the extended Technology Acceptance Model. IAFOR Journal of Education, 8(2). https://doi.org/10.22492/ije.8.2.05

Koh, J. H. L., & Kan, R. Y. P. (2020). Perceptions of learning management system quality, satisfaction, and usage: Differences among students of the arts. Australasian Journal of Educational Technology, 36(3), 26–40. https://doi.org/10.14742/ajet.5187

Tubagus, M., Muslim, S., & Suriani, S. (2020). Development of learning management system-based blended learning model using Claroline in higher education. International Journal of Interactive Mobile Technologies, 14(6), 186–194. https://doi.org/10.3991/ijim.v14i06.13399

Yakubu, M. N., Dasuki, S. I., Abubakar, A. M., et al. (2020). Determinants of learning management systems adoption in Nigeria: A hybrid SEM and artificial neural network approach. Education and Information Technologies, 25, 3515–3539. https://doi.org/10.1007/s10639-020-10110-w

Mohammadi, M. K., Mohibbi, A. A., & Hedayati, M. H. (2021). Investigating the challenges and factors influencing the use of the learning management system during the Covid-19 pandemic in Afghanistan. Education and Information Technologies, 26, 5165–5198. https://doi.org/10.1007/s10639-021-10517-z

Si, J. (2022). Critical e-learning quality factors affecting student satisfaction in a Korean medical school. Korean Journal of Medical Education, 34(2), 107–119. https://doi.org/10.3946/kjme.2022.223

Osman, S. Z. M. (2022). Combining synchronous and asynchronous learning: Student satisfaction with online learning using learning management systems. Journal of Education and e-Learning Research, 9(3), 147–154. https://doi.org/10.20448/jeelr.v9i3.4103

Dangaiso, P., Makudza, F., & Hogo, H. (2022). Modelling perceived e-learning service quality, student satisfaction and loyalty: A higher education perspective. Cogent Education. https://doi.org/10.1080/2331186X.2022.2145805

Mella-Norambuena, J., Chiappe, A., & Badilla-Quintana, M. G. (2025). Theoretical and empirical models underlying the teaching use of LMS platforms in higher education: A systematic review. Journal of Computers in Education, 12, 997–1023. https://doi.org/10.1007/s40692-024-00336-9

DOI: https://doi.org/10.46749/jiko.v10i2.223