Advancing Health Workforce Education: Development and Psychometric Validation of the Challenges in Team-Based Learning Questionnaire (CTBLQ) in Vietnam

Pham Thi Kien; Leslie F Lazaro

doi:10.58418/ijni.v5i1.241

Authors

Pham Thi Kien Dong A University
Leslie F Lazaro Trinity University of Asia

DOI:

https://doi.org/10.58418/ijni.v5i1.241

Keywords:

Team-Based Learning, Nursing Students, Psychometric Validation, Questionnaire Development, Nursing Education, Vietnam

Abstract

Although Team-Based Learning (TBL) is widely adopted in health professions education to strengthen collaborative competencies, instruments specifically designed to identify barriers to its implementation remain limited, particularly in transitioning educational contexts. This study aimed to develop and psychometrically validate the Challenges in Team-Based Learning Questionnaire (CTBLQ) among undergraduate nursing students in Vietnam. A methodological research design was employed involving 280 undergraduate nursing students selected through stratified simple random sampling. The 18-item questionnaire underwent expert content evaluation and linguistic review before reliability testing and exploratory factor analysis. The CTBLQ demonstrated excellent internal consistency (Cronbach’s α = 0.910), and all corrected item–total correlations exceeded the recommended threshold of 0.30. Sampling adequacy was confirmed by a Kaiser–Meyer–Olkin value of 0.853, while Bartlett’s test of sphericity was statistically significant (χ²(153) = 4098.257, p < 0.001). Exploratory factor analysis supported a three-factor structure explaining 68.10% of the total variance, comprising learning preparation, participation, and motivation challenges; interpersonal and social conflict challenges; and learning benefit and team harmony challenges. Overall, the CTBLQ demonstrated satisfactory psychometric properties and provides a standardized diagnostic instrument for identifying barriers to Team-Based Learning implementation. The instrument may support evidence-informed curriculum evaluation, educational planning, and future research in nursing education while contributing to the advancement of health workforce education through improved implementation of collaborative learning.

References

Alberti, S., Motta, P., Ferri, P., & Bonetti, L. (2021). The effectiveness of team-based learning in nursing education: A systematic review. Nurse Education Today, 97, 104721. https://doi.org/10.1016/j.nedt.2020.104721

Alexander, E., White, A., Varol, A., Appel, K., & Lieneck, C. (2024). Team- and Problem-Based Learning in Health Services: A Systematic Literature Review of Recent Initiatives in the United States. Education Sciences, 14(5), 515. https://doi.org/10.3390/educsci14050515

Alizadeh, M., Bahrami, S., Saeedi, Z., & Khaninezhad, L. (2025). Outcomes of team based learning in teaching medical ethics: a systematic review. BMC Medical Ethics, 26(1), 184. https://doi.org/10.1186/s12910-025-01329-8

Alizadeh, M., Masoomi, R., Mafinejad, M. K., Parmelee, D., Khalaf, R. J., & Norouzi, A. (2024). Team-based learning in health professions education: an umbrella review. BMC Medical Education, 24(1), 1131. https://doi.org/10.1186/s12909-024-06147-x

Almarwani, A. M., & Alzahrani, N. S. (2023). Factors affecting the development of clinical nurses’ competency: A systematic review. Nurse Education in Practice, 73, 103826. https://doi.org/10.1016/j.nepr.2023.103826

Baris, V. K., Intepeler, S. S., & Unal, A. (2023). Development and psychometric validation of the Sickness Presenteeism Scale‐Nurse. International Journal of Nursing Practice, 29(5), e13168. https://doi.org/10.1111/ijn.13168

Burgess, A., van Diggele, C., Roberts, C., & Mellis, C. (2020). Team-based learning: design, facilitation and participation. BMC Medical Education, 20(S2), 461. https://doi.org/10.1186/s12909-020-02287-y

Burton, R., Kellett, U., Mansah, M., & Sriram, D. (2024). A systematic review of online team based learning approaches in health professional education. Nurse Education Today, 138, 106156. https://doi.org/10.1016/j.nedt.2024.106156

Chair, S. Y., Wong, F. K. Y., Bryant-Lukosius, D., Liu, T., & Jokiniemi, K. (2023). Construct validity of advanced practice nurse core competence scale: an exploratory factor analysis. BMC Nursing, 22(1), 57. https://doi.org/10.1186/s12912-023-01203-1

Choi, H.-G., & Ahn, S. H. (2021). Effects of a conflict resolution training program on nursing students: A quasi-experimental study based on the situated learning theory. Nurse Education Today, 103, 104951. https://doi.org/10.1016/j.nedt.2021.104951

Considine, J., Berry, D., Allen, J., Hewitt, N., Oldland, E., Sprogis, S. K., & Currey, J. (2021). Team‐based learning in nursing education: A scoping review. Journal of Clinical Nursing, 30(7–8), 903–917. https://doi.org/10.1111/jocn.15599

Dnyanesh, S., Shirahatti, A., Bhimalli, S. M., Yadav, S. K., & Dnyanesh, K. (2024). Team-based Learning (TBL) in Medical Education: Fostering Collaboration and Enhancing Learning Outcomes. Medical Journal of Dr. D.Y. Patil Vidyapeeth, 17(5), 1036–1042. https://doi.org/10.4103/mjdrdypu.mjdrdypu_908_23

Elsman, E. B. M., Mokkink, L. B., Terwee, C. B., Beaton, D., Gagnier, J. J., Tricco, A. C., Baba, A., Butcher, N. J., Smith, M., Hofstetter, C., Lee Aiyegbusi, O., Berardi, A., Farmer, J., Haywood, K. L., Krause, K. R., Markham, S., Mayo-Wilson, E., Mehdipour, A., Ricketts, J., … Offringa, M. (2024). Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024. Journal of Clinical Epidemiology, 173, 111422. https://doi.org/10.1016/j.jclinepi.2024.111422

Filomeno, L., Truglia, I., Mario, S. Di, Tartaglini, D., Ivziku, D., Muzio, M. Di, & Minciullo, A. (2026). Psychometric properties analysis of instruments assessing evidence based nursing barriers and implementation levels: A COSMIN systematic review of the literature. Teaching and Learning in Nursing, 21(1), e321–e331. https://doi.org/10.1016/j.teln.2025.08.014

Gunawan, J., Marzilli, C., & Aungsuroch, Y. (2021). Establishing appropriate sample size for developing and validating a questionnaire in nursing research. Belitung Nursing Journal, 7(5), 356–360. https://doi.org/10.33546/bnj.1927

Hill, E., Gurbutt, D., Makuloluwa, T., Gordon, M., Georgiou, R., Roddam, H., Seneviratne, S., Byrom, A., Pollard, K., Abhayasinghe, K., & Chance-Larsen, K. (2021). Collaborative healthcare education programmes for continuing professional education in low and middle-income countries: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 65. Medical Teacher, 43(11), 1228–1241. https://doi.org/10.1080/0142159X.2021.1962832

Ho, L., & Dimmock, C. (2023). Changing teachers’ beliefs and practices towards learner-centred education: experiences and lessons from Vietnam’s education system reforms. PRACTICE, 5(3), 200–219. https://doi.org/10.1080/25783858.2023.2177191

Ho, T.-T.-T., & Oh, J. (2022). Development and Evaluation of Cultural Competence Course on Undergraduate Nursing Students in Vietnam. International Journal of Environmental Research and Public Health, 19(2), 888. https://doi.org/10.3390/ijerph19020888

Horii, S., Nguyen, C. T. M., Pham, H. T. T., Amaike, N., Ho, H. T., & Aiga, H. (2021). Effectiveness of a standard clinical training program in new graduate nurses’ competencies in Vietnam: A quasi-experimental longitudinal study with a difference-in-differences design. PLOS ONE, 16(7), e0254238. https://doi.org/10.1371/journal.pone.0254238

Hsieh, L.-W., Chang, Y.-C., & Yen, M. (2022). Improving Leadership Competence Among Undergraduate Nursing Students: Innovative Objectives Development, Implementation, and Evaluation. Nursing Education Perspectives, 43(1), 24–29. https://doi.org/10.1097/01.NEP.0000000000000866

Imanipour, M., Ebadi, A., Monadi Ziarat, H., & Mohammadi, M. M. (2022). The effect of competency‐based education on clinical performance of health care providers: A systematic review and meta‐analysis. International Journal of Nursing Practice, 28(1), e13003. https://doi.org/10.1111/ijn.13003

Ing, M., Chinen, S., Jackson, K., & Smith, T. M. (2021). When Should I Use a Measure to Support Instructional Improvement at Scale? The Importance of Considering Both Intended and Actual Use in Validity Arguments. Educational Measurement: Issues and Practice, 40(1), 92–100. https://doi.org/10.1111/emip.12393

James, A. H., Watkins, D., & Carrier, J. (2022). Perceptions and experiences of leadership in undergraduate nurse education: A narrative inquiry. Nurse Education Today, 111, 105313. https://doi.org/10.1016/j.nedt.2022.105313

Khan, R. A., Spruijt, A., Mahboob, U., Al Eraky, M., & van Merrienboer, J. J. G. (2021). Development and validation of teacher and student questionnaires measuring inhibitors of curriculum viability. BMC Medical Education, 21(1), 405. https://doi.org/10.1186/s12909-021-02843-0

Kweon, Y.-R., & Park, J. (2023). Using the design-thinking method to develop and validate a peer evaluation scale for team-based learning (PES-TBL) for nursing students. Nurse Education Today, 127, 105849. https://doi.org/10.1016/j.nedt.2023.105849

Mansoor, J., Abdul Hameed, A., Zaidi, T. W., Naeem, F. U. A., Mansoor, F., Bilal, M., & Kadir, M. M. (2026). Use of case-based, problem-based and team-based learning in public health education – a scoping review. BMJ Open, 16(6), e108317. https://doi.org/10.1136/bmjopen-2025-108317

Mennenga, H. A. (2012). Development and Psychometric Testing of the Team-Based Learning Student Assessment Instrument. Nurse Educator, 37(4), 168–172. https://doi.org/10.1097/NNE.0b013e31825a87cc

Mikkonen, K., Tomietto, M., & Watson, R. (2022). Instrument development and psychometric testing in nursing education research. Nurse Education Today, 119, 105603. https://doi.org/10.1016/j.nedt.2022.105603

Mokkink, L. B., Elsman, E. B. M., & Terwee, C. B. (2024). COSMIN guideline for systematic reviews of patient-reported outcome measures version 2.0. Quality of Life Research, 33(11), 2929–2939. https://doi.org/10.1007/s11136-024-03761-6

Muraraneza, C., & Mtshali, G. N. (2021). Planning reform to competency based curricula in undergraduate nursing and midwifery education: A qualitative study. Nurse Education Today, 106, 105066. https://doi.org/10.1016/j.nedt.2021.105066

Ngoc, L. D. T., Dieu, T. D. N., Le Van, A., Duy, B. H., Thuy, V. P. T., Truong, S. N., Thanh, P. D. T., Duc, H. D., & Quynh, A. N. N. (2024). Enhancing Learning, Classroom Engagement, and Attitude Through Team-Based Learning among Vietnamese Nursing Students: A Quasi-Experimental Study. Pacific Rim International Journal of Nursing Research, 28(4), 885–897. https://doi.org/10.60099/prijnr.2024.268402

Nguyen, V. N. B., Hoang, A. P., Nguyen, T. T. H., & Nguyen, H. T. H. (2022). The development and professionalization of nursing in Vietnam. Nursing Forum, 57(4), 681–685. https://doi.org/10.1111/nuf.12712

Nyoni, C. N., & Goddard, V. C. T. (2021). Needs of early adopters in supporting a nursing curriculum innovation in a low resource setting: An exploratory case study. Nurse Education Today, 104, 105002. https://doi.org/10.1016/j.nedt.2021.105002

Phuong, N. T. A., Trang, H. T. T., Duc, T. N. M., Nguyet, T. T., Hang, T. T., Thao, N. T. T., & Huy, N. V. Q. (2020). Exploring Learning Strategies of Nursing Students at Hue University of Medicine and Pharmacy, Vietnam. Journal of Problem-Based Learning, 7(2), 74–85. https://doi.org/10.24313/jpbl.2020.00276

Putri, S. T., & Sumartini, S. (2021). Integrating Peer Learning Activities and Problem-Based Learning in Clinical Nursing Education. SAGE Open Nursing, 7, 23779608211000264. https://doi.org/10.1177/23779608211000262

Roossien, L., van Klaveren, L.-M., de Vos, R., Dolmans, D. H. J. M., & Boerboom, T. B. B. (2025). Team-based learning (TBL) in health professions education: A systematic review on its conceptual elements and outcomes. Medical Teacher, 47(12), 1933–1947. https://doi.org/10.1080/0142159X.2025.2506723

Stefana, A., Damiani, S., Granziol, U., Provenzani, U., Solmi, M., Youngstrom, E. A., & Fusar-Poli, P. (2025). Psychological, psychiatric, and behavioral sciences measurement scales: best practice guidelines for their development and validation. Frontiers in Psychology, 15, 1494261. https://doi.org/10.3389/fpsyg.2024.1494261

Sterpu, I., Herling, L., Nordquist, J., Rotgans, J., & Acharya, G. (2024). Team-based learning (TBL) in clinical disciplines for undergraduate medical students—a scoping review. BMC Medical Education, 24(1), 18. https://doi.org/10.1186/s12909-023-04975-x

Swan, K., Speyer, R., Scharitzer, M., Farneti, D., Brown, T., Woisard, V., & Cordier, R. (2023). Measuring what matters in healthcare: a practical guide to psychometric principles and instrument development. Frontiers in Psychology, 14, 1225850. https://doi.org/10.3389/fpsyg.2023.1225850

Tran, T. D., Vu, P. M., Pham, H. T. M., Au, L. N., Do, H. P., Doan, H. T. T., Huynh, N., Huynh, Q. T. V., Le, B. K., Ngo, D. Q., Nguyen, H. T. M., Nguyen, K. D., Nguyen, N. A., Nguyen, P. H., Nguyen, T. A., Tran, T. C., Chau, H. N., Vuong, L. N., & Vu, N. V. (2022). Transforming medical education to strengthen the health professional training in Viet Nam: A case study. The Lancet Regional Health - Western Pacific, 27, 100543. https://doi.org/10.1016/j.lanwpc.2022.100543

Ulfa, Y., Igarashi, Y., Takahata, K., Shishido, E., & Horiuchi, S. (2021). A comparison of team-based learning and lecture-based learning on clinical reasoning and classroom engagement: a cluster randomized controlled trial. BMC Medical Education, 21(1), 444. https://doi.org/10.1186/s12909-021-02881-8

White, M. (2022). Sample size in quantitative instrument validation studies: A systematic review of articles published in Scopus, 2021. Heliyon, 8(12), e12223. https://doi.org/10.1016/j.heliyon.2022.e12223

Williams, I., Rotimi, O., Burrows, L., Navaratnam, A. V., & Tan, N. (2025). Content Validity of Patient‐Reported Outcome Measures Developed for Assessing Disease‐Specific Quality of Life in Children With Sinonasal Disease: A Systematic Review. International Forum of Allergy & Rhinology, 15(3), 317–327. https://doi.org/10.1002/alr.23539

Yeung, M. M.-Y., Yuen, J. W.-M., Chen, J. M.-T., & Lam, K. K.-L. (2023). The efficacy of team-based learning in developing the generic capability of problem-solving ability and critical thinking skills in nursing education: A systematic review. Nurse Education Today, 122, 105704. https://doi.org/10.1016/j.nedt.2022.105704

Zhang, Q., Tang, X., Zhao, Y., & Wang, Z. (2023). Team-based learning vs. lecture-based learning in nursing: A systematic review of randomized controlled trials. Frontiers in Public Health, 10, 1044014. https://doi.org/10.3389/fpubh.2022.1044014