Limitations of the MBI-HSS in Colombian health personnel psychometric Evaluation after modification of its response options
Article Sidebar
Main Article Content
Objective:
To establish the construct validity, internal consistency, and difficulty and discrimination of the items in the Maslach Burnout Inventory- Human Services Survey, with modified response options, for measuring burnout in healthcare workers in Colombia.
Methods:
A descriptive study of validation of measurement instruments was conducted. With the support of a panel of experts, the response options were modified, and the new version was administered to 377 healthcare workers. Internal consistency was evaluated, and confirmatory factor analysis was conducted to assess the structural construct validity. The structural Equation Modeling model was calculated using the diagonally weighted least squares estimation method. Finally, item discrimination and difficulty thresholds of the response options were calculated using the generalized partial credit model of Item Response Theory.
Results:
The emotional exhaustion and personal accomplishment subscales showed good internal consistency (α= 0.87 and 0.77), while the depersonalization subscale was low (0.45). The confirmatory factor analysis indicated an acceptable but not ideal fit (NFI and RFI <0.95; RMSEA >0.06). Inadequate functioning of the response options and measurement bias were identified.
Conclusions:
The previously validated version of the Maslach Burnout Inventory- Human Services Survey and the adapted version in this study have limitations in Colombian healthcare workers, especially in the depersonalization subscale. A thorough revision is suggested to appropriately measure burnout in healthcare personnel in our context.
- Maslach Burnout Inventory
- Emotional Exhaustion
- Depersonalization
- Latent Class Analysis
- Least-Squares Analysis
- Burnout, Professional
- Factor Analysis, Statistical
- Delivery of Health Care
Ana Carolina Amaya Arias, Sociedad Coolombiana de Anestesiología y Reanimación.
https://orcid.org/0000-0002-6266-8482Fabián Jaimes, Universidad de Antioquia
Jenny Garcia-Valencia, Universidad de Antioquia
Maslach C, Schaufeli WB, Leiter MP. Job burnout. Annual review of psychology. 2001;52(1):397-422. https://doi.org/10.1146/annurev.psych.52.1.397 PMid:11148311 DOI: https://doi.org/10.1146/annurev.psych.52.1.397
Al-Ghunaim TA, Johnson J, Biyani CS, Alshahrani KM, Dunning A, O'Connor DB. Surgeon burnout, impact on patient safety and professionalism: A systematic review and meta- analysis. Am J Surg. 2022; 224(1, Part A): 228-238. https://doi.org/10.1016/j.amjsurg.2021.12.027 PMid:34974884 DOI: https://doi.org/10.1016/j.amjsurg.2021.12.027
Jun J, Ojemeni MM, Kalamani R, Tong J, Crecelius ML. Relationship between nurse burnout, patient and organizational outcomes: Systematic review. Internat J Nursing Studies. 2021; 119: 103933. https://doi.org/10.1016/j.ijnurstu.2021.103933 PMid:33901940 DOI: https://doi.org/10.1016/j.ijnurstu.2021.103933
Maslach C, Jackson SE. The measurement of experienced burnout. J Organizational Behavior. 1981; 2(2): 99-113. https://doi.org/10.1002/job.4030020205 DOI: https://doi.org/10.1002/job.4030020205
Gil-Monte PR. Factorial validity of the Maslach Burnout Inventory (MBI-HSS) among Spanish professionals. Rev Saúde Pública. 2005; 39(1): 1-8. https://doi.org/10.1590/S0034-89102005000100001 PMid:15654454 DOI: https://doi.org/10.1590/S0034-89102005000100001
Gil-Monte PR, Zuñiga-Caballero LC. Validez factorial del "Cuestionario para la Evaluación del Síndrome de Quemarse por el Trabajo" (CESQT) en una muestra de médicos mexicanos. 2010; 9(1): 169-178. https://doi.org/10.11144/Javeriana.upsy9-1.vfce DOI: https://doi.org/10.11144/Javeriana.upsy9-1.vfce
Portoghese I, Leiter MP, Maslach C, Galletta M, Porru F, D'Aloja E, et al. Measuring Burnout among university students: factorial validity, invariance, and latent profiles of the italian version of the Maslach Burnout Inventory Student Survey (MBI-SS). Frontiers Psychol. 2018; 9: 2105. https://doi.org/10.3389/fpsyg.2018.02105 PMid:30483171 PMCid:PMC6240654 DOI: https://doi.org/10.3389/fpsyg.2018.02105
Matejic B, Milenovic M, Kisic Tepavcevic D, Simic D, Pekmezovic T, Worley JA. Psychometric properties of the serbian version of the maslach burnout inventory-human services survey: a validation study among anesthesiologists from Belgrade Teaching Hospitals. Scient World J. 2015; 2015: 903597. https://doi.org/10.1155/2015/903597 PMid:26090517 PMCid:PMC4454751 DOI: https://doi.org/10.1155/2015/903597
Khani MH, Mohammadi M, Anvari F, Farsi M. Students School Burnout Inventory: Development, Validation, and Reliability of Scale. Internat J School Health. 2018; 5(1): p. 1-6. https://doi.org/10.5812/intjsh.57594 DOI: https://doi.org/10.5812/intjsh.57594
Bria M, Spânu F, Baban A, Dumitrascu DL. Maslach burnout inventory-general survey: factorial validity and invariance among Romanian healthcare professionals. Burn Res. 2014;1(3):103-111. https://doi.org/10.1016/j.burn.2014.09.001 DOI: https://doi.org/10.1016/j.burn.2014.09.001
Kristensen TS, Borritz M, Villadsen E, Christensen KB. The Copenhagen Burnout Inventory: A new tool for the assessment of burnout. Work Stress. 2005;19(3):192-207. https://doi.org/10.1080/02678370500297720 DOI: https://doi.org/10.1080/02678370500297720
Pando MM, Aranda BC, López PMdR. Validez factorial del Maslach Burnout Inventory-General Survey en ocho países latinoamericanos. Ciencia Trabajo. 2015; 17(52): 28-31. https://doi.org/10.4067/S0718-24492015000100006 DOI: https://doi.org/10.4067/S0718-24492015000100006
Córdoba L, Tamayo JA, González MA, Martínez MI, Rosales A, Barbato SH. Adaptation and validation of the Maslach Burnout inventory-human services survey in Cali, Colombia. Colomb Méd. 2011;42(3):286-293. https://doi.org/10.25100/cm.v42i3.874 DOI: https://doi.org/10.25100/cm.v42i3.874
Ministerio de Salud. Resolución 2646: Por la cual se establecen disposiciones y se definen responsabilidades para la identificación, evaluación, prevención, intervención y monitoreo permanente de la exposición a factores de riesgo psicosocial en el trabajo y para la determinación del origen de las patologías causadas por el estrés ocupacional. Bogotá: Ministerio de Salud; 2008.
Congreso de Colombia. Ley 1562 Por la cual se modifica el Sistema de Riesgos Laborales y se dictan otras disposiciones en materia de Salud Ocupacional. Bogotá: . Congreso de Colombia; 2012.
COSMIN. Checklist for Assessing study qualities. Accessed: agosto 7 2018; s.f. https://www.cosmin.nl/tools/ checklists-assessing-methodological-study-qualities/
Mokkink L, Terwee C, Patrick D, Alonso J, Strat-ford P, Knol D. International consensus on taxonomy, terminology, and definitions of measurement properties for health- related patient reported outcomes: results of the COSMIN study. J Clin Epidemiol. 2010; 63(7): 737-45. https://doi.org/10.1016/j.jclinepi.2010.02.006 PMid:20494804 DOI: https://doi.org/10.1016/j.jclinepi.2010.02.006
Ortiz MS, Fernández-Pera M. Modelo de ecuaciones estructurales: una guía para ciencias médicas y ciencias de la salud. Terapia Psicológica. 2018; 36(1): 51-57. https://doi.org/10.4067/s0718-48082017000300047 DOI: https://doi.org/10.4067/s0718-48082017000300047
Li C-H. The performance of ML, DWLS, and ULS estimation with robust corrections in structural equation models with ordinal variables. Psychological Methods. 2016; 21(3): 369. https://doi.org/10.1037/met0000093 PMid:27571021 DOI: https://doi.org/10.1037/met0000093
Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: A review. J Educational Res. 2006; 99(6): 323-338. https://doi.org/10.3200/JOER.99.6.323-338 DOI: https://doi.org/10.3200/JOER.99.6.323-338
Guevara BLM, Ocampo AN. Propiedades psicométricas de confiabilidad y validez del Maslach Burnout Inventory-General Survey. Rev Interamericana Psicol Ocupac. 2016; 33(2): 128-142. https://doi.org/10.21772/ripo DOI: https://doi.org/10.21772/ripo.v33n2a04
Escobar-Pérez J, Cuervo-Martínez A. Validez de contenido y juicio de expertos: una aproximación a su utilización. Avances Medición. 2008; 6: 27-36.
Cañadas I, Sánchez A. Categorías de respuesta en escalas tipo Likert. Psicothema. 1998; 10(3): 623-631.
Martínez R. Psicometría: Teoría de los test psicológicos y educativos. Síntesis; 1995.
Brown FG. Principios de la medición en psicología y educación. Manual Moderno; 1980.
De Vet HC, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide. Cambridge University Press; 2011. https://doi.org/10.1017/CBO9780511996214 DOI: https://doi.org/10.1017/CBO9780511996214
Rhemtulla M, Brosseau-Liard PÉ, Savalei V. When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods. 2012; 17(3): 354. https://doi.org/10.1037/a0029315 PMid:22799625 DOI: https://doi.org/10.1037/a0029315
Freiberg HA, Stover JB, de la Iglesia G, Fernández LM. Correlaciones policóricas y tetracóricas en estudios factoriales exploratorios y confirmatorios. Ciencias Psicológicas. 2013; 7(2): 151-164. https://doi.org/10.22235/cp.v7i1.1057 DOI: https://doi.org/10.22235/cp.v7i1.1057
Özdemir HF, Toraman Ç, Kutlu Ö. The use of polychoric and Pearson correlation matrices in the determination of construct validity of Likert type scales. Turkish J Education. 2019; 8(3): 180-195. https://doi.org/10.19128/turje.519235 DOI: https://doi.org/10.19128/turje.519235
de Ayala RJ. The theory and practice of item response theory. Guilford Publications; 2013.
Embretson SE, Reise SP. Item response theory. Psychology Press; 2013. https://doi.org/10.4324/9781410605269 DOI: https://doi.org/10.4324/9781410605269
Baker FB. The basics of item response theory. ERIC; 2001.
Bollen KA, Noble MD. Structural equation models and the quantification of behavior. Proceedings National Academy Sci. 2011; 108(supplement 3): 15639-15646. https://doi.org/10.1073/pnas.1010661108 PMid:21730136 PMCid:PMC3176611 DOI: https://doi.org/10.1073/pnas.1010661108
Gilla MA, Belén Giménez S, Moran VE, Olaz FO. Adaptación y validación del Inventario de Burnout de Maslach en profesionales argentinos de la salud mental. Liberabit. 2019;25(2):179-193. https://doi.org/10.24265/liberabit.2019.v25n2.04 DOI: https://doi.org/10.24265/liberabit.2019.v25n2.04
Lara RMM, Jiménez BM, Muñoz AR, Benadero MEM, Viveros GRO. Análisis factorial confirmatorio del MBI-HSS en una muestra de psicólogos mexicanos. Psicología Salud. 2008;18(1):107-116. https://doi.org/10.25009/pys.v18i1.681
Olivares-Faúndez V, Mena-Miranda L, Jélvez-Wilker C, Macía-Sepúlveda F. Validez factorial del Maslach Burnout Inventory human services (MBI-HSS) en profesionales Chilenos. Universitas Psychologica. 2014;13(1):145-159. https://doi.org/10.11144/Javeriana.UPSY13-1.vfmb DOI: https://doi.org/10.11144/Javeriana.UPSY13-1.vfmb
Calderón-De la Cruz GA, Merino-Soto CS. Análisis de la estructura interna del Maslach Burnout Inventory (Human Service Survey) en médicos peruanos. Rev Ciencias Salud. 2020; 18(2): 1-17. https://doi.org/10.12804/revistas.urosario.edu.co/revsalud/a.9275 DOI: https://doi.org/10.12804/revistas.urosario.edu.co/revsalud/a.9275
Babbie ER. The practice of social research. Cengage learning; 2020.
Downloads
Funding data
-
Ministerio de Ciencia, Tecnología e Innovación
Grant numbers 757-2016
Accepted 2025-02-25
Published 2024-09-30
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
The copy rights of the articles published in Colombia Médica belong to the Universidad del Valle. The contents of the articles that appear in the Journal are exclusively the responsibility of the authors and do not necessarily reflect the opinions of the Editorial Committee of the Journal. It is allowed to reproduce the material published in Colombia Médica without prior authorization for non-commercial use