Internal consistency and content validity of DELBI scale
Keywords:
Questionnaires, Practice guidelines, Breast neoplasm, Prostatic neoplasms, Colonic neoplasms, Health services research, Health care quality indicatorsAbstract
Objectives: To assess internal consistency and content validity of the DELBI scale used to evaluate clinical practice guidelines (CPG).
Methods: The DELBI scale was applied to a selection of 146 CPG for breast, colorectal and prostate cancer. Internal consistency of the full scale and by domains was assessed using Cronbach‘s alpha coefficient, and the content validity was assessed using an Exploratory Factor Analysis (EFA) with orthogonal rotation and a Confirmatory Factor Analysis (CFA) applying structural equation modelling. Bartlett’s test of sphericity and KMO test were used to determine the factorability of the intercorrelation matrix, with the ordinal nature of the item-scores as a Likert-type scale. Estimation methods were performed using polychoric correlation, and asymptotic covariance matrices.
Results: For the full scale, a good internal consistency was observed (0.89), which varies between 0.46 and 0.74 by domains. A four-factor structure was found: applicability, clarity and presentation, rigour of development, and stakeholder involvement. The goodness-of-fit tests of the scale organised by 4 domains was better than the 8 domains from the original scale and had a better internal consistency.
Conclusions: It is concluded that the scale has acceptable psychometric properties and it is suggested to consider four dimensions of quality of CPGs in the interpretation of the evaluations performed with the DELBI scale.
Author Biographies
Fabio Sierra, Instituto Nacional de Cancerología
Grupo de Investigación Clínica, Instituto Nacional de Cancerología, Bogotá D. C., Colombia
Esperanza Peña, Instituto Nacional de Cancerología
Grupo de Investigación Clínica, Instituto Nacional de Cancerología, Bogotá D. C., Colombia
Magda Alba, Instituto Nacional de Cancerología
Grupo de Investigación Clínica, Instituto Nacional de Cancerología, Bogotá D. C., Colombia
Ricardo Sánchez, Instituto Nacional de Cancerología
Grupo de Investigación Clínica, Instituto Nacional de Cancerología, Bogotá D. C., Colombia
Facultad de Medicina, Universidad Nacional de Colombia, Bogotá D. C., Colombia
References
International Agency for Research on Cancer (IARC). GLOBO- CAN 2008 [internet]. 2008 [citado 2010 jun 6]. Disponible en: http://globocan.,iarc.,fr/.
Hayward RS, Wilson MC, Tunis SR, Bass EB, Guyatt G. Users' guides to the medical literature. VIII. How to use clinical practice guidelines. A. Are the recommendations valid? The EvidenceBased Medicine Working Group. JAMA. 1995;274(7):570-4.
https://doi.org/10.1001/jama.1995.03530070068032
Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318(7182):527-30.
https://doi.org/10.1136/bmj.318.7182.527
Lohr K, Field M. A provisional instrument for assessing clinical practice guidelines. En: Field M, Lohr K, editores. Guidelines for clinical practice From development to use. Washington, D.C: National Academy Press; 1992.
Ministerio de la Protección Social, Colciencias, Centro de Estudios e Investigación en Salud de la Fundación Santa Fe de Bogotá, Escuela de Salud Pública de la Universidad de Harvard. Guía Metodológica para la elaboración de Guías Atención Integral en el Sistema General de Seguridad Social en Salud Colombiano. Bogotá; 2010.
Lozano JM, Cuervo LG. Desarrollo de guías de práctica clínica. En: Ruiz AM, Luis, editores. Epidemiología clínica: investigación clínica aplicada. Bogotá: Editorial Médica Internacional; 2004. p. 373-94.
The ADAPTE Collaboration. Resource toolkit for guideline adaptation, versión 1.0 [Internet]. 2007. Disponible en: http://www.adapte.org/
Fervers B, Burgers JS, Haugh MC, Latreille J, Mlika-Cabanne N, Paquet L, et al. Adaptation of clinical guidelines: literature review and proposition for a framework and procedure. Int J Qual Health Care. 2006;18(3):167-76.
https://doi.org/10.1093/intqhc/mzi108
Haute Autorité de Santé. Méthode et processus d'adaptation des recommendations pour la practique clinique existantes. Guide Méthodologique, HAS, 2007 [citado 2013 oct 10]. Disponible en: http://www.has-sante.fr
Graham ID, Harrison MB. Evaluation and adaptation of clinical practice guidelines. Evid Based Nurs. 2005;8(3):68-72.
https://doi.org/10.1136/ebn.8.3.68
German Instrument for Methodological Guideline Appraisal. Deutsches Instrument zur methodischen Leitlinien-Bewertung (DELBI). Version 2005/2006. Disponible en: http://www.english.delbi.de
Agree collaboration. Introduction to AGREE II [internet]. 2013 [citado 2013 oct 10]. Disponible en: http://www.agreetrust.org
von Troschkel J, Selbmann HK, Encke A. Health services research and guidelines-from the Association of the Scientific Medical Societies' (AWMF) perspective. Z Arztl Fortbild Qualitatssich. 2006;100(8):597-602.
Dans AL, Dans LF. Appraising a tool for guideline appraisal (the AGREE II instrument). J Clin Epidemiol. 2010;63(12):1281-2.
https://doi.org/10.1016/j.jclinepi.2010.06.005
Collaboration A. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003;12(1):18-23.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. Development of the AGREE II, part 1: performance, usefulness and areas for improvement. CMAJ. 2010;182(10): 1045-52.
https://doi.org/10.1503/cmaj.091714
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. Development of the AGREE II, part 2: assessment of validity of items and tools to support application. CMAJ. 2010;182(10):E472-8.
https://doi.org/10.1503/cmaj.091716
DeVellis RF. Scale development: theory and applications, viii, 2nd ed. Thousand Oaks, Calif: Sage Publications, Inc; 2003. p. 171.
Streiner DL, Norman GR. Health measurement scales: A practical guide to their development and use, xii, 3 rd ed. Oxford; New York: Oxford University Press; 2003. p. 283.
Batista-Foguet JM, Coenders G, Alonso J. Análisis factorial confirmatorio. Su utilidad en la validación de cuestionarios relacionados con la salud. Med Clin (Barc). 2004;122 Supl 1:21-7.
https://doi.org/10.1157/13057542
StataCorp. Stata Structural Equation Modeling Reference Manual Release 12. College Station, Texas: StataCorp; 2011. 294 p.
Manzano A, Zamora S. Sistema de ecuaciones estructurales: una herramienta de investigación. Cuaderno técnico 4. México: Centro Nacional de Evaluación para la Educación Superior (CENEVAL); 2009.
Diamantopoulos A, Siguaw JA. Introducing Lisrel: a guide for the uninitiated, xii. London: SAGE; 2000. p. 171.
https://doi.org/10.4135/9781849209359
Hu L-t, Bentler P. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6(1):1-55.
https://doi.org/10.1080/10705519909540118
Revelle W. Psych: Procedures for Personality and Psychological Research. R package version 1.0-91 [internet]. 2010. Disponible en: http://personality-project.org/r, http://personalityproject.org/r/psych.manual.pdf
Rosseel Y. Lavaan: An R package for Structural Equation Modeling. Journal of Statistical Software. 2012;48(2): 1-36.
https://doi.org/10.18637/jss.v048.i02
Rosseel Y, Oberski D, Byrnes J, Vanbrabant L, Savalei V, Merkle E, et al. Package 'lavaan' [internet]. 2012 [citado 2012 sep 15]. Disponible en: http://cran.r-project.org/web/packages/lavaan/lavaan.pdf
MacDermid JC, Brooks D, Solway S, Switzer-McIntyre S, Brosseau L, Graham ID. Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines. BMC Health Serv Res. 2005;5(1):18
https://doi.org/10.1186/1472-6963-5-18
Ministerio de Protección Social. Guía de Practica Clínica para la detección temprana, tratamiento integral, seguimiento y rehabilitación del cáncer de mama Bogotá [internet]. 2013 [citado 2013 octubre 10]. Disponible en: http://gpc.minsalud.gov.co/guias/Pages/Gu%C3%ADa-de-c%C3%A1ncer-de-mama.aspx
Peña Torres E, Alba M, Sierra F. P334 Challenges And Advantages Adapting Recommendations: Gpc Breast Cancer. BMJ Qual Saf. 2013;22 Suppl 1:86.
https://doi.org/10.1136/bmjqs-2013-002293.261
Alba LH, Murillo R, Castillo JS, INC Gedgdcdtd. Counseling interventions for smoking cessation: systematic review. Salud Publica Mex. 2013;55(2):196-206.
https://doi.org/10.1590/S0036-36342013000200012
Frese T, Franke M, Keyser M, Rurik I, Sandholzer H. Primary care guidelines for geriatric assessment. A structured, comparative analysis. Z Gerontol Geriatr. 2012;45(3):224-9.
https://doi.org/10.1007/s00391-011-0219-9
Wiegele C, Glattacker M, Gülich M, Helbing G, Jäckel WH. The methodological quality of rehabilitation guidelines. Gesundheitswesen. 2011;73(3):162-8.
https://doi.org/10.1055/s-0030-1255084
Linacre JM. Optimizing rating scale category effectiveness. J Appl Meas. 2002;3(1):85-106.
Linacre JM. Users's guide to Winsteps. Chicago: Mesa Press; 2005.
Linacre M. Winsteps Rasch Tutorial 3 [internet]. 2012 [citado 2012 sep 13]. Disponible en: http://www.winsteps.com/a/winsteps-tutorial-3.pdf
Jöreskog K. Structural equation modeling with ordinal variables using LISREL [internet]. 2005 [citado 2012 Jun 06]. Disponible en: http://www.ssicentral.com/lisrel/advancedtopics.html.
How to Cite
Downloads
Downloads
Published
Issue
Section
License
Todos los derechos reservados.
