Development of the Quality Improvement Minimum Quality Criteria Set (QI-MQCS): A tool for critical appraisal of quality improvement intervention publications

BMJ Quality and Safety

Volumn 24, Issue 12, 2015, Pages 796-804

  Hempel, Susanne ^a   Shekelle, Paul G ^a,b   Liu, Jodi L ^a   Danz, Margie Sherwood ^a,b   Foy, Robbie ^c   Lim, Yee Wei ^d   Motala, Aneesa ^a   Rubenstein, Lisa V ^a,b,e  

^a RAND CORPORATION   (United States)

^b VETERANS AFFAIRS MEDICAL CENTER   (United States)

^c UNIVERSITY OF LEEDS   (United Kingdom)

^d NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HEALTH CARE QUALITY; HUMAN; INSTRUMENT VALIDATION; INTERNAL CONSISTENCY; MAJOR CLINICAL STUDY; MOTIVATION; PUBLICATION; STATISTICS; STUDY DESIGN; TOTAL QUALITY MANAGEMENT; VALIDITY; HEALTH SERVICES RESEARCH; ORGANIZATION AND MANAGEMENT; PSYCHOMETRY; PUBLISHING; REPRODUCIBILITY; STANDARDS;

HEALTH SERVICES RESEARCH; HUMANS; PERIODICALS AS TOPIC; PSYCHOMETRICS; PUBLISHING; QUALITY IMPROVEMENT; REPRODUCIBILITY OF RESULTS;

EID: 84948403422     PISSN: 20445415     EISSN: None     Source Type: Journal    
DOI: 10.1136/bmjqs-2014-003151     Document Type: Article

References (39)

1. Rubenstein LV, Hempel S, Farmer MM, et al. Finding order in heterogeneity: types of quality-improvement intervention publications. Qual Saf Health Care 2008;17:403-8.
2. Rubenstein L, Khodyakov D, Hempel S, et al. How can we recognize continuous quality improvement? Int J Qual Health Care 2014;26:6-15.
3. Ogrinc G, Mooney SE, Estrada C, et al. The SQUIRE (Standards for QUality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration. Qual Saf Health Care 2008;17(Suppl 1):i13-32.
4. Fan E, Laupacis A, Pronovost PJ, et al. How to use an article about quality improvement. JAMA 2010;304:2279-87.
5. Higgins JP, Altman DG, Gotzsche PC, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928.
6. Hempel S. Content validity. In: Davey G, ed. Encyclopaedic dictionary of psychology. London: Hodder Arnold, 2005: Statistic section (Section Ed: A. Field) p. 421.
7. Whiting P, Rutjes AW, Reitsma JB, et al. The development of QUADAS: A tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 2003;3:25.
8. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 1996;17:1-12.
9. Speroff T, James BC, Nelson EC, et al. Guidelines for appraisal and publication of PDSA quality improvement. Qual Manag Health Care 2004;13:33-9.
10. Moss F, Thompson R. A new structure for quality improvement reports. Qual Health Care 1999;8:76.
11. Moss F, Thomson R. A new structure for quality improvement reports. Qual Saf Health Care 2004;13:6-7.
12. Abraham C, Albarracín D, Araújo-Soares V, et al. WIDER Recommendations to Improve Reporting of the Content of Behaviour Change Interventions.
13. Strengthening the reporting of observational epidemiological studies. STROBE Statement. Checklist of Essential Items. Secondary Strengthening the reporting of observational epidemiological studies. STROBE Statement. Checklist of Essential Items. http://www.strobe-statement.org/Checkliste.html
14. Consolidated Standards of Reporting Trials (CONSORT). Secondary Consolidated Standards of Reporting Trials (CONSORT). http://www.consort-statement.org/
15. Reach Effectiveness Adoption Implementation Maintenance (RE-AIM). Secondary Reach Effectiveness Adoption Implementation Maintenance (RE-AIM). http://www.re-aim.org/
16. Medical Research Council. Developing and evaluating complex interventions: new guidance. Secondary Developing and evaluating complex interventions: new guidance. http://www.mrc. ac.uk/Utilities/Documentrecord/index.htm?d=MRC004871
17. West S, King V, Carey TS, et al. Systems to rate the strength of scientific evidence. Evid Rep Technol Assess (Summ) 2002;47:1-11.
18. Sanderson S, Tatt ID, Higgins JP. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: A systematic review and annotated bibliography. Int J Epidemiol 2007;36:666-76.
19. Deeks JJ, Dinnes J, D'Amico R, et al. Evaluating non-randomised intervention studies. Health Technol Assess 2003;7:iii-x, 1-173.
20. Rubenstein L, Danz M, Hempel S, et al. Advancing the science of continuous quality improvement: A framework for identifying, classifying and evaluating continuous quality improvement studies. Final project report. June 2010.
21. Rubenstein L, Hempel S, Danz M, et al. Final Progress Report Expert Panel Meeting Advancing the Science of Continuous Quality Improvement. Grant Award Number: 1R13HS018139-01. Prepared for AHRQ,May 2011.
22. AGREE: Advancing the science of practicing guidelines. Secondary AGREE: Advancing the science of practicing guidelines. http://www.agreetrust.org/
23. Hempel S, Rubenstein LV, Shanman RM, et al. Identifying quality improvement intervention publications-A comparison of electronic search strategies. Implement Sci 2011;6:85.
24. Danz MS, Rubenstein LV, Hempel S, et al. Identifying quality improvement intervention evaluations: is consensus achievable? Qual Saf Health Care 2010;19:279-83.
25. Hempel S, Shetty KD, Shekelle PG, et al. Machine learning methods in systematic reviews: identifying quality improvement intervention evaluations. Research White Paper (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-2007-10062-I). AHRQ Publication No. 12-EHC125-EF. Rockville, MD: Agency for Healthcare Research and Quality, September 2012. http://www. effectivehealthcare.ahrq.gov/ehc/products/478/1270/WhitePaper-MachineLearningSR-FinalReport-20120920.pdf
26. Hempel S, Suttorp MJ, Miles JNV, et al. Empirical Evidence of Associations Between Trial Quality and Effect Sizes. Methods Research Report. (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-2007-10062-I). AHRQ Publication No. 11-EHC045-EF. Rockville, MD: Agency for Healthcare Research and Quality, April 2011. http://effectivehealthcare.ahrq.gov
27. Hempel S. Reliability. In: Miles J, Gilbert P, eds. A handbook of research methods for clinical & health psychology. Oxford: Oxford University Press, 2005, pp. 193-204.
28. Hempel S, Newberry S, Wang Z, et al. Hospital fall prevention: A systematic review of implementation, components, adherence, and effectiveness. J Am Geriatr Soc 2013;61:483-94.
29. Hartling L, Hamm MP, Milne A, et al. Testing the risk of bias tool showed low reliability between individual reviewers and across consensus assessments of reviewer pairs. J Clin Epidemiol 2013;66:973-81.
30. Cochrane Effective Practice and Organisation of Care Group. Suggested risk of bias criteria for EPOC reviews. Secondary Suggested risk of bias criteria for EPOC reviews 12 August 2013. 2013. http://epoc.cochrane.org/sites/epoc.cochrane.org/files/uploads/14%20Suggested%20risk%20of%20bias%20criteria% 20for%20EPOC%20reviews%202013%2008%2012.pdf
31. Ovretveit J, Gustafson D. Evaluation of quality improvement programmes. Qual Saf Health Care 2002;11:270-5.
32. Hensing JA. The quest for upper-quartile performance at Banner Health. J Healthc Qual 2008;30:18-24.
33. Panaretto KS, Mitchell MR, Anderson L, et al. Sustainable antenatal care services in an urban Indigenous community: The Townsville experience. Med J Aust 2007;187:18-22.
34. Pronovost P, Needham D, Berenholtz S, et al. An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med 2006;355:2725-32.
35. Peterson A, Carlhed R, Lindahl B, et al. Improving guideline adherence through intensive quality improvement and the use of a National Quality Register in Sweden for acute myocardial infarction. Qual Manag Health Care 2007;16:25-37.
36. Kanara N, Cain KP, Laserson KF, et al. Using program evaluation to improve the performance of a TB-HIV project in Banteay Meanchey, Cambodia. Int J Tuberc Lung Dis 2008;12 (3 Suppl 1):44-50.
37. Stajduhar KI, Bidgood D, Norgrove L, et al. Using quality improvement to enhance research readiness in palliative care. J Healthc Qual 2006;28:22-8.
38. Liu SK, Homa K, Butterly JR, et al. Improving the simple, complicated and complex realities of community-acquired pneumonia. Qual Saf Health Care 2009;18:93-8.
39. Barton SA, Johnson MR, Price LV. Achieving restraint-free on an inpatient behavioral health unit. J Psychosoc Nurs Ment Health Serv 2009;47:34-40.