Systematic reviews need to consider applicability to disadvantaged populations: Inter-rater agreement for a health equity plausibility algorithm

BMC Medical Research Methodology

Volumn 12, Issue , 2012, Pages

  Welch, Vivian ^a,b   Brand, Kevin ^c   Kristjansson, Elizabeth ^b   Smylie, Janet ^d,e   Wells, George ^a,f   Tugwell, Peter ^a,b  

^a OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

^c UNIVERSITY OF OTTAWA   (Canada)

^d ST MICHAEL'S HOSPITAL   (Canada)

^e UNIVERSITY OF TORONTO   (Canada)

^f UNIVERSITY OF OTTAWA HEART INSTITUTE   (Canada)

Author keywords

Applicability; Health equity; Sex and gender; Socioeconomic status; Systematic reviews

Indexed keywords

ARTICLE; CULTURAL DEPRIVATION; FEMALE; HEALTH CARE DISPARITY; HUMAN; MALE; METHODOLOGY; POVERTY; QUESTIONNAIRE; SEX DIFFERENCE; SOCIOECONOMICS;

CULTURAL DEPRIVATION; FEMALE; HEALTHCARE DISPARITIES; HUMANS; MALE; POVERTY AREAS; QUESTIONNAIRES; RESEARCH DESIGN; SEX FACTORS; SOCIOECONOMIC FACTORS;

MLCS; MLOWN;

EID: 84871117683     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-12-187     Document Type: Article

References (61)

1. The concepts and principles of equity and health. Whitehead M, Int J Health Serv 1992 22 429 445 10.2190/986L-LHQ6-2VTE-YRRN 1644507 (Pubitemid 23364255)
2. Kelly MP, Morgan A, Exworthy M, Popay J, Tugwell P, Robinson V, Simpson S, Narayan T, Myer L, Houweling T, et al. The social determinants of health: developing an evidence base for political action: final report to the world health organization commission on the social determinants of health Geneva 2007
3. How and why do interventions that increase health overall widen inequalities with populations? White M, Adams J, Heywood P, Social inequality and public health Bristol: The Policy Press, University of Bristol, Babones SJ, 1 2009 65 82
4. World Health Assembly, Resolution 5834 on the ministerial summit on health research 2005 5834
5. Working within and beyond the cochrane collaboration to make systematic reviews more useful to healthcare managers and policy makers. Lavis JN, Davies HTO, Gruen RL, Healthcare Policy 2006 1 21 33 19305677
6. Tackling inequalities in health: the need for building a systematic evidence base. Mackenbach JP, J Epidemiol Community Health 2003 57 162 10.1136/jech.57.3.162 12594189 (Pubitemid 36250175)
7. Population tobacco control interventions and their effects on social inequalities in smoking: systematic review. [Review] [109 refs]. Thomas S, Fayter D, Misso K, Ogilvie D, Petticrew M, Sowden A, Whitehead M, Worthy G, Thomas S, Fayter D, et al. Tob Control 2008 17 230 237 10.1136/tc.2007.023911 18426867
8. Effects of policy options for human resources for health: an analysis of systematic reviews. Chopra M, Munro S, Lavis JN, Vist G, Bennett S, Lancet 2008 371 668 774 10.1016/S0140-6736(08)60305-0 18295024 (Pubitemid 351273398)
9. Tsikata S, Robinson V, Petticrew M, Kristjansson B, Moher D, McGowan J, Shea B, Wells G, Tugwell P, Do cochrane systematic reviews contain useful information about health equity? [abstract]. XI cochrane colloquium: evidence, health care and culture; 2003 Oct 26 31 Barcelona, Spain 2003 77
10. Evidence for public health policy on inequalities: 1: the reality according to policymakers. Petticrew M, Whitehead M, Macintye SJ, Graham H, Egan M, J Epidemiol Community Health 2004 58 811 816 10.1136/jech.2003.015289 15365104 (Pubitemid 39279737)
11. Towards systematic reviews that inform health care management and policy-making. Lavis JN, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E, J Health Serv Res Policy 2005 10 35 48 10.1258/1355819054308549 16053582 (Pubitemid 40993883)
12. Cochrane and campbell collaborations, and health equity. Tugwell P, Petticrew M, Robinson V, Kristjansson E, Maxwell L, Lancet 2006 367 1128 1130 10.1016/S0140-6736(06)68490-0 16616547
13. Better evidence about wicked issues in tackling health inequities. Petticrew M, Tugwell P, Welch V, Ueffing E, Kristjansson E, Armstrong R, Doyle J, Waters E, J Public Health 2009 31 453 456 10.1093/pubmed/fdp076
14. Road traffic crashes: operationalizing equity in the context of health sector reform. Evans T, Brown H, Inj Control Saf Promot 2003 10 11 12 10.1076/icsp.10.1.11.14117 12772480
15. Kavanagh J, Oliver S, Lorenc T, Reflections in developing and using PROGRESS-plus. Equity update (2) Ottawa 2008 1 3
16. US Department of Health and Human Services, Understanding and improving health Washington, DC 2000
17. Commission on social determinants of health: closing the gap in a generation: health equity through action on the social determinants of health. Marmot M, Friel S, Bell R, Houweling TA, Taylor S, Lancet 2008 372 1661 1669 10.1016/S0140-6736(08)61690-6 18994664
18. Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses. Sun X, Briel M, Walter SD, Guyatt GH, Br Med J 2010 340 117 10.1136/bmj.c117
19. Credibility of claims of subgroup effects in randomised controlled trials: systematic review. Sun X, Briel M, Busse JW, You JJ, Akl EA, Mejza F, Bala MM, Bassler D, Mertz D, Diaz-Granados N, Vandvik PO, Malaga G, Srinathan SK, Dahm P, Johnston BC, Alonso-Coello P, Hassouneh B, Walter SD, Heels-Ansdell D, Bhatnagar N, Altman DG, Guyatt GH, Br Med J 2012 344 1553 10.1136/bmj.e1553
20. Damned if you do, damned if you don't: subgroup analysis and equity. Petticrew M, Tugwell P, Kristjansson E, Oliver S, Ueffing E, Welch V, J Epidemiol Community Health 2011 epub ahead of print
21. Feinstein AR, Clinimetrics New Haven: Yale University Press 1987
22. Feinstein AR, Feinstein AR. Clinical epidemiology: the architecture of clinical research Philadelphia: Saunders 1985 39 52 Philadelphia: Saunders; 1985
23. Users' Guides to the medical literature: XIV. How to decide on the applicability of clinical trial results to your patient. Evidence-based medicine working group.[see comment]. Dans AL, Dans LF, Guyatt GH, Richardson S, JAMA 1998 279 545 549 10.1001/jama.279.7.545 9480367 (Pubitemid 28113435)
24. Tuberculosis: evidence review for newly arriving immigrants. Greenaway C, Sandoe A, Vissandjee B, Kitai I, Gruner D, Ueffing E, Wobeser W, Menzies D, Schwartzman K, Can Med Assoc J 2010 183 12 939 E951
25. How effects on health equity are assessed in systematic reviews of interventions. Welch V, Tugwell P, Wells GA, Kristjansson E, Petticrew M, McGowan J, DeMontigny J, Benkhalti M, Ueffing E, Cochrane Database Syst Rev 2010 12 R000028
26. Finding common ground in team-based qualitative research using the convergent interviewing method. Driedger SM, Gallois C, Sanders CB, Santesso N, Driedger SM, Gallois C, Sanders CB, Santesso N, Qual Health Res 2006 16 1145 1157 10.1177/1049732306289705 16954531 (Pubitemid 44323355)
27. Welch V, Smylie JK, Kristjansson E, Brand K, Tugwell P, Wells GA, What is the role of systematic reviews in tackling health inequity? University of Ottawa 2010 PhD Thesis
28. Applying results to individual patients. Dans AL, Dans LF, Guyatt G, Users' Guides to the medical literature: a manual for evidence-based clinical practice New York, USA: The McGraw-Hill Companies, Inc, Guyatt G, Rennie D, Meade MO, Cook DJ, 2 2008 273 289 23297082
29. Measuring nominal scale agreement among many raters. Fleiss JL, Psychol Bull 1971 76 378 382
30. High agreement but low kappa: II. Cicchetti DV, Feinstein AR, Resolving the paradoxes. Journal of Clinical Epidemiology 1990 43 551 558 10.1016/0895-4356(90)90159-M (Pubitemid 20178544)
31. WHO choosing interventions that are cost effective (CHOICE) millennium development goals team: evaluation of current strategies and future priorities for improving health in developing countries. Evans DB, Lim SS, Adam T, Edejer TT, BMJ 2005 331 1457 1461 10.1136/bmj.38658.675243.94 16282377 (Pubitemid 41830716)
32. Jamison DT, Breman JG, Measham AR, Alleyne G, Claeson M, Evans DB, Jha P, Mills A, Musgrove P, Priorities in health New York: Oxford University Press 2006
33. Projections of global mortality and burden of disease from 2002 to 2030. Mathers CD, Loncar D, PLoS Med 2006 3 3442
34. OMERACT: an international initiative to improve outcome measurement in rheumatology. Tugwell P, Boers M, Brooks P, Simon L, Strand V, Idzerda L, Trials 2007 8 38 10.1186/1745-6215-8-38 18039364
35. Mass media interventions for promoting HIV testing. Vidanapathirana J, Abramson MJ, Forbes A, Fairley C, Cochrane Database Syst Rev 2005 3 D004775
36. Population tobacco control interventions and their effects on social inequalities in smoking: placing an equity lens on existing systematic reviews. Main C, Thomas S, Ogilvie D, Stirk L, Petticrew M, Whitehead M, Sowden A, BMC Publ Health 2008 8 178 10.1186/1471-2458-8-178 (Pubitemid 351794085)
37. Psychological treatment of post-traumatic stress disorder (PTSD). Bisson J, Andrew M, Cochrane Database Syst Rev 2007 3 D003388
38. First-line drugs for hypertension. Wright JM, Musini VM, Cochrane Database Syst Rev 2009 Art. No. CD001841
39. Surgical interventions for age-related cataract. Riaz Y, Mehta JS, Wormald R, Evans JR, Foster A, Ravilla T, Snelligen T, Cochrane Database Syst Rev 2006 4 Art. No. CD001323 10.1002/14651858.CD001323.pub2
40. Vaccines for measles, mumps and rubella in children. Demicheli V, Jefferson T, Rivetti A, Price D, Cochrane Database Syst Rev 4 Art. No. CD004407 10.1002/14651858.CD004407.pub2
41. Antidepressants versus placebo for depression in primary care. Arroll B, Elley CR, Fishman T, Goodyear-Smith FA, Kenealy T, Blashki G, Kerse N, McGillivray S, Cochrane Database Syst Rev 2009 3 Art. No CD007954 10.1002/14651858.CD007954
42. Artemisinin-based combination therapy for treating uncomplicated malaria. Sinclair D, Zani B, Donegan S, Olliaro P, Garner P, Cochrane Database Syst Rev 2009
43. Effectiveness of primary enforcement safety belt laws and enhanced enforcement of safety belt laws: a summary of the guide to community preventive services systematic reviews. Shults RA, Nichols JL, Dinh-Zarr TB, Sleet DA, Elder RW, J Safety Res 2004 35 189 196 10.1016/j.jsr.2004.03.002 15178238
44. Hand washing for preventing diarrhoea. Ejemot RI, Ehiri JE, Meremikwu MM, Critchley JA, Cochrane Database Syst Rev 2008 1 Art No. CD004265 10.1002/14651858.CD004265.pub2 (Pubitemid 351807564)
45. Tutorial in biostatistics: kappa coefficients in medical research. Kraemer HC, Periyakoil VS, Noda A, Stat Med 2002 21 2109 2129 10.1002/sim.1180 12111890 (Pubitemid 34752626)
46. The dependence of Cohen's kappa on the prevalence does not matter. Vach W, J Clin Epidemiol 2005 58 655 661 10.1016/j.jclinepi.2004.02.021 15939215 (Pubitemid 40797894)
47. Using cognitive interviews to develop surveys in diverse populations. Napoles-Springer A, Santoyo-Olsson J, O'Brien H, Stewart AL, Medical Care 2006 44 21 s30 10.1097/01.mlr.0000245425.65905.1d 17060830 (Pubitemid 44632027)
48. Assessing equity in systematic reviews: realising the recommendations of the commission on social determinants of health. Tugwell P, Petticrew M, Kristjansson E, Welch V, Ueffing E, Waters E, Bonnefoy J, Morgan A, Doohan E, Kelly MP, BMJ 2010 341 4739 10.1136/bmj.c4739 20837575
49. Applying the results of trials and systematic reviews to individual patients.[see comment]. Glasziou P, Guyatt GH, Dans AL, Dans LF, Straus S, Sackett DL, ACP J Club 1998 129 15 A16 9825009
50. National Health and Medical Research Council, How to use the evidence: assessment and application of scientific evidence Canberra, Australia 2000
51. Developing an evidence-based guide to community preventive services-methods. The task force on community preventive services. Briss PA, Zaza S, Pappaioanou M, Fielding J, Wright-De AL, Truman BI, Hopkins DP, Mullen PD, Thompson RS, Woolf SH, et al. Am J Prev Med 2000 18 Suppl 43
52. Treating individuals 2. Subgroup analysis in randomised controlled trials: importance, indications, and interpretation. Rothwell PM, Lancet 2005 365 176 186 10.1016/S0140-6736(05)17709-5 15639301 (Pubitemid 40091809)
53. Applicability and transferability of interventions in evidence-based public health. Wang S, Moss JR, Hiller JE, Health Promot Int 2006 21 76 83 16249192 (Pubitemid 43288768)
54. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. [Review] [91 refs]. Green LW, Glasgow RE, Eval Health Prof 2006 29 126 153 10.1177/0163278705284445 16510882 (Pubitemid 43797500)
55. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, Gøtzsche PC, Lang T, Ann Intern Med 2001 134 663 694 11304107 (Pubitemid 32322245)
56. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011] The Cochrane Collaboration, Higgins JPT, Green S, 2011 Available from http://www.cochrane-handbook.org
57. Use of research to inform public policymaking.[see comment]. Lavis JN, Posada FB, Haines A, Osei E, Lancet 2004 364 1615 1621 10.1016/S0140-6736(04) 17317-0 15519634 (Pubitemid 39446388)
58. Assessing equity in clinical practice guidelines. [Review] [53 refs]. Dans AM, Dans L, Oxman AD, Robinson V, Acuin J, Tugwell P, Dennis R, Kang D, J Clin Epidemiol 2007 60 540 546 10.1016/j.jclinepi.2006.10.008 17493507 (Pubitemid 46705481)
59. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D, BMJ 2009 339 2700 10.1136/bmj.b2700 19622552
60. Tackling health inequalities in Europe: an integrated approach Rotterdam EUROTHINE: final report. 2007
61. Using systematic reviews for evidence-based health promotion: basic methodology issues. Buendia-Rodriguez JA, Sanchez-Villamil JP, Buendia-Rodriguez JA, Sanchez-Villamil JP, Revista de Salud Publica 2006 8 Suppl 2 94 105 17361581