Assessment of study quality for systematic reviews: A comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: Methodological research

Journal of Evaluation in Clinical Practice

Volumn 18, Issue 1, 2012, Pages 12-18

  Armijo Olivo, Susan ^a   Stiles, Carla R ^b   Hagen, Neil A ^c   Biondo, Patricia D ^b   Cummings, Greta G ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

^b TOM BAKER CANCER CENTRE   (Canada)

^c UNIVERSITY OF CALGARY   (Canada)

Author keywords

Instruments; Methodological research; Quality assessment; Systematic reviews

Indexed keywords

ARTICLE; CANCER PAIN; COMPARATIVE STUDY; CONCURRENT VALIDITY; HUMAN; INTERRATER RELIABILITY; MEDICAL RESEARCH; PRIORITY JOURNAL; PSYCHOMETRY; QUALITY CONTROL; RANDOMIZED CONTROLLED TRIAL (TOPIC); RELIABILITY; SYSTEMATIC REVIEW;

BIAS (EPIDEMIOLOGY); HUMANS; PSYCHOMETRICS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; REVIEW LITERATURE AS TOPIC;

EID: 84855558418     PISSN: 13561294     EISSN: 13652753     Source Type: Journal    
DOI: 10.1111/j.1365-2753.2010.01516.x     Document Type: Article

References (51)

1. Khan, K. S., ter Riet, G., Popay, J., Nixon, J. & Kleijnen, J. (2001) Stage II: Conducting the review, phase 5: study quality assessment. In Undertaking Systematic Reviews of Research Effectiveness: CRD's Guidance for Those Carrying Out or Commissioning Reviews, 2nd edn (eds K. S. Khan, G. ter Riet, J. Glanville, et al.), pp. 1-20. CRD Report 4. York: NHS Centre for Reviews and Dissemination, University of York.
2. Moher, D., Cook, D. J., Jadad, A. R., Tugwell, P., Moher, M., Jones, A., Pham, B. & Klassen, T. P. (1999) Assessing the quality of reports of randomised trials: implications for the conduct of meta-analyses. Health Technology Assessment, 3 (12), 1-98.
3. Chalmers, T. C., Celano, P., Sacks, H. S. & Smith, H. Jr (1983) Bias in treatment assignment in controlled clinical trials. New England Journal of Medicine, 309 (22), 1358-1361. (Pubitemid 14246558)
4. Schulz, K. F., Chalmers, I., Hayes, R. J. & Altman, D. G. (1995) Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. Journal of the American Medical Association, 273 (5), 408-412.
5. Pildal, J., Hrobjartsson, A., Jorgensen, K. J., Hilden, J., Altman, D. G. & Gotzsche, P. C. (2007) Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. International Journal of Epidemiology, 36 (4), 847-857. (Pubitemid 47394153)
6. Kunz, R., Vist, G. & Oxman, A. D. (2007) Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Systematic Reviews, (2), MR000012.
7. Sneed, J. R., Rutherford, B. R., Rindskopf, D., Lane, D. T., Sackeim, H. A. & Roose, S. P. (2008) Design makes a difference: a meta-analysis of antidepressant response rates in placebo-controlled versus comparator trials in late-life depression. American Journal of Geriatric Psychiatry, 16 (1), 65-73.
8. Armijo-Olivo, S., Macedo, L. G., Gadotti, I. C., Fuentes, J., Stanton, T. & Magee, D. J. (2008) Scales to assess the quality of randomized controlled trials: a systematic review. Physical Therapy, 88 (2), 156-175. (Pubitemid 351210558)
9. Streiner, D. L. & Norman, G. R. (2004) Health Measurement Scales: A Practical Guide to Their Development and Use, 3rd edn. Oxford: Oxford University Press.
10. Juni, P., Witschi, A., Bloch, R. & Egger, M. (1999) The hazards of scoring the quality of clinical trials for meta-analysis. Journal of the American Medical Association, 282 (11), 1054-1060. (Pubitemid 29436453)
11. Colle, F., Rannou, F., Revel, M., Fermanian, J. & Poiraudeau, S. (2002) Impact of quality scales on levels of evidence inferred from a systematic review of exercise therapy and low back pain. Archives of Physical Medicine and Rehabilitation, 83 (12), 1745-1752. (Pubitemid 35424698)
12. Herbison, P., Hay-Smith, J. & Gillespie, W. J. (2006) Adjustment of meta-analyses on the basis of quality scores should be abandoned. Journal of Clinical Epidemiology, 59 (12), 1249-1256.
13. Lundh, A. & Gotzsche, P. C. (2008) Recommendations by Cochrane Review Groups for assessment of the risk of bias in studies. BMC Medical Research Methodology, 8, 22.
14. Higgins, J. & Altman, D. G. (2008) Chapter 8: Assessing risk of bias in included studies. In Cochrane Handbook for Systematic Reviews of Interventions Version 5.0 (eds J. Higgins & S. Green). Available at: http://www.cochrane-handbook.org (last accessed 20 July 2010).
15. Hartling, L., Ospina, M., Liang, Y., Dryden, D. M., Hooton, N., Krebs, S. J. & Klassen, T. P. (2009) Risk of bias versus quality assessment of randomised controlled trials: cross sectional study. BMJ, 339, b4012.
16. Cummings, G. G., Hagen, N. A., Fainsinger, R., Armijo-Olivo, S., Stiles, C. & Biondo, P. (2008) Effectiveness of knowledge translation interventions to improve cancer pain management [Protocol]. Cochrane Database of Systematic Reviews, (4): CD007499.
17. Jackson, N. & Waters, E. (2005) Criteria for the systematic review of health promotion and public health interventions. Health Promotion International, 20 (4), 367-374. (Pubitemid 41668817)
18. Thomas, B. H., Ciliska, D., Dobbins, M. & Micucci, S. (2004) A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions. Worldviews on Evidence-Based Nursing, 1 (3), 176-184.
19. Deeks, J. J., Dinnes, J., D'Amico, R., Sowden, A. J., Sakarovitch, C., Song, F., Petticrew, M. & Altman, D. G. (2003) Evaluating nonrandomised intervention studies. Health Technology Assessment, 7 (27), 3-173.
20. Anderson, K. O., Mendoza, T. R., Payne, R., et al. (2004) Pain education for underserved minority cancer patients: a randomized controlled trial. Journal of Clinical Oncology, 22 (24), 4918-4925. (Pubitemid 46638616)
21. Chang, V. T., Hwang, S. S. & Kasimis, B. (2002) Longitudinal documentation of cancer pain management outcomes: a pilot study at a VA medical center. Journal of Pain and Symptom Management, 24 (5), 494-505. (Pubitemid 36120425)
22. Clotfelter, C. E. (1999) The effect of an educational intervention on decreasing pain intensity in elderly people with cancer. Oncology Nursing Forum, 26 (1), 27-33.
23. Dalton, J. A. (1987) Education for pain management: a pilot study. Patient Education and Counseling, 9, 155-165.
24. de Wit, R., van Dam, F., Zandbelt, L., van Buuren, A., van der Heijden, K., Leenhouts, G. & Loonstra, S. (1997) Apain education program for chronic cancer pain patients: follow-up results from a randomized controlled trial. Pain, 73 (1), 55-69. (Pubitemid 27470826)
25. de Wit, R. & van Dam, F. (2001) From hospital to home care: a randomized controlled trial of a Pain Education Programme for cancer patients with chronic pain. Journal of Advanced Nursing, 36 (6), 742-754.
26. de Wit, R., van Dam, F., Loonstra, S., Zandbelt, L., van Buuren, A., van der Heijden, K., Leenhouts, G., Duivenvoorden, H. & Huijer Abu-Saad, H. (2001) Improving the quality of pain treatment by a tailored pain education programme for cancer patients in chronic pain. European Journal of Pain, 5 (3), 241-256. (Pubitemid 32927548)
27. Du Pen, A. R., Du, P. S., Hansberry, J., Miller-Kraybill, B., Millen, J., Everly, R., Hansen, N. & Syrjala, K. (2000) An educational implementation of a cancer pain algorithm for ambulatory care. Pain Management Nursing, 1 (4), 116-128.
28. Elliott, T. E., Murray, D. M., Oken, M. M., Johnson, K. M., Elliott, B. A. & Post-White, J. (1995) The Minnesota Cancer Pain Project: design, methods, and education strategies. Journal of Cancer Education, 10 (2), 102-112.
29. Elliott, T. E., Murray, D. M., Oken, M. M., Johnson, K. M., Braun, B. L., Elliott, B. A. & Post-White, J. (1997) Improving cancer pain management in communities: main results from a randomized controlled trial. Journal of Pain and Symptom Management, 13 (4), 191-203. (Pubitemid 27194540)
30. Ferrell, B. R., Rhiner, M. & Ferrell, B. A. (1993) Development and implementation of a pain education program. Cancer, 72 (11 Suppl), 3426-3432. (Pubitemid 23357985)
31. Kalauokalani, D., Franks, P., Oliver, J.W., Meyers, F. J. & Kravitz, R. L. (2007) Can patient coaching reduce racial/ethnic disparities in cancer pain control? Secondary analysis of a randomized controlled trial. Pain Medicine, 8 (1), 17-24. (Pubitemid 46128763)
32. Kim, J. E., Dodd, M., West, C., Paul, S., Facione, N., Schumacher, K., Tripathy, D., Koo, P. & Miaskowski, C. (2004) The PRO-SELF pain control program improves patients' knowledge of cancer pain management. Oncology Nursing Forum, 31 (6), 1137-1143.
33. Lai, Y. H., Guo, S. L., Keefe, F. J., Tsai, S. L., Chien, C. C., Sung, Y. C. & Chen, M. L. (2004) Effects of brief pain education on hospitalized cancer patients with moderate to severe pain. Supportive Care in Cancer, 12 (9), 645-652. (Pubitemid 39280315)
34. Lin, C. C., Chou, P. L., Wu, S. L., Chang, Y. C. & Lai, Y. L. (2006) Long-term effectiveness of a patient and family pain education program on overcoming barriers to management of cancer pain. Pain, 122 (3), 271-281.
35. McDonald, M. V., Pezzin, L. E., Feldman, P. H., Murtaugh, C. M. & Peng, T. R. (2005) Can just-in-time, evidence-based 'reminders'improve pain management among home health care nurses and their patients? Journal of Pain and Symptom Management, 29 (5), 474-488. (Pubitemid 40724741)
36. Miaskowski, C., Dodd, M., West, C., Schumacher, K., Paul, S. M., Tripathy, D. & Koo, P. (2004) Randomized clinical trial of the effectiveness of a self-care intervention to improve cancer pain management. Journal of Clinical Oncology, 22 (9), 1713-1720. (Pubitemid 41079811)
37. Miaskowski, C., Dodd, M., West, C., Paul, S. M., Schumacher, K., Tripathy, D. & Koo, P. (2007) The use of a responder analysis to identify differences in patient outcomes following a self-care intervention to improve cancer pain management. Pain, 129 (1-2), 55-63. (Pubitemid 46566468)
38. Oliver, J. W., Kravitz, R. L., Kaplan, S. H. & Meyers, F. J. (2001) Individualized patient education and coaching to improve pain control among cancer outpatients. Journal of Clinical Oncology, 19 (8), 2206-2212. (Pubitemid 32366974)
39. Patiraki, E. I., Papathanassoglou, E. D., Tafas, C., Akarepi, V., Katsaragakis, S. G., Kampitsi, A. & Lemonidou, C. (2006) A randomized controlled trial of an educational intervention on Hellenic nursing staff's knowledge and attitudes on cancer pain management. European Journal of Oncology Nursing, 10 (5), 337-352. (Pubitemid 44817622)
40. Rimer, B., Levy, M. H., Keintz, M. K., Fox, L., Engstrom, P. F. & MacElwee, N. (1987) Enhancing cancer pain control regimens through patient education. Patient Education and Counseling, 10 (3), 267-277. (Pubitemid 17166868)
41. Vallerand, A. H., Riley-Doucet, C., Hasenau, S. M. & Templin, T. (2004) Improving cancer pain management by homecare nurses. Oncology Nursing Forum, 31 (4), 809-816.
42. Ward, S., Donovan, H. S., Owen, B., Grosen, E. & Serlin, R. (2000) An individualized intervention to overcome patient-related barriers to pain management in women with gynecologic cancers. Research in Nursing and Health, 23 (5), 393-405.
43. Wells, N., Hepworth, J. T., Murphy, B. A., Wujcik, D. & Johnson, R. (2003) Improving cancer pain management through patient and family education. Journal of Pain and Symptom Management, 25 (4), 344-356. (Pubitemid 36411790)
44. Yates, P., Edwards, H., Nash, R., Aranda, S., Purdie, D., Najman, J., Skerman, H. & Walsh, A. (2004) A randomized controlled trial of a nurse-administered educational intervention for improving cancer pain management in ambulatory settings. Patient Education and Counseling, 53 (2), 227-237. (Pubitemid 38622067)
45. Schuck, P. (2004) Assessing reproducibility for interval data in health-related quality of life questionnaires: which coefficient should be used? Quality of Life Research, 13 (3), 571-586.
46. Byrt, T. (1996) How good is that agreement? Epidemiology, 7 (5), 561.
47. McDowell, I. (2006) Chapter 2: the theoretical and technical foundations of health measurements. Measuring Health, 3rd edn (ed. I. McDowell), pp. 10-54. New York: Oxford University Press.
48. Verhagen, A. P., De Bie, R. A., Lenssen, A. F., De Vet, H. C. W., Kessels, A. G. H., Boers, M. & Van den Brandt, P. A. (2000) Quality assessment of trials: a comparison of three criteria lists. Physical Therapy Review, 5, 49-58. (Pubitemid 33268104)
49. Stiles, C., Biondo, P., Cummings, G. G. & Hagen, N. A. (2010) Clinical trials focusing on cancer pain educational interventions: core components to include during planning and reporting. Journal of Pain and Symptom Management, in press, DOI:10.1016/j.jpainsymman.2009.12.011.
50. Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P. & Walsh, S. (1995) Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists. Controlled Clinical Trials, 16 (1), 62-73.
51. Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P. & Klassen, T. P. (1998) Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet, 352 (9128), 609-613. (Pubitemid 28380142)