Development of the RTI item bank on risk of bias and precision of observational studies

Journal of Clinical Epidemiology

Volumn 65, Issue 2, 2012, Pages 163-178

  Viswanathan, Meera ^a   Berkman, Nancy D ^a  

^a RTI INTERNATIONAL   (United States)

Author keywords

Instrument development; Observational studies; Quality assessment; Reliability testing; Risk of bias assessment; Systematic review methodology; Validity testing

Indexed keywords

ACCURACY; CONTENT VALIDITY; DATA BASE; EVALUATION; INTERRATER RELIABILITY; OBSERVATIONAL STUDY; PRIORITY JOURNAL; RESEARCH; REVIEW; RISK OF BIAS; RTI ITEM BANK; SYSTEMATIC ERROR;

EID: 84855350542     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2011.05.008     Document Type: Article

References (126)

1. Lohr KN. Emerging methods in comparative effectiveness and safety: symposium overview and summary. Med Care 2007;45(10 Suppl 2):S5-8. PMID: 17909383.
2. Viswanathan M. Systematic review: assessing the quality of individual studies. Rockville, MD: Agency for Healthcare Quality and Review; 2010. Available at http://www.effectivehealthcare.ahrq.gov/index.cfm/slides/? pageAction5displaySlides&tk524. Accessed June 9, 2011.
3. Norris SL, Atkins D. Challenges in using nonrandomized studies in systematic reviews of treatment interventions. Ann Intern Med 2005;142(12 Pt 2):1112-9. PMID: 15968036. (Pubitemid 40847714)
4. Chou R, Aronson N, Atkins D, Ismaila AS, Santaguida P, Smith DH, et al. AHRQ series paper 4: assessing harms when comparing medical interventions: AHRQ and the effective health-care program. J Clin Epidemiol 2010;63:502-12. PMID: 18823754.
5. Agency for Healthcare Research and Quality. Methods reference guide for effectiveness and comparative effectiveness reviews, version 1.0. Rockville, MD: Agency for Healthcare Research andQuality; 2007. Available at http://effectivehealthcare.ahrq.gov/repFiles/2007-10DraftMethodsGuide.pdf. Accessed June 9, 2011.
6. Juni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ 2001;323:42-6. PMID: 11440947. (Pubitemid 32682008)
7. Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions version 5.0.2. London, UK: The Cochrane Collaboration; 2009. Available at www.cochrane-handbook.org. Accessed June 9, 2011.
8. Rothman KJ, Greenland S, Lash TL. Modern epidemiology. 3rd edition. Philadelphia, PA: Lippincott, Williams, & Wilkins; 2008.
9. Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, et al. Evaluating non-randomised intervention studies. Health Technol Assess 2003;7(27). iii-x, 1-173. PMID: 14499048.
10. West SL, King V, Carey TS, Lohr KN, McKoy N, Sutton SF, et al. Systems to rate the strength of scientific evidence. Evidence Report/Technology Assessment No. 47 (Prepared by the Research Triangle Institute-University of North Carolina Evidence-based Practice Center under Contract No. 290-97-0011). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E016.
11. Sanderson S, Tatt ID, Higgins JP. Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int J Epidemiol 2007;36:666-76. PMID: 17470488. (Pubitemid 47244573)
12. Katrak P, Bialocerkowski AE, Massy-Westropp N, Kumar S, Grimmer KA. A systematic review of the content of critical appraisal tools. BMC Med Res Methodol 2004;4:22. PMID: 15369598.
13. Thomas H. Quality assessment tool for quantitative studies. Effective Public Health Practice Project. Toronto, Canada: McMaster University.
14. Wells G, Shay B, O'Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analysis. Ottawa, Canada: University of Ottawa. Available at: http://www.effectivehealthcare.ahrq.gov/index.cfm/slides/? pageAction5displaySlides&tk524. Accessed June 9, 2011.
15. Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 1998;52:377-84. PMID: 9764259. (Pubitemid 28438523)
16. Zaza S, Wright-De Aguero LK, Briss PA, Truman BI, Hopkins DP, Hennessy MH, et al. Data collection instrument and procedure for systematic reviews in the Guide to Community Preventive Services. Task Force on Community Preventive Services. Am J Prev Med 2000;18(1 Suppl):44-74. PMID: 10806979. (Pubitemid 30114234)
17. Cowley DE. Prostheses for primary total hip replacement. A critical appraisal of the literature. Int J Technol Assess Health Care 1995;11:770-8. PMID: 8567209. (Pubitemid 26007335)
18. Reisch JS, Tyson JE, Mize SG. Aid to the evaluation of therapeutic studies. Pediatrics 1989;84(5):815-27. PMID: 2797977. (Pubitemid 19265153)
19. Stroup DF, Berlin JA, Morton SC, Olkin I,Williamson GD, Rennie D, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 2000;283:2008-12. PMID: 10789670. (Pubitemid 30214957)
20. Peipert JF, Phipps MG. Observational studies. Clin Obstet Gynecol 1998;41:235-44. PMID: 9646956. (Pubitemid 28287816)
21. Wilt TJ, Lederle FA, MacDonald R, Jonk YC, Rector TS, Kane RL. Comparison of endovascular and open surgical repairs for abdominal aortic aneurysm, structured abstract. Evidence Report/Technology Assessment No. 144 (Prepared by the University of Minnesota Evidence-based Practice Center under Contract No. 290-02-0009). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E017.
22. Lau J, Ioannidis JPA, Balk E, Milch C, Chew P, Terrin N, et al. Evaluation of technologies for identifying acute cardiac ischemia in emergency departments. Evidence Report/Technology Assessment Number 26 (Prepared by The New England Medical Center Evidence-based Practice Center under Contract No. 290-97-0019). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E006.
23. Sharma M, Clark H, Armour T, Stotts G, Coté R, Hill MD, et al. Acute stroke: evaluation and treatment. Evidence Report/Technology Assessment No. 127 (Prepared by the University of Ottawa Evidence-based Practice Center under Contract No. 290-02-0021). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E023-2.
24. Jadad AR, Boyle M, Cunningham C, Kim M, Schachar R. Treatment of attention-deficit/hyperactivity disorder. Evidence Report/Technology Assessment No. 11 (Prepared by McMaster University under Contract No. 290-97-0017). Rockville, MD: Agency for Healthcare Research and Quality; 1999. AHRQ Publication No. 00-E005.
25. Myers ER, Bastian LA, Havrilesky LJ, Kulasingam SL, Terplan MS, Cline KE, et al. Management of adnexal mass. Evidence Report/Technology Assessment No. 130 (Prepared by the Duke Evidence-based Practice Center under Contract No. 290-02-0025). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E004.
26. Lau J, Balk E, Rothberg M, Ioannidis JPA, DeVine D, Litt M, et al. Management of clinically inapparent adrenal mass. Evidence Report/Technology Assessment No. 56 (Prepared by New England Medical Center Evidence-based Practice Center under Contract No. 290-97-0019). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E014.
27. Chou R, Fu R, Carson S, Saha S, Helfand M. Empirical evaluation of the association between methodological shortcomings and estimates of adverse events. Technical Review No. 13 (Prepared by the Oregon Evidence-based Practice Center under Contract No. 290-02-0024). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 07-0003.
28. Hardy M, Coulter I, Venuturupalli S, Roth EA, Favreau J, Morton SC, et al. Ayurvedic interventions for diabetes mellitus: a systematic review. Evidence Report/Technology Assessment No. 41 (Prepared by Southern California Evidence-based Practice Center/RAND under Contract No. 290-97-0001). Rockville, MD: Agency for Healthcare Review and Quality; 2001. AHRQ Publication No. 01-E040.
29. Balk E, Chung M, Raman G, Tatsioni A, Chew P, Ip S, et al. B vitamins and berries and age-related neurodegenerative disorders. Evidence Report/Technology Assessment No. 134 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E008.
30. Catlett C, Perl T, Jenckes MW, Robinson KA, Mitchell D, Hage J, et al. Training of clinicians for public health events relevant to bioterrorism preparedness. Evidence Report/Technology Assessment No. 51 (Prepared by Johns Hopkins Evidence-based Practice Center under Contract No. 290-97-006). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E011.
31. Bravata DM, McDonald K, Owens DK, Buckeridge D, Haberland C, Rydzak C, et al. Bioterrorism preparedness and response: use of information technologies and decision support systems. Evidence Report/Technology Assessment No. 59 (Prepared by University of California San Francisco B Stanford Evidence-based Practice Center under Contract No. 290-97-0013). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E028.
32. Appel LJ, Robinson KA, Guallar E, Erlinger T, Masood SO, Jehn J, et al. Utility of blood pressure monitoring outside of the clinic setting. Evidence Report/Technology Assessment No. 63 (Prepared by the Johns Hopkins Evidence-based Practice Center under Contract No. 290-97-006). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 03-E004.
33. Balion C, Santaguida P, Hill S, Worster A, McQueen M, Oremus M, et al. Testing for BNP and NT-proBNP in the diagnosis and prognosis of heart failure. Evidence Report/Technology Assessment No. 142 (Prepared by the McMaster University Evidence-based Practice Center under Contract No. 290-02-0020). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E014.
34. Viswanathan M, King VJ, Bordley C, Honeycutt AA, Wittenborn J, Jackman AM, et al. Management of bronchiolitis in infants and children. Evidence Report/Technology Assessment No. 69 (Prepared by RTI International-University of North Carolina at Chapel Hill Evidence-based Practice Center under Contract No. 290-97-0011). Rockville, MD: U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E014.
35. Ford JG, Howerton MW, Bolen S, Gary TL, Lai GY, Tilburt J, et al. Knowledge and access to information on recruitment of underrepresented populations to cancer clinical trials. Evidence Report/Technology Assessment No. 122 (Prepared by the Johns Hopkins University Evidence-based Practice Center under Contract No. 290-02-0018). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E019-2.
36. Ellis P, Robinson P, Ciliska D, Armour T, Raina P, Brouwers M, et al. Diffusion and dissemination of evidence-based cancer control interventions. Evidence Report/Technology Assessment Number 79 (Prepared by McMaster University under Contract No. 290-97-0017). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E033.
37. Whelan TJ, O'Brien MA, Villasis-Keever M, Robinson P, Skye A, Gafni A, et al. Impact of cancer-related decision aids. Evidence Report/Technology Assessment Number 46 (Prepared by McMaster University under Contract No. 290-97-0017). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E004.
38. Ammerman A, Lindquist C, Hersey J, Jackman AM, Gavin NI, Garces C, et al. Efficacy of interventions to modify dietary behavior related to cancer risk. Evidence Report/Technology Assessment No. 25 (Contract No. 290-97-0011 to the Research Triangle Institute-University of North Carolina at Chapel Hill Evidence-based Practice Center). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E029.
39. McAlister F, Ezekowitz J, Wiebe N, Rowe B, Spooner C, Crumley E, et al. Cardiac resynchronization therapy for congestive heart failure. Evidence Report/Technology Assessment No. 106 (Prepared by the University of Alberta Evidence-based Practice Center under Contract No. 290-02-0023). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 05-E001-2.
40. Schein OD, Friedman DS, Fleisher LA, Lubomski LH, Magaziner J, Sprintz M, et al. Anesthesia management during cataract surgery. Evidence Report/Technology Assessment No. 16 (Prepared by the Johns Hopkins University Evidence-based Practice Center under Contract No. 290-097-0006). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E017.
41. Jampel H, Lubomski L, Friedman D. Treatment of coexisting cataract and glaucoma. Evidence Report/Technology Assessment Number 38 (Prepared by Johns Hopkins University Evidence-based Practice Center under Contract No. 290-97-0006). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E041.
42. Viswanathan M, Ammerman A, Eng E, Gartlehner G, Lohr KN, Griffith D, et al. Community-based participatory research: assessing the evidence. Evidence Report/Technology Assessment No. 99 (Prepared by RTI University of North Carolina Evidence-based Practice Center under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication 04-E022-2.
43. Rostom A, Dubé C, Cranney A, Saloojee N, Sy R, Garritty C, et al. Celiac disease. Evidence Report/Technology Assessment No. 104 (Prepared by the University of Ottawa Evidence-based Practice Center, under Contract No. 290-02-0021). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E029-2.
44. Grady D, Chaput L, Kristof M. Results of systematic review of research on diagnosis and treatment of coronary heart disease in women. Evidence Report/Technology Assessment No. 80 (Prepared by the University of California, San Francisco-Stanford Evidencebased Practice Center under Contract No. 290-97-0013). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-0035.
45. Marinopoulos SS, Dorman T, Ratanawongsa N, Wilson LM, Ashar BH, Magaziner JL, et al. Effectiveness of continuing medical education. Evidence Report/Technology Assessment No. 149 (Prepared by the Johns Hopkins Evidence-based Practice Center, under Contract No. 290-02-0018). Rockville, MD: Agency for Healthcare Research and Quality; 2007. AHRQ Publication No. 07-E006.
46. McCrory DC, Brown C, Gray RN, Goslin RE, Kolimaga JT, MacIntyre NR, et al. Management of acute exacerbations of COPD. Evidence Report/Technology Assessment No. 19 (Contract 290-97-0014 to the Duke University Evidence-based Practice Center). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E003.
47. Flamm CR, Aronson N, Bohn R, Finkelstein B, Piper M, Seidenfeld J, et al. Use of epoetin for anemia in chronic renal failure. Evidence Report/Technology Assessment No. 29 (Prepared by the Blue Cross and Blue Shield Association Technology Evaluation Center under Contract No. 290-97-0015). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E016.
48. Viswanathan M, Visco AG, Hartmann K, Wetcher ME, Gartlehner G, Wu JM, et al. Cesarean delivery on maternal request. Evidence Report/Technology Assessment No. 133 (Prepared by the RTI International-University of North Carolina Evidence-Based Practice Center under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E009.
49. Bonito AJ, Palton LL, Shugars DA, Lohr KN, Nelson JP, Bader JD, et al. Management of dental patients who are HIV-positive. Evidence Report/Technology Assessment No. 37 (Contract 290-97-0011 to the Research Triangle Institute-University of North Carolina at Chapel Hill Evidence-based Practice Center). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 01-E042.
50. Bader JD, Bonito AJ, Shugars DA. Cardiovascular effects of epinephrine on hypertensive dental patients. Evidence Report/Technology Assessment Number 48 (Prepared by Research Triangle Institute under Contract No. 290-97-0011). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E006.
51. Golden S, Boulware LE, Berkenblit G, Brancati F, Chander G, Marinopoulos S, et al. Use of glycated hemoglobin and microalbuminuria in the monitoring of diabetes mellitus. Evidence Report/Technology Assessment No. 84 (Prepared by Johns Hopkins Evidence-based Practice Center under Contract No. 290-97-0006). Rockville, MD: Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services; 2003. AHRQ Publication No. 04-E001.
52. Ross SD, Levine C, Ganz N, Frame D, Estok R, Stone L, et al. Systematic review of the current literature related to disability and chronic fatigue syndrome. Evidence Report/Technology Assessment No. 66 (Prepared by MetaWorks Inc. Evidence-based Practice Center under Contract No 290-97-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 03-E007.
53. Segal JB, Eng J, Jenckes MW, Tamariz LJ, Bolger DT, Krishnan JA, et al. Diagnosis and treatment of deep venous thrombosis and pulmonary embolism. Evidence Report/Technology Assessment Number 68 (Prepared by Johns Hopkins University Evidence-based Practice Center under Contract No. 290-97-0007). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E016.
54. Berkman ND, Bulik CM, Brownley KA, Lohr KN, Sedway JA, Rooks A, et al. Management of eating disorders. Evidence Report/Technology Assessment No. 135 (Prepared by the RTI International-University of North Carolina Evidence-Based Practice Center under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E010.
55. Lorenz K, Lynn J, Morton SC, Dy S, Mularski R, Shugarman L, et al. End-of-life care and outcomes. Evidence Report/Technology Assessment No. 110 (Prepared by the Southern California Evidence-based Practice Center, under Contract No. 290-02-0003). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 05-E004-2.
56. Aronson N, Flamm CR, Mark D, Lefevre F, Bohn RL, Finkelstein B, et al. Endoscopic retrograde cholangiopancreatography. Evidence Report/Technology Assessment Number 50 (Prepared by Blue Cross and Blue Shield Association under Contract No. 290-97-001-5). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E017.
57. Ross SD, Estok R, Chopra S, French J, et al. Management of newly diagnosed patients with epilepsy: a systematic reviewof the literature. Evidence Report/Technology Assessment No. 39 (Contract 290-97-0016 to MetaWorks, Inc.). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E038.
58. Chapell R, Reston J, Snyder D. Management of treatment-resistant epilepsy. Evidence Report/Technology Assessment No. 77 (Prepared by the ECRI Evidence-based Practice Center under Contract No 290-97-0020). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-0028.
59. Viswanathan M, Hartmann K, Palmieri R, Lux L, Swinson T, Lohr KN, et al. The use of episiotomy in obstetrical care: a systematic review. Evidence Report/ Technology Assessment No. 112 (Prepared by the RTI-UNC Evidence-based Practice Center, under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E009-2.
60. Perrin EC, Cole CH, Frank DA, Glicken SR, Guerina N, Petit K, et al. Criteria for determining disability in infants and children: failure to thrive. Evidence Report/Technology Assessment No. 72 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center under Contract No. 290-97-0019). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E026.
61. McDonagh MS, Carson S, Ash JS, Russman BS, Stavri PZ, Krages KP, et al. Hyperbaric oxygen therapy for brain injury, cerebral palsy, and stroke. Evidence Report/Technology Assessment No. 85 (Prepared by the Oregon Health & Science University Evidence-based Practice Center under Contract No. 290-97-0018). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 04-E003.
62. Berkman ND, DeWalt DA, Pignone MP, Sheridan SL, Lohr KN, Lux L, et al. Literacy and health outcomes. Evidence Report/Technology Assessment No. 87 (Prepared by RTI International-University of North Carolina under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E007-2.
63. Oremus M, Hanson M, Whitlock R, Young E, Gupta A, Dal Cin A, et al. The uses of heparin to treat burn injury. Evidence Report/Technology Assessment No. 148 (Prepared by the McMaster University Evidence-based Practice Center, under Contract No. 290-02-0020). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 07-E004.
64. Gebo KA, Jenckes MJ, Chander G, Torbenson MS, Ghanem KG, Herlong HF, et al. Management of chronic hepatitis C. Evidence Report/Technology Assessment No. 60 (Prepared by the Johns Hopkins University Evidence-based Practice Center under Contract No 290-97-0006). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E030.
65. Santaguida PL, Balion C, Hunt D, Morrison K, Gerstein H, Raina P, et al. Diagnosis, prognosis, and treatment of impaired glucose tolerance and impaired fasting glucose. Evidence Report/Technology Assessment No. 128 (Prepared by the McMaster University Evidence-based Practice Center under Contract No. 290-02-0020). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E026-2.
66. Buscemi N, Vandermeer B, Friesen C, Bialy L, Tubman M, Ospina M, et al. Manifestations and management of chronic insomnia in adults. Evidence Report/Technology Assessment No. 125 (Prepared by the University of Alberta Evidence-based Practice Center, under Contract No. C400000021). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E021-2.
67. Cole C, Binney G, Casey P, Fiascone J, Hagadorn J, Kim C, et al. Criteria for determining disability in infants and children: low birth weight. Evidence Report/Technology Assessment No. 70 (Prepared by Tufts New England Medical Center Evidence-based Practice Center under Contract No. 290-97-0019). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 03-E010.
68. Meenan RT, Saha S, Chou R, Swarztrauber K, Krages KP, O'Keefee-Rosetti M, et al. Effectiveness and cost-effectiveness of echocardiography and carotid imaging in the management of stroke. Evidence Report/Technology Assessment Number 49 (Prepared by Oregon Health & Science University Evidence-based Practice Center under Contract No. 290-97-0018). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-EO22.
69. Cook D, Meade M, Guyatt G, Griffith L, Booker L. Criteria for weaning from mechanical ventilation. Evidence Report/Technology Assessment No. 23 (Prepared by McMaster University under Contract No. 290-97-0017). Rockville, MD: Agency for Healthcare Research and Quality; 2000. AHRQ Publication No. 01-E010.
70. Buscemi N, Vandermeer B, Pandya R, Hooton N, Tjosvold L, Hartling L, et al. Melatonin for treatment of sleep disorders. Evidence Report/Technology Assessment No. 108 (Prepared by the University of Alberta Evidence-based Practice Center, under Contract No. 290-02-0023). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 05-E002-2.
71. Nelson HD, Haney E, Humphrey L, Miller J, Nedrow A, Nicolaidis C, et al. Management of menopause-related symptoms. Evidence Report/Technology Assessment No. 120 (Prepared by the Oregon Evidence-based Practice Center, under Contract No. 290-02-0024). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E016-2.
72. Beach MC, Cooper LA, Robinson KA, Price EG, Gray TL, Jenckes MW, et al. Strategies for improving minority healthcare quality. Evidence Report/Technology Assessment No. 90 (Prepared by the Johns Hopkins University Evidence-based Practice Center, Baltimore, MD). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E008-02.
73. McCrory DC, Pompeii LA, Skeen MB, Moon SD, Gray RN, Kolimaga JT, et al. Criteria to determine disability related to multiple sclerosis. Evidence Report/Technology Assessment No. 100 (Prepared by the Duke Evidence-based Practice Center, Durham, NC, under Contract No. 290-02-0025). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E019-2.
74. Ip S, Glicken S, Kulig J, O'Brien R, Sege RS. Management of neonatal hyperbilirubinemia. Evidence Report/Technology Assessment No. 65 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center under Contract No. 290-97-0019). Rockville, MD: U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E011.
75. Shekelle PG, Morton SC, Maglione MA, Suttorp M, Tu W, Li Z, et al. Pharmacological and surgical treatment of obesity. Evidence Report/Technology Assessment No. 103 (Prepared by the Southern California-RAND Evidence-Based Practice Center, Santa Monica, CA, under contract Number 290-02-0003). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E028-2.
76. Hodge W, Barnes D, Schachter H, Pan Y, Lowcock E, Zhang L, et al. Effects of omega-3 fatty acids on eye health. Evidence Report/Technology Assessment No. 117 (Prepared by University of Ottawa Evidence-based Practice Center under Contract No. 290-02-0021). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E008-2.
77. MacLean CH, Issa AM, Newberry SJ, Mojica WA, Morton SC, Garland RH, et al. Effects of omega-3 fatty acids on cognitive function with aging, dementia, and neurological diseases. Evidence Report/Technology Assessment No. 114 (Prepared by the Southern California Evidence-based Practice Center, under Contract No. 290-02-0003). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E011-2.
78. MacLean CH, Mojica WA, Morton SC, Pencharz J, Hasenfeld Garland R, Tu W, et al. Effects of omega-3 fatty acids on lipids and glycemic control in type II diabetes and the metabolic syndrome and on inflammatory bowel disease, rheumatoid arthritis, renal disease, systemic lupus erythematosus, and osteoporosis. Evidence Report/Technology Assessment. No. 89 (Prepared by Southern California/RAND Evidence-based Practice Center, under Contract No. 290-02-0003). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E012-2.
79. Lewin GA, Schachter HM, Yuen D, Marchant P, Mamaladze V, Tsertsvadze A, et al. Effects of omega-3 fatty acids on child and maternal health. Evidence Report/Technology Assessment No. 118 (Prepared by the University of Ottawa Evidence-based Practice Center, under Contract No. 290-02-0021). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E025-2.
80. Schachter HM, Kourad K, Merali Z, Lumb A, Tran K, Miguelez M, et al. Effects of omega-3 fatty acids on mental health. Evidence Report/Technology Assessment No. 116 (Prepared by the University of Ottawa Evidence-based Practice Center, Under Contract No. 290-02-0021). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E022-2.
81. Bonis PA, Chung M, Tatsioni A, sun Y, Kupelnick B, Lichtenstcin A, et al. Effects of omega-3 fatty acids on organ transplantation. Evidence Report/Technology Assessment No. 115 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E012-2.
82. Schachter H, Reisman J, Tran K, Dales B, Kourad K, Barnes D, et al. Health effects of omega-3 fatty acids on asthma. Evidence Report/Technology Assessment No. 91 (Prepared by University of Ottawa Evidence-based Practice Center under Contract No. 290-02-0021). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E013-2.
83. Wang C, Chung M, Lichtenstein A, Balk E, Kupelnick B, Devine D, et al. Effects of omega-3 fatty acids on cardiovascular disease. Evidence Report/Technology Assessment No. 94 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center, under Contract No. 290-02-0022). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E009-2.
84. Marcy M, Takata G, Chan LS, Shekelle P, Mason W, Wachsman W, Wachsman L, et al. Management of acute otitis media. Evidence Report/Technology Assessment No. 15 (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-97-0001). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E010.
85. Shekelle P, Takata G, Chan LS, MangioneeSmith R, Corley PM, Morphew T, et al. Diagnosis, natural history, and late effects of otitis media with effusion. Evidence Report/Technology Assessment No. 55 (Prepared by Southern California Evidence-based Practice Center under Contract No. 290-97-0001, Task Order No. 4). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E023.
86. Hickam DH, Severance S, Feldstein A, Ray L, Gorman P, Schuldheis S, et al. The effect of health care working conditions on patient safety. Evidence Report/Technology Assessment Number 74 (Prepared by Oregon Health & Science University under Contract No. 290-97-0018). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E024.
87. Gaynes BN, Gavin N, Meltzer-Brody S, Lohr KN, Swinson T, Gartlehner G, et al. Perinatal depression: prevalence, screening accuracy, and screening outcomes. Evidence Report/Technology Assessment No. 119 (Prepared by the RTI-University of North Carolina Evidence-based Practice Center, under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E006-2.
88. Holtzman J, Schmitz K, Babes G, Kane RL, Duval S, Wilt TJ, et al. Effectiveness of behavioral interventions to modify physical activity behaviors in general populations and cancer patients and survivors. Evidence Report/Technology Assessment No. 102 (Prepared by the Minnesota Evidence-based Practice Center, under Contract No. 290-02-0009). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E027-2.
89. Myers ER, Blumrick R, Christian AL, Datta S, Gray RN, Kolimaga JT, et al. Management of prolonged pregnancy. Evidence Report/Technology Assessment No. 53 (Prepared by Duke Evidence-based Practice Center, Durham, NC, under Contract No. 290-97-0014). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E018.
90. Bush DE, Ziegelstein RC, Patel UV, Thombs BD, Ford DE, Fauerbach JA, et al. Post-myocardial infarction depression. Evidence Report/Technology Assessment No. 123 (Prepared by the Johns Hopkins University Evidence-based Practice Center under Contract No. 290-02-0018). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E018-2.
91. Long A, McFadden C, DeVine D, Litt M, Chew P, Kupelnick B, et al. Management of allergic and nonallergic rhinitis. Evidence Report/Technology Assessment No. 54 (Prepared by New England Medical Center Evidence-based Practice Center under Contract No. 290-97-0019). Rockville, MD: Agency for Healthcare Research and Quality; 2002. AHRQ Publication No. 02-E024.
92. Balk E, Chung M, Chew P, Ip S, Raman G, Kupelnick B, et al. Effects of soy on health outcomes. Evidence Report/Technology Assessment No. 126 (Prepared by Tufts-New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 05-E024-2.
93. McCrory DC, Samsa GP, Hamilton BB, Govert JA, Matchar DB, Goslin RE, et al. Treatment of pulmonary disease following cervical spinal cord injury. Evidence Report/Technology Assessment Number 27 (Prepared by the Duke Evidence-based Practice Center under Contract No. 290-97-0014). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E014.
94. DeForge D, Blackmer J, Moher D, Garritty C, Cronin V, Yazdi F, et al. Sexuality and reproductive health following spinal cord injury. Evidence Report/Technology Assessment No. 109 (Prepared by the University of Ottawa Evidence-based Practice Center under Contract No. 290-02-0021). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 05-E003-2.
95. Ranney L, Melvin C, Lux LJ, McClain E, Morgan L, Lohr KN, et al. Tobacco use: prevention, cessation, and control. Evidence Report/Technology Assessment No. 140 (Prepared by the RTI-University of North Carolina Evidence-based Practice Center under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E015.
96. Kiddoo D, Klassen TP, Lang ME, Friesen C, Russell K, Spooner C, et al. The effectiveness of different methods of toilet training for bowel and bladder control. Evidence Report/Technology Assessment No. 147 (Prepared by the University of Alberta Evidence-based Practice Center, under contract number 290-02-0023). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 07-E003.
97. Kane RL, Saleh KJ, Wilt TJ, Bershadsky B, cross WW III, MacDonald RM, et al. Total knee replacement. Evidence Report/Technology Assessment No. 86 (Prepared by the Minnesota Evidence-based Practice Center, Minneapolis, MN). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 04-E006-2.
98. Viswanathan M, Hartmann K, McKoy N, Stuart G, Rankins N, Thieda P, et al. Management of uterine fibroids: an update of the evidence. Evidence Report/Technology Assessment No. 154 (Prepared by RTI International-University of North Carolina Evidence-based Practice Center under Contract No. 290-02-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2007. AHRQ Publication No. 07-E011.
99. Guise J-M, McDonagh MS, Hashima J, Kraemer DF, Eden KB, Berlin M, et al. Vaginal birth after cesarean (VBAC). Evidence Report/Technology Assessment No. 71 (Prepared by the Oregon Health & Science University Evidence-based Practice Center under Contract No 290-97-0018). Rockville, MD: Agency for Healthcare Research and Quality; 2003. AHRQ Publication No. 03-E018.
100. Velmahos GC, Kern J, Chan L, Oder D, Murray JA, Shekelle P, et al. Prevention of venous thromboembolism after injury. Evidence Report/ Technology Assessment No. 22 (Prepared by Southern California Evidence-based Practice Center/RAND under Contract No. 290-97-0001). Rockville, MD: Agency for Healthcare Research and Quality; 2000. AHRQ Publication No. 01-E004.
101. Chan LS, Kipke MD, Schneir A, Iverson E, Warf C, Limbos MA, et al. Preventing violence and related health-risking social behaviors in adolescents. Evidence Report/Technology Assessment No. 107 (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-02-2003). Rockville, MD: Agency for Healthcare Research and Quality; 2004. AHRQ Publication No. 04-E032-2.
102. Beach J, Rowe BH, Blitz S, Crumley E, Hooton N, Russell K, et al. Diagnosis and management of work-related asthma. Evidence Report/Technology Assessment No. 129 (Prepared by the University of Alberta Evidence-based Practice Center, under Contract No. 290-02-0023). Rockville, MD: Agency for Healthcare Research and Quality; 2005. AHRQ Publication No. 06-E003-2.
103. Coulter ID, Hardy ML, Favreau JT, Elfenbaum PD, Morton SC, Roth EA, et al. Mind-body interventions for gastrointestinal conditions. Evidence Report/Technology Assessment No. 40 (Prepared by Southern California Evidence-based Practice Center/RAND under Contract No. 290-97-0001). Rockville, MD: Agency for Healthcare Research and Quality; 2001. AHRQ Publication No. 01-E030.
104. Hersh WR, Hickam DH, Severance SM, Dana TL, Krages KP, Helfand M. Telemedicine for the medicare population: update. Evidence Report/Technology Assessment No. 131 (Prepared by the Oregon Evidence-based Practice Center under Contract No. 290-02-0024). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E007.
105. Levine C, Armstrong K, Chopra S, Estok R, Zhang S, Ross S. Diagnosis and management of specific breast abnormalities. Evidence Report/Technology Assessment No. 33 (Prepared by MetaWorks, Inc., Boston, MA under Contract No. 290-97-0016). Rockville, MD: Agency for Healthcare Research and Quality; 2001.AHRQPublication No. 01-E046.
106. Matchar DB, Thakur ME, Grossman I, McCrory Dc, Orlando LA, Steffens DC, et al. Testing for cytochrome P450 polymorphisms in adults with non-psychotic depression treated with selective serotonin reuptake inhibitors (SSRIs). Evidence Report/Technology Assessment No. 146 (Prepared by the Duke Evidence-based Practice Center under Contract No. 290-02-0025). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 07-E002.
107. Seidenfeld J, Samson DJ, Bonnell CJ, Ziegler KM, Aronson N. Management of small cell lung cancer. Evidence Report/Technology Assessment No. 143 (Prepared by Blue Cross and Blue Shield Association Technology Evaluation Center Evidence-based Practice Center under Contract No. 290-02-0026). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 06-E016.
108. Myers ER, Havrilesky LJ, Kulasingam SL, Sanders GD, Cline KE, Gray RN, et al. Genomic tests for ovarian cancer detection and management. Evidence Report/Technology Assessment No. 145 (Prepared by the Duke University Evidence-based Practice Center under Contract No. 290-02-0025). Rockville, MD: Agency for Healthcare Research and Quality; 2006. AHRQ Publication No. 07-E001.
109. ECRI Institute Evidence-based Practice Center. Quality item checklist for SINGLE-GROUP studies (unpublished). 2008.
110. University Of Alberta Evidence-Based Practice Centre. Quality Assessment Tool for Observational Analytical Studies.
111. National Institute for Health and Clinical Excellence. The guidelines manual. London, UK: National Institute for Health and Clinical Excellence; 2007. Available at www.nice.org.uk. Accessed June 9, 2011.
112. Khan KS, ter Riet G, Glanville J, et al., editors. Undertaking systematic reviews of research on effectiveness. 2nd edition. York, UK: NHS Centre for Reviews and Dissemination; 2001.
113. Johnston P, Wilkinson K. Enhancing validity of critical tasks selected for college and university program portfolios. National Forum Teach Educ J 2009;19(3):1-6.
114. Crisp AH, Callender JS, Halek C, Hsu LKG. Long-term mortality in anorexia nervosa: a 20-year follow-up of the St. George's and Aberdeen cohorts. Br J Psychiatry 1992;161:104-7. PMID: 1638303.
115. Daniel M, Green LW, Marion SA, Gamble D, Herbert CP, Hertzman C, et al. Effectiveness of community-directed diabetes prevention and control in a rural Aboriginal population in British Columbia, Canada. Soc Sci Med 1999;48:815-32. PMID: 10190643. (Pubitemid 29089266)
116. Hedderson MM, Weiss NS, Sacks DA, Petttt DJ, Selby JV, Quesenberry CP, et al. Pregnancy weight gain and risk of neonatal complications.ObstetGynecol 2006;108:1153-61.PMID: 17077237.
117. Di Lieto A, Iannotti F, De Falco M, Staibano S, Pollio F, Ciociola F, et al. Immunohistochemical detection of insulin-like growth factor type I receptor and uterine volume changes in gonadotropin-releasing hormone analog-treated uterine leiomyomas. Am J Obstet Gynecol 2003;188:702-6. PMID: 12634644. (Pubitemid 36332437)
118. Coleman FH. Safety and efficacy of combined ritodrine and magnesium sulfate for preterm labor: a method for reduction of complications. Am J Perinatol 1990;7(4):366-9. PMID: 2222631. (Pubitemid 20375592)
119. Schindl M, Birner P, Reingrabner M, Joura EA, Husslein P, Langer M. Elective cesarean section vs. spontaneous delivery: a comparative study of birth experience. Acta Obstet Gynecol Scand 2003;82:834-40. PMID: 12911445. (Pubitemid 37082913)
120. Fouad MN, Kiefe CI, Bartolucci AA, Burst NM, Ulene V, Harvey MR. A hypertension control program tailored to unskilled and minority workers. Ethn Dis 1997;7:191-9. PMID: 9467701. (Pubitemid 127606316)
121. Baker DW, Gazmararian JA, Williams MV, Scott T, Parker RM, Green D, et al. Functional health literacy and the risk of hospital admission among Medicare managed care enrollees. Am J Public Health 2002;92:1278-83. PMID: 12144984. (Pubitemid 34815791)
122. Kinney TR, Helms RW, O'Branski EE, Ohene-Frempong K, Wang W, Daeschner C, et al. Safety of hydroxyurea in children with sickle cell anemia: results of the HUG-KIDS Study, a phase I/II trial. Blood 1999;94:1550-4. PMID: 10477679. (Pubitemid 29411304)
123. VanHamMAPC,van Dongen PWJ, Mulder J. Maternal consequences of caesarean section. A retrospective study of intra-operative and postoperative maternal complications of caesarean section during a 10-year period. Eur J Obstet Gynecol Reprod Biol 1997;74(1):1-6. PMID: 9243191.
124. Blood E, Spratt KF. Disagreement on agreement: two alternative agreement coefficients. Paper 186-2007 SAS Global Forum. 2007.
125. Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med 1998 Jan 15;17(1):101-10. (Pubitemid 28020212)
126. Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 1990;43:543-9. PMID: 2348207. (Pubitemid 20178543)