Reliability analysis for a proposed critical appraisal tool demonstrated value for diverse research designs

Journal of Clinical Epidemiology

Volumn 65, Issue 4, 2012, Pages 375-383

  Crowe, Michael ^a   Sheppard, Lorraine ^a,b   Campbell, Alistair ^a  

^a JAMES COOK UNIVERSITY   (Australia)

^b UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

Author keywords

Critical appraisal; Evidence based practice; Methodology; Reliability; Research; Research design; Validation

Indexed keywords

ARTICLE; CLINICAL RESEARCH; CORRELATION COEFFICIENT; CRITICAL APPRAISAL TOOL; DECISION MAKING; EVIDENCE BASED PRACTICE; PARTICIPANT OBSERVATION; PRIORITY JOURNAL; QUALITY CONTROL; RATING SCALE; RELIABILITY; RESEARCH ETHICS; SAMPLING; STUDY DESIGN; VALIDATION PROCESS;

AUSTRALIA; EPIDEMIOLOGIC RESEARCH DESIGN; EVIDENCE-BASED MEDICINE; FEEDBACK, PSYCHOLOGICAL; HUMANS; REPRODUCIBILITY OF RESULTS; SAMPLING STUDIES; STATISTICS AS TOPIC;

EID: 81855225077     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2011.08.006     Document Type: Article

References (30)

1. M. Crowe, and L. Sheppard A review of critical appraisal tools show they lack rigour: alternative tool structure is proposed J Clin Epidemiol 64 2011 79 89
2. P. Glasziou, L. Irwig, C. Bain, and G. Colditz Systematic reviews in health care: a practical guide 2001 Cambridge University Press Cambridge, MA
3. J.J. Deeks, J. Dinnes, R. D'Amico, A.J. Sowden, C. Sakarovitc, and M. Petticrew Evaluating non-randomised intervention studies Health Technol Assess 7 27 2003
4. S. Armijo Olivo, L.G. Macedo, I.C. Gadotti, J. Fuentes, T. Stanton, and D.J. Magee Scales to assess the quality of randomized controlled trials: a systematic review Phys Ther 88 2 2008 156 175 (Pubitemid 351210558)
5. P. Jüni, A. Witschi, R. Bloch, and M. Egger The hazards of scoring the quality of clinical trials for meta-analysis JAMA 282 11 1999 1054 1060 (Pubitemid 29436453)
6. A. Moyer, and J.W. Finney Rating methodological quality: toward improved assessment and investigation Account Res 12 4 2005 299 313
7. A.E. Bialocerkowski, K.A. Grimmer, S.F. Milanese, and S. Kumar Application of current research evidence to clinical physiotherapy practice J Allied Health 33 4 2004 230 237 (Pubitemid 40115494)
8. C.G. Maher, C. Sheerington, R.D. Herbert, A.M. Moseley, and M. Elkins Reliability of the PEDro scale for rating quality of randomized controlled trials Phys Ther 83 8 2003 713 721 (Pubitemid 37238882)
9. Crowe M, Sheppard L. A proposed critical appraisal tool: An evaluation of construct validity. Int J Nurs Stud [Epub ahead of press; doi:10.1016/j. ijnurstu.2011.06.004 ].
10. American Educational Research Association American Psychological Association National Council on Measurement in Education Standards for educational and psychological testing 2nd ed 1999 American Educational Research Association Washington, DC
11. K.S. Khan, G. ter Riet, J. Glanville, A.J. Sowden, and J. Kleijen Undertaking systematic reviews of research on effectiveness: CRD's guidance for those carrying out or commissioning reviews (CRD Report 4) 2001 University of York York, England
12. D. Moher, A. Jones, and L. Lepage Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation JAMA 285 2001 1992 1995 (Pubitemid 32366952)
13. M.K. Cho, and L.A. Bero Instruments for assessing the quality of drug studies published in the medical literature JAMA 272 2 1994 101 104 (Pubitemid 24206037)
14. S. Reis, D. Hermoni, R. Van-Raalte, R. Dahan, and J.M. Borkan Aggregation of qualitative studies - from theory to practice: patient priorities and family medicine/general practice evaluations Patient Educ Couns 65 2007 214 222 (Pubitemid 46073561)
15. B. Shea, J. Grimshaw, G. Wells, M. Boers, N. Andersson, and C. Hamel Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews BMC Med Res Methodol 7 10 2007
16. R.L. Tate, S. McDonald, M. Perdices, L. Togher, R. Schultz, and S. Savage Rating the methodological quality of single-subject designs and n-of-1 trials: introducing the single-case experimental design (SCED) scale Neuropsychol Rehabil 18 4 2008 385 401 (Pubitemid 351896818)
17. A.R. Jadad, R.A. Moore, D. Carroll, C. Jenkinson, D.J.M. Reynolds, and D.J. Gavaghan Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 17 1 1996 1 12 (Pubitemid 26120810)
18. L.J. Cronbach, and R.J. Shavelson My current thoughts on coefficient alpha and successor procedures Educ Psychol Meas 64 2004 391 418
19. G.A. Marcoulides Generalizability theory H.E.A. Tinsley, S.D. Brown, Handbook of applied multivariate statistics and mathematical modeling 2000 Academic Press San Diego, CA 527 551
20. D.L. Streiner, and G.R. Norman Health measurement scales: a practical guide to their development and use 4th ed 2008 Oxford University Press Oxford, UK
21. J.W. Creswell Research design: qualitative, quantitative, and mixed methods approaches 2nd ed 2008 Sage Thousand Oaks, CA
22. W.L. Neuman Social research methods: qualitative and quantitative approaches 2006 Pearson Boston, MA
23. L.G. Portney, and M.P. Watkins Foundations of clinical research: applications to practice 3rd ed 2008 Prentice Hall Upper Saddle River, NJ
24. Haadr M. Random.org: random sequence generator. 2009. Available at http://www.random.org/sequences. Accessed November 24, 2010.
25. S.D. Walter, M. Eliasziw, and A. Donner Sample size and optimal designs for reliability studies Stat Med 17 1998 101 110 (Pubitemid 28020212)
26. R. Bloch G-String-III. Version 5.4.2 2010 Programme for Educational Research and Development Hamilton, ON
27. R.L. Brennan Generalizability theory 2001 Springer New York
28. Thompson B, editor. A brief introduction to generalizability theory. In: Score reliability: contemporary thinking on reliability issues. Thousand Oaks, CA: Sage; 2003:43-58.
29. C. Mushquash, and B.P. O'Connor SPSS and SAS programs for generalizability theory analyses Behav Res Method 38 2006 542 547
30. SPSS Inc. PASW Statistics 18 command syntax reference 2009 IBM SPSS Inc Chicago, IL