Interrater Reliability in Assessing Quality of Diagnostic Accuracy Studies Using the QUADAS Tool. A Preliminary Assessment

Academic Radiology

Volumn 13, Issue 7, 2006, Pages 803-810

  Hollingworth, William ^a   Medina, L Santiago ^c   Lenkinski, Robert E ^d   Shibata, Dean K ^a   Bernal, Byron ^c   Zurakowski, David ^e   Comstock, Bryan ^b   Jarvik, Jeffrey G ^a  

^a Department of Radiology ^*  (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

^c MIAMI CHILDREN'S HOSPITAL   (United States)

^d BETH ISRAEL DEACONESS MEDICAL CENTER   (United States)

^e HARVARD MEDICAL SCHOOL   (United States)

Author keywords

evidence based medicine; methods; radiology; review, systematic; Sensitivity and specificity

Indexed keywords

ARTICLE; CORRELATION ANALYSIS; DIAGNOSTIC ACCURACY; EVALUATION; INTERRATER RELIABILITY; METHODOLOGY; NUCLEAR MAGNETIC RESONANCE IMAGING; NUCLEAR MAGNETIC RESONANCE SPECTROSCOPY; PRIORITY JOURNAL; QUALITY CONTROL; STANDARDIZATION; STATISTICAL ANALYSIS;

BRAIN NEOPLASMS; CONSENSUS; DIAGNOSTIC SERVICES; EVIDENCE-BASED MEDICINE; HUMANS; MAGNETIC RESONANCE SPECTROSCOPY; OBSERVER VARIATION; PEER REVIEW, RESEARCH; QUALITY CONTROL; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; REVIEW LITERATURE; REVIEW LITERATURE AS TOPIC;

EID: 33744999823     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2006.03.008     Document Type: Article

References (35)

1. Glasziou P., Irwig L., Bain C., and Colditz G. Systematic Reviews in Health Care. A Practical Guide (2001), Cambridge University Press, Cambridge
2. Greenland S., and O'Rourke K. On the bias produced by quality scores in meta-analysis, and a hierarchical view of proposed solutions. Biostatistics 2 (2001) 463-471
3. Whiting P., Rutjes A.W., Dinnes J., Reitsma J.B., Bossuyt P.M., and Kleijnen J. A systematic review finds that diagnostic reviews fail to incorporate quality despite available tools. J Clin Epidemiol 58 (2005) 1-12
4. Thompson S.G., and Higgins J.P. How should meta-regression analyses be undertaken and interpreted?. Stat Med 21 (2002) 1559-1573
5. Clark H.D., Wells G.A., Huet C., et al. Assessing the quality of randomized trials. reliability of the Jadad scale. Control Clin Trials 20 (1999) 448-452
6. Whiting P., Rutjes A.W., Reitsma J.B., Bossuyt P.M., and Kleijnen J. The development of QUADAS. a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 3 (2003) 25
7. Hays R.D., Anderson R., and Revicki D. Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res 2 (1993) 441-449
8. Stengel D., Bauwens K., Rademacher G., Mutze S., and Ekkernkamp A. Association between compliance with methodological standards of diagnostic research and reported test accuracy. meta-analysis of focused assessment of US for trauma. Radiology 236 (2005) 102-111
9. Westwood M.E., Whiting P.F., and Kleijnen J. How does study quality affect the results of a diagnostic meta-analysis?. BMC Med Res Methodol 5 (2005) 20
10. Whiting P., Harbord R., and Kleijnen J. No role for quality scores in systematic reviews of diagnostic accuracy studies. BMC Med Res Methodol 5 (2005) 19
11. Whiting P.F., Westwood M.E., Rutjes A.W., Reitsma J.B., Bossuyt P.M., and Kleijnen J. Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Med Res Methodol 6 (2006) 9
12. Hollingworth W., Medina L.S., Lenkinski R.E., et al. A systematic literature review of magnetic resonance spectroscopy (MRS) for the characterization of brain tumors. AJNR Am J Neuroradiol (2006) In Press
13. Astrakas L.G., Zurakowski D., Tzika A.A., et al. Noninvasive magnetic resonance spectroscopic imaging biomarkers to predict the clinical grade of pediatric brain tumors. Clin Cancer Res 10 (2004) 8220-8228
14. Devos A., Lukas L., Suykens J.A., et al. Classification of brain tumours using short echo time 1H MR spectra. J Magn Reson 170 (2004) 164-175
15. Fountas K.N., Kapsalaki E.Z., Vogel R.L., Fezoulidis I., Robinson J.S., and Gotsis E.D. Noninvasive histologic grading of solid astrocytomas using proton magnetic resonance spectroscopy. Stereotact Funct Neurosurg 82 (2004) 90-97
16. Gajewicz W., Papierz W., Szymczak W., and Goraj B. The use of proton MRS in the differential diagnosis of brain tumors and tumor-like processes. Med Sci Monit 9 (2003) MT97-MT105
17. Herminghaus S., Dierks T., Pilatus U., et al. Determination of histopathological tumor grade in neuroepithelial brain tumors by using spectral pattern analysis of in vivo spectroscopic data. J Neurosurg 98 (2003) 74-81
18. Huang Y., Lisboa P.J., and El-Deredy W. Tumour grading from magnetic resonance spectroscopy. a comparison of feature extraction with variable selection. Stat Med 22 (2003) 147-164
19. Law M., Yang S., Wang H., et al. Glioma grading. sensitivity, specificity, and predictive values of perfusion MR imaging and proton MR spectroscopic imaging compared with conventional MR imaging. AJNR Am J Neuroradiol 24 (2003) 1989-1998
20. Lukas L., Devos A., Suykens J.A., et al. Brain tumor classification based on long echo proton MRS signals. Artif Intell Med 31 (2004) 73-89
21. Majos C., Alonso J., Aguilera C., et al. Adult primitive neuroectodermal tumor. proton MR spectroscopic findings with possible application for differential diagnosis. Radiology 225 (2002) 556-566
22. Majos C., Alonso J., Aguilera C., et al. Utility of proton MR spectroscopy in the diagnosis of radiologically atypical intracranial meningiomas. Neuroradiology 45 (2003) 129-136
23. Majos C., Alonso J., Aguilera C., et al. Proton magnetic resonance spectroscopy ((1)H MRS) of human brain tumours. assessment of differences between tumour types and its applicability in brain tumour categorization. Eur Radiol 13 (2003) 582-591
24. Majos C., Julia-Sape M., Alonso J., et al. Brain tumor classification by proton MR spectroscopy. comparison of diagnostic accuracy at short and long TE. AJNR Am J Neuroradiol 25 (2004) 1696-1704
25. McKnight T.R., von dem Bussche M.H., Vigneron D.B., et al. Histopathological validation of a three-dimensional magnetic resonance spectroscopy index as a predictor of tumor presence. J Neurosurg 97 (2002) 794-802
26. Mishra A.M., Gupta R.K., Jaggi R.S., et al. Role of diffusion-weighted imaging and in vivo proton magnetic resonance spectroscopy in the differential diagnosis of ring-enhancing intracranial cystic mass lesions. J Comput Assist Tomogr 28 (2004) 540-547
27. Moller-Hartmann W., Herminghaus S., Krings T., et al. Clinical application of proton magnetic resonance spectroscopy in the diagnosis of intracranial mass lesions. Neuroradiology 44 (2002) 371-381
28. Nafe R., Herminghaus S., Raab P., et al. Preoperative proton-MR spectroscopy of gliomas-correlation with quantitative nuclear morphology in surgical specimen. J Neurooncol 63 (2003) 233-245
29. Opstad K.S., Murphy M.M., Wilkins P.R., Bell B.A., Griffiths J.R., and Howe F.A. Differentiation of metastases from high-grade gliomas using short echo time 1H spectroscopy. J Magn Reson Imaging 20 (2004) 187-192
30. 1H MR-spectroscopy at 3.0 T in the differential diagnosis of recurrent or residual gliomas. a comparative study. J Neurooncol 70 (2004) 49-58
31. Tate A.R., Majos C., Moreno A., Howe F.A., Griffiths J.R., and Arus C. Automated classification of short echo time in in vivo 1H brain tumor spectra. a multicenter study. Magn Reson Med 49 (2003) 29-36
32. Viera A.J., and Garrett J.M. Understanding interobserver agreement. the kappa statistic. Fam Med 37 (2005) 360-363
33. Kundel H.L., and Polansky M. Measurement of observer agreement. Radiology 228 (2003) 303-308
34. Chmura Kraemer H., Periyakoil V.S., and Noda A. Kappa coefficients in medical research. Stat Med 21 (2002) 2109-2129
35. Vach W. The dependence of Cohen's kappa on the prevalence does not matter. J Clin Epidemiol 58 (2005) 655-661