The STARD statement for reporting studies of diagnostic accuracy: Explanation and elaboration

Clinical Chemistry

Volumn 49, Issue 1, 2003, Pages 7-18

  Bossuyt, Patrick M ^a   Reitsma, Johannes B ^a   Bruns, David E ^b,c   Gatsonis, Constantine A ^d   Glasziou, Paul P ^e   Irwig, Les M ^f   Moher, David ^g   Rennie, Drummond ^h,i   De Vet, Henrica C W ^j   Lijmer, Jeroen G ^a  

^a ACADEMIC MEDICAL CENTER   (Netherlands)

^b UNIVERSITY OF VIRGINIA   (United States)

^c Clinical Chemistry   (United States)

^d BROWN UNIVERSITY   (United States)

^e UNIVERSITY OF QUEENSLAND   (Australia)

^f UNIVERSITY OF SYDNEY   (Australia)

^g Chalmers Research Group   (Canada)

^h UNIVERSITY OF CALIFORNIA   (United States)

ⁱ AMERICAN MEDICAL ASSOCIATION   (United States)

^j UNIVERSITY OF AMSTERDAM   (Netherlands)

more..

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARTICLE; DECISION MAKING; DIAGNOSTIC ACCURACY; EVALUATION; EVIDENCE BASED MEDICINE; HEALTH CARE QUALITY; MEDICAL RESEARCH; QUALITY CONTROL; SCORING SYSTEM; STANDARD; STANDARD FOR REPORTING OF DIAGNOSTIC ACCURACY; TREATMENT OUTCOME;

ALGORITHMS; BIAS (EPIDEMIOLOGY); CLINICAL TRIALS; DIAGNOSTIC TECHNIQUES AND PROCEDURES; PUBLISHING; REFERENCE STANDARDS; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; SENSITIVITY AND SPECIFICITY; STATISTICS;

EID: 0037232979     PISSN: 00099147     EISSN: None     Source Type: Journal    
DOI: 10.1373/49.1.7     Document Type: Article

References (87)

1. Guyatt GH, Tugwell PX, Feeny DH, Haynes RB, Drummond M. A framework for clinical evaluation of diagnostic technologies. CMAJ 1986;134:587-94.
2. Sackett DL, Haynes RB. The architecture of diagnostic research. In: Knottnerus JA, ed. The evidence base of clinical diagnosis. London: BMJ Publishing Group, 2002:19-38.
3. Jaeschke R, Guyatt G, Sackett DL. Users' guides to the medical literature. III. How to use an article about a diagnostic test. A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA 1994;271:389-91.
4. Jaeschke R, Guyatt GH, Sackett DL. Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA 1994;271:703-7.
5. Mower WR. Evaluating bias and variability in diagnostic test reports. Ann Emerg Med 1999;33:85-91.
6. Begg CB. Biases in the assessment of diagnostic tests. Stat Med 1987;6:411-23.
7. Sheps SB, Schechter MT. The assessment of diagnostic tests. A survey of current medical research. JAMA 1984;252:2418-22.
8. Reid MC, Lachs MS, Feinstein AR. Use of methodological standards in diagnostic test research. Getting better but still not good. JAMA 1995;274:645-51.
9. Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA 1999; 282:1061-6.
10. Knottnerus JA, Muds JW. Assessment of the accuracy of diagnostic tests: the cross-sectional study. In: Knottnerus JA, ed. The evidence base of clinical diagnosis. London: BMJ Publishing Group, 2002:39-59.
11. Griner PF, Mayewski RJ, Mushlin AI, Greenland P. Selection and interpretation of diagnostic tests and procedures. Principles and applications. Ann Intern Med 1981;94:557-92.
12. Habbema JDF, Eijkemans R, Krijnen P, Knottnerus JA. Analysis of data on the accuracy of diagnostic tests. In: Knottnerus JA, ed. The evidence base of clinical diagnosis. London: BMJ Publishing Group, 2002:117-44.
13. Irwig LM, Bossuyt PM, Glasziou PP, Gatsonis C, Lijmer JG. Designing studies to ensure that estimates of test accuracy will travel. In: Knottnerus JA, ed. The evidence base of clinical diagnosis. London: BMJ Publishing Group, 2002:95-116.
14. Yee J, Akerkar GA, Hung RK, Steinauer-Gebauer AM, Wall SD, McQuaid KR. Colorectal neoplasia: Performance characteristics of CT colonography for detection in 300 patients. Radiology 2001; 219:685-92.
15. Haynes RB, Wilczynski N, McKibbon KA, Walker CJ, Sinclair JC. Developing optimal search strategies for detecting clinically sound studies in MEDLINE. J Am Med Inform Assoc 1994;1:447-58.
16. Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ 1994;309:1286-91.
17. McKibbon KA, Walker-Dilks CJ. Beyond ACP Journal Club: how to harness MEDLINE for diagnostic problems. ACP J Club 1994; 121(Suppl 2):A10-2.
18. Deville WL, Bezemer PD, Bouter LM. Publications on diagnostic test evaluation in family medicine journals: An optimal search strategy. J Clin Epidemiol 2000;53:65-9.
19. Wilczynski NL, McKibbon KA, Haynes RB. Enhancing retrieval of best evidence for health care from bibliographic databases: Calibration of the hand search of the literature. Medinfo 2001;10: 390-3.
20. Kim WY, Danias PG, Stuber M, Flamm SD, Plein S, Nagel E, et al. Coronary magnetic resonance angiography for the detection of coronary stenoses. N Engl J Med 2001;345:1863-9.
21. World Medical Association Declaration of Helsinki. Recommendations guiding physicians in biomedical research involving human subjects. JAMA 1997;277:925-6.
22. Newhall WJ, Johnson RE, DeLisle S, Fine D, Hadgu A, Matsuda B, et al. Head-to-head evaluation of five chlamydia tests relative to a quality-assured culture standard. J Clin Microbiol 1999;37: 681-5.
23. Philbrick JT, Horwitz RI, Feinstein AR. Methodologic problems of exercise testing for coronary artery disease: Groups, analysis and bias. Am J Cardiol 1980;46:807-12.
24. Detrano R, Gianrossi R, Froelicher V. The diagnostic accuracy of the exercise electrocardiogram: a meta-analysis of 22 years of research. Prog Cardiovasc Dis 1989;32:173-206.
25. Stein PD, Gottschalk A, Henry JW, Shivkumar K. Stratification of patients according to prior cardiopulmonary disease and probability assessment based on the number of mismatched segmental equivalent perfusion defects. Approaches to strengthen the diagnostic value of ventilation/perfusion lung scans in acute pulmonary embolism. Chest 1993;104:1461-7.
26. Knottnerus JA, Knipschild PG, Sturmans F. Symptoms and selection bias: the influence of selection towards specialist care on the relationship between symptoms and diagnoses. Theor Med 1989; 10:67-81.
27. Knottnerus JA, Leffers P. The influence of referral patterns on the characteristics of diagnostic tests. J Clin Epidemiol 1992;45: 1143-54.
28. Melbye H, Straume B. The spectrum of patients strongly influences the usefulness of diagnostic tests for pneumonia. Scand J Prim Health Care 1993;11:241-6.
29. van der Schouw YT, Van Dijk R, Verbeek AL. Problems in selecting the adequate patient population from existing data files for assessment studies of new diagnostic tests. J Clin Epidemiol 1995;48:417-22.
30. Kline JA, Israel EG, Michelson EA, O'Neil BJ, Plewa MC, Portelli DC. Diagnostic accuracy of a bedside D-dimer assay and alveolar dead-space measurement for rapid exclusion of pulmonary embolism: a multicenter study. JAMA 2001;285:761-8.
31. Vande Berg BC, Lecouvet FE, Poilvache P, Dubuc JE, Bedat B, Maldague B, et al. Dual-detector spiral CT arthrography of the knee: accuracy for detection of meniscal abnormalities and unstable meniscal tears. Radiology 2000;216:851-7.
32. Sorensen HT, Sabroe S, Olsen J. A framework for evaluation of secondary data sources for epidemiological research. Int J Epidemiol 1996;25:435-42.
33. Mayeux R, Saunders AM, Shea S, Mirra S, Evans D, Roses AD, et al. Utility of the apolipoprotein E genotype in the diagnosis of Alzheimer's disease. Alzheimer's Disease Centers Consortium on Apolipoprotein E and Alzheimer's Disease. N Engl J Med 1998; 338:506-11.
34. Mol BW, Lijmer JG, van der Meulen J, Pajkrt E, Bilardo CM, Bossuyt PM. Effect of study design on the association between nuchal translucency measurement and Down syndrome. Obstet Gynecol 1999;94:864-9.
35. Corley DE, Kirtland SH, Winterbauer RH, Hammar SP, Dail DH, Bauermeister DE, et al. Reproducibility of the histologic diagnosis of pneumonia among a panel of four pathologists: analysis of a gold standard. Chest 1997;112:458-65.
36. Magklara A, Scorilas A, Catalona WJ, Diamandis EP. The combination of human glandular kallikrein and free prostate-specific antigen (PSA) enhances discrimination between prostate cancer and benign prostatic hyperplasia in patients with moderately increased total PSA. Clin Chem 1999;45:1960-6.
37. Smith H, Pickering RM, Struthers A, Simpson I, Mant D. Biochemical diagnosis of ventricular dysfunction in elderly patients in general practice: observational study. BMJ 2000;320:906-8.
38. Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med 1999;130:515-24.
39. Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15: 361-87.
40. Hartz AJ, Guse C, Kajdacsy-Balla A. Identification of heavy drinkers using a combination of laboratory tests. J Clin Epidemiol 1997; 50:1357-68.
41. Elmore JG, Feinstein AR. A bibliography of publications on observer variability (final installment). J Clin Epidemiol 1992;45: 567-80.
42. Brealey S, Scally AJ, Thomas NB. Review article: methodological standards in radiographer plain film reading performance studies. Br J Radiol 2002;75:107-13.
43. Elmore JG, Wells CK, Lee CH, Howard DH, Feinstein AR. Variability in radiologists' interpretations of mammograms. N Engl J Med 1994;331:1493-9.
44. Brealey S, Scally AJ. Bias in plain film reading performance studies. Br J Radiol 2001;74:307-16.
45. Ronco G, Montanari G, Aimone V, Parisio F, Segnan N, Valle A, et al. Estimating the sensitivity of cervical cytology: errors of interpretation and test limitations. Cytopathology 1996;7:151-8.
46. Cohen MB, Rodgers RP, Hales MS, Gonzales JM, Ljung BM, Beckstead JH, et al. Influence of training and experience in fine-needle aspiration biopsy of breast. Receiver operating characteristics curve analysis. Arch Pathol Lab Med 1987;111:518-20.
47. Egglin TK, Feinstein AR. Context bias. A problem in diagnostic radiology. JAMA 1996;276:1752-5.
48. Doubilet P, Herman PG. Interpretation of radiographs: effect of clinical history. A JR Am J Roentgenol 1981;137:1055-8.
49. Berbaum KS, Franken EA Jr, Dorfman DD, Barloon T. Ell SR, Lu OH, et al. Tentative diagnoses facilitate the detection of diverse lesions in chest radiographs. Invest Radiol 1986;21:532-9.
50. Leung DA, Hoffmann U, Pfammatter T, Hany TF, Rainoni L, Hilfiker P, et al. Magnetic resonance angiography versus duplex sonography for diagnosing renovascular disease. Hypertension 1999;33: 726-31.
51. Lang TA, Secic M. Generalizing from a sample to a population: reporting estimates and confidence intervals. In: Lang TA, Secic M, eds. How to report statistics in medicine: annotated guidelines for authors, editors, and reviewers. Philadelphia: American College of Physicians, 1997:55-63.
52. Quinn MF. Relation of observer agreement to accuracy according to a two-receiver signal detection model of diagnosis. Med Decis Making 1989;9:196-206.
53. DesJardin JA, Falagas ME, Ruthazer R, Griffith J, Wawrose D, Schenkein D, et al. Clinical utility of blood cultures drawn from indwelling central venous catheters in hospitalized patients with cancer. Ann Intern Med 1999;131:641-7.
54. Wells PS, Brill-Edwards P, Stevens P, Panju A, Patel A, Douketis J, et al. A novel and rapid whole-blood assay for D-dimer in patients with clinically suspected deep vein thrombosis. Circulation 1995; 91:2184-7.
55. Garcia Pena BM, Mandl KD, Kraus SJ, Fischer AC, Fleisher GR, Lund DP, et al. Ultrasonography and limited computed tomography in the diagnosis and management of appendicitis in children. JAMA 1999;282:1041-6.
56. Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med 1978; 299:926-30.
57. Choi BC. Sensitivity and specificity of a single diagnostic test in the presence of work-up bias. J Clin Epidemiol 1992;45:581-6.
58. Zhou XH. Effect of verification bias on positive and negative predictive values. Stat Med 1994;13:1737-45.
59. Begg CB, Greenes RA. Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics 1983; 39:207-15.
60. Greenes RA, Begg CB. Assessment of diagnostic technologies. Methodology for unbiased estimation from samples of selectively verified patients. Invest Radiol 1985;20:751-6.
61. Cecil MP, Kosinski AS, Jones MT, Taylor A, Alazraki NP, Pettigrew RI, et al. The importance of work-up (verification) bias correction in assessing the accuracy of SPECT thallium-201 testing for the diagnosis of coronary artery disease. J Clin Epidemiol 1996;49: 735-42.
62. Diamond GA, Rozanski A, Forrester JS, Morris D, Pollock BH, Staniloff HM, et al. A model for assessing the sensitivity and specificity of tests subject to selection bias. Application to exercise radionuclide ventriculography for diagnosis of coronary artery disease. J Chronic Dis 1986;39:343-55.
63. Diamond GA. Off Bayes: effect of verification bias on posterior probabilities calculated using Bayes' theorem. Med Decis Making 1992;12:22-31.
64. Egger M, Juni P, Bartlett C. Value of flow diagrams in reports of randomized controlled trials. JAMA 2001;285:1996-9.
65. Fletcher RH. Carcinoembryonic antigen. Ann Intern Med 1986; 104:66-73.
66. Lachs MS, Nachamkin I, Edelstein PH, Goldman J, Feinstein AR, Schwartz JS. Spectrum bias in the evaluation of diagnostic tests: lessons from the rapid dipstick test for urinary tract infection. Ann Intern Med 1992;117:135-40.
67. O'Connor PW, Tansay CM, Detsky AS, Mushlin AI, Kucharczyk W. The effect of spectrum bias on the utility of magnetic resonance imaging and evoked potentials in the diagnosis of suspected multiple sclerosis. Neurology 1996;47:140-4.
68. Moons KG, van Es GA, Deckers JW, Habbema JD, Grobbee DE. Limitations of sensitivity, specificity, likelihood ratio, and Bayes' theorem in assessing diagnostic probabilities: a clinical example. Epidemiology 1997;8:12-7.
69. Hlatky MA, Pryor DB, Harrell FE Jr, Califf RM. Mark DB, Rosati RA. Factors affecting sensitivity and specificity of exercise electrocardiography. Multivariable analysis. Am J Med 1984;77:64-71.
70. Harris JM Jr. The hazards of bedside Bayes. JAMA 1981;246: 2602-5.
71. Philbrick JT, Horwitz RI, Feinstein AR, Langou RA, Chandler JP. The limited spectrum of patients studied in exercise test research. Analyzing the tip of the iceberg. JAMA 1982;248:2467-70.
72. Giard RW, Hermans J. Use and accuracy of fine-needle aspiration cytology in histologically proven thyroid carcinoma: an audit using a national nathology database. Cancer 2000;90:330-4.
73. Bizzaro N, Mazzanti G, Tonutti E, Villalta D, Tozzoli R. Diagnostic accuracy of the anti-citrulline antibody assay for rheumatoid arthritis. Clin Chem 2001;47:1089-93.
74. Bonnamy L, Marret H, Perrotin F, Body G, Berger C, Lansac J. Sonohysterography: a prospective survey Of results and complications in 81 patients. Eur J Obstet Gynecol Reprod Biol 2002;102: 42-7.
75. Ioannidis JP, Lau J. Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA 2001;285: 437-43.
76. Towler BP, Irwig L, Glasziou P, Weller D, Kewenter J. Screening for colorectal cancer using the faecal occult blood test, hemoccult. Cochrane Database Syst Rev 2000:CD001216.
77. Anton RF, Dominick C, Bigelow M, Westby C. Comparison of Bio-Rad %CDT TIA and CDTect as laboratory markers of heavy alcohol use and their relationships with γ-glutamyltransferase. Clin Chem 2001;47:1769-75.
78. Harper R, Reeves B. Reporting of precision of estimates for diagnostic accuracy: a review. BMJ 1999;318:1322-3.
79. Begg CB, Greenes RA, Iglewicz B. The influence of uninterpretability on the assessment of diagnostic tests. J Chronic Dis 1986; 39:575-84.
80. Simel DL, Feussner JR, DeLong ER, Matchar DB. Intermediate, indeterminate, and uninterpretable diagnostic test results. Med Decis Making 1987;7:107-14.
81. Pisano ED, Fajardo LL, Tsimikas J, Sneige N, Frable WJ, Gatsonis CA, et al. Rate of insufficient samples for fine-needle aspiration for nonpalpable breast lesions in a multicenter clinical trial: The Radiologic Diagnostic Oncology Group 5 Study. The RDOG5 investigators. Cancer 1998;82:679-88.
82. Giard RW, Hermans J. The value of aspiration cytologic examination of the breast. A statistical review of the medical literature. Cancer 1992;69:2104-10.
83. Value of the ventilation/perfusion scan in acute pulmonary embolism. Results of the prospective investigation of pulmonary embolism diagnosis (PIOPED). The PIOPED investigators. JAMA 1990; 263:2753-9.
84. Oxman AD, Guyatt GH. A consumer's guide to subgroup analyses. Ann Intern Med 1992;116:78-84.
85. Hobbs FD, Davis RC, Roalfe AK, Hare R, Davies MK, Kenkre JE. Reliability of N-terminal pro-brain natriuretic peptide assay in diagnosis of heart failure: cohort study in representative and high risk community populations. BMJ 2002;324:1498-500.
86. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD Initiative. Ann intern Med 2003;138:40-4.
87. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD Initiative. Clin Chem 2003;49:1-6.