Designing Studies to Ensure that Estimates of Test Accuracy Will Travel

The Evidence Base of Clinical Diagnosis: Theory and methods of diagnostic research: Second Edition

Volumn , Issue , 2009, Pages 96-117

  Irwig, Les M ^a   Bossuyt, Patrick M M ^b   Glasziou, Paul P ^c   Gatsonis, Constantine ^d   Lijmer, Jeroen G ^e  

^a UNIVERSITY OF SYDNEY   (Australia)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d BROWN UNIVERSITY   (United States)

^e Waterland Hospital   (Netherlands)

Author keywords

Accuracy of test in primary care; Choosing relevant reference standard; Diagnostic test performance discrimination and calibration; Ensuring estimates of test accuracy; Measures of test accuracy as fixed characteristics; Population clinical question symptoms, signs; Replacement or incremental test; Test performance measures and first two assumptions; Transferability of test results; Value of designing studies

Indexed keywords

EID: 84889455194     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781444300574.ch6     Document Type: Chapter

References (61)

1. Begg C. Biases in the assessment of diagnostic tests. Stat Med. 1987;6:411-23.
2. Molarius ASJ, Sans S, Tuomilehto J, et al. Varying sensitivity of waist action levels to identify subjects with overweight or obesity in 19 populations of theWHOMONICA Project. J Clin Epidemiol. 1999;52:1213-24.
3. Detrano R, Janosi A, Lyons KP, et al. Factors affecting sensitivity and specificity of a diagnostic test: the exercise thallium scintigram. Am J Med. 1988;84:699-710.
4. Hlatky M, Pryor D, Harrell FE, Jr, et al. Factors affecting sensitivity and specificity of exercise electrocardiography. Am J Med. 1984;77:64-71.
5. Rozanski ADG, Berman D, Forrester JS, et al. The declining specificity of exercise radionuclide ventriculography. N Engl J Med. 1983;309:518-22.
6. Lachs MS, Nachamkin I, Edelstein PH, et al. Spectrum bias in the evaluation of diagnostic tests: lessons from the rapid dipstick test for urinary tract infection. Ann Intern Med. 1992;117:135-40.
7. Molarius ASJ, Sans S, Tuomilehto J, et al. Varying sensitivity of waist action levels to identify subjects with overweight or obesity in 19 populations of theWHOMONICA Project. J Clin Epidemiol. 1999;52:1213-24.
8. Starmans R, Muris JW, Fijten GH, et al. The diagnostic value of scoring models for organic and non-organic gastrointestinal disease, including the irritable-bowel syndrome. Med Decis Making. 1994;14:208-16.
9. Glasziou P, Irwig L. An evidence-based approach to individualising treatment. BMJ. 1995;311:1356-59.
10. National Health and Medical Research Council. How to use the evidence: assessment and application of scientific eviden. Handbook series on preparing clinical practice guidelines. Canberra, Commonwealth of Australia; 2000. Available from:http://www.health.gov.au/nhmrc/publicat/synopses/cp65syn.htm
11. Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med. 1999;130:515-24.
12. Gatsonis C, McNeil BJ. Collaborative evaluations of diagnostic tests: experience of the Radiology Diagnostic Oncology Group. Radiology. 1990;175:571-75.
13. Sackett D, Straus S, Richardson WS, et al. Evidence-based medicine: how to practice and teach EBM. Edinburgh: Churchill Livingstone; 2000.
14. Richardson W, Wilson M, Nishikawa J, et al. The well-built clinical question: a key to evidence-based decisions. ACP J Club. 1995;123:A12.
15. Brenner H. Measures of differential diagnostic value of diagnostic procedures. J Clin Epidemiol. 1996;49:1435-39.
16. Sappenfield RW, Beeler MF, Catrou PG, et al. Nine-cell diagnostic decision matrix. A model of the diagnostic process: a framework for evaluating diagnostic protocols. Am J Clin Pathol. 1981;75:769-72.
17. Taube A, Tholander B. Over- and underestimation of the sensitivity of a diagnostic malignancy test due to various selections of the study population. ACTA Oncol. 1990;29:1-5.
18. Buck A, Gart J. Comparison of a screening test and a reference test in epidemiologic studies. I. Indices of agreement and their relation to prevalence. Am J Epidemiol. 1966;83:586-92.
19. Gart J, Buck A. Comparison of a screening test and a reference test in epidemiologic studies. II. A probabilistic model for the comparison of diagnostic tests. Am J Epidemiol. 1966;83:593-602.
20. Kelsey JL, Whittemore AS, Evans AS, Thompson WD. Methods in observational epidemiology. 2nd ed. New York: Oxford University Press; 1996.
21. Walter SD, Irwig L, Glasziou PP. Meta-analysis of diagnostic tests with imperfect reference standards. J Clin Epidemiol. 1999;52:943-51.
22. Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978;299:926-30.
23. Coley C, Barry M, Fleming C, et al. Early detection of prostate cancer. I. Prior probability and effectiveness of tests. Ann Intern Med. 1997;126:394-406.
24. van Beek EJR, Schenk BE, Michel BC. The role of plasma d-dimer concentration in the exclusion of pulmonary embolism. Br J Haematol. 1996;92:725-32.
25. Knottnerus J, Leffers P. The influence of referral patterns on the characteristics of diagnostic tests. J Clin Epidemiol. 1992;45:1143-54.
26. van der Schouw YT, van Dijk R, Verbeek AL. Problems in selecting the adequate patient population from existing data files for assessment studies of new diagnostic tests. J Clin Epidemiol. 1995;48:417-22.
27. Katz IA, Irwig L, Vinen JD, et al. Biochemical markers of acute myocardial infarction: strategies for improving their clinical usefulness. Ann Clin Biochem. 1998;35:393-99.
28. Whitsel E, Boyko E, Siscovick DS. Reassessing the role of QT in the diagnosis of autonomic failure among patients with diabetes: a meta-analysis. Arch Intern Med. 2000;23:241-47.
29. Conde-Agudelo A, Kafury-Goeta AC. Triple-marker test as screening for Down's syndrome: a meta-analysis. Obstet Gynecol Surv. 1998;53:369-76.
30. Mol B, Hajenius P, Engelsbel S. Serum human chorionic gonadotrophin measurement in the diagnosis of ectopic pregnancy when transvaginal sonography is inconclusive. Fertil Steril. 1995;70:972-81.
31. Flamen PSS, van Cutsem E, Dupont P, et al. Additional value of whole-body positron emission tomography with fluorine-18-2-fluoro-2-deoxy-d-glucose in recurrent colorectal cancer. J Clin Oncol. 1999;17:894-901.
32. Decode Study Group. Glucose tolerance and mortality: comparison of WHO and American Diabetes Association diagnostic criteria. Lancet. 1999;354:617-21.
33. Scouller K, Conigrave KM, Macaskill P, et al. Should we use CDT instead of GGT for detecting problem drinkers? A systematic review and meta-analysis. Clin Chem. 2000;46:1894-902.
34. West OC, Anbari MM, Pilgram TK, et al. Acute cervical spine trauma: diagnostic performance of single-view versus three-view radiographic screening. Radiology. 1997;204:819-23.
35. Scheiber CMM, Dumitresco B, Demangeat JL, et al. The pitfalls of planar threephase bone scintigraphy in nontraumatic hip avascular osteonecrosis. Clin Nucl Med. 1999;24:488-94.
36. Krupinski EA,Weinstein RS, Rozek LS. Experience-related differences in diagnosis from medical images displayed on monitors. Telemed J. 1996;2:101-8.
37. Egglin TK, Feinstein AR. Context bias: a problem in diagnostic radiology. JAMA. 1996;276:1752-55.
38. Irwig L, Groeneveld HT, Pretorius JP, Itnizdo E. Relative observer accuracy for dichotomized variables. J Chronic Dis. 1985;28:899-906.
39. D'Orsi C, Swets J. Variability in the interpretation of mammograms. N Engl J Med. 1995;332:1172.
40. Beam C, Layde P, Sullivan DC. Variability in the interpretation of screening mammograms by US radiologists. Findings from a national sample. Arch Intern Med. 1996;156:209-13.
41. Warren R, Hayes C, Pointon L, Hoff, et al. A test of performance of breast MRI interpretation in a multicentre screening study. Magn Reson Imaging. 2006;24:917-29.
42. Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ. 2003;326:41-44.
43. Valenstein PN. Evaluating diagnostic tests with imperfect standards.AmJ Clin Pathol. 1990;93:252-8.
44. Walter S, Irwig L. Estimation of test error rates, disease prevalence and relative risk from misclassified data: A review. J Clin Epidemiol. 1988;41:923-37.
45. Garcia Pena BM, Mandl KD, Kraus SJ, et al. Ultrasonography and limited computed tomography in the diagnosis and management of appendicitis in children. JAMA. 1999;282:1041-46.
46. Marshall R. The predictive value of simple rules for combining two diagnostic tests. Biometrics. 1989;45:1213-22.
47. Biggerstaff B. Comparing diagnostic tests: a simple graphic using likelihood ratios. Statistics Med 2000;19:649-63.
48. Chock C, Irwig L, Berry G, et al. Comparing dichotomous screening tests when individuals negative on both tests are not verified. J Clin Epidemiol. 1997;50:1211-17.
49. Oxman A, Guyatt G. A consumer guide to subgroup analyses. Ann Intern Med. 1992;116:78-84.
50. Tosteson ANA, Weinstein MC, Wittenberg J, et al. ROC curve regression analysis:the use of ordinal regression models for diagnostic test assessment. Environ Health Perspect. 1994;102(Suppl 8):73-78.
51. Toledano A, Gatsonis C. Ordinal regression methodology for ROC curves derived from correlated data. Stat Med. 1996;15:1807-26.
52. Pepe M. An interpretation for the ROC curve and inference using GLM procedures. Biometrics. 2000;56:352-59.
53. Leisenring W, Pepe M. Regression modelling of diagnostic likelihood ratios for the evaluation of medical diagnostic tests. Biometrics. 1998;54:444-52.
54. LeisenringW, Pepe M, Longton G. A marginal regression modelling framework for evaluating medical diagnostic tests. Stat Med. 1997;16:1263-81.
55. Furukawa T, Goldberg DP. Cultural invariance of likelihood ratios for the General Health Questionnaire. Lancet. 1999;353:561-62.
56. Zandbergen EGJ, de Haan RJ, et al. Prognostic predictors of coma transferable from one setting to another in SR. Lancet. 1998;352:1808-12.
57. Irwig L, Tosteson ANA, Gatsonis C, et al. Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med 1994;120:667-76.
58. Rutter C, Gatsonis C. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20(19):2865-84.
59. Harbord RM, Deeks JJ, Egger M, et al. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics. 2007;8(2):239-51.
60. Schmid C, Lau J, McIntoshMW, et al. An empirical study of the effect of the control rate as a predictor of treatment efficacy in meta-analysis of clinical trials. Stat Med. 1998;17:1923-42.
61. Boyko EJ. Comment on "Meta-analysis of Pap test." Am J Epidemiol. 1996;143(4):406-7.