Anticipating missing reference standard data when planning diagnostic accuracy studies

BMJ (Online)

Volumn 352, Issue , 2016, Pages

  Naaktgeboren, Christiana A ^a   De Groot, Joris A H ^a   Rutjes, Anne W S ^b   Bossuyt, Patrick M M ^c   Reitsma, Johannes B ^a   Moons, Karel G M ^a  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b UNIVERSITY OF BERN   (Switzerland)

^c UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

CALGRANULIN;

ARTICLE; BLOOD SAMPLING; BREAST CANCER; COLPOSCOPY; DIAGNOSTIC TEST ACCURACY STUDY; ECHOGRAPHY; FECES ANALYSIS; HEALTH CARE COST; HEALTH CARE QUALITY; HUMAN; INFLAMMATORY BOWEL DISEASE; INTERMETHOD COMPARISON; INTESTINE BIOPSY; INTESTINE ENDOSCOPY; INVASIVE PROCEDURE; MALARIA; MALARIA RAPID TEST; MICROSCOPY; PATIENT SAFETY; PRIORITY JOURNAL; PROSPECTIVE STUDY; SENSITIVITY ANALYSIS; STANDARD; UTERINE CERVIX BIOPSY; UTERINE CERVIX CANCER; VALIDATION PROCESS; DIAGNOSTIC TEST; REPRODUCIBILITY; STANDARDS; STATISTICAL ANALYSIS;

DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC TESTS, ROUTINE; HUMANS; PROSPECTIVE STUDIES; REFERENCE STANDARDS; REPRODUCIBILITY OF RESULTS;

EID: 84960157418     PISSN: 09598146     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.i402     Document Type: Article

References (40)

1. Knottnerus JA, van Weel C. General introduction: evaluation of diagnostic procedures. In: Knottnerus JA, ed. The evidence base of clinical diagnosis.BMJ Books, 2002: 1-18.
2. Grobbee DE, Hoes AW. Clinical epidemiology.Jones and Bartlett Publishers, 2009.
3. Rutjes AW. Sources of bias and variation in diagnostic studies. Febodruk BV, 2005 (available at http://dare.uva.nl/record/1/242222).
4. Reitsma JB, Rutjes AW, Khan KS, Coomarasamy A, Bossuyt PM. A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J Clin Epidemiol 2009;62:797-806. doi:10.1016/j.jclinepi.2009.02.005.
5. Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, Kleijnen J. Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med 2004;140:189-202. doi:10.7326/0003-4819-140-3-200402030-00010.
6. Rutjes AW, Reitsma JB, Di Nisio M, Smidt N, van Rijn JC, Bossuyt PM. Evidence of bias and variation in diagnostic accuracy studies. CMAJ 2006;174:469-76. doi:10.1503/cmaj.050090.
7. Ransohoff DF, Muir WA. Diagnostic workup bias in the evaluation of a test. Serum ferritin and hereditary hemochromatosis. Med Decis Making 1982;2:139-45. doi:10.1177/0272989X8200200205.
8. Choi BC. Sensitivity and specificity of a single diagnostic test in the presence of work-up bias. J Clin Epidemiol 1992;45:581-6. doi:10.1016/0895-4356(92)90129-B.
9. de Groot JA, Bossuyt PM, Reitsma JB, et al. Verification problems in diagnostic accuracy studies: consequences and solutions. BMJ 2011;343:d4770. doi:10.1136/bmj.d4770.
10. Diamond GA. Off Bayes: effect of verification bias on posterior probabilities calculated using Bayes' theorem. Med Decis Making 1992;12:22-31. doi:10.1177/0272989X9201200105.
11. Begg CB, Greenes RA. Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics 1983;39:207-15. doi:10.2307/2530820.
12. Alonzo TA. Verification bias-impact and methods for correction when assessing accuracy of diagnostic tests. Rev Stat 2014;12:67-83.
13. Rutjes AW, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PM. Evaluation of diagnostic tests when there is no gold standard: a review of methods. Health Technol Assess 2007;11(50):iii, ix-51.
14. de Groot JA, Dendukuri N, Janssen KJ, Reitsma JB, Bossuyt PM, Moons KG. Adjusting for differential-verification bias in diagnostic-Accuracy studies: a Bayesian approach. Epidemiology 2011;22:234-41. doi:10.1097/EDE.0b013e318207fc5c.
15. de Groot JA, Janssen KJ, Zwinderman AH, Bossuyt PM, Reitsma JB, Moons KG. Correcting for partial verification bias: a comparison of methods. Ann Epidemiol 2011;21:139-48. doi:10.1016/j. annepidem.2010.10.004.
16. de Groot JA, Janssen KJ, Zwinderman AH, Moons KG, Reitsma JB. Multiple imputation to correct for partial verification bias revisited. Stat Med 2008;27:5880-9. doi:10.1002/sim.3410.
17. Rutjes AW, Reitsma JB, Vandenbroucke JP, Glas AS, Bossuyt PM. Case-control and two-gate designs in diagnostic accuracy studies. Clin Chem 2005;51:1335-41. doi:10.1373/clinchem.2005.048595.
18. Moons KG, Grobbee DE. Diagnostic studies as multivariable, prediction research. J Epidemiol Community Health 2002;56:337-8. doi:10.1136/jech.56.5.337.
19. Ahmed R, Levy EI, Maratina SS, et al. Performance of four HRP-2/pLDH combination rapid diagnostic tests and field microscopy as screening tests for malaria in pregnancy in Indonesia: a cross-sectional study. Malar J 2015;14:420. doi:10.1186/s12936-015-0943-5.
20. Katki HA, Li Y, Edelstein DW, Castle PE. Estimating the agreement and diagnostic accuracy of two diagnostic tests when one test is conducted on only a subsample of specimens. Stat Med 2012;31:436-48. doi:10.1002/sim.4422.
21. University of Zimbabwe/JHPIEGO Cervical Cancer Project. Visual inspection with acetic acid for cervical-cancer screening: test qualities in a primary-care setting Lancet 1999;353:869-73. doi:10.1016/S0140-6736(98)07033-0.
22. Holtman GA, Lisman-van Leeuwen Y, Kollen BJ, et al. Challenges in diagnostic accuracy studies in primary care: the fecal calprotectin example. BMC Fam Pract 2013;14:179. doi:10.1186/1471-2296-14-179.
23. Lehman CD, Lee CI, Loving VA, Portillo MS, Peacock S, DeMartini WB. Accuracy and value of breast ultrasound for primary imaging evaluation of symptomatic women 30-39 years of age. AJR Am J Roentgenol 2012;199:1169-77. doi:10.2214/AJR.12.8842.
24. Groenwold RH, Moons KG, Vandenbroucke JP. Randomized trials with missing outcome data: how to analyze and what to report. CMAJ 2014;186:1153-7. doi:10.1503/cmaj.131353.
25. Kosinski AS, Barnhart HX. A global sensitivity analysis of performance of a medical diagnostic test when verification bias is present. Stat Med 2003;22:2711-21. doi:10.1002/sim.1517.
26. Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res 2013;22:278-95. doi:10.1177/0962280210395740.
27. Sterne JA, White IR, Carlin JB, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ 2009;338:b2393. doi:10.1136/bmj.b2393.
28. Little RJA, Rubin DR. Statistical analysis with missing data.Wiley, 2002doi:10.1002/9781119013563.
29. White IR, Royston P, Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. Stat Med 2011;30:377-99. doi:10.1002/sim.4067.
30. Moons KG, Donders RA, Stijnen T, Harrell FE Jr. Using the outcome for imputation of missing predictor values was preferred. J Clin Epidemiol 2006;59:1092-101. doi:10.1016/j.jclinepi.2006.01.009.
31. Alonzo TA, Brinton JT, Ringham BM, Glueck DH. Bias in estimating accuracy of a binary screening test with differential disease verification. Stat Med 2011;30:1852-64. doi:10.1002/sim.4232.
32. Naaktgeboren CA, de Groot JA, van Smeden M, Moons KG, Reitsma JB. Evaluating diagnostic accuracy in the face of multiple reference standards. Ann Intern Med 2013;159:195-202. doi:10.7326/0003-4819-159-3-201308060-00009.
33. Rothman KJ, Greenland S, Lash TL. Modern epidemiology.Lippincott Williams & Wilkins, 2008.
34. Bossuyt PM, Reitsma JB, Bruns DE, et al. STARD Group. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 2015;351:h5527. doi:10.1136/bmj.h5527.
35. Cronin AM, Vickers AJ. Statistical methods to correct for verification bias in diagnostic studies are inadequate when there are few false negatives: a simulation study. BMC Med Res Methodol 2008;8:75. doi:10.1186/1471-2288-8-75.
36. Lord SJ, Irwig L, Simes RJ. When is measuring sensitivity and specificity sufficient to evaluate a diagnostic test, and when do we need randomized trials?Ann Intern Med 2006;144:850-5. doi:10.7326/0003-4819-144-11-200606060-00011.
37. Bossuyt PM, Irwig L, Craig J, Glasziou P. Comparative accuracy: assessing new tests against existing diagnostic pathways. BMJ 2006;332:1089-92. doi:10.1136/bmj.332.7549.1089.
38. Glasziou P, Irwig L, Deeks JJ. When should a new test become the current reference standard?Ann Intern Med 2008;149:816-22. doi:10.7326/0003-4819-149-11-200812020-00009.
39. Biesheuvel CJ, Grobbee DE, Moons KG. Distraction from randomization in diagnostic research. Ann Epidemiol 2006;16:540-4. doi:10.1016/j.annepidem.2005.10.004.
40. Lijmer JG, Leeflang M, Bossuyt PM. Proposals for a phased evaluation of medical tests.Agency for Healthcare Research and Quality, 2009.