Estimating the agreement and diagnostic accuracy of two diagnostic tests when one test is conducted on only a subsample of specimens

Statistics in Medicine

Volumn 31, Issue 5, 2012, Pages 436-448

  Katki, Hormuzd A ^a   Li, Yan ^b   Edelstein, David W ^c   Castle, Philip E ^d  

^a NATIONAL CANCER INSTITUTE   (United States)

^b UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

^d American Society for Clinical Pathology   (United States)

Author keywords

Gold standard; HPV; Kappa; Sensitivity; Specificity; Symmetry test; Two phase design; Verification bias

Indexed keywords

ARTICLE; CHLAMYDIA TRACHOMATIS; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST; GOLD STANDARD; HUMAN; HUMAN PAPILLOMAVIRUS TYPE 16; HUMAN PAPILLOMAVIRUS TYPE 18; INVERSE PROBABILITY WEIGHTING; PREDICTIVE VALUE; PROBABILITY; SAMPLING; SCREENING TEST; SENSITIVITY AND SPECIFICITY; SIMULATION; STATISTICAL ANALYSIS; STRATIFIED SAMPLE; SUBSAMPLING; UTERINE CERVIX CANCER; VARIANCE;

ALPHAPAPILLOMAVIRUS; BIOMETRY; CHLAMYDIA; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; DIAGNOSTIC TESTS, ROUTINE; FEMALE; HUMANS; REPRODUCIBILITY OF RESULTS; SAMPLING STUDIES; SENSITIVITY AND SPECIFICITY; VAGINAL SMEARS;

EID: 84856473125     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.4422     Document Type: Article

References (43)

1. Pepe MS, Etzioni R, Feng Z, Potter JD, Thompson ML, Thornquist M, Winget M, Yasui Y. Phases of biomarker development for early detection of cancer. Journal of the National Cancer Institute Jul 2001; 93(14):1054-1061.
2. Pepe MS, Feng Z, Janes H, Bossuyt PM, Potter JD. Pivotal evaluation of the accuracy of a biomarker used for classification or prediction: standards for study design. Journal of the National Cancer Institute Oct 2008; 100(20):1432-1438. DOI: 10.1093/jnci/djn326. URL.
3. Baker SG. Improving the biomarker pipeline to develop and evaluate cancer screening tests. Journal of the National Cancer Institute Aug 2009; 101(16):1116-1119. DOI: 10.1093/jnci/djp186. URL.
4. Pepe MS. The Statistical Evaluation of Medical Tests for Classification and Prediction, Oxford University Press:New York, 2003.
5. Bishop YMM, Fienberg SE, Holland PW. Discrete multivariate analysis: theory and practice, The MIT Press: Cambridge, Mass.-London, 1975. With the collaboration of Richard J. Light and Frederick Mosteller.
6. Kinney W, Stoler MH, Castle PE. Special commentary: patient safety and the next generation of HPV DNA tests. American Journal of Clinical Pathology Aug 2010; 134(2):193-199. DOI: 10.1309/AJCPRI8XPQUEAA3K. URL.
7. Castle PE, Porras C, Quint WG, Rodriguez AC, Schiffman M, Gravitt PE, Gonzlez P, Katki HA, Silva S, Freer E, et al. Comparison of two PCR-based human papillomavirus genotyping methods. Journal of Clinical Microbiology Oct 2008; 46(10):3437-3445. URl.
8. Hui SL, Zhou XH. Evaluation of diagnostic tests without gold standards. Statistical Methods in Medical Research Dec 1998; 7(4):354-370.
9. Quint K, Porras C, Safaeian M, Gonzalez P, Hildesheim A, Quint W, van Doorn LJ, Silva S, Melchers W, Schiffman M, et al. Evaluation of a novel PCR-based assay for detection and identification of chlamydia trachomatis serovars in cervical specimens. Journal of Clinical Microbiology Dec 2007; 45(12):3986-3991. DOI:10.1128/JCM.01155-07.
10. Begg CB. Biases in the assessment of diagnostic tests. Statistics in Medicine Jun 1987; 6(4):411-423.
11. Zhou XH. Effect of verification bias on positive and negative predictive values. Statistics in Medicine Sep 1994; 13(17):1737-1745.
12. Begg CB, Greenes RA. Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics Mar 1983; 39(1):207-215.
13. Tosteson TD, Titus-Ernstoff L, Baron JA, Karagas MR. A two-stage validation study for determining sensitivity and specificity. Environmental Health Perspectives Nov 1994; 102(Suppl 8):11-14.
14. Baker SG. Evaluating multiple diagnostic tests with partial verification. Biometrics Mar 1995; 51(1):330-337.
15. Zhou XH. A nonparametric maximum likelihood estimator for the receiver operating characteristic curve area in the presence of verification bias. Biometrics Mar 1996; 52(1):299-305.
16. Toledano AY, Gatsonis C. Ordinal regression methodology for ROC curves derived from correlated data. Statistics in Medicine Aug 1996; 15(16):1807-1826, DOI: 3.0.CO;2-U. URL .
17. Rodenberg C, Zhou XH. ROC curve estimation when covariates affect the verification process. Biometrics Dec 2000; 56(4):1256-1262. URL.
18. Schneider DL, Burke L, Wright TC, Spitzer M, Chatterjee N, Wacholder S, Herrero R, Bratti MC, Greenberg MD, Hildesheim A, et al. Can cervicography be improved? An evaluation with arbitrated cervicography interpretations. American Journal of Obstetrics & Gynecology Jul 2002; 187(1):15-23.
19. Alonzo TA. Verification bias-corrected estimators of the relative true and false positive rates of two binary screening tests. Statistics in Medicine 2005; 24(3):403-417.
20. Alonzo TA, Kittelson JM. A novel design for estimating relative accuracy of screening tests when complete disease verification is not feasible. Biometrics Jun 2006; 62(2):605-612. DOI:10.1111/j.1541-0420.2005.00445.x. URL.
21. Albert PS, Dodd LE. On estimating diagnostic accuracy from studies with multiple raters and partial gold standard evaluation. Journal of the American Statistical Association Mar 2008; 103(481):61-73. DOI: 10.1198/016214507000000329. URL .
22. Kraemer H. Evaluating Medical Tests: Objective and Quantitative Guidelines, Sage Publications Inc: Thousand Oaks, CA, 1992.
23. Cochran WG. Sampling Techniques, 1sted., John Wiley & Sons: Hoboken, NJ, 1953.
24. Pickles A, Dunn G, Vázquez-Barquero JL. Screening for stratification in two-phase ('two-stage') epidemiological surveys. Statistical Methods in Medical Research Mar 1995; 4(1):73-89.
25. Tenenbein A. A double sampling scheme for estimating from binomial data with misclassifications. Journal of the American Statistical Association 1970; 65(331):1350-1361. URL
26. Hochberg Y. On the use of double sampling schemes in analyzing categorical data with misclassification errors. Journal of the American Statistical Association 1977; 72:914-921.
27. Haitovsky Y, Rapp J. Conditional resampling for misclassified multinomial data with applications to sampling inspection (Corr: 94V36 p334). Technometrics 1992; 34:473-483.
28. Tenenbein A. A double sampling scheme for estimating from binomial data with misclassifications: sample size determination. Biometrics 1971; 27:935-944.
29. Irwig L, Glasziou PP, Berry G, Chock C, Mock P, Simpson JM. Efficient study designs to assess the accuracy of screening tests. American Journal of Epidemiology Oct 1994; 140(8):759-769.
30. McNamee R. Optimal designs of two-stage studies for estimation of sensitivity, specificity and positive predictive value. Statistics in Medicine Dec 2002; 21(23):3609-3625. DOI: 10.1002/sim.1318. URL
31. Wruck LM, Yiannoutsos CT, Hughes MD. A sequential design to estimate sensitivity and specificity of a diagnostic or screening test. Statistics in Medicine Oct 2006; 25(20):3458-3473. DOI: 10.1002/sim.2451. URL
32. Kosinski AS, Chen Y, Lyles RH. Sample size calculations for evaluating a diagnostic test when the gold standard is missing at random. Statistics in Medicine Jul 2010; 29(15):1572-1579. DOI: 10.1002/sim.3899. URL
33. Katki HA, Edelstein DW. CompareTests: estimating agreement and diagnostic accuracy when one test is not conducted on all specimens, 2011. URL, r package version 1.0.
34. McNemar Q. Note on the sampling error of the differences between correlated proportions of percentages. Psychometrika 1947; 12:153-7. DOI:10.1007/BF02295996.
35. Raj D. Sampling Theory, McGraw-Hill Book Co.: New York, 1968.
36. Korn EL, Graubard B. Analysis of Health Surveys, John Wiley & Sons: Hoboken, NJ, 1999.
37. Koch GG, Freeman Jr DH, Freeman JL. Strategies in the multivariate analysis of data from complex surveys. International Statistical Review 1975; 43:59-78.
38. Gravitt PE, Paul P, Katki HA, Vendantham H, Ramakrishna G, Sudula M, Kalpana B, Ronnett BM, Vijayaraghavan K, Shah KV, et al. Effectiveness of via, pap, and hpv dna testing in a cervical cancer screening program in a peri-urban community in andhra pradesh, india. PLoS One 2010; 5(10):e13711. DOI: 10.1371/journal.pone.0013711. URL
39. Waller JL, Addy CL, Jackson KL, Garrison CZ. Confidence intervals for weighted proportions. Statistics in Medicine May 1994; 13(10):1071-1082.
40. Lumley T. survey: analysis of complex survey samples, 2010. URL, r package version 3.23-3.
41. Alonzo TA, Pepe MS. Using a combination of reference tests to assess the accuracy of a new diagnostic test. Statistics in Medicine Nov 1999; 18(22):2987-3003.
42. Jones G, Johnsonm WO, Hanson TE, Christensen R. Identifiability of models for multiple diagnostic testing in the absence of a gold standard. Biometrics Sep 2009. DOI: 10.1111/j.1541-0420.2009.01330.x. URL
43. Albert PS, Dodd LE. A cautionary note on the robustness of latent class models for estimating diagnostic error without a gold standard. Biometrics Jun 2004; 60(2):427-435. DOI: 10.1111/j.0006-341X.2004.00187.x. URL