Use of statistical analysis of cytologic interpretation to determine the causes of interobserver disagreement and in quality improvement

Cancer

Volumn 81, Issue 4, 1997, Pages 212-219

  Renshaw, Andrew A ^a   Lee, Kenneth R ^a   Granter, Scott R ^a  

^a BRIGHAM AND WOMEN S HOSPITAL   (United States)

Author keywords

Cervicovaginal; Cytopathology; Kappa statistic; Papanicolaou smear; Receiver operating characteristic curves; Statistics

Indexed keywords

ARTICLE; CYTOPATHOLOGY; DIAGNOSTIC ACCURACY; HUMAN; OBSERVER VARIATION; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; STATISTICAL ANALYSIS; UTERINE CERVIX CYTOLOGY;

CYTOLOGICAL TECHNIQUES; FEMALE; HUMANS; OBSERVER VARIATION; ROC CURVE; STATISTICS; VAGINAL SMEARS;

EID: 0031586239     PISSN: 0008543X     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1097-0142(19970825)81:4<212::AID-CNCR3>3.0.CO;2-R     Document Type: Article

References (39)

1. Davey DD, Naryshkin S, Nielsen ML, Mine TS. Atypical squamous cells of undertermined significance: interlaboratory comparison and quality assurance monitors. Diagn Cytopathol 1994;11:390-6.
2. Williams ML, Rimm DL, Pedigo MA, Frable WJ. Atypical squamous cells of undetermined significance: correlative histologic and follow-up studies from an academic center. Diagn Cytopathol 1997;16:1-7.
3. Howell LP, Davis RL. Follow-up of Papanicolaou smears diagnosed as atypical squamous cells of undetermined significance. Diagn Cytopathol 1996;14:20-4.
4. Kaye KS, Dhurandhar NR. Atypical cells of undetermined significance: follow-up biopsy and Pap smear findings. Am J Clin Pathol 1993;99:332.
5. Cocchi V, Carretti D, Fanti S, Baldazzi P, Casotti MT, Piazza R, et al. Intralaboratory quality assurance in cervical/vaginal cytology: evaluation of intercytologist diagnostic reproducibility. Diagn Cytopathol 1997;16:87-92.
6. Sidaway MK, Tabbara SO. Reactive change and atypical squamous cells of undetermined significance in Papanicolaou smears: a cytohistologic correlation. Diagn Cytopathol 1993;9:423-9.
7. Sherman ME, Schiffman MH, Lorincz AT, Manos MM, Scott DR, Kurman RJ, et al. Toward objective quality assurance in cervical cytopathology. Correlation of cytopathologic diagnoses with detection of high-risk human papillomavirus types. Am J Clin Pathol 1994;102:182-7.
8. Epstein JI, Grignon DJ, Humphrey PA, McNeal JE, Sesterhenn IA, Troncoso P, et al. Interobserver reproducibility in the diagnosis of prostatic intraepithelial neoplasia. Am J Surg Pathol 1995;19:873-86.
9. Allam CK, Bostwick DG, Hayes JA, Upton MP, Wade GG, Domanowski GF, et al. Interobserver variability in the diagnosis of high grade prostatic intraepithelial neoplasia and adenocarcinoma. Mod Pathol 1996;9:742-51.
10. Raab SS, Isacson C, Layfield LJ, Lenel JC, Slagel DD, Thomas PA. Atypical glandular cells of undetermined significance. Am J Clin Pathol 1995;104:574-82.
11. Beck JR, Shultz EK. The use of relative operating characteristic (ROC) curves in test performance evaluation. Arch Pathol Lab Med 1986;110:13-20.
12. Raab SS. Diagnostic accuracy in cytopathology. Diagn Cytopathol 1994;10:68-75.
13. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982;143:29-36.
14. McNeil BJ, Hanley JA. Statistical approaches to the analysis of receiver operating characteristic (ROC) curves. Med Decis Making 1984:4:137-50.
15. Hanley JA. Receiver operating characteristic (ROC) methodology: the state of the art. Crit Rev Diagn Imaging 1989; 29:307-35.
16. Metz CE, Kronman HB. Statistical significance tests for binormal ROC curves. J Math Psych 1980;22:218-43.
17. Dorfman DD, Alf E. Maximum-likelihood estimation parameters of signal-detection theory and determination of confidence intervals-rating-method data. J Math Psych 1969; 6:487-96.
18. Giard RWM, Hermans J. Interpretation of diagnostic cytology with likelihood ratios. Arch Pathol Lab Med 1990; 114:852-4.
19. Raab SS, Slagel DD, Jensen CS, Teague MW, Savell VH, Ozkutlu D, et al. Transitional cell carcinoma: cytologic criteria to improve diagnostic accuracy. Mod Pathol 1996;9:225-31.
20. Cohen MB, Rodgers C, Hales MS, Gonzales JM, Ljung BME, Beckstead JH, et al. Influence of training and experience in fine needle aspration biopsy of the breast. Arch Pathol Lab Med 1987;111:518-20.
21. Raab SS, Thomas PA, Lenel JC, Bottles K, Fitzsimmons KM, Zaleski MS, et al. Pathology and probability. Am J Clin Pathol 1995;103:588-93.
22. Bacus JW, Wiley EL, Galbraith W, Marshall PN, Wilbanks GD, Weinstein RS. Malignant cell detection and cervical cancer screening. Anal Quant Cytol Histol 1984;6:121-30.
23. Raab SS, Snider TE, Potts SA, McDaniel HL, Robinson RA, Nelson DL, et al. Atypical glandular cells of undetermined significance. Diagnostic accuracy and interobserver variability using select cytologic criteria. Am J Clin Pathol 1997; 107:299-307.
24. Langley FA, Buckley CH, Tasker M. The use of ROC curves in histopathologic decision making. Anal Quant Cytol Histol 1985;7:167-73.
25. Hermann GA, Herrera N, Sugiura HT. Comparison of interlaboratory survey data in terms of receiver operating chracteristic (ROC) indices. J Nucl Med 1982;23:525-31.
26. The Bethesda Committee. The Bethesda system for reporting cervical/vaginal cytologic diagnoses. Acta Cytol 1993;37:115-24.
27. Metz CE, Wang PL, Kronan HB. A new approach for testing the significance of differences between ROC curves measured from correlated data. In: DeConinck F, editor. Information processing in medical imaging. The Hague: Martinus Nijhoff, 1984;432-45.
28. Chhieng DC, Taylor J, Schmee J, McKenna BJ. Cytologic criteria for subclassification of ASCUS improve correlation with biopsy outcome [abstract]. Mod Pathol 1997;10:32A.
29. Ettler HC, Downing P, Wright VC, Joseph MG. Atypical squamous cells of undetermined significance: a cytohistologic study in a colposcopy unit [abstract]. Mod Pathol 1997; 10:33A.
30. Flynn C, Pitman M. Cytohistological correlation of subclassified ASCUS Pap smears [abstract]. Mod Pathol 1997;10;33A.
31. Collins LC, Wang HH, Abu-Jawdeh GM. Qualifiers of atypical squamous cells of undetermined significance help in patient management. Mod Pathol 1996;9:677-81.
32. Mine MJ, Davey DD. Atypical squamous cells of undetermined significance qualified: a follow-up study. Diagn Cytopathol 1996;14:380-4.
33. Cramer SF. Interobserver variability in surgical pathology. In: Weinstein RS, editor. Advances in pathology and laboratory medicine. Vol. 9. St. Louis: C.V. Mosby, 1996;3-82.
34. Rohr R. Quality assurance in gynecologic cytology. Am J Clin Pathol 1990;94:754-8.
35. Dodd LG, Sneige N, Villarreal Y, Fanning CV, Staerkel GA, Caraway NP, et al. Quality-assurance study of simultaneously sampled, non-correlating cervical cytology and biopsies. Diagn Cytopathol 1993;9:138-44.
36. Cramer H, Schlenk E. An analysis of discrepancies between the cervical cytologic diagnosis and subsequent histopathologic diagnosis in 1260 cases [abstract]. Acta Cytol 1994; 38:812.
37. Tritz DM, Weeks JA, Spires SE, Sattich M, Banks H, Cibull ML, et al. Etiologies for non-correlating cervical cytologies and biopsies. Am J Clin Pathol 1995;103:594-7.
38. Joste NE, Crum CP, Cibas ES. Cytologic/histologic correlation for quality control in cervicovaginal cytology. Am J Clin Pathol 1995;103:32-4.
39. Jones BA, Novis DA. Cervical biopsy-cytology correlation. Arch Pathol Lab Med 1996;120:523-31.