Interlaboratory quality control in gynecologic cytopathology using the novel CONQUISTADOR software: Interobserver reproducibility in the Latin American screening study

Acta Cytologica

Volumn 51, Issue 6, 2007, Pages 872-881

  Alderisio, Mauro ^a   Branca, Margherita ^a   Eržen, Mojca ^b   Longatto Filho, Adhemar ^c,d   Derchain, Sophie ^e   Tatti, Silvio ^f   Vighi, Susana ^f   Roteli Martins, Cecilia ^g   Leoncini, Luciano ^a   Maeda, Marina Y S ^c   Montis, Douglas ^e   Gontijo, Renata ^e   Sarian, Luis Otavio ^e   Syrjänen, Kari ^a,h  

^a ISTITUTO SUPERIORE DI SANITÀ   (Italy)

^b SIZE Diagnostic Center   (Slovenia)

^c INSTITUTO ADOLFO LUTZ   (Brazil)

^d UNIVERSITY OF MINHO   (Portugal)

^e UNIVERSITY OF CAMPINAS   (Brazil)

^f HOSPITAL DE CLÍNICAS JOSÉ DE SAN MARTÍN   (Argentina)

^g HOSPITAL MATERNIDADE LEONOR MENDES DE BARROS   (Brazil)

^h TURKU UNIVERSITY HOSPITAL   (Finland)

Author keywords

Diagnostic accuracy index; Kappa; Pap smear; Performance indicators; Quality control; Reproducibility; Software

Indexed keywords

ARGENTINA; ARTICLE; BRAZIL; COMPUTER PROGRAM; CYTOPATHOLOGY; DIAGNOSTIC ACCURACY; GYNECOLOGIC DISEASE; GYNECOLOGICAL EXAMINATION; HUMAN; LABORATORY DIAGNOSIS; OBSERVER VARIATION; PRIORITY JOURNAL; QUALITY CONTROL; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SLOVENIA; STATISTICAL ANALYSIS;

NUCLEOPOLYHEDROVIRUS;

EID: 36348974486     PISSN: 00015547     EISSN: 19382650     Source Type: Journal    
DOI: 10.1159/000325863     Document Type: Article

References (41)

1. IARC Working Group on Cervical Screening and UICC Project Group on Evaluation of Screening Programs for Cancer of the Uterine Cervix. In Screening for Cancer of the Uterine Cervix. Edited by M Hakama, AB Miller, NE Day. Lyon, IARC Press, 1986, pp 147-160
2. Franco E, Syrjänen K, de Wolff C, Patnick J, Ferenczy A, McGoogan E, Bosch X, Singer A, Munoz N, Meheus A, Monsonego J: New developments in cervical cancer screening and prevention. Cancer Epidemiol Biomarker Prev 1996;5:853-856
3. Miller AB, Nazeer S, Fonn S, Brandup-Lukanow A, Rehman R, Cronje H, Sankaranarayanan R, Koroltchouk V, Syrjänen K, Singer A, Onsrud M: Report on Consensus conference on Cervical Cancer Screening and Management. Int J Cancer 2000; 86:440-447
4. Koss LG: The Papanicolaou test for cervical cancer detection: A triumph and a tragedy. JAMA 1989;261:737-743
5. Koss LG: Diagnostic accuracy in cervico-vaginal cytology. Arch Pathol Lab Med 1993;117:1240-1242
6. Coleman D, Day N, Douglas G, Farmery E, Lynge E, Philip J, Ponti AN, Ronco G, Segnan S: European guidelines for quality assurance in cervical cancer screening. Eur J Cancer Suppl 4 1993;29A:S1-S38
7. Schenck V, Somrak TM, Vooijs GP: Compendium on quality assurance, proficiency testing and workload limitations in clinical cytology. In Tutorials of Cytology. Edited by GL Wied, CM Keebler, DL Rosenthal. Chicago, 1995, pp 1-356
8. Syrjänen KJ: Quality assurance in the cytopathology laboratories of the Finnish Cancer Society. In Compendium of Quality Assurance, Proficiency Testing and Workload Limitations in Clinical Cytology. Edited by GL Wied, CM Keebler, DL Rosenthal. Chicago, Tutorials of Cytology, 1995, pp 134-141
9. Krieger PA, McGoogan E, Vooijs GP, Amma NS, Cochand-Priollet B, Colgan TJ, Davey DD, Geyer JW, Goodell RM, Grohs DH, Gupta SK, Jones BA, Koss LG, Mango LJ, McCallum SM, Nielsen M, Robinowitz M, Sauer T, Schumann JL, Syrjänen KJ, Suprun HZ, Topalides T, Wertlake PT, Whittaker J: Quality assurance/control issues: IAC task force summary. Acta Cytol 1998;42:133-140
10. Mody DR, Davey DD, Branca M, Raab SS, Schenck UG, Stanley MW, Gordon WR, Arbyn M, Beccati D, Bishop JW, Collaco LM, Cramer SF, Fitzgerald P, Heinrich J, Jhala NC, Montanari G, Kapila K, Naryshkin S, Suprun HZ: Quality assurance and risk reduction guidelines. Acta Cytol 2000;44:496-507
11. Branca M, Morosini PL, Marsan C, Coleman D: Continuous quality improvement in laboratories which undertake cervical cytology: Leonardo da Vinci-Cytotrain Project 1996-2002. Rome, PHARMIT Edizioni Scientifiche, 2002, pp 1-39
12. Evans DMD, Shelley G, Cleary S, Baldwin Y: Observer variation and quality control of cytodiagnosis. J Clin Pathol 1974;27: 945-950
13. Klinkhamer PJJM, Vooijs GP, de Haan AFJ: Intraobserver and interobserver variability in the quality assessment of the cervical smears. Acta Cytol 1989;33:215-218
14. Horn PI, Lowell DM, LiVolsi VA, Boyle CA: Reproducibility of the cytologic diagnosis of human papillomavirus infection. Acta Cytol 1985;29:692-694
15. Klinkhamer PJ, Vooijs GP, de Haan AF: Intraobserver and interobserver variability in the diagnosis of epithelial abnormalities in cervical smears. Acta Cytol 1988;32:794-800
16. Yobs AR, Plott AE, Hicklin MD, Coleman SA, Johnston WW, Ashton PR, Rube IF, Watts JC, Naib ZM, Woods RJ, Recalde AL, Ingram FR, Mangum CA: Retrospective evaluation of gynecologic cytodiagnosis: II. Interlaboratory reproducibility as shown in rescreening large consecutive samples of reported cases. Acta Cytol 1987;31:900-910
17. Confortini M, Biggeri A, Cariaggi MP, Carozzi MF, Minuti PM, Russo A, Palli D: Intralaboratory reproducibility in cervical cytology: Results of the application of a 100-set slide set. Acta Cytol 1993;37:49-54
18. Sherman ME, Schiffman MH, Lorincz AT, Manos MM, Scott DR, Kuman RJ, Kiviat NB, Stoler M, Glass AG, Rush BB: Toward objective quality assurance in cervical cytopathology: Correlation of cytopathologic diagnoses with detection of high-risk human papillomavirus types. Am J Clin Pathol 1994;102:182-187
19. Young NA, Naryshkin S, Atkinson BF, Ehya H, Gupta PK, Kline TS, Luff RD: Inter-observer variability of cervical smears with squamous-cell abnormalities: A Philadelphia study. Diagn Cytopathol 1994;11:352-357
20. Branca M, Duca PG, Riti MG, Rossi E, Leoncni L, Turolla E, Morosini PL, the National Working Group for External Quality Control in Cervical Screening: Reliability and accuracy of reporting cervical intraepithelial neoplasia (CIN) in 15 laboratories throughout Italy: Phase 1 of a national programme of external quality control in cervical screening. Cytopathology 1996;7:159-172
21. Raab SS, Snider TE, Potts SA, McDaniel HL, Robinson RA, Nelson DL, Sigman JD, Thomas PA: Atypical glandular cells of undetermined significance: Diagnostic accuracy and interobserver variability using selected cytological criteria. Am J Clin Pathol 1997;107:299-307
22. Ciatto S, Cariaggi MP, Minuti PM, Confortini M, Palli D, Pas L, Schenck U, Bonaccorsi A, Corradis G, Olivati S, Pieri L, Carretti D, Cocchi V: Interlaboratory reproducibility in reporting inadequate cervical smears: A multicentre multinational study. Cytopathology 1996;7:386-390
23. Cocchi V, Sintoni C, Carretti D, Sama D, Chiari U, Segaia V, DeLazer AL, Grilli N, Papaleo R, Ghirardini C, Bucchi L: External quality assurance in cervical-vaginal cytology: Interlaboratory agreement in the Emilia-Romagna region of Italy. Acta Cytol 1996;40:480-488
24. Ronco G, Montanari G, Aimone V, Parisio F, Segnan N, Valle A, Volante R: Estimating the sensitivity of cervical cytology errors of interpretation and test limitation. Cytopathology 1996; 7:151-158
25. Branca M, Morosini PL, Duca PG, Verderio P, Giovagnoli MR, Riti MG, Leoncini L: Reliability and accuracy in reporting CIN in 14 laboratories: Developing new indices of diagnostic variability in an interlaboratory study. Acta Cytol 1998;42: 1370-1376
26. Stoler MH, Schiffman M: Interobserver reproducibility of cervical cytologic and histologic interpretations: Realistic estimates from the ASCUS-LSIL Triage study. JAMA 2001;285: 1500-1505
27. Fleiss JL: Statistical Models for Rates and Proportions. New York, J Wiley, 1981, pp 212-225
28. Landis JR, Koch GG: The measurement of observer agreement for categorical date. Biometrics 1977;33:159-174
29. Fleiss JL, Cohen J: The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psych Meas 1973;33:613-619
30. Branca M, Morosini P, Severi P, Erzen M, Di Benedetto C, Syrjänen K: New statistical software for intralaboratory and interlaboratory quality control in clinical cytology: Validation in a simulation study on clinical samples. Acta Cytol 2005;49:398-404
31. Syrjänen K, Naud P, Derchain SM, Roteli-Martins C, Longatto-Filho A, Tatti S, Branca M, Erzen M, Serpa-Hammes L, Matos J, Gontijo R, Sarian L, Lima TP, Maeda MYS, Lörincz A, Dores GB, Costa S, Syrjänen S: Comparing PAP smear cytology, aided visual inspection, screening colposcopy, cervicography and HPV testing as optional screening tools in Latin America: Study design and baseline data of the LAMS study. Anticancer Res 2005;25:3469-3480
32. Penner DW: An overview of the College of American Pathologists' program in surgical pathology and cytopathology. Acta Cytol 1989;33:439-442
33. Bonfiglio TA: Quality assurance in cytopathology: Recommendations and ongoing quality assurance activites of the American Society of Clinical Pathologists. Acta Cytol 1989;33:431-433
34. Yobs AR, Swanson RA, Lamotte LC Jr: Laboratory reliability of the Papanicolaou smear. Obstet Gynecol 1985;65:235-244
35. Thomas GDH, Head C, Thorogood J: Quality assessment in cervical cytology: A pilot study. J Clin Pathol 1988;41:215-219
36. Husain O, Butler EB, Woodford FP: Combined external quality assessment of cytology and histology opinions: A pilot scheme for a cluster of five laboratories. J Clin Pathol 1984; 37:993-1001
37. Collins DN, Kaufmann W, Clinton W: Quality evaluation of cytology laboratories in New York State: Expanded program - 1971-1973. Acta Cytol 1974;18:404-413
38. Fahey MT, Irwig L, Macaskill P: Meta-analysis of Pap test accuracy. Am J Epidemiol 1995:141:680-089
39. O'Sullivan JP, Ismail SM, Barnes WS: Interobserver variation in diagnosis and grading of dyskaryosis in cervical smears: Specialist cytopathologist compared with non-specialist. J Clin Pathol 1994:47:515-518
40. Palli D, Confortini M, Biggeri A, Russo A, Cariaggi MP, Carozzi MF: A quality control system involving peer review of abnormal cervical smears. Cytopathology 1993;4:17-25
41. Rosenthal DL: Criteria and standards for cytology proficiency testing in quality assurance, proficiency testing and workload limitations in clinical cytology. In Tutorials of Cytology. Edited by GL Wied, CM Keebler, DL Rosenthal. Chicago, 1995, pp 238-240