Multipoint rank-order study methodology: Observer issues

Investigative Radiology

Volumn 35, Issue 2, 2000, Pages 125-130

  Towers, Jeffrey D ^a   Holbert, J Michael ^a   Britton, Cynthia A ^a   Costello, Phillip ^a   Sciulli, Robert ^a   Gur, David ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

Imaging systems evaluations; Interobserver variability; Observer performance

Indexed keywords

ARTICLE; DIAGNOSTIC IMAGING; HUMAN; IMAGE ANALYSIS; IMAGE QUALITY; INTERSTITIAL LUNG DISEASE; OBSERVER VARIATION; PNEUMOTHORAX; PRIORITY JOURNAL; TASK PERFORMANCE; THORAX RADIOGRAPHY;

EID: 0033960736     PISSN: 00209996     EISSN: None     Source Type: Journal    
DOI: 10.1097/00004424-200002000-00006     Document Type: Article

References (22)

1. Metz CE. Some practical issues of experimental design and data analysis in radiological ROC studies. Invest Radiol 1989;24:234-245.
2. MacMahon H, Doi K, Sanada M, et al. Data compression: Effect on diagnostic accuracy in digital chest radiography. Radiology 1991; 178:175-179.
3. Rockette HE, Obuchowski NA, Gur D, Good WF. Effect of experimental design on sample size. Proc SPIE 1991;1446:276-283.
4. Cox GG, Cook LT, McMillan JH, Rosenthal SJ, Dwyer SJ III. Chest radiography: Comparison of high-resolution digital displays with conventional and digital film. Radiology 1990;176:771-776.
5. Rockette HE, Obuchowski N, Metz CE, Gur D. Statistical issues in ROC curve analysis. Proc SPIE 1990;1234:111-119.
6. Holbert JM, Staiger M, Chang TS, Towers JD, Britton CA. Selection of processing algorithms for digital image compression: A rankorder study. Acad Radiol 1995;2:273-276.
7. Britton CA, Gabriele OF, Chang TS, et al. Subjective quality assessment of computed radiography hand images. J Digit Imaging 1996;9:21-24.
8. Gur D, Rubin DA, Kart BH, et al. Forced choice and ordinal discrete rating assessment of image quality: A comparison. J Digit Imaging 1997;10:103-107.
9. Good WF, Sumkin JH, Dash N, et al. Observer sensitivity to small differences: A multipoint rank order experiment. Am J Roentgenol 1999;173:275-278.
10. Rockette HE, King JL, Thaete FL, Fuhrman CR, Slifko RM, Gur D. Selection of subtle cases for observer-performance studies: The importance of knowing the true diagnosis. Acad Radiol 1998;5:86-92.
11. Good WF, Maitz G, King J, Gennari R, Gur D. Observer performance assessment of JPEG-compressed high-resolution chest images. Proc SPIE 1999;3663:8-13.
12. Nill NB. A visual model weighted cosine transform for image compression and quality assessment. IEEE Trans Commun 1985;COM-33:551-557.
13. Ngan KN, Leong KS, Harcharan S. Cosine transform coding incorporating human visual system model. Proc SPIE 1986;707:165-171.
14. Kelly DH. Visual contrast sensitivity. Opt Acta 1977;24:107-129.
15. Ishigaki T, Sakuma S, Ideda M, et al. Clinical evaluation of irreversible image compression: Analysis of chest imaging with computed radiography. Radiology 1990;175:739-743.
16. Aberle DR, Gleeson F, Sayre JW, et al. The effect of irreversible compression on diagnostic accuracy in thoracic imaging. Invest Radiol 1993;28:398-403.
17. Cox GG, Cook LT, Insana MF, et al. The effects of lossy compression on the detection of subtle pulmonary nodules. Med Phys 1996;23: 127-132.
18. Siegel S. Nonparametric statistics for the behavioral sciences. New York, NY: McGraw-Hill Book Company; 1956.
19. Slasky BS, Gur D, Good WF, et al. Receiver operating characteristic analysis of chest image interpretation with conventional, laser-printed, and high-resolution workstation images. Radiology 1990; 174:775-780.
20. Thaete FL, Fuhrman CR, Oliver JH, et al. Digital radiography and conventional imaging of the chest: A comparison of observer performance. Am J Roentgenol 1994;162:575-581.
21. Dony RD, Coblentz CL, Nabmias C, Haykin S. Compression of digital chest radiographs with a mixture of principal components neural network: Evaluation of performance. Radiographies 1996;16:1481-1488.
22. Pocock SJ. Clinical trials - A practical approach. Chichester, Great Britain: John Wiley & Sons; 1983.