Evaluation of diagnostic performance in radiography

Radiography

Volumn 4, Issue 1, 1998, Pages 49-60

  Manning, D J ^a  

^a UNIVERSITY OF CUMBRIA   (United Kingdom)

Author keywords

Diagnostic performance; Image quality; Radiography; ROC; Signal detection

Indexed keywords

ARTICLE; DIAGNOSTIC ACCURACY; DIAGNOSTIC IMAGING; DIAGNOSTIC VALUE; HUMAN; IMAGE QUALITY; MEDICAL LITERATURE; PRIORITY JOURNAL; RADIOGRAPHY; RECEIVER OPERATING CHARACTERISTIC; SIGNAL DETECTION; TIME;

EID: 0031885627     PISSN: 10788174     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1078-8174(98)80030-8     Document Type: Review

References (61)

1. Swets J. Measuring the performance of diagnostic systems. Science 1988; 2: 1285-93.
2. Green DM, Swets JA. Signal detection theory and psychophysics. New York: John Wiley & Sons, 1966; New York: Krieger, 1974.
3. Hay GA, Chesters MS. Signal transfer functions in threshold and suprathreshold vision. J Opt Soc Am 1972; 62: 990-8.
4. Rose A. The relative sensitivities of television pickup tubes, photographic film and the human eye. Proc Instr Radio Engineers 1942; 30: 295-300.
5. Rose A. The sensitivity performance of the human eye on an absolute scale. J Opt Soc Am 1948; 38: 196-208.
6. De Vries H. The quantum character of light and its bearing on the threshold of vision, the differential sensitivity and acuity of the eye. Physica 1943; 10: 553-64.
7. Hecht S, Shlaer S, Pirenne M. Energy, quanta and vision. J Gen Physiol 1942; 25: 819-40.
8. Chesters S. Human visual perception and ROC methodology in medical imaging. Phys Med Biol 1992; 37: 1433-76.
9. Nagaraja NS. Effect of luminance noise on contrast thresholds. J Opt Soc Am 1964; 54: 950-5.
10. Schnitzler AD. Image detector model and parameters of the human visual system. J Opt Soc Am 1973; 63: 1357-68.
11. Chesters S, Hay GA. Quantitative relationship between detectability and noise power. Phys Med Biol 1983; 28: 1113-25.
12. Evans AL. The evaluation of medical images. Medical Physics Handbooks, 10. Bristol: Adam Hilger, Institute of Physics: 7.
13. Hay GA, Chesters S. Medical Images; formation perception and measurement. Proceedings of the 7th L.H. Gray Conference. G. A. Hay, ed. Bristol Institute of Physics, Chichester: Wiley, 1976.
14. Burgess AE, Wagner RF, Jennings RJ, Barlow HB. Efficiency of human visual signal discrimination. Science 1981; 214: 93-4.
15. Tanner WP, Birdsall TG. Definitions of d′ and n as psychophysical measures. J Acoust Soc Am 1958; 30: 922-8.
16. Wagner RF, Brown DG. Unified SNR analysis of medical imaging systems. Phys Med Biol 1985; 30: 489-518.
17. Ghandeharian H, Burgess AE. Visual signal detection I. Ability to use phase information. J Opt Soc Am 1984; A1: 900-5.
18. Burgess AE. Visual signal detection, III. On Baysian use of prior knowledge and cross correlation. J Opt Soc Am 1985; A2: 1498-507.
19. Leach J, Morris PE. Underwater visibility and the recall of subsea marker panels. Ergonomics 1993; 36.5: 569-78.
20. Manning DJ, Rogers N. Applications of signal detection theory in chest radiography. London: British Inst. of Radiology. Proceedings of Roentgen Centenary Congress 1995. BIR, 1995.
21. Myers KJ, Barrett HH, Borgstrom MC, Patton DD, Seely GW. Effect of noise correlation on detectability of disc signals in medical imaging. J Opt Soc Am 1985; A2: 1752-9.
22. Ishida M, Doi K, Loo L-N, Metz CE, Lehr JL. Digital image processing: effects on detectability of simulated low contrast radiographic patterns. Radiology 1984; 150: 569-75.
23. Ogawa M, Tanimoto K, Kodera Y, Suei A, Taguchi A, Tomita S. Image salvage in panoramic radiography using histogram optimization. Dentomaxillofac Radiol 1991; 20: 93-9.
24. Hill CR. A future for radiological science? Br J Radiol 1991; 64: 289-97.
25. Pizzutiello R, Cullinan J. Introduction to Medical Radiographic Imaging. Rochester NY: Eastman Kodak, 1993: 111.
26. Workman A, Cowen A. Image quality characteristics of radiographic film screen systems and their measurement. MDD Evaluation Report 94-34, 1994.
27. Dainty JC, Shaw R. In Image Science. London: Academic Press, 1974; page 156.
28. Blackwell HR. Contrast thresholds of the human eye. J Opt Soc Am 1946; 36: 624-43.
29. Williams HS. BJR Special report No. 9. A survey of images of a phantom produced by radioisotope scanners and cameras. BIR, 1976.
30. Lopez H, Loew MH, Butler PF, Hill MC. A clinical evaluation of contrast detail analysis for ultrasound images. Med Phys 1990; 17: 48-57.
31. Cohen G, DiBianca FA. The use of contrast-detail dose evaluation of image quality in a computed tomography scanner. J Comp Ass Tomog 1979; 3: 189-95.
32. Cohen G, Wagner LK, Amtev SR, DiBianca FA. Contrast-detail-noise dose efficiency analysis of a scanning digital and a screen-film-grid radiographic system. Med Phys 1981; 8: 358-68.
33. Hay GA, Clarke OF, Colman NJ, Cowan AR. A set of test objects for quality control in television fluoroscopy. Br J Radiol 1985; 58: 335-44.
34. Cowan AR, Haywood JM, Workman A, Clarke OF. A set of X-ray test objects for image quality control in digital subtraction fluorography: design considerations. Br J Radiol 1987; 60: 1001-9.
35. Payne M, Lawinski CP. A comparison of four mammographic image quality test objects. Br J Radiol 1992; 65 (772): 339-41.
36. Harrison RM, Lambert GD. A method and contrast detail phantom for the quantitative assessment of radiotherapy portal imaging systems. Br J Radiol 1994; 67 (796): 384-8.
37. Robson KJ, Kotre CJ, Faulkner k. An experimental investigation of the effect of light-box luminance on the detection of low contrast objects in mammography. Br J Radiol 1996; 69 (818): 153-9.
38. Launders JH, McArdle S, Workman A, Cowan AR. Update on the viewing protocol for FAXIL threshold contrast detail detectability test objects used in television fluoroscopy. Br J Radiol 1995; 68 (805): 70-7.
39. 39: Lusted LB. Perceptions of the roentgen image. Radiol J Clin N Am 1969; vii3: 435-45.
40. Fukunaga K. In Introduction to statistical pattern recognition. London: Academic Press, 1972: page 247.
41. Eddy D. Probablistic reasoning in clinical medicine. In: Kahnman D, Slovic P, Tversky A, eds. Judgement under uncertainty. Cambridge: Cambridge University Press, 1993: 252.
42. Mossman D, Somoza E. ROC curves, test accuracy and the description of diagnostic tests. J Neuro Psychi Clin Neurosci 1991; 3: 330-33.
43. Metz CE. Basic principles of ROC analysis. Semin Nucl Med 1978; viii4: 283-98.
44. Egan JP. Signal detection theory and ROC analysis. New York: Academic Press, 1975: 74-5.
45. Rockette HE, Gur D, Metz C. The use of discrete and continuous confidence judgements in receiver operating characteristic studies of diagnostic imaging techniques. Invest Radiol 1992; 27: 169-72.
46. Shiraishi J, Yamasaki M, Tanaka K, Kishimoto K, Hatagawa M. Advantage of ROC analysis using the method for continuously distributed (non-categorised) test results. Jpn J Radiol Technol 1994; 12: 266-76.
47. Bamber D. The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. J Math Psychol 1975; 12: 387-58.
48. Hanley JA, McNeil BJ. A method of comparing the areas under the ROC curve derived from the same cases. Radiology 1983; 148: 839-43.
49. Donaldson W. Accuracy of d′ and A′ as estimates of sensitivity. Bul Psychonomic Soc 1993; 31: 271-4.
50. Metz CE. Statistical analysis of ROC data in evaluating diagnostic performance. In: Herbert D, Myers R, eds. Multiple Regression Analysis; applications in health sciences. N.Y. American Institute of Physics, 1986: 365-84.
51. Thompson ML, Zucchini W. On the statistical analysis of ROC curves. Statistics in Med 1989; 8: 1277.
52. Metz CE. Some practical issues of experimental design and data analysis in radiological ROC studies. Invest Radiol 1989; 24: 234-45.
53. Begg CB, McNeil BJ. Assessment of radiological tests; control of bias and other design considerations. Radiology 1988; 167: 565-69.
54. Swets JA. Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance. Psychol Bull 1986; 99: 181-98.
55. Metz CE, Shen J-H. Gains in accuracy from replicated readings of diagnostic images: predictions and assessment in terms of ROC analysis. Med Decis Making 1992; 12: 60-75.
56. Samuel S, Kundel H, Nodine C, Toto L. Mechanism of satisfaction of search: eye position recordings in the reading of chest radiographs. Radiology 1995; 194: 895-902.
57. Egan JP, Greenberg GZ, Schulman A. Operating characteristics, signal detectability and the method of free response. J Acoust Soc Am 1961; 33: 993-1007.
58. Bunch PC, Hamilton JF, Sanderson GK, Simmons AH. A free response approach to the measurement and characterisation of radiographic-observer performance. J Appl Photo Eng 1978; 4: 166-71.
59. Chakraborty DP, Breatnach ES, Yester MV, Soto B, Barnes GT, Fraser RG. Digital and conventional chest imaging: a modified ROC study of observer performance using simulated nodules. Radiology 1986; 158: 35-9.
60. Chakraborty DP, Winter LHL. Free response methodology: alternative analysis and a new observer-performance experiment. Radiology 1990; 174: 873-81.
61. Garra BS, Insana MF, Shawker TH, Wagner RF, Bradford M, Russell M. Quantitative ultrasonic detection and classification of diffuse liver disease: comparison with human observer performance. Invest Radiol 1989; 24: 194-203.