Correlation between model observer and human observer performance in CT imaging when lesion location is uncertain

Medical Physics

Volumn 40, Issue 8, 2013, Pages

  Leng, Shuai ^a   Yu, Lifeng ^a   Zhang, Yi ^a   Carter, Rickey ^a   Toledano, Alicia Y ^b   McCollough, Cynthia H ^a  

^a MAYO CLINIC   (United States)

^b Biostatistics Consulting   (United States)

Author keywords

channelized Hotelling observer; human observer; lesion detection and localization; LROC; model observer

Indexed keywords

IMAGE QUALITY; LOCATION; PHANTOMS; POSITRON EMISSION TOMOGRAPHY;

CHANNELIZED HOTELLING OBSERVERS; HUMAN OBSERVERS; LESION DETECTION AND LOCALIZATIONS; LROC; MODEL OBSERVER;

COMPUTERIZED TOMOGRAPHY;

AREA UNDER THE CURVE; ARTICLE; COMPUTED TOMOGRAPHY SCANNER; COMPUTER ASSISTED TOMOGRAPHY; HUMAN; IMAGE QUALITY; INTERMETHOD COMPARISON; NOISE REDUCTION; OBSERVER VARIATION; PHANTOM; PRIORITY JOURNAL; RADIATION DOSE; SIGNAL DETECTION; SIGNAL NOISE RATIO; TASK PERFORMANCE; IMAGE PROCESSING; NEOPLASM; PROCEDURES; RADIOGRAPHY; UNCERTAINTY; METHODOLOGY;

IMAGE PROCESSING, COMPUTER-ASSISTED; NEOPLASMS; OBSERVER VARIATION; PHANTOMS, IMAGING; TOMOGRAPHY, X-RAY COMPUTED; UNCERTAINTY;

EID: 84881623926     PISSN: 00942405     EISSN: None     Source Type: Journal    
DOI: 10.1118/1.4812430     Document Type: Article

References (47)

1. D. J. Brenner and E. J. Hall, " Computed tomography-an increasing source of radiation exposure.," N. Engl. J. Med. 357, 2277-2284 (2007). 10.1056/NEJMra072149
2. R. Smith-Bindman, J. Lipson, R. Marcus, K. P. Kim, M. Mahesh, R. Gould, A. Berrington de Gonzalez, and D. L. Miglioretti, " Radiation dose associated with common computed tomography examinations and the associated lifetime attributable risk of cancer.," Arch. Intern. Med. 169, 2078-2086 (2009). 10.1001/archinternmed.2009.427
3. A. Berrington de Gonzalez, M. Mahesh, K. P. Kim, M. Bhargavan, R. Lewis, F. Mettler, and C. Land, " Projected cancer risks from computed tomographic scans performed in the United States in 2007.," Arch. Intern Med. 169, 2071-2077 (2009). 10.1001/archinternmed.2009.440
4. AAPM CT Summit, " Scan parameter optimization.," (2010) (available URL: http://www.aapm.org/meetings/2010CTS/default.asp). Date accessed 1/10/2011.
5. W. R. Hendee, G. J. Becker, J. P. Borgstede, J. Bosma, W. J. Casarella, B. A. Erickson, C. D. Maynard, J. H. Thrall, and P. E. Wallner, " Addressing overutilization in medical imaging.," Radiology 257, 240-245 (2010). 10.1148/radiol.10100063
6. A. Apel, J. G. Fletcher, J. L. Fidler, D. M. Hough, L. Yu, L. S. Guimaraes, M. E. Bellemann, C. H. McCollough, D. R. Holmes 3rd, and C. D. Eusemann, " Pilot multi-reader study demonstrating potential for dose reduction in dual energy hepatic CT using non-linear blending of mixed kV image datasets.," Eur. Radiol. 21, 644-652 (2010). 10.1007/s00330-010-1947-8
7. L. S. Guimaraes, J. G. Fletcher, W. S. Harmsen, L. Yu, H. Siddiki, Z. Melton, J. E. Huprich, D. Hough, R. Hartman, and C. H. McCollough, " Appropriate patient selection at abdominal dual-energy CT using 80 kV: Relationship between patient size, image noise, and image quality.," Radiology 257, 732-742 (2010). 10.1148/radiol.10092016
8. International Commission on Radiation Units and Measurements, " Medical imaging-The assessment of image quality.," Report 54, (International Commission on Radiation Units and Measurements, Bethesda, MD, 1996), pp. 1-88.
9. H. H. Barrett, J. Yao, J. P. Rolland, and K. J. Myers, " Model observers for assessment of image quality.," Proc. Natl. Acad. Sci. U.S.A. 90, 9758-9765 (1993). 10.1073/pnas.90.21.9758
10. J. Beutel, H. Kundel, and R. Van Metter, Handbook of medical imaging: Physics and psychophysics (SPIE, Bellingham, WA, 2000).
11. K. J. Myers and H. H. Barrett, " Addition of a channel mechanism to the ideal-observer model.," J. Opt. Soc. Am. A 4, 2447-2457 (1987). 10.1364/JOSAA.4.002447
12. A. E. Burgess, " Statistically defined backgrounds: performance of a modified nonprewhitening observer model.," J. Opt. Soc. Am. A Opt. Image Sci. Vis 11, 1237-1242 (1994). 10.1364/JOSAA.11.001237
13. C. K. Abbey and H. H. Barrett, " Human- and model-observer performance in ramp-spectrum noise: effects of regularization and object variability.," J. Opt. Soc. Am. A Opt. Image Sci. Vis 18, 473-488 (2001). 10.1364/JOSAA.18.000473
14. M. Eckstein, J. Bartroff, C. Abbey, J. Whiting, and F. Bochud, " Automated computer evaluation and optimization of image compression of x-ray coronary angiograms for signal known exactly detection tasks.," Opt. Express 11, 460-475 (2003). 10.1364/OE.11.000460
15. M. P. Eckstein, C. K. Abbey, and J. S. Whiting, " Human vs model observers in anatomic backgrounds.," Proc. SPIE 3340, 16-26 (1998). 10.1117/12.306180
16. S. Richard and J. H. Siewerdsen, " Comparison of model and human observer performance for detection and discrimination tasks using dual-energy x-ray images.," Med. Phys. 35, 5043-5053 (2008). 10.1118/1.2988161
17. A. E. Burgess, F. L. Jacobson, and P. F. Judy, " Human observer detection experiments with mammograms and power-law noise.," Med. Phys. 28, 419-437 (2001). 10.1118/1.1355308
18. A. S. Chawla, E. Samei, R. S. Saunders, J. Y. Lo, and J. A. Baker, " A mathematical model platform for optimizing a multiprojection breast imaging system.," Med. Phys. 35, 1337-1345 (2008). 10.1118/1.2885367
19. A. S. Chawla, E. Sarnei, R. Saunders, C. Abbey, and D. Delong, " Effect of dose reduction on the detection of mammographic lesions: A mathematical observer model analysis.," Med. Phys. 34, 3385-3398 (2007). 10.1118/1.2756607
20. M. L. Hill, J. G. Mainprize, and M. J. Yaffe, " An observer model for lesion detectability in contrast-enhanced digital mammography.," Digit. Mammogr. 6136, 720-727 (2010). 10.1007/978-3-642-13666-5-97
21. P. Bonetto, J. Qi, and R. M. Leahy, " Covariance approximation for fast and accurate computation of channelized Hotelling observer statistics.," IEEE Trans. Nucl. Sci. 47, 1567-1572 (2000). 10.1109/23.873017
22. H. C. Gifford, M. A. King, D. J. de Vries, and E. J. Soares, " Channelized hotelling and human observer correlation for lesion detection in hepatic SPECT imaging.," J. Nucl. Med. 41, 514-521 (2000).
23. H. C. Gifford, R. G. Wells, and M. A. King, " A comparison of human observer LROC and numerical observer ROC for tumor detection in SPECT images.," IEEE Trans. Nucl. Sci. 46, 1032-1037 (1999). 10.1109/23.790820
24. S. Kulkarni, P. Khurd, I. Hsiao, L. Zhou, and G. Gindi, " A channelized Hotelling observer study of lesion detection in SPECT MAP reconstruction using anatomical priors.," Phys. Med. Biol. 52, 3601-3617 (2007). 10.1088/0031-9155/52/12/017
25. C. Lartizien, P. E. Kinahan, and C. Comtat, " Volumetric model and human observer comparisons of tumor detection for whole-body positron emission tomography.," Acad. Radiol. 11, 637-648 (2004). 10.1016/j.acra.2004.03.002
26. M. D. Tisdall and M. S. Atkins, " Using human and model performance to compare MRI reconstructions.," IEEE Trans. Med. Imaging 25, 1510-1517 (2006). 10.1109/TMI.2006.881374
27. D. J. Tward, J. H. Siewerdsen, M. J. Daly, S. Richard, D. J. Moseley, D. A. Jaffray, and N. S. Paul, " Soft-tissue detectability in cone-beam CT: Evaluation by 2AFC tests in relation to physical performance metrics.," Med. Phys. 34, 4459-4471 (2007). 10.1118/1.2790586
28. G. J. Gang, D. J. Tward, J. Lee, and J. H. Siewerdsen, " Anatomical background and generalized detectability in tomosynthesis and cone-beam CT.," Med. Phys. 37, 1948-1965 (2010). 10.1118/1.3352586
29. S. Park, R. Jennings, H. Liu, A. Badano, and K. J. Myers, " A statistical, task-based evaluation method for three-dimensional x-ray breast imaging systems using variable-background phantoms.," Med. Phys. 37, 6253-6270 (2010). 10.1118/1.3488910
30. P. F. Judy, R. G. Swensson, and M. Szulc, " Lesion detection and signal-to-noise ratio in CT images.," Med. Phys. 8, 13-23 (1981). 10.1118/1.594903
31. K. L. Boedeker and M. F. McNitt-Gray, " Application of the noise power spectrum in modern diagnostic MDCT: Part II. Noise power spectra and signal to noise.," Phys. Med. Biol. 52, 4047-4061 (2007). 10.1088/0031-9155/52/14/003
32. A. Wunderlich and F. Noo, " Image covariance and lesion detectability in direct fan-beam x-ray computed tomography.," Phys. Med. Biol. 53, 2471-2493 (2008). 10.1088/0031-9155/53/10/002
33. L. Yu, S. Leng, L. Chen, J. M. Kofler, R. E. Carter, and C. H. McCollough, " Prediction of human observer performance in a 2-alternative forced choice low-contrast detection task using channelized Hotelling observer: Impact of radiation dose and reconstruction algorithms.," Med. Phys. 40, 041908 (9pp.) (2013). 10.1118/1.4794498
34. M. P. Eckstein, B. Pham, and C. K. Abbey, " Effect of image compression for model and human observers in signal-known-statistically tasks.," Proc. SPIE. 4686, 13-24 (2002). 10.1117/12.462673
35. H. C. Gifford, M. A. King, P. H. Pretorius, and R. G. Wells, " A comparison of human and model observers in multislice LROC studies.," IEEE Trans. Med. Imaging 24, 160-169 (2005). 10.1109/TMI.2004.839362
36. L. M. Popescu and R. M. Lewitt, " Small nodule detectability evaluation using a generalized scan-statistic model.," Phys. Med. Biol. 51, 6225-6244 (2006). 10.1088/0031-9155/51/23/020
37. Y. Zhang, B. Pham, and M. P. Eckstein, " Evaluation of JPEG 2000 encoder options: Human and model observer detection of variable signals in X-ray coronary angiograms.," IEEE Trans. Med. Imaging 23, 613-632 (2004). 10.1109/TMI.2004.826359
38. R. G. Swensson, " Unified measurement of observer performance in detecting and localizing target objects on images.," Med. Phys. 23, 1709-1725 (1996). 10.1118/1.597758
39. ACR Electronic Practice Guideline, " ACR Technical standard for electronic practice of medical imaging.," (2007) [See http://gm.acr.org/ SecondaryMainMenuCategories/quality-safety/guidelines/med-phys/ electronic-practice.aspx].
40. A. Wunderlich and F. Noo, " A nonparametric procedure for comparing the areas under correlated LROC curves.," IEEE. Trans. Med. Imaging 31, 2050-2061 (2012). 10.1109/TMI.2012.2205015
41. L. M. Popescu, " Nonparametric ROC and LROC analysis.," Med. Phys. 34, 1556-1564 (2007). 10.1118/1.2717407
42. M. K. Whitaker, E. Clarkson, and H. H. Barrett, " Estimating random signal parameters from noisy images with nuisance parameters: Linear and scanning-linear methods.," Opt. Express 16, 8150-8173 (2008). 10.1364/OE.16.008150
43. C. K. Abbey, F. Bochud, " Modeling visual detection tasks in correlated image noise with linear model observers.," in Handbook of Medical Imaging: Physics and Psychophysics, edited by, J. Beutel, H. Kundel, and, R. Van Metter, (SPIE, Bellingham, WA, 2000), Vol. 1.
44. H. H. Barrett and K. J. Myers, Foundations of Image Science (Wiley, Hoboken, NJ, 2004).
45. Y. Zhang, C. K. Abbey, and M. P. Eckstein, " Adaptive detection mechanisms in globally statistically nonstationary-oriented noise.," J. Opt. Soc. Am. A Opt. Image. Sci. Vis. 23, 1549-1558 (2006). 10.1364/JOSAA.23. 001549
46. A. E. Burgess and B. Colborne, " Visual signal detection. IV. Observer inconsistency.," J. Opt. Soc. Am. A 5, 617-627 (1988). 10.1364/JOSAA.5.000617
47. Y. Zhang, B. T. Pham, and M. P. Eckstein, " Evaluation of internal noise methods for Hotelling observer models.," Med. Phys. 34, 3312-3322 (2007). 10.1118/1.2756603