The influence of experience and training in a group of novice observers: A jackknife alternative free-response receiver operating characteristic analysis

Radiography

Volumn 20, Issue 4, 2014, Pages 300-305

  Buissink, C ^a   Thompson, J D ^b   Voet, M ^a   Sanderud, A ^c   Kamping, L V ^a   Savary, L ^d   Mughal, M ^c   Rocha, C S ^e   Hart, G E ^b   Parreiral, R ^e   Martin, G ^b   Hogg, P ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b UNIVERSITY OF SALFORD   (United Kingdom)

^c OSLO METROPOLITAN UNIVERSITY   (Norway)

^d UNIVERSITY OF LAUSANNE   (Switzerland)

^e INSTITUTO POLITÉCNICO DE LISBOA   (Portugal)

Author keywords

FROC; JAFROC; Novice observer; ROC

Indexed keywords

ARTICLE; CLINICAL EVALUATION; CLINICAL OBSERVATION; CLINICAL PRACTICE; EVALUATION STUDY; EXPERIENCE; JACKKNIFE ALTERNATIVE FREE RESPONSE RECEIVER OPERATING; JACKKNIFE TEST; MEDICAL DECISION MAKING; MEDICAL EDUCATION; METHODOLOGY; NOVICE OBSERVER; OBSERVER VARIATION; PROBABILITY; RADIOGRAPHY; RADIOLOGIST; RECEIVER OPERATING CHARACTERISTIC; SIMULATION; TASK PERFORMANCE;

EID: 84908548537     PISSN: 10788174     EISSN: 15322831     Source Type: Journal    
DOI: 10.1016/j.radi.2014.06.016     Document Type: Article

References (25)

1. Paterson A. Preliminary clinical evaluation and clinical reporting by radiographers: policy and practice guidance 2013, 1-11.
2. McConnell J.R., Webster A.J. Improving radiographer highlighting of trauma films in the accident and emergency department with a short course of study-an evaluation. Br J Radiol 2000, 73:608-612.
3. Hardy M., Culpan G. Accident and emergency radiography: a comparison of radiographer commenting and "red dotting". Radiography 2007, 13(1):65-71. 10.1016/j.radi.2005.09.009.
4. Brealey S., Scally A., Hahn S., Thomas N., Godfrey C., Crane S. Accuracy of radiographers red dot or triage of accident and emergency radiographs in clinical practice: a systematic review. Clin Radiol 2006, 61(7):604-615. 10.1016/j.crad.2006.01.015.
5. Manning D., Ethell S., Donovan T., Crawford T. How do radiologists do it? The influence of experience and training on searching for chest nodules. Radiography 2006, 12:134-142. 10.1016/j.radi.2005.02.003.
6. Krupinski E.A. Current perspectives in medical image perception. Atten Percept Psychophys 2010, 72:1205-1217.
7. Donovan T., Manning D.J. Successful reporting by non-medical practitioners such as radiographers, will always be task-specific and limited in scope. Radiography 2006, 12:7-12. 10.1016/j.radi.2005.01.004.
8. Hanley J.A. Receiver operating characteristic (ROC) methodology: the state of the art. Crit Rev Diagn Imaging 1989, 29:307-335.
9. Chakraborty D.P. Recent developments in imaging system assessment methodology, FROC analysis and the search model. Nucl Instrum Method Phys Res Sect A Accel Spectrom Detect Assoc Equip 2011, 648. 10.1016/j.nima.2010.11.042.
10. Chakraborty D.P., Winter L.H. Free-response methodology: alternate analysis and a new observer-performance experiment. Radiology 1990, 174:873-881.
11. Digital imaging and communications in medicine ( DICOM ) part 14: grayscale standard display function 2006, National Electrical Manufacturers Association, Available at:. http://medical.nema.org/dicom/2006/06_14pu.pdf.
12. The Royal College of Radiologists Picture archiving and communication systems (PACS) and guidelines on diagnostic display devices 2012, London, Available at:. http://www.rcr.ac.uk/docs/radiology/pdf/BFCR(12)16_PACS_DDD.pdf, 2nd ed.
13. Gur D., Rockette H.E., Armfield D.R., Blachar A., Bogan J.K., Brancatelli G., et al. Prevalence effect in a laboratory environment. Radiology 2003, 228:10-14.
14. Reed W.M., Ryan J.T., Mcentee M.F., Evanoff M.G., Brennan P.C. The effect of abnormality- prevalence expectation on expert observer performance and visual search. Radiology 2011, 258(3):938-943.
15. Nocum D.J., Brennan P.C., Huang R.T., Reed W.M. The effect of abnormality-prevalence expectation on naïve observer performance and visual search. Radiography 2013, 19(3):196-199. 10.1016/j.radi.2013.04.004.
16. Burgess A.E. Visual perception studies and observer models in medical imaging. Semin Nucl Med 2011, 41:419-436. 10.1053/j.semnuclmed.2011.06.005.
17. Thompson J., Hogg P., Thompson S., Manning D., Szczepura K. ROCView: prototype software for data collection in jackknife alternative free-response receiver operating characteristic analysis. Br J Radiol 2012, 85(1017):1320-1326. 10.1259/bjr/99497945.
18. Chakraborty D.P., Berbaum K.S. Observer studies involving detection and localization: modeling, analysis, and validation. Med Phys 2004, 31(8):2313-2330. 10.1118/1.1769352.
19. Kok P., Pitman A.G., Cawson J.N., Gledhill S., Kremer S., Lawson J., et al. Diagnostic accuracy of mammography readers and their memory performance have no correlation with each other. JMed Imaging Radiat Oncol 2010, 54(4):315-324. 10.1111/j.1754-9485.2010.02177.x.
20. Holm O., Christensen A., Buskov L., Christensen H., Hansen C., Abild A. Radiographers and trainee radiologists reporting accident radiographs: a comparative plain film-reading performance study. Clin Radiol 2012, 68:55-58. 10.1016/j.crad.2012.06.104.
21. Hardy M., Spencer N., Snaith B. Radiographer emergency department hot reporting: an assessment of service quality and feasibility. Radiography 2008, 14(4):301-305. 10.1016/j.radi.2007.10.003.
22. Howard M.L. An exploratory study of radiographer's perceptions of radiographer commenting on musculo-skeletal trauma images in rural community based hospitals. Radiography 2013, 19(2):137-141. 10.1016/j.radi.2012.12.002.
23. Lancaster A., Hardy M. An investigation into the opportunities and barriers to participation in a radiographer comment scheme, in a multi-centre NHS trust. Radiography 2012, 18(2):105-108. 10.1016/j.radi.2011.08.003.
24. Snaith B., Hardy M. Radiographer abnormality detection schemes in the trauma environment-an assessment of current practice. Radiography 2008, 14(4):277-281. 10.1016/j.radi.2007.09.001.
25. Coleman L., Piper K. Radiographic interpretation of the appendicular skeleton: a comparison between casualty officers, nurse practitioners and radiographers. Radiography 2009, 15:196-202. 10.1016/j.radi.2007.12.001.