Receiver operating characteristic analysis of eyewitness memory: Comparing the diagnostic accuracy of simultaneous versus sequential lineups

Journal of Experimental Psychology: Applied

Volumn 18, Issue 4, 2012, Pages 361-376

  Mickes, Laura ^a   Flowe, Heather D ^b   Wixted, John T ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF LEICESTER   (United Kingdom)

Author keywords

Eyewitness memory; Receiver operating characteristic; ROC analysis; Sequential lineups; Simultaneous lineups

Indexed keywords

ADOLESCENT; ADULT; AGED; ARTICLE; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; CRIME; CRIMINAL LAW; DECISION MAKING; FEMALE; HUMAN; MALE; MIDDLE AGED; RANDOMIZED CONTROLLED TRIAL; RECALL; RECEIVER OPERATING CHARACTERISTIC; RECOGNITION;

ADOLESCENT; ADULT; AGED; CRIME; CRIMINAL LAW; DECISION MAKING; FEMALE; HUMANS; MALE; MENTAL RECALL; MIDDLE AGED; RECOGNITION (PSYCHOLOGY); ROC CURVE;

EID: 84874794072     PISSN: 1076898X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0030609     Document Type: Article

References (44)

1. Bothwell, R. K., Deffenbacher, K. A., & Brigham, J. C. (1987). Correlation of eyewitness accuracy and confidence: Optimality hypothesis revisited. Journal of Applied Psychology, 72, 691-695. doi:10.1037/0021-9010 .72.4.691
2. Brewer, N., Keast, A., & Rishworth, A. (2002). The confidence-accuracy relationship in eyewitness identification: The effects of reflection and disconfirmation on correlation and calibration. Journal of Experimental Psychology: Applied, 8, 44-56. doi:10.1037/1076-898X.8.1.44
3. Brewer, N., & Wells, G. L. (2006). The confidence-accuracy relation in eyewitness identification: Effects of lineup instructions, foil similarity, and target-absent base rates. Journal of Experimental Psychology: Ap-plied, 12, 11-30. doi:10.1037/1076-898X.12.1.11
4. Carlson, C. A., Gronlund, S. D., & Clark, S. E. (2008). Lineup composition, suspect position, and the sequential lineup advantage. Journal of Experimental Psychology: Applied, 14, 118-128. doi:10.1037/1076-898X.14.2.118
5. Clark, S. E. (2012). Costs and benefits of eyewitness identification reform: Psychological science and public policy. Perspectives on Psychological Science, 7, 238-259.
6. Clark, S. E., Erickson, M. A., & Breneman, J. (2011). Probative value of absolute and relative judgments in eyewitness identification. Law and Human Behavior, 35, 364-380. doi:10.1007/s10979-010-9245-1
7. Ebbesen, E. B., & Flowe, H. D. (2002). Simultaneous v. sequential lineups: What do we really know? Retrieved from http://www2.le.ac.uk/departments/psychology/ppl/hf49/SimSeq%20Submit.pdf
8. Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York, NY: Wiley.
9. Gronlund, S. D., Carlson, C. A., Dailey, S. B., & Goodsell, C. A. (2009). Robustness of the sequential lineup advantage. Journal of Experimental Psychology: Applied, 15, 140-152. doi:10.1037/a0015082
10. Gronlund, S. D., Carlson, C. A., Neuschatz, J. S., Goodsell, C. A., Wet-more, S., Wooten, A. & Graham, M. (in press). Showups versus lineups: An evaluation using ROC analysis. Journal of Applied Research in Memory and Cognition.
11. Halpern, E. J., Albert, M., Krieger, A. M., Metz, C., & Maidment, A. D. (1996). Comparison of receiver operating characteristic curves on the basis of optimal operating points. Academic Radiology, 3, 245-253. doi:10.1016/S1076-6332(96)80451-X
12. Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29-36.
13. Hautus, M., Macmillan, N. A., & Rotello, C. M. (2008). Toward a complete decision model of item and source recognition. Psychonomic Bulletin & Review, 15, 889-905. doi:10.3758/PBR.15.5.889
14. Heathcote, A. (2003). Item recognition memory and the ROC. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 12101230. doi:10.1037/0278-7393.29.6.1210
15. Juslin, P., Olsson, N., & Winman, A. (1996). Calibration and diagnosticity of confidence in eyewitness identification: Comments on what can be inferred from the low confidence-accuracy correlation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22, 13041316. doi:10.1037/0278-7393.22.5.1304
16. Lindsay, D. S., Read, J. D., & Sharma, K. (1998). Accuracy and confidence in person identification: The relationship is strong when witnessing conditions vary widely. Psychological Science, 9, 215-218. doi: 10.1111/1467-9280.00041
17. Lindsay, R. C. L., Lea, J. A., Nosworthy, G. J., Fulford, J. A., Hector, J., LeVan, V., & Seabrook, C. (1991). Biased lineups: Sequential presentation reduces the problem. Journal of Applied Psychology, 76, 796802. doi:10.1037/0021-9010.76.6.796
18. Lindsay, R. C. L., & Wells, G. L. (1985). Improving eyewitness identifications from lineups: Simultaneous versus sequential lineup presentation. Journal of Applied Psychology, 70, 556-564. doi:10.1037/0021-9010.70.3.556
19. Lusted, L. B. (1971a). Decision-making studies in patient management. New England Journal of Medicine, 284, 416-424. doi:10.1056/ NEJM197102252840805
20. Lusted, L. B. (1971b, March 26). Signal detectability and medical decisionmaking. Science, 171, 1217-1219. doi:10.1126/science.171.3977.1217
21. Macmillan, N. A., & Creelman, C. D. (1996). Triangles in ROC space: History and theory of "nonparametric" measures of sensitivity and response bias. Psychonomic Bulletin & Review, 3, 164-170. doi: 10.3758/BF03212415
22. McQuiston-Surrett, D. E., Malpass, R. S., & Tredoux, C. G. (2006). Sequential vs. simultaneous lineups: A review of methods, data, and theory. Psychology, Public Policy, and Law, 12, 137-169. doi:10.1037/ 1076-8971.12.2.137
23. Meissner, C. A., Tredoux, C. G., Parker, J. F., & MacLin, O. H. (2005). Eyewitness decisions in simultaneous and sequential lineups: A dualprocess signal detection theory analysis. Memory & Cognition, 33, 783-792. doi:10.3758/BF03193074
24. Metz, C. E. (1978). Basic principles of ROC analysis. Seminars in Nuclear Medicine, 8, 283-298. doi:10.1016/S0001-2998(78)80014-2
25. Mickes, L., Hwe, V., Wais, P. E., & Wixted, J. T. (2011). Strong memories are hard to scale. Journal of Experimental Psychology: General, 140, 239-257. doi:10.1037/a0023007
26. Mickes, L., Johnson, E. M., & Wixted, J. T. (2010). Continuous recollection vs. unitized familiarity in associative recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 843863. doi:10.1037/a0019755
27. Mickes, L., Wixted, J. T., & Wais, P. (2007). A direct test of the unequal variance signal detection model of recognition memory. Psychonomic Bulletin & Review, 14, 858-865. doi:10.3758/BF03194112
28. Palmer, M. A., & Brewer, N. (2012). Sequential lineup presentation promotes less biased criterion setting but does not improve discriminability. Law and Human Behavior, 36, 247-255. doi:10.1037/h0093923
29. Penrod, S., & Cutler, B. (1995). Witness confidence and witness accuracy: Assessing their forensic relation. Psychology, Public Policy, and Law, 1, 817-845. doi:10.1037/1076-8971.1.4.817
30. Pisano, E. D., Gatsonis, C., Hendrick, E., Yaffe, M., Baum, J. K., Acha-ryya, S.,Rebner, M. (2005). Diagnostic performance of digital versus film mammography for breast-cancer screening. New England Journal of Medicine, 353, 1773-1783. doi:10.1056/NEJMoa052911
31. Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J., & Müller, M. (2011). pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12, 77. doi: 10.1186/1471-2105-12-77
32. Roediger, H. L., Wixted, J. T., & DeSoto, K. A. (2012). The curious complexity between confidence and accuracy in reports from memory. In L. Nadel & W. Sinnott-Armstrong (Eds.), Memory and law (pp. 84-118). New York, NY: Oxford University Press.
33. Sporer, S. L., Penrod, S., Read, D., & Cutler, B. (1995). Choosing, confidence, and accuracy: A meta-analysis of the confidence-accuracy relation in eyewitness identification studies. Psychological Bulletin, 118, 315-327. doi:10.1037/0033-2909.118.3.315
34. Steblay, N. K., Dysart, J. E., & Wells, G. L. (2011). Seventy-two tests of the sequential lineup superiority effect: A meta-analysis and policy discussion. Psychology, Public Policy, and Law, 17, 99-139. doi: 10.1037/a0021650
35. Stretch, V., & Wixted, J. T. (1998). Decision rules for recognition memory confidence judgments. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 1397-1410. doi:10.1037/0278-7393.24.6.1397
36. Swets, J. A. (1979). ROC analysis applied to the evaluation of medical imaging techniques. Investigative Radiology, 14, 109-121. doi:10.1097/ 00004424-197903000-00002
37. Swets, J. A., Dawes, R. M., & Monahan, J. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1, 1-26. doi:10.1111/1529-1006.001
38. Technical Working Group for Eyewitness Evidence. (1999). Eyewitness evidence: A guide for law enforcement. Washington, DC: U. S. Department of Justice, Office of Justice Programs.
39. van Erkel, A. R., & Pattynama, P. M. (1998). Receiver operating characteristic (ROC) analysis: Basic principles and applications in radiology. European Journal of Radiology, 27, 88-94. doi:10.1016/S0720-048X(97)00157-5
40. Verde, M. E., Macmillan, N. A., & Rotello, C. M. (2006). Measures of sensitivity based on a single hit rate and false alarm rate: The accuracy, precision, and robustness of d=,Az, and A=. Perception & Psychophysics, 68, 643-654. doi:10.3758/BF03208765
41. Wells, G. L., & Murray, D. M. (1984). Eyewitness confidence. In G. L. Wells & E. F. Loftus (Eds.), Eyewitness testimony: Psychological perspectives (pp. 155-170). New York, NY: Cambridge University Press.
42. Wells, G. L., Olson, E. A., & Charman, S. D. (2002). The confidence of eyewitnesses in their lineup identifications from lineups. Current Directions in Psychological Science, 11, 151-154. doi:10.1111/1467-8721.00189
43. Wixted, J. T., & Mickes, L. (2012). The field of eyewitness memory should abandon "probative value" and embrace receiver operating characteristic analysis. Perspectives on Psychological Science, 7, 275-278. doi: 10.1177/1745691612442906
44. Zweig, M. H., & Campbell, G. (1993). Receiver operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39, 561-577.