Recognition ROCs Are Curvilinear-or Are They? On Premature Arguments Against the Two-High-Threshold Model of Recognition

Journal of Experimental Psychology: Learning Memory and Cognition

Volumn 35, Issue 3, 2009, Pages 587-606

  Bröder, Arndt ^a,b   Schütz, Julia ^a  

^a UNIVERSITY OF BONN   (Germany)

^b MAX PLANCK INSTITUTE FOR RESEARCH ON COLLECTIVE GOODS   (Germany)

Author keywords

recognition; signal detection; threshold models

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ATTENTION; EPIDEMIOLOGY; FEMALE; HUMAN; LEARNING; LONG TERM MEMORY; MALE; MIDDLE AGED; MOTIVATION; PERCEPTIVE DISCRIMINATION; PERCEPTIVE THRESHOLD; PSYCHOMETRY; RECOGNITION; REINFORCEMENT; ROC CURVE; STATISTICAL MODEL; STATISTICS;

ADOLESCENT; ADULT; ATTENTION; BIAS (EPIDEMIOLOGY); FEMALE; HUMANS; LINEAR MODELS; MALE; MIDDLE AGED; MODELS, STATISTICAL; MOTIVATION; PSYCHOMETRICS; RECOGNITION (PSYCHOLOGY); REINFORCEMENT (PSYCHOLOGY); RETENTION (PSYCHOLOGY); ROC CURVE; SENSORY THRESHOLDS; SIGNAL DETECTION, PSYCHOLOGICAL; VERBAL LEARNING; YOUNG ADULT;

EID: 65749099244     PISSN: 02787393     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0015279     Document Type: Article

References (96)

1. Akaike H. Information theory and an extension of the maximum likelihood principle. In: Petrox B.N., and Caski F. (Eds). Second international symposium on information theory (1973), Adademiai Kiado, Budapest, Hungary 267-281
2. Allen L.R., and Garton R.F. Detection and criterion change associated with different test contexts in recognition memory. Perception & Psychophysics 6 1 (1969) 1-4
3. Atkinson R.C., and Juola J.F. Search and decision processes in recognition memory. In: Krantz D.H., Atkinson R.C., Luce R.D., and Suppes P. (Eds). Contemporary developments in mathematical psychology: I. Learning, memory and thinking (1974), Freeman, Oxford, England 243-293
4. Banks W.P. Signal detection theory and human memory. Psychological Bulletin 74 2 (1970) 81-99
5. Banks W.P. Recognition and source memory as multivariate decision processes. Psychological Science 11 4 (2000) 267-273
6. Batchelder W.H., and Riefer D.M. Theoretical and empirical review of multinomial process tree modeling. Psychonomic Bulletin and Review 6 1 (1999) 57-86
7. Berch D.B. Effects of stimulus probability and information feedback on response biases in children's recognition memory. Bulletin of the Psychonomic Society 10 4 (1977) 328-330
8. Blackwell H.R. Neural theories of simple visual discriminations. Journal of the Optical Society of America 53 (1963) 129-160
9. Bozdogan H. Akaike information criterion and recent developments in information complexity. Journal of Mathematical Psychology 44 (2000) 62-91
10. Bröder A., and Meiser T. Measuring source memory. Zeitschrift für Psychologie/Journal of Psychology 215 (2007) 52-60
11. Buchner A., Erdfelder E., and Vaterrodt-Plünnecke B. Toward unbiased measurement of conscious and unconscious memory processes within the process dissociation framework. Journal of Experimental Psychology: General 124 2 (1995) 137-160
12. Busemeyer J.R., and Wang Y.-M. Model comparisons and model selections based on generalization criterion methodology. Journal of Mathematical Psychology 44 1 (2000) 171-189
13. Cleary A.M. ROCs in recognition with and without identification. Memory 13 5 (2005) 472-483
14. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. (1988), Erlbaum, Mahwah, NJ
15. Curran T., DeBuse C., and Leynes P.A. Conflict and criterion setting in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 33 1 (2007) 2-17
16. DeCarlo L.T. An application of signal detection theory with finite mixture distributions to source discrimination. Journal of Experimental Psychology: Learning, Memory, and Cognition 29 (2003) 767-778
17. DeCarlo L.T. Source monitoring and multivariate signal detection theory, with a model for selection. Journal of Mathematical Psychology 47 (2003) 292-303
18. Dehaene S., Changeux J.-P., Naccache L., Sackur J., and Sergent C. Conscious, preconscious, and subliminal processing: A testable taxonomy. Trends in Cognitive Sciences 10 5 (2006) 204-211
19. Dewhurst S.A., and Conway M.A. Pictures, images, and recollective experience. Journal of Experimental Psychology: Learning, Memory, and Cognition 20 (1994) 1088-1098
20. Dewhurst S.A., Holmes S., Brandt K.R., and Dean G.M. Measuring the speed of the conscious components of recognition memory: Remembering is faster than knowing. Consciousness and Cognition 15 (2006) 147-162
21. Donaldson W. The role of decision processes in remembering and knowing. Memory & Cognition 24 (1996) 523-533
22. Drake A.I., and Hannay H.J. Continuous recognition memory tests: Are the assumptions of the theory of signal detection met?. Journal of Clinical and Experimental Neuropsychology 14 4 (1992) 539-544
23. Dunn J.C. Remember-know: A matter of confidence. Psychological Review 111 (2004) 524-542
24. Dunn J.C. The dimensionality of the remember-know task: A state-trace analysis. Psychological Review 115 (2008) 426-446
25. Egan J.P., Schulman A.I., and Greenberg G.Z. Operating characteristics determined by binary decisions and by ratings. Journal of the Acoustical Society of America 31 (1959) 768-773
26. Erdfelder E., and Buchner A. Process-dissociation measurement models: Threshold theory or detection theory?. Journal of Experimental Psychology: General 127 1 (1998) 83-97
27. Estes W.K., and Maddox W.T. Interaction of stimulus attributes, base rates, and feedback in recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 21 (1995) 1075-1095
28. Gardner R.M., Macfee M., and Krinsky R. A comparison of binary and rating techniques in the signal detection analysis of recognition memory. Acta Psychologica 39 (1975) 13-19
29. Gigerenzer G. From tools to theories: A heuristic of discovery in cognitive psychology. Psychological Review 98 (1991) 254-267
30. Glanzer M., Adams J.K., Iverson G.J., and Kim K. The regularities of recognition memory. Psychological Review 100 3 (1993) 546-567
31. Glanzer M., Hilford A., and Kim K. Six regularities of source recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 6 (2004) 1176-1195
32. Grasha A.F. Detection theory and memory processes: Are they compatible?. Perceptual and Motor Skills 30 (1970) 123-135
33. Hager W., and Hasselhorn M. Handbuch deutschsprachiger Wortnormen [Handbook of German word norms] (1994), Hogrefe, Göttingen, Germany
34. Healy A.F., and Jones C. Can subjects maintain a constant criterion in a memory task?. Memory & Cognition 3 3 (1975) 233-238
35. Healy A.F., and Kubovy M. The effects of payoffs and prior probabilities on indices of performance and cut-off location in recognition memory. Memory & Cognition 6 5 (1978) 544-553
36. Heit E., Brockdorff N., and Lamberts K. Adaptive changes of response criterion in recognition memory. Psychonomic Bulletin & Review 10 3 (2003) 718-723
37. Henriques J.B., Glowacki J.M., and Davidson R.J. Reward fails to alter response bias in depression. Journal of Abnormal Psychology 103 3 (1994) 460-466
38. Henson R.N.A., Rugg M.D., Shallice T., Josephs O., and Dolan R.J. Recollection and familiarity in recognition memory: An event-related functional magnetic resonance imaging study. The Journal of Neuroscience 19 (1999) 3962-3972
39. Herrmann T. Über Urteilskonkordanz und Urteilsnuanziertheit [About judgment concordance and judgment accentuation]. Zeitschrift für Experimentelle und Angewandte Psychologie 7 (1960) 532-546
40. Hintzman D.L. "Schema abstraction" in a multiple memory model. Psychological Review 93 (1986) 411-428
41. Hintzman D.L. Judgments of frequency and recognition memory in a multiple-trace model. Psychological Review 95 (1988) 528-551
42. Hu X., and Batchelder W.H. The statistical analysis of general processing tree models with the EM algorithm. Psychometrika 59 1 (1994) 21-47
43. Johns E.E., and Mewhort D.J.K. What information underlies correct rejections in short-term recognition memory?. Memory & Cognition 30 1 (2002) 46-59
44. King-Smith P.E. Threshold nonlinearities and signal detection theory. Perception 34 8 (2005) 941-946
45. Kintsch W. Memory and decision aspects of recognition learning. Psychological Review 74 (1967) 496-504
46. Krantz D.H. Threshold theories of signal detection. Psychological Review 76 3 (1969) 308-324
47. Lockart R.S., and Murdock B.B. Memory and the theory of signal detection. Psychological Bulletin 74 2 (1970) 100-109
48. Macmillan N.A., and Creelman C.D. Detection theory: A user's guide. 2nd ed. (2005), Erlbaum, Mahwah, NJ
49. Malmberg K.J. On the form of ROCs constructed from confidence ratings. Journal of Experimental Psychology: Learning, Memory, and Cognition 28 2 (2002) 380-387
50. Malmberg K.J. Recognition memory: A review of the critical findings and an integrated proposal for relating them. Cognitive Psychology 57 (2008) 335-384
51. Malmberg K.J., Holden J.E., and Shiffrin R.M. Modeling the effects of repetitions, similarity, and normative word frequency on judgments of frequency and recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 319-331
52. Malmberg K.J., and Xu J. The influence of averaging and noisy decision strategies on the recognition memory ROC. Psychonomic Bulletin & Review 13 1 (2006) 99-105
53. Malmberg K.J., and Xu J. On the flexibility and the fallibility of associative memory. Memory & Cognition 35 3 (2007) 545-556
54. Marken R.S., and Sandusky A.J. Stimulus probability and sequential effect in recognition memory. Bulletin of the Psychonomic Society 4 1 (1974) 48-51
55. McNicol D. A primer of signal detection theory (1972), Allen & Unwin, London
56. Mewhort D.J.K., and Johns E.E. The extralist-feature effect: A test of item matching in short-term recognition memory. Journal of Experimental Psychology: General 129 (2000) 262-284
57. Mewhort D.J.K., and Johns E.E. Sharpening the echo: An iterative-resonance model for short-term recognition memory. Memory 13 (2005) 300-307
58. Murdock B.B. TODAM2: A model for the storage and retrieval of item, associative, and serial-order information. Psychological Review 100 2 (1993) 183-203
59. Myung I.J., and Pitt M.A. Applying Occam's razor in modeling cognition: A Bayesian approach. Psychonomic Bulletin & Review 4 (1997) 79-95
60. Myung I.J., and Pitt M.A. Issues in selecting mathematical models of cognition. In: Grainger J., and Jacobs A.M. (Eds). Localist connectionist approaches to human cognition (1998), Erlbaum, Hillsdale, NJ 327-355
61. Paivio A. Imagery and verbal processes (1971), Holt, Rinehart & Winston, New York
62. Paivio A. Mental representations (1986), Oxford University Press, New York
63. Parks T.E. Signal-detectability theory of recognition-memory performance. Psychological Review 73 1 (1966) 44-58
64. Psychology Software Tools (2002), Author, Pittsburgh, PA E-Prime Version 1.2 [Computer software]
65. Qin J., Raye C.L., Johnson M.K., and Mitchell K.J. Source ROCs are (typically) curvilinear: Comment on Yonelinas (1999). Journal of Experimental Psychology: Learning, Memory, and Cognition 27 (2001) 1110-1115
66. Raaijmakers J.G.W., and Shiffrin R.M. SAM: A theory of probabilistic search of associative memory. In: Bower G. (Ed). The psychology of learning and motivation 14 (1980), Academic Press, New York 207-262
67. Raaijmakers J.G.W., and Shiffrin R.M. Search of associative memory. Psychological Review 88 2 (1981) 93-134
68. Ratcliff R. A theory of memory retrieval. Psychological Review 85 2 (1978) 59-108
69. Ratcliff R., and Murdock B.B. Retrieval processes in recognition memory. Psychological Review 83 (1976) 190-214
70. Ratcliff R., Sheu C.-F., and Gronlund S.D. Testing global memory models using ROC curves. Psychological Review 99 3 (1992) 518-535
71. R Development Core Team. R: A language and environment for statistical computing (2006). http://www.R-project.org R Foundation for Statistical Computing, Vienna, Austria. Available from http://www.R-project.org
72. Rhodes M.G., and Jacoby L.L. On the dynamic nature of response criterion in recognition memory: Effects of base rate, awareness, and feedback. Journal of Experimental Psychology: Learning, Memory, and Cognition 33 (2007) 305-320
73. Richardson J.T.E. Continuous recognition memory tests: Are the assumptions of the theory of signal detection really met?. Journal of Clinical and Experimental Neuropsychology 16 3 (1994) 482-486
74. Riefer D.M., and Batchelder W.H. Multinomial modeling and the measurement of cognitive processes. Psychological Review 95 3 (1988) 318-339
75. Rothkegel R. AppleTree: A multinomial processing tree modeling program for Macintosh computers. Behavior Research Methods, Instruments & Computers 31 4 (1999) 696-700
76. Schwarz G. Estimating the dimension of a model. The Annals of Statistics 6 (1978) 461-464
77. Schwarz N., Knauper B., Hippler H.J., and Neumann E. Rating scales: Numeric values may change the meaning of scale labels. Public Opinion Quarterly 55 4 (1991) 570-582
78. Shiffrin R.M., and Steyvers M. The effectiveness of retrieval from memory. In: Oaksford M., and Chater N. (Eds). Rational models of cognition (1998), Oxford University Press, London 73-95
79. Slotnick S.D., and Dodson C.S. Support for a continuous (single-process) model of recognition memory and source memory. Memory & Cognition 33 (2005) 151-170
80. Slotnick S.D., Klein S.A., Dodson C.S., and Shimamura A.P. An analysis of signal detection and threshold models of source memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 26 6 (2000) 1499-1517
81. Smith E.E., Shoben E.J., and Rips L.J. Structure and process in semantic memory: A featural model for semantic decisions. Psychological Review 81 (1974) 214-241
82. Snodgrass J.G., and Corwin J. Pragmatics of measuring recognition memory: Applications to dementia and amnesia. Journal of Experimental Psychology: General 117 1 (1988) 34-50
83. Snodgrass J.G., and Vanderwart M. A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory 6 2 (1980) 174-215
84. Stahl C., and Klauer K.C. HMMTree: A computer program for latent-class hierarchical multinomial processing tree models. Behavior Research Methods 39 2 (2007) 267-273
85. Strack F., and Bless H. Memory for nonoccurrences: Metacognitive and presuppositional strategies. Journal of Memory and Language 33 2 (1994) 203-217
86. Szekely A., Jacobsen T., D'Amico S., Devescovi A., Andonova A., Herron D., et al. A new on-line resource for psycholinguistic studies. Journal of Memory and Language 51 (2004) 247-250
87. Tulving E. Memory and consciousness. Canadian Psychologist 26 (1985) 1-12
88. Van Zandt T. ROC curves and confidence judgments in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 26 3 (2000) 582-600
89. Van Zandt T., and Maldonado-Molina M.M. Response reversals in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 30 (2004) 1147-1166
90. Wassermann L. Bayesian model selection and model averaging. Journal of Mathematical Psychology 44 (2000) 92-107
91. Wickelgren W.A., and Norman D.A. Strength models and serial position in short-term recognition memory. Journal of Mathematical Psychology 3 (1966) 316-347
92. Wickens T.D. Elementary signal detection theory (2002), Oxford University Press, New York
93. Wixted J.T. Dual-process theory and signal-detection theory of recognition memory. Psychological Review 114 1 (2007) 152-176
94. Wixted J.T. Spotlighting the probative findings: Reply to Parks and Yonelinas (2007). Psychological Review 114 1 (2007) 203-209
95. Wixted J.T., and Stretch V. In defense of the signal detection interpretation of remember/know judgments. Psychonomic Bulletin & Review 11 (2004) 616-641
96. Yonelinas A.P., and Parks C.M. Receiver operating characteristics (ROCs) in recognition memory: A review. Psychological Bulletin 133 5 (2007) 800-832