Binary rocs in perception and recognition memory are curved

Journal of Experimental Psychology: Learning Memory and Cognition

Volumn 38, Issue 1, 2012, Pages 130-151

  Dube, Chad ^a   Rotello, Caren M ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

Measurement; Recognition; ROC curves; Signal detection

Indexed keywords

ADULT; ARTICLE; EPIDEMIOLOGY; FEMALE; HUMAN; LINGUISTICS; MALE; NEUROPSYCHOLOGICAL TEST; PATTERN RECOGNITION; PERCEPTIVE DISCRIMINATION; PHOTOSTIMULATION; PHYSIOLOGY; PREDICTIVE VALUE; RECEIVER OPERATING CHARACTERISTIC; RECOGNITION; STATISTICAL MODEL;

ADULT; BIAS (EPIDEMIOLOGY); FEMALE; HUMANS; MALE; MODELS, STATISTICAL; NEUROPSYCHOLOGICAL TESTS; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; PREDICTIVE VALUE OF TESTS; RECOGNITION (PSYCHOLOGY); ROC CURVE; SIGNAL DETECTION, PSYCHOLOGICAL; VOCABULARY; YOUNG ADULT;

EID: 84855267763     PISSN: 02787393     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0024957     Document Type: Article

References (88)

1. Balakrishnan J.D. Decision processes in discrimination: Fundamental misrepresentations of signal detection theory. Journal of Experimental Psychology: Human Perception and Performance 1999, 25:1189-1206. doi: 10.1037/0096-1523.25.5.1189.
2. Ball L.J., Phillips P., Wade C.N., Quayle J.D. Effects of belief and logic on syllogistic reasoning: Eye-movement evidence for selective processing models. Experimental Psychology 2006, 53:77-86. doi: 10.1027/1618-3169.53.1.77.
3. Batchelder W.H., Riefer D.M. Multinomial processing models of source monitoring. Psychological Review 1990, 97:548-564. doi: 10.1037/0033-295X.97.4.548.
4. Batchelder W.H., Riefer D.M. Theoretical and empirical review of multinomial process tree modeling. Psychonomic Bulletin & Review 1999, 6:57-86. doi: 10.3758/BF03210812.
5. Bayen U.J., Murnane K., Erdfelder E. Source discrimination, item detection, and multinomial models of source monitoring. Journal of Experimental Psychology: Learning, Memory, and Cognition 1996, 22:197-215. doi: 10.1037/0278-7393.22.1.197.
6. Benjamin A.S., Diaz M., Wee S. Signal detection with criterion noise: Applications to recognition memory. Psychological Review 2009, 116:84-115. doi: 10.1037/a0014351.
7. Bonin P., Peereman R., Malardier N., Méot A., Chalard M. A new set of 299 pictures for psycholinguistic studies: French norms for name agreement, image agreement, conceptual familiarity, visual complexity, image variability, age of acquisition, and naming latencies. Behavior Research Methods, Instruments, & Computers 2003, 35:158-167. doi: 10.3758/BF03195507.
8. Bröder A., Meiser T. Measuring source memory. Journal of Psychology 2007, 215:52-60. doi: 10.1027/0044-3409.215.1.52.
9. Bröder A., Schütz J. Recognition ROCs are curvilinear-or are they? On premature arguments against the two-high-threshold model of recognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 2009, 35:587-606. doi: 10.1037/a0015279.
10. Bröder A., Schütz J. Correction to Bröder and Schütz (2009). Journal of Experimental Psychology: Learning, Memory, and Cognition 2011, Advance online publication. doi: 10.1037/a0024783.
11. Coltheart M. The MRC psycholinguistic database. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 1981, 33A:497-505. doi: 10.1080/14640748108400805.
12. Creelman C.D., Donaldson W. ROC curves for discrimination of linear extent. Journal of Experimental Psychology 1968, 77:514-516. doi: 10.1037/h0025930.
13. Curran T., DeBuse C., Leynes P.A. Conflict and criterion setting in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2007, 33:2-17. doi: 10.1037/0278-7393.33.1.2.
14. Cycowicz Y.M., Friedman D., Rothstein M., Snodgrass J.G. Picture naming by young children: Norms for name agreement, familiarity, and visual complexity. Journal of Experimental Child Psychology 1997, 65:171-237. doi: 10.1006/jecp.1996.2356.
15. Dougal S., Rotello C.M. "Remembering" emotional words is based on response bias, not recollection. Psychonomic Bulletin & Review 2007, 14:423-429. doi: 10.3758/BF03194083.
16. Dube C., Rotello C.M., Heit E. Assessing the belief bias effect with ROCs: It's a response bias effect. Psychological Review 2010, 117:831-863. doi: 10.1037/a0019634.
17. Dube C., Rotello C.M., Heit E. The belief bias effect is aptly named: A reply to Klauer and Kellen (2011). Psychological Review 2011, 118:155-163. doi: 10.1037/a0021774.
18. Egan J.P. Recognition memory and the operating characteristic [U.S. Air Force Operational Applications Laboratory Technical Note No. 58-51] 1958, Indiana University, Hearing and Communication Laboratory, Bloomington.
19. Egan J.P., Schulman A.I., Greenberg G.Z. Operating characteristics determined by binary decisions and by ratings. Journal of the Acoustical Society of America 1959, 31:768-773. doi: 10.1121/1.1907783.
20. Emmerich D.S. ROCs obtained with two signal intensities presented in random order, and a comparison between yes-no and rating ROCs. Perception & Psychophysics 1968, 3:35-40. doi: 10.3758/BF03212709.
21. Erdfelder E., Buchner A. Decomposing the hindsight bias: A multinomial processing tree model for separating recollection and reconstruction in hindsight. Journal of Experimental Psychology: Learning, Memory, and Cognition 1998, 24:387-414. doi: 10.1037/0278-7393.24.2.387.
22. Estes W.K. The problem of inference from curves based on group data. Psychological Bulletin 1956, 53:134-140. doi: 10.1037/h0045156.
23. Evans J.St.B., Barston J.L., Pollard P. On the conflict between logic and belief in syllogistic reasoning. Memory & Cognition 1983, 11:295-306. doi: 10.3758/BF03196976.
24. Evans J.St.B.T., Curtis-Holmes J. Rapid responding increases belief bias: Evidence for the dual-process theory of reasoning. Thinking & Reasoning 2005, 11:382-389. doi: 10.1080/13546780542000005.
25. Evans J.St.B.T., Newstead S.E., Allen J.L., Pollard P. Debiasing by instruction: The case of belief bias. European Journal of Cognitive Psychology 1994, 6:263-285. doi: 10.1080/09541449408520148.
26. Friedman M.P., Carterette E.C., Nakatani L., Ahumada A. Comparisons of some learning models for response bias in signal detection. Perception & Psychophysics 1968, 3:5-11. doi: 10.3758/BF03212703.
27. Glanzer M., Kim K., Hilford A., Adams J.K. Slope of the receiver-operating characteristic in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 1999, 25:500-513. doi: 10.1037/0278-7393.25.2.500.
28. Green D.M., Swets J.A. Signal detection theory and psychophysics 1966, Wiley, Oxford, England.
29. Han S., Dobbins I.G. Examining recognition criterion rigidity during testing using a biased-feedback technique: Evidence for adaptive criterion learning. Memory & Cognition 2008, 36:703-715. doi: 10.3758/MC.36.4.703.
30. Han S., Dobbins I.G. Regulating recognition decisions through incremental reinforcement learning. Psychonomic Bulletin & Review 2009, 16:469-474. doi: 10.3758/PBR.16.3.469.
31. Hautus M.J., Macmillan N.A., Rotello C.M. Toward a complete decision model of item and source recognition. Psychonomic Bulletin & Review 2008, 15:889-905. doi: 10.3758/PBR.15.5.889.
32. Heathcote A. Item recognition memory and the receiver operating characteristic. Journal of Experimental Psychology: Learning, Memory, and Cognition 2003, 29:1210-1230. doi: 10.1037/0278-7393.29.6.1210.
33. Heit, E., & Hayes, B. K. (2010, April). Modeling reasoning and memory. Paper presented at the Ninth Annual Context and Episodic Memory Symposium, Philadelphia, PA.
34. Heit E., Hayes B.K. Predicting reasoning from memory. Journal of Experimental Psychology: General 2011, 140:76-101. doi: 10.1037/a0021488.
35. Heit E., Rotello C.M. Relations between inductive reasoning and deductive reasoning. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 36:805-812. doi: 10.1037/a0018784.
36. Henriques J.B., Glowacki J.M., Davidson R.J. Reward fails to alter response bias in depression. Journal of Abnormal Psychology 1994, 103:460-466. doi: 10.1037/0021-843X.103.3.460.
37. Hilford A., Glanzer M., Kim K., DeCarlo L.T. Regularities of source recognition: ROC analysis. Journal of Experimental Psychology: General 2002, 131:494-510. doi: 10.1037/0096-3445.131.4.494.
38. Jaeger T.F. Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language 2008, 59:434-446. doi: 10.1016/j.jml.2007.11.007.
39. Kinchla R.A. Comments on Batchelder and Riefer's multinomial model for source monitoring. Psychological Review 1994, 101:166-171. doi: 10.1037/0033-295X.101.1.166.
40. Klauer K.C., Kellen D. Toward a complete decision model of item and source recognition: A discrete-state approach. Psychonomic Bulletin & Review 2010, 17:465-478. doi: 10.3758/PBR.17.4.465.
41. Klauer K.C., Kellen D. Assessing the belief bias effect with ROCs: Reply to Dube, Rotello, and Heit (2010). Psychological Review 2011, 118:164-173. doi: 10.1037/a0020698.
42. Klauer K.C., Musch J., Naumer B. On belief bias in syllogistic reasoning. Psychological Review 2000, 107:852-884. doi: 10.1037/0033-295X.107.4.852.
43. Krantz D.H. Threshold theories of signal detection. Psychological Review 1969, 76:308-324. doi: 10.1037/h0027238.
44. Kučera H., Francis W.N. Computational analysis of present-day American English 1967, Brown University Press, Providence, RI.
45. Luce R.D. Individual choice behavior: A theoretical analysis 1959, Wiley, New York, NY.
46. Macmillan N.A., Creelman C.D. Detection theory: A user's guide 2005, Erlbaum, Mahwah, NJ. 2nd ed.
47. Macmillan N.A., Rotello C.M., Miller J.O. The sampling distributions of Gaussian ROC statistics. Perception & Psychophysics 2004, 66:406-421. doi: 10.3758/BF03194889.
48. Malmberg K.J. On the form of ROCs constructed from confidence ratings. Journal of Experimental Psychology: Learning, Memory, and Cognition 2002, 28:380-387. doi: 10.1037/0278-7393.28.2.380.
49. Markowitz J., Swets J.A. Factors affecting the slope of empirical ROC curves: Comparison of binary and rating responses. Perception & Psychophysics 1967, 2:91-97. doi: 10.3758/BF03210301.
50. Morley N.J., Evans J.St.B.T., Handley S.J. Belief bias and figural bias in syllogistic reasoning. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 2004, 57A:666-692. doi: 10.1080/02724980343000440.
51. Mueller S.T., Weidemann C.T. Decision noise: An explanation for observed violations of signal detection theory. Psychonomic Bulletin & Review 2008, 15:465-494. doi: 10.3758/PBR.15.3.465.
52. Nelson D.L., Reed V.S., Walling J.R. Pictorial superiority effect. Journal of Experimental Psychology: Human Learning and Memory 1976, 2:523-528. doi: 10.1037/0278-7393.2.5.523.
53. Newstead S.E., Pollard P., Evans J.S., Allen J.L. The source of belief bias effects in syllogistic reasoning. Cognition 1992, 45:257-284. doi: 10.1016/0010-0277(92)90019-E.
54. Onyper S.V., Zhang Y.X., Howard M.W. Some-or-none recollection: Evidence from item and source memory. Journal of Experimental Psychology: General 2010, 139:341-364. doi: 10.1037/a0018926.
55. Paivio A. Imagery and verbal processes 1971, Holt, Rinehart & Winston, Oxford, England.
56. Parks T.E. Signal-detectability theory of recognition-memory performance. Psychological Review 1966, 73:44-58. doi: 10.1037/h0022662.
57. Pratte M.S., Rouder J.N., Morey R.D. Separating mnemonic process from participant and item effects in the assessment of ROC asymmetries. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 36:224-232. doi: 10.1037/a0017682.
58. Quayle J.D., Ball L.J. Working memory, metacognitive uncertainty, and belief bias in syllogistic reasoning. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 2000, 53A:1202-1223. doi: 10.1080/02724980050156362.
59. Ratcliff R., McKoon G., Tindall M. Empirical generality of data from recognition memory receiver-operating characteristic functions and implications for the global memory models. Journal of Experimental Psychology: Learning, Memory, and Cognition 1994, 20:763-785. doi: 10.1037/0278-7393.20.4.763.
60. Ratcliff R., Sheu C., Gronlund S.D. Testing global memory models using ROC curves. Psychological Review 1992, 99:518-535. doi: 10.1037/0033-295X.99.3.518.
61. Roberts M.J., Sykes E.D.A. Belief bias and relational reasoning. Quarterly Journal of Experimental Psychology: Human Experimental Psychology 2003, 56A:131-154. doi: 10.1080/02724980244000233.
62. Rotello, C. M., Hautus, M. J., & Macmillan, N. A. (2011). Source and item recognition memory: Comparing likelihood-ratio signal-detection, dual-process signal-detection, and multinomial processing models. Manuscript submitted for publication.
63. Rotello C.M., Heit E. Modeling the effects of argument length and validity on inductive and deductive reasoning. Journal of Experimental Psychology: Learning, Memory, and Cognition 2009, 35:1317-1330. doi: 10.1037/a0016648.
64. Rotello C.M., Macmillan N.A., Hicks J.L., Hautus M.J. Interpreting the effects of response bias on remember-know judgments using signal-detection and threshold models. Memory & Cognition 2006, 34:1598-1614. doi: 10.3758/BF03195923.
65. Rotello C.M., Masson M.E.J., Verde M.F. Type I error rates and power analyses for single-point sensitivity measures. Perception & Psychophysics 2008, 70:389-401. doi: 10.3758/PP.70.2.389.
66. Schulman A.I., Greenberg G.Z. Operating characteristics and a priori probability of the signal. Perception & Psychophysics 1970, 8:317-320. doi: 10.3758/BF03212600.
67. Schwarz N., Knäuper B., Hippler H.-J., Noelle-Neumann E., Clark L. Rating scales: Numeric values may change the meaning of scale labels. Public Opinion Quarterly 1991, 55:570-582. doi: 10.1086/269282.
68. Shynkaruk J.M., Thompson V.A. Confidence and accuracy in deductive reasoning. Memory & Cognition 2006, 34:619-632. doi: 10.3758/BF03193584.
69. Sidman M. Tactics of scientific research 1960, Basic Books, Oxford, England.
70. Slotnick S.D., Dodson C.S. Support for a continuous (single-process) model of recognition memory and source memory. Memory & Cognition 2005, 33:151-170. doi: 10.3758/BF03195305.
71. Slotnick S.D., Klein S.A., Dodson C.S., Shimamura A.P. An analysis of signal detection and threshold models of source memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2000, 26:1499-1517. doi: 10.1037/0278-7393.26.6.1499.
72. Snodgrass J.G., Corwin J. Pragmatics of measuring recognition memory: Applications to dementia and amnesia. Journal of Experimental Psychology: General 1988, 117:34-50. doi: 10.1037/0096-3445.117.1.34.
73. Snodgrass J.G., Vanderwart M. A standardized set of 260 pictures: Norms for name agreement, image agreement, familiarity, and visual complexity. Journal of Experimental Psychology: Human Learning and Memory 1980, 6:174-215. doi: 10.1037/0278-7393.6.2.174.
74. Stupple E.J.N., Ball L.J. Belief-logic conflict resolution in syllogistic reasoning: Inspection-time evidence for a parallel-process model. Thinking & Reasoning 2008, 14:168-181. doi: 10.1080/13546780701739782.
75. Swets J.A. Form of empirical ROCs in discrimination and diagnostic tasks: Implications for theory and measurement of performance. Psychological Bulletin 1986, 99:181-198. doi: 10.1037/0033-2909.99.2.181.
76. Swets J.A. Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psychological Bulletin 1986, 99:100-117. doi: 10.1037/0033-2909.99.1.100.
77. Swets J.A., Tanner W.P., Birdsall T.G. Decision processes in perception. Psychological Review 1961, 68:301-340. doi: 10.1037/h0040547.
78. Szekely A., Jacobsen T., D'Amico S., Devescovi A., Andonova A., Herron D., Bates E. A new on-line resource for psycholinguistic studies. Journal of Memory and Language 2004, 51:247-250. doi: 10.1016/j.jml.2004.03.002.
79. Tanner T.A., Haller R.W., Atkinson R.C. Signal recognition as influenced by presentation schedules. Perception & Psychophysics 1967, 2:349-358. doi: 10.3758/BF03210070.
80. Thompson V.A., Striemer C.L., Reikoff R., Gunter R.W., Campbell J.I.D. Syllogistic reasoning time: Disconfirmation disconfirmed. Psychonomic Bulletin & Review 2003, 10:184-189. doi: 10.3758/BF03196483.
81. Treisman M., Faulkner A. The effect of signal probability on the slope of the receiver operating characteristic given by the rating procedure. British Journal of Mathematical and Statistical Psychology 1984, 37:199-215.
82. Treisman M., Faulkner A. Can decision criteria interchange locations? Some positive evidence. Journal of Experimental Psychology: Human Perception and Performance 1985, 11:187-208. doi: 10.1037/0096-1523.11.2.187.
83. Van Zandt T. ROC curves and confidence judgments in recognition memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2000, 26:582-600. doi: 10.1037/0278-7393.26.3.582.
84. Verde M.F., Rotello C.M. Does familiarity change in the revelation effect?. Journal of Experimental Psychology: Learning, Memory, and Cognition 2003, 29:739-746. doi: 10.1037/0278-7393.29.5.739.
85. Wixted J.T. Dual-process theory and signal-detection theory of recognition memory. Psychological Review 2007, 114:152-176. doi: 10.1037/0033-295X.114.1.152.
86. Yonelinas A.P. Receiver-operating characteristics in recognition memory: Evidence for a dual-process model. Journal of Experimental Psychology: Learning, Memory, and Cognition 1994, 20:1341-1354. doi: 10.1037/0278-7393.20.6.1341.
87. Yonelinas A.P. The contribution of recollection and familiarity to recognition and source-memory judgments: A formal dual-process model and an analysis of receiver operating characteristics. Journal of Experimental Psychology: Learning, Memory, and Cognition 1999, 25:1415-1434. doi: 10.1037/0278-7393.25.6.1415.
88. Yonelinas A.P., Parks C.M. Receiver operating characteristics (ROCs) in recognition memory: A review. Psychological Bulletin 2007, 133:800-832. doi: 10.1037/0033-2909.133.5.800.