Signal Detection by Human Observers: A Cutoff Reinforcement Learning Model of Categorization Decisions under Uncertainty

Psychological Review

Volumn 105, Issue 2, 1998, Pages 280-298

  Erev, Ido ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL TRIAL; DECISION MAKING; GAME; HUMAN; LEARNING; META ANALYSIS; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; PROBABILITY; PSYCHOLOGICAL MODEL; STATISTICAL MODEL;

DECISION MAKING; GAME THEORY; HUMANS; LEARNING; LIKELIHOOD FUNCTIONS; MODELS, PSYCHOLOGICAL; PROBABILITY; SIGNAL DETECTION (PSYCHOLOGY);

EID: 0032043480     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.105.2.280     Document Type: Article

References (67)

1. Ashby, F. G., & Gott, R. E. (1988). Decision rules in perception and categorization of multidimensional stimuli. Journal of Experimental Psychology: Human Learning and Memory, 14, 33-53.
2. Bereby-Meyer, Y., & Erev, I. (in press). On learning to become a successful loser: A comparison of alternative abstractions of learning in the loss domain. Journal of Mathematical Psychology.
3. Blackburn, J. M. (1936). Acquisition of skill: An analysis of learning curves (IHRB Report No. 73).
4. Bornstein, G., Erev, I., & Goren, H. (1994). Learning processes and reciprocity in intergroup conflicts. Journal of Conflict Resolution, 38, 690-707.
5. Brown, J. S., Clark, F. R., & Stein, L. (1958). A new technique for studying spatial generalization with voluntary responses. Journal of Experimental Psychology, 55, 359-362.
6. Budescu, D. V., Wallsten, T. S., & Au, W. T. (1997). On the importance of random error in the study of probability judgment: II. Bias estimation with a stochastic model of judgment. Journal of Behavioral Decision Making, 10, 173-188.
7. Busemeyer, J. R., & Myung, I. J. (1992). An adaptive approach to human decision making: Learning theory, decision theory, and human performance. Journal of Experimental Psychology: General, 121, 177-194.
8. Bush, R. R., Luce, D. R., & Rose, R. A. (1964). Learning models for psychophysics. In R. C. Atkinson (Ed.), Studies in mathematical psychology (pp. 201-217), Stanford, CA: Stanford University Press.
9. Bush, R. R., & Mosteller, F. (1955). Stochastic models for learning. New York: Wiley.
10. Crossman, E. R. F. W. (1959). A theory of acquisition of speed-skill. Ergonomics, 2, 153-166.
11. Davis, D. R., & Parasuraman, R. (1982). The psychology of vigilance. London: Academic Press.
12. Dorfman, D. D. (1977). Comments on "The decision rule in probabilistic categorization: What it is and how it is learned" by Kubovy and Healy. Journal of Experimental Psychology: General, 106, 447-449.
13. Dorfman, D. D., & Biderman, M. (1971). A learning model for continuum of sensory states. Journal of Mathematical Psychology, 10, 73-85.
14. Duffy, J., & Nagel, R. (1997). On the robustness of behavior in experimental "P-beauty contest" games. Economic Journal, 107, 1684-1700.
15. Erev, I., & Gopher, D. (in press). A cognitive game theoretic analysis of attention strategies, ability, and incentives. In D. Gopher & A. Koriat (Eds.), Attention and performance XVII: Cognitive regulation of performance: Interaction of theory and applications. Cambridge, MA: MIT Press.
16. Erev, I., Gopher, D., Itkin, R., & Greenshpan, Y. (1995). Toward a generalization of signal detection theory to n-person games: The example of two person safety problem. Journal of Mathematical Psychology, 39, 360-375.
17. Erev, I., & Rapoport, A. E. (in press). Coordination, "magic," and reinforcement learning in a market entry game. Games and Economic Behavior.
18. Erev, I., & Roth, A. (1996). On the need for low rationality cognitive game theory: Reinforcement learning in games with unique mixed strategy equilibrium. Unpublished technical report, University of Pittsburgh, Pittsburgh, Pennsylvania, and Technion, Haifa, Israel.
19. Erev, I., & Roth, A. (in press). Predicting how people play games: Reinforcement learning in games with unique mixed strategy equilibrium. American Economic Review.
20. Erev, I., Wallsten, T. S., & Budescu, D. V. (1994). Simultaneous over-and underconfidence: The role of error in judgment processes. Psychological Review, 101, 519-527.
21. Ferrel, W. R., & McGoey, P. J. (1980). A model of calibration for subjective probabilities. Organizational Behavior and Human Performance, 26, 32-52.
22. Friedman, D. (1991). Evolutionary games in economics. Econometrica, 59, 637-666.
23. Fudenberg, D., & Levine, D. (1996). Theory of learning in games. Available: http://Levine.sscnet.ucea.edu/papers/contents.htm.
24. Gigerenzer, G., & Hoffrage, U. (1995). How to improve Bayesian reasoning without instruction: Frequency formats. Psychological Review, 102, 684-704.
25. Gilat, S., Meyer, J., Erev, I., & Gopher, D. (1997). Beyond Bayes theorem: The effect of base rate information in consensus games. Journal of Experimental Psychology: Applied, 3, 83-104.
26. Gopher, D., Itkin, T., Erev, I., Meyer, J., & Armony, L. (1995, August). Top down and bottom up processes in perceptual games. Paper presented at Subjective Probability Utility and Decision Making-15, Jerusalem, Israel.
27. Green, D. M., & Swets, J. A. (1988). Signal detection theory and psychophysics. Los Altos, CA: Peninsula. (Original work published 1966)
28. Harley, C. B. (1981). Learning the evolutionary stable strategy. Journal of Theoretical Biology, 89, 611-633.
29. Healy, A. F., & Kubovy, M. (1977). A comparison of recognition memory to numerical decisions: How prior probabilities affect cutoff location. Memory & Cognition, 5, 3-9.
30. Healy, A. F., & Kubovy, M. (1981). Probability matching and the formation of conservative decision rules in a numerical analog of signal detection. Journal of Experimental Psychology: Human Learning and Memory, 7, 344-354.
31. Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of Experimental Analysis of Behavior, 4, 267-272.
32. Kahneman, D., Slovic, P., & Tversky, A. (1982). Judgment under uncertainty: Heuristics and biases. Cambridge, England: Cambridge University Press.
33. Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80, 237-251.
34. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263-291.
35. Kahneman, D., & Tversky, A. (1996). On the reality of cognitive illusions. Psychological Review, 103, 582-591.
36. Kubovy, M., & Healy, A. F. (1977). The decision rule in probabilistic categorization: What it is and how it is learned. Journal of Experimental Psychology: General, 106, 427-446.
37. Kubovy, M., Rapoport, A., & Tversky, A. (1971). Deterministic vs. probabilistic strategies in detection. Perception & Psychophysics, 9, 427-429.
38. Lee, W. (1963). Choosing among confusably distributed stimuli with specified likelihood ratios. Perceptual and Motor Skills, 16, 445-467.
39. Lee, W., & Janke, M. (1964). Categorizing externally distributed stimulus samples for three continua. Journal of Experimental Psychology, 68, 376-382.
40. Lee, W., & Zentall, T. R. (1966). Factorial effects in the categorization of externally distributed stimulus samples. Perception & Psychophysics, 1, 120-124.
41. Luce, R. D. (1959). Individual choice behavior. New York: Wiley.
42. Macmillan, N. A., & Creelman, C. (1991). Detection theory: A user guide. Cambridge, England: Cambridge University Press.
43. March, J. G. (1996). Learning to become risk averse. Psychological Review, 103, 309-319.
44. Nagel, R. (1995). Unraveling in guessing games: An experimental study. American Economics Review, 85, 1313-1326.
45. Ochs, J. (1995). Games with unique mixed strategy equilibrium: An experimental study. Games and Economic Behavior, 10, 202-217.
46. Payne, J. W., Bettman, J. R., & Johnson, E. J. (1993). The adaptive decision maker. Cambridge, England: Cambridge University Press.
47. Rapoport, A., Erev, I., Abraham, E., & Olsen, D. E. (1997). Randomization and adaptive learning in a simplified poker game. Organizational Behavior and Human Performance, 69, 31-49.
48. Rapoport, A., Seale, D. A., Erev, I., & Sundali, J. A. (in press). Coordination success in market entry games: Tests of equilibrium and adaptive learning models. Management Science.
49. Roth, A. E., & Erev, I. (1995). Learning in extensive form games: Experimental data and simple dynamic models in the intermediate term. Games and Economic Behavior, 3, 3-24.
50. Savage, L. J. (1954). The foundation of statistics. New York: Wiley.
51. Schoeffler, M. S. (1965). Theory for psychological learning. Journal of the Acoustical Society of America, 37, 1124-1133.
52. Selten, R., & Buchta, J. (in press). Experimental sealed bid first price auction with directly observed bid functions. In D. V. Budescu, I. Erev, & R. Zwick (Eds.), Games and human behavior: Essays in the honor of Amnon Rapoport. Hillsdale, NJ: Erlbaum.
53. Selten, R., & Stoecker, R. (1986). End behavior in sequences of finite prisoner's dilemma supergames, a learning theory approach. Journal of Economic Behavior, 7, 47-70.
54. Sorkin, R. D., & Dai, H. (1994). Signal detection analysis of the ideal group. Organizational Behavior and Human Decision Processes, 60, 1-13.
55. Sperling, G., & Dosher, B. A. (1986). Strategy and optimization in human information processing. In K. Boff, L. Kaufman, & J. Thomas (Eds.), Handbook of perception and human performance: Vol. 1. Cognitive processes and performance (pp. 2-65). New York: Wiley.
56. Swennsen, R. G., Hessel, S. J., & Herman, P. G. (1977). Omission in radiology: Faulty search or stringent reporting criteria? Radiology, 123, 563-567.
57. Swets, J. A., & Green, D. M. (1961). Sequential observations by human observers of signal and noise. In C. Cherry (Ed.), Information theory. London: Butterworths.
58. Thaler, R. (1987). The psychology of choice and the assumption of economics. In A. E. Roth (Ed.), Laboratory experimentation in economics: Six points of view (pp. 99-130). Cambridge, England: Cambridge University Press.
59. Thomas, E. A. C. (1973). On a class of additive learning models: Error correcting and probability matching. Journal of Mathematical Psychology, 10, 241-264.
60. Thorndike, E. L. (1898). Animal intelligence: An experimental study of the associative processes in animals. Psychological Monographs, 2 (Whole No. 8).
61. Treisman, M. (1987). Effects of the setting and adjustment of decision criteria on psychological performance. In E. E. Roskam & R. Suck (Eds.), Progress in mathematical psychology - Psychological performance (pp. 253-297). Amsterdam: Elsevier.
62. Tversky, A. (1969). Intransitivity of preference. Psychological Review, 76, 31-48.
63. Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131.
64. von Neumann, J., & Morgenstern, O. (1947). Theory of games and economic behavior. Princeton, NJ: Princeton University Press.
65. Wallsten, T. S., & Gonzalez-Vallejo, C. (1994). Statement verification: A stochastic model of judgment and response. Psychological Review, 101, 490-504.
66. Ward, L. W. (1973). Use of Markov encoded sequential information in numerical signal detection. Perception & Psychophysics, 14, 337-342.
67. Ward, L. W., Livingston, J. W., Jr., & Joseph, L. (1988). On probabilistic categorization: The Markovian observer. Perception & Psychophysics, 43, 125-136.