The partial-reinforcement extinction effect and the contingent-sampling hypothesis

Psychonomic Bulletin and Review

Volumn 20, Issue 6, 2013, Pages 1336-1342

  Hochman, Guy ^a,b   Erev, Ido ^c  

^a DUKE UNIVERSITY   (United States)

^b INTERDISCIPLINARY CENTER   (Israel)

^c TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Choice behavior; Decision making; Judgment; Reinforcement learning

Indexed keywords

ADULT; ARTICLE; DECISION MAKING; FEMALE; HUMAN; LEARNING; MALE; REINFORCEMENT; YOUNG ADULT;

ADULT; CHOICE BEHAVIOR; EXTINCTION, PSYCHOLOGICAL; FEMALE; HUMANS; LEARNING; MALE; REINFORCEMENT (PSYCHOLOGY); REINFORCEMENT SCHEDULE; YOUNG ADULT;

EID: 84889581800     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-013-0432-1     Document Type: Article

References (29)

1. Atkinson, R. L., Atkinson, R. C., Smith, E. E., Bem, D. J., & Nolen-Hoeksema, S. (1995). Introduction to psychology (10th ed.). Orlando: Harcourt College.
2. Baron, R. A., & Kalsher, M. J. (2000). Psychology (5th ed.). Boston: Allyn & Bacon.
3. Biele, G., Erev, I., & Ert, E. (2009). Learning, risk attitudes and hot stoves in restless bandit problems. Journal of Mathematical Psychology, 53, 155-167.
4. Brewer, N., & Ridgway, T. (1998). Effects of supervisory monitoring on productivity and quality of performance. Journal of Experimental Psychology. Applied, 4, 211-227.
5. Camilleri, A. R., & Newell, B. R. (2011). When and why rare events are underweight: A direct comparison of the sampling, partial feedback, full feedback and description choice paradigm. Psychonomic Bulletin & Review, 18, 377-384.
6. Chen, W., Liu, S., Chen, C., & Lee, Y. (2011). Bounded memory, inertia, sampling and weighting model for market entry games. Games, 2, 187-199.
7. Erev, I., & Barron, G. (2005). On adaptation, maximization, and reinforcement learning among cognitive strategies. Psychological Review, 112, 912-931.
8. Erev, I., Ert, E., & Roth, A. E. (2010). A choice prediction competition for market entry games: An introduction. Games, 1, 117-136.
9. Erev, I., & Haruvy, E. (2013). Learning and the economics of small decisions. In J. H. Kagel & A. E. Roth (Eds.), The handbook of experimental economics (2nd ed.). Princeton: Princeton University Press (in press).
10. Fiedler, K., & Kareev, Y. (2006). Does decisions quality (always) increase with the size of information samples? Some vicissitudes in applying the law of large numbers. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 883-903.
11. Fudenberg, D., & Levine, D. K. (1999). Conditional universal consistency. Games and Economic Behavior, 29, 104-130.
12. Gershman, S. J., Blei, D. M., & Niv, Y. (2010). Context, learning, and extinction. Psychological Review, 117, 197-209.
13. Gonzalez, C., Lerch, J. F., & Lebiere, C. (2003). Instance-based learning in dynamic decision making. Cognitive Science, 27, 591-635.
14. Grant, D. A., Hake, H. W., & Hornseth, J. P. (1951). Acquisition and extinction of a verbal conditioned response with differing percentages of reinforcements. Journal of Experimental Psychology. General, 42, 1-5.
15. Grosslight, J. H., & Child, I. L. (1947). Persistence as a function of previous experience of failure followed by success. The American Journal of Psychology, 60, 378-387.
16. Hertwig, R., Barron, G., Weber, E. U., & Erev, I. (2004). Decisions from experience and the effect of rare events in risky choice. Psychological Science, 15, 534-539. doi: 10. 1111/j. 0956-7976. 2004. 00715. x.
17. Humphreys, L. G. (1939). The effect of random alternation of reinforcement on the acquisition and extinction of conditioned eyelid reactions. Journal of Experimental Psychology. General, 25, 141-158.
18. Latham, G. P., & Dossett, D. L. (1978). Designing incentive plans for unionized employees: A comparison of continuous and variable-ratio reinforcement schedules. Personnel Psychology, 37, 47-61.
19. Mowrer, O. H., & Jones, H. (1945). Habit strength as a function of the pattern of reinforcement. Journal of Experimental Psychology. General, 35, 293-311.
20. Nevin, J. A. (1988). Behavioral momentum and the partial reinforcement effect. Psychological Bulletin, 103, 44-56.
21. Nevin, J. A., & Grace, R. C. (2000). Behavioral momentum and the law of effect. The Behavioral and Brain Sciences, 23, 73-130.
22. Nevin, J. A., & Grace, R. C. (2005). Resistance to extinction in the steady state and in transition. Journal of Experimental Psychology. Animal Behavior Processes, 31, 199-212.
23. Papini, M. R., Thomas, B. L., & McVicar, D. G. (2002). Between-subject PREE and within-subject reversed PREE in spaced-trial extinction with pigeons. Learning and Motivation, 33, 485-509.
24. Patalano, A. L., & Ross, B. H. (2007). The role of category coherence in experience-based prediction. Psychonomic Bulletin & Review, 14, 629-634.
25. Pavlik, W. B., & Flora, S. P. (1993). Human responding on multiple variable interval schedules and extinction. Learning and Motivation, 24, 88-99.
26. Pritchard, R. D., Hollenback, J., & DeLeo, P. J. (1980). The effects of continuous and partial schedules of reinforcement on effort, performance and satisfaction. Organizational Behavior and Human Performance, 16, 205-230.
27. Svartdal, F. (2000). Persistence during extinction: Conventional and reversed PREE under multiple schedules. Learning and Motivation, 31, 21-40.
28. Yechiam, E., & Busemeyer, J. R. (2005). Comparison of basic assumptions embedded in learning models from experience-based decision making. Psychonomic Bulletin & Review, 12, 387-402. doi: 10. 3758/BF03193783.
29. Yukl, G. A., Latham, G. P., & Pursell, E. D. (1976). The effectiveness of performance incentives under continuous and variable ratio schedules of reinforcement. Personnel Psychology, 29, 221-231.