Learning in noise: Dynamic decision-making in a variable environment

Journal of Mathematical Psychology

Volumn 53, Issue 3, 2009, Pages 180-193

  Gureckis, Todd M ^a   Love, Bradley C ^b  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 67349207841     PISSN: 00222496     EISSN: 10960880     Source Type: Journal    
DOI: 10.1016/j.jmp.2009.02.004     Document Type: Article

References (50)

1. Barron G., and Erev I. Small feedback-based decisions and their limited correspondence to description-based decisions. Journal of Behavioral Decision Making 16 (2003) 215-233
2. Berry D.C., and Broadbent D.E. Interactive tasks and the implicit-explicit distinction. British Journal of Psychology 79 (1988) 251-272
3. Bogacz R., McClure S., Li J., Cohen J., and Montague P. Short-term memory traces for action bias in human reinforcement learning. Brain Research 1153 (2007) 111-121
4. Brehmer B. Dynamic decision making: Human control of complex systems. Acta Psychologica (1992) 211-241
5. Burns B. Heuristics as beliefs and as behaviors: The adaptiveness of the hot hand. Cognitive Psychology 48 (2004) 295-311
6. Busemeyer J. Dynamic decision making. In: Smelser N.J., and Baltes P.B. (Eds). International encyclopedia of the social and behavioral sciences Vol. 6 (2002), Elsevier Press, Oxford 3903-3908
7. Busemeyer J., Byun E., Delosh E., and McDaniel M. Learning functional relations based on experience with input-output pairs by humans and artificial neural networks. In: Lamberts K., and Shanks D.R. (Eds). Knowledge, concepts, and categories. Studies in cognition series (1997), Psychology Press 405-435
8. Busemeyer J., and Myung I.J. An adaptive approach to human decision making: Learning theory, decision theory, and human performance. Journal of Experimental Psychology: General 121 2 (1992) 177-194
9. Busemeyer, J., & Pleskac, T. Theoretical tools for understanding and aiding dynamic decision making. Journal of Mathematical Psychology, in this issue (doi:10.1016/j.jmp.2008.12.007)
10. Daw, N. (2003). Reinforcement learning models of the dopamine system and their behavioral implications. Unpublished doctoral dissertation. Carnegie Mellon
11. Daw N., O'Doherty J., Seymour B., Dayan P., and Dolan R. Cortical substrates for exploratory decision in humans. Nature 441 (2006) 876-879
12. Daw N., and Touretzky D. Behavioral considerations suggest and average reward TD model of the dopamine system. Neurocomputing 32-33 (2000) 679-684
13. Denrell J. Why most people disapprove of me: Experience sampling in impression formation. Psychological Review 112 4 (2005) 951-978
14. Edwards W. Dynamic decision making and probabilistic information processing. Human Factors 4 (1962) 59-73
15. Fu W., and Anderson J. From recurrent choice to skill learning: A reinforcement-learning model. Journal of Experimental Psychology: General 135 2 (2006) 184-206
16. Gilbert D., and Malone P. The correspondence bias. Psychological Bulletin 117 1 (1995) 21-38
17. Gold J., Sekuler A., and Bennett P. Characterizing perceptual learning with external noise. Cognitive Science 28 2 (2004) 167-207
18. Green D., and Swets J. Signal detection theory and psychophysics (1966), John Wiley and Sons, Inc., New York
19. Gureckis, T., & Love, B.C. Short term gains, long term pains: How cues about state aid learning in dynamic environments. Cognition (in press)
20. Herrnstein R. Experiments on stable suboptimality in individual behavior. The American Economic Review 81 2 (1991) 360-364
21. Herrnstein R., and Prelec D. Melioration: A theory of distributed choice. The Journal of Economic Perspectives 5 3 (1991) 137-156
22. Jones E., and Harris V. The attribution of attitudes. Journal of Experimental Social Psychology 3 (1967) 1-24
23. Kacelnik A. Normative and descriptive models of decision making: Time discounting and risk sensitivity. In: Houk J., Davis J., and Beiser D. (Eds). Models of information processing in the basal ganglia (1995), MIT Press 249-270
24. Kahneman D., and Tversky A. On the psychology of prediction. Psychological Review 80 (1973) 237-251
25. Kalman R. A new approach to linear filtering and prediction problems. Journal of Basic Engineering 82 1 (1960) 35-45
26. Kirkpatrick S., Gelatt C., and Vecchi M. Optimization by simulated annealgin. Science 220 4598 (1983) 671-680
27. Kruschke J. Bayesian approaches to associative learning: From passive to active learning. Learning and Behavior 36 3 (2008) 210-226
28. Littman, M.L. A tutorial on partially observable Markov decision processes. Journal of Mathematical Psychology, in this issue (doi:10.1016/j.jmp.2009.01.005)
29. Lu Z., and Dosher B. Characterizing human perceptual inefficiencies with equivalent internal noise. Journal of the Optical Society of America A: Optics, Image Science, and Vision 16 3 (1999) 764-778
30. Luce R.D. Individual choice behavior: A theoretical analysis (1959), Greenwood Press, Westport, CT
31. Maddox W., Baldwin G., and Markman A. A test of the regulatory fit hypothesis in perceptual classification learning. Memory & Cognition 34 7 (2006) 1371-1397
32. Myerson J., and Green L. Discounting of delayed rewards: Models of individual choice. Journal of the Experimental Analysis of Behavior 64 (1995) 263-276
33. Neth H., Sims C., and Gray W. Melioration dominates maximization: Stable suboptimal performance despite global feedback. In: Sun R., and Miyake N. (Eds). Proceedings of the 28th annual meeting of the cognitive science society (2006), Lawrence Erlbaum Associates, Hillsdale, NJ
34. Niv, Y. (2007). The effects of motivation on habitual instruental behavior. Unpublished doctoral dissertation. Hebrew University of Jerusalem
35. Pelli D., and Farell B. Why use noise?. Journal of the Optical Society of America A 16 (1999) 647-653
36. Redish A., Jensen S., Johnson A., and Kurth-Nelson Z. Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addition, relapse, and problem gamling. Psychological Review 114 3 (2007) 784-805
37. Schwartz A. A reinforcement learning method for maximizing undiscounted rewards. Proceedings of the 10th international conference on machine learning (1993), Morgan-Kaufmann, San Mateo, CA
38. Skinner B.F. 'Superstition' in the pigeon. Journal of Experimental Psychology 38 2 (1948) 168-172
39. Stanley W., Mathew R., Russ R., and Kotler-Cope S. Insight without awareness: On the interaction of verbalization, instruction, and practice in a simulated process control task. Quartley Journal of Experimental Psychology 41A 3 (1989) 553-577
40. Sun R., Slusarz P., and Terry C. The interaction of the explicit and the implicit in skill learning: A dual-process approach. Psychological Review 112 1 (2005) 159-192
41. Sutton R., and Barto A. Reinforcement learning: An introduction (1998), MIT Press, Cambridge, MA
42. Tadepalli P., and Ok D. Model-based average reward reinforcement learning. Artificial Intelligence (1996) 881-887
43. Tsitsiklis J., and Van Roy B. Average cost temporal-difference learning. Automatica 35 (1999) 319-349
44. Tunney R.J., and Shanks D.R. A re-examination of melioration and rational choice. Journal of Behavioral Decision Making 15 (2002) 291-311
45. Tversky A., and Kahneman D. Belief in the law of small numbers. Psychological Bulletin 2 (1971) 105-110
46. Veksler, V., Gray, W., & Schoelles, M. (2007). Categorization and reinforcement learning: State identification in reinforcement learning and network reinforcement learning. In Proceedings of the 29th annual conference of the cognitive science society
47. Watkins, C. (1989). Learning from delayed rewards. Unpublished doctoral dissertation. Cambridge University, Cambridge, England
48. Whitehead S., and Ballard D. Learning to perceive and act by trial and error. Machine Learning 7 1 (1991) 45-83
49. Widrow B., and Hoff M. Adaptive switching circuits. Institute of Radio Engineers, Western Electronic Show and Convention Record 4 (1960) 96-104
50. Worthy D., Maddox W., and Markman A. Regulatory fit effects in a choice task. Psychonomic Bulletin and Review (2007)