Building a bridge into the future: Dynamic connectionist modeling as an integrative tool for research on intertemporal choice

Frontiers in Psychology

Volumn 3, Issue NOV, 2012, Pages

  Scherbaum, Stefan ^a   Dshemuchadse, Maja ^a   Goschke, Thomas ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Connectionist modeling; Date delay effect; Decision making; Dynamic systems; Impulsivity; Intertemporal choice; Temporal discounting; Time perception

Indexed keywords

EID: 84870913141     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2012.00514     Document Type: Article

References (67)

1. Amari, S. (1977). Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27, 77-87.
2. Ballard, K., and Knutson, B. (2009). Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage 45, 143-150.
3. Berns, G. S., Laibson, D., and Loewen-stein, G. (2007). Intertemporal choice - toward an integrative framework. Trends Cogn. Sci. (Regul. Ed.) 11,482-488.
4. Bickel, W. K., and Marsch, L. A. (2001). Toward a behavioral economic understanding of drug dependence: delay discounting processes. Addiction 96, 73-86.
5. Bogacz, R., Usher, M., Zhang, J., and McClelland, J. L. (2007). Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice. Philos. Trans. R. Soc. Lond. B Biol Sci. 362, 1655-1670.
6. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., and Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychol. Rev. 108, 624-652.
7. Busemeyer, J. R., and Johnson, J. G. (2004). Computational models of decision making. Judgm. Decis. Mak. 1, 133-154.
8. Busemeyer, J. R., Johnson, J. G., and Jessup, R. K. (2006). "Preferences constructed from dynamic microprocessing mechanisms," in The Construction of Preference, eds S. Lichtenstein, and P. Slovic (New York: Cambridge University Press), 220-234.
9. Busemeyer, J. R., and Townsend, J. T. (1993). Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol. Rev. 100, 432-459.
10. Cohen, J. D., Servan-Schreiber, D., and McClelland, J. L. (1992). A parallel distributed processing approach to automaticity. Am. J. Psychol. 239-269.
11. Doyle, J. (2010). Survey of Time Preference, Delay Discounting Models. Social Science Research Network. Available at: http://ssrn.com/ abstract=1685861
12. Dshemuchadse, M., Scherbaum, S., and Goschke, T. (2012). How decisions emerge: action dynamics in intertemporal decision making. J. Exp. Psychol. Gen. [Epub ahead of print].
13. Ebert, J. E. J., and Prelec, D. (2007). The fragility of time: time-insensitivity and valuation of the near and far future. Manage. Sci. 53, 1423-1438.
14. Erlhagen, W., and Schöner, G. (2002). Dynamic field theory of movement preparation. Psychol. Rev. 109, 545-572.
15. Evenden, J.L. (1999).Varieties of impulsivity. Psychopharmacology (Berl.) 146, 348-361.
16. Fishburn, P. C. (1968). Utility theory. Manage. Sci. 14, 335-378.
17. Franco-Watkins, A. M., Pashler, H., and Rickard, T. C. (2006). Does Working Memory Load Lead to Greater Impulsivity? Commentary on Hinson, Jameson, and Whitney (2003). Available at: http://psycnet. apa.org/journals/xlm/32/2/443/ [accessed November 1,2012].
18. Frederick, S., Loewenstein, G., and O'Donoghue, T. (2002). Time discounting and time preference: a critical review. J. Econ. Lit. 40, 351-401.
19. Fudenberg, D., and Levine, D. K. (2006). A dual-self model of impulse control. Am. Econ. Rev. 1449-1476.
20. Glöckner, A., and Betsch, T. (2008). Modeling Option and Strategy Choices with Connectionist Networks: Towards an Integrative Model of Automatic and Deliberate Decision Making. SSRN eLibrary. Available at: http://papers.ssrn.com/sol3/papers. cfm?abstract_id= 1090866 [accessed September 10,2012].
21. Goschke, T. (2012). "Volition in action: intentions, control dilemmas and the dynamic regulation of intentional control," in Action Science: Foundations of an Emerging Discipline, eds W. Prinz, A. Beisert, and A. Herwig (Cambridge, MA: MIT Press) (in press).
22. Green, L., Fristoe, N., and Myerson, J. (1994). Temporal discounting and preference reversals in choice between delayed outcomes. Psychon. Bull. Rev. 1, 383-389.
23. Heatherton, T. F., and Wagner, D. D. (2011). Cognitive neuroscience of self-regulation failure. Trends Cogn. Sci. (Regul. Ed.) 15, 132-139.
24. Hinson, J. M., Jameson, T. L., and Whitney, P. (2003). Impulsive decision making and working memory. J. Exp. Psychol. Learn. Mem. Cogn. 29, 298-306.
25. Hofmann, W., Friese, M., and Strack, F. (2009). Impulse and self-control from a dual-systems perspective. Perspect. Psychol. Sci. 4, 162-176.
26. Johnson, J. G., and Busemeyer, J. R. (2010). Decision making under risk and uncertainty. Cogn. Sci. 1, 736-749.
27. Kable, J. W., and Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625-1633.
28. Kahneman, D., and Tversky, A. (1984). Choices, values, and frames. Am. Psychol. 39, 341-350.
29. Killeen, P. R. (2009). An additive-utility model of delay discounting. Psychol. Rev. 116,602-619.
30. Kim, S., and Lee, D. (2011). Prefrontal cortex and impulsive decision making. Biol. Psychiatry 69,1140-1146.
31. Laibson, D. (1997). Golden eggs and hyperbolic discounting. Q. J. Econ. 112,443-477.
32. LeBoeuf, R. A. (2006). Discount rates for time versus dates: the sensitivity of discounting to time-interval description. J. Mark. Res. 43, 59-72.
33. Loewenstein, G., and Prelec, D. (1992). Anomalies in intertemporal choice: evidence and an interpretation. Q. J. Econ. 107, 573-597.
34. Loomes, G. (2010). Modeling choice and valuation in decision experiments. Psychol. Rev. 117, 902-924.
35. McClelland, J. L. (2009). The place of modeling in cognitive science. Top. Cogn. Sci. 1,11-38.
36. McKerchar, T. L., Green, L., Myerson, J., Pickford, T. S., Hill, J. C., and Stout, S. C. (2009). A comparison of four models of delay discounting in humans. Behav. Processes 81, 256-259.
37. Metcalfe, J., and Mischel, W (1999). A hot/cool-system analysis of delay of gratification: dynamics of willpower. Psychol. Rev. 106, 3-19.
38. Otter, T., Johnson, J., Rieskamp, J., Allenby, G. M., Brazell, J. D., Diederich, A., et al. (2008). Sequential sampling models of choice: some recent advances. Mark. Lett. 19, 255-267.
39. Palmer, J., Huk, A. C., and Shadlen, M. N. (2005). The effect of stimulus strength on the speed and accuracy of a perceptual decision. J. Vis. 5, 376-404.
40. Rangel, A., Camerer, C., and Montague, P. R. (2008). A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9, 545-556.
41. Ratcliff, R., and Smith, P. L. (2004). A comparison of sequential sampling models for two-choice reaction time. Psychol. Rev. 111,333-367.
42. Read, D., Frederick, S., Orsel, B., and Rahman, J. (2005). Four score and seven years from now: the date/delay effect in temporal discounting. Manage. Sci. 51, 1326-1335.
43. Resulaj, A., Kiani, R., Wolpert, D. M., and Shadlen, M. N. (2009). Changes of mind in decision-making. Nature 461,263-266.
44. Roe, R. M., Busemeyer, J. R., and Townsend, J. T. (2001). Multial-ternative decision field theory: a dynamic connectionist model of decision making. Psychol. Rev. 108, 370-392.
45. Rumelhart, D. E., and McClelland, J. L. (1986). Parallel Distributed Processing. Explorations in the Microstruc-ture of Cognition: Foundations, Vol. 1. Cambridge: MIT Press.
46. Samuelson, P. A. (1937). A note on measurement of utility. Rev. Econ. Stud. 4, 155-161.
47. Santisteban, C., and Arce, E. (2006). Impulsivity: areview. Psicothema 18, 213-220.
48. Scherbaum, S., Dshemuchadse, M., Ruge, H., and Goschke, T. (2012). Dynamic goal states: adjusting cognitive control without conflict monitoring. Neuroimage 63, 126-136.
49. Scherbaum, S., Fischer, R., Dshemuchadse, M., and Goschke, T. (2011). The dynamics of cognitive control: evidence for within-trial conflict adaptation from frequency-tagged EEG. Psychophysiology 48, 591-600.
50. Scholten, M., and Read, D. (2010). The psychology of intertemporal tradeoffs. Psychol. Rev. 117, 925-944.
51. Shadlen, M. N., and Newsome, W. T. (1998). The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J. Neurosci. 18, 3870-3896.
52. Soubrie, P. (1986). Reconciling the role of central serotonin neurons in human and animal behavior. Behav. Brain Sci. 9, 319-335.
53. Spivey, M. J., Grosjean, M., and Knoblich, G. (2005). Continuous attraction toward phonological competitors. Proc. Natl. Acad. Sci. U.S.A. 102, 10393-10398.
54. Stein, D. J., Hollander, E., and Liebowitz, M. R. (1993). Neurobiology of impulsivity and the impulse control disorders. J. Neuropsychiatry Clin. Neurosci. 5, 9-17.
55. Stewart, N., Chater, N., and Brown, G. D. A. (2006). Decision by sampling. Cogn. Psychol. 53, 1-26.
56. Suddendorf, T., Addis, D. R., and Cor-ballis, M. C. (2009). Mental time travel and the shaping of the human mind. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 1317-1324.
57. Sugrue, L. P., Corrado, G. S., and Newsome, W. T. (2005). Choosing the greater of two goods: neural currencies for valuation and decision making. Nat. Rev. Neurosci. 6, 363-375.
58. Summerfield, C., and Tsetsos, K. (2012). Building bridges between perceptual and economic decision-making: neural and computational mechanisms. Front. Neurosci. 6:70. doi:10.3389/fnins.2012.00070
59. Thaler, R.H.,and Shefrin, H.M. (1981). An economic theory of self-control. J. Polit. Econ. 392-406.
60. Trope, Y., and Liberman, N. (2003). Temporal construal. Psychol. Rev. 110, 403-421.
61. Trope, Y., and Liberman, N. (2010). Construal-level theory of psychological distance. Psychol. Rev. 117, 440-463.
62. Tsetsos, K., Usher, M., and Chater, N. (2010). Preference reversal in mul-tiattribute choice. Psychol. Rev. 117, 1275-1291.
63. Usher, M., and McClelland, J. L. (2001). The time course of perceptual choice: the leaky, competing accumulator model. Psychol. Rev. 108, 550-592.
64. van Rullen, R., and Thorpe, S. J. (2001). Rate coding versus temporal order coding: what the retinal ganglion cells tell the visual cortex. Neural Comput. 13, 1255-1283
65. Wang, X. J. (2008). Decision making in recurrent neuronal circuits. Neuron 60,215-234.
66. Wittmann, M., and Paulus, M. P. (2008). Decision making, impulsivity and time perception. Trends Cogn. Sci. (Regul. Ed.) 12, 7-12.
67. Zauberman, G., Kim, B. K., Malkoc, S. A., and Bettman, J. R. (2009). Discounting time and time discounting: subjective time perception and intertemporal preferences. J. Mark. Res. 46, 543-556.