Predicting investment behavior: An augmented reinforcement learning model

Neurocomputing

Volumn 72, Issue 16-18, 2009, Pages 3447-3461

  Shimokawa, Tetsuya ^a   Suzuki, Kyoko ^b   Misawa, Tadanobu ^a   Okano, Yoshitaka ^c  

^a TOKYO UNIVERSITY OF SCIENCE   (Japan)

^b UNIVERSITY OF TOKYO   (Japan)

^c OSAKA UNIVERSITY   (Japan)

Author keywords

Disposition effect; Hierarchical Bayes; Reinforcement learning; Sequential investment task; Three layered perceptron

Indexed keywords

BASIS FUNCTIONS; DISPOSITION EFFECT; FINANCIAL INVESTMENTS; HIERARCHICAL BAYES; HIERARCHICAL BAYESIAN; HUMAN DECISION-MAKING; INVESTMENT DECISION MAKING; LEARNING MODELS; NONLINEAR EFFECT; OVERFITTING; PARAMETER VALUES; PERCEPTRON; PREDICTIVE TEST; REINFORCEMENT LEARNING MODELS; SEQUENTIAL INVESTMENT TASK; THREE-LAYERED PERCEPTRON; TYPE LEARNING;

BAYESIAN NETWORKS; DECISION MAKING; INVESTMENTS; REINFORCEMENT; REINFORCEMENT LEARNING;

EDUCATION;

ADULT; ARTICLE; BAYESIAN LEARNING; CONTROLLED STUDY; DECISION MAKING; FEMALE; FINANCIAL MANAGEMENT; HUMAN; HUMAN EXPERIMENT; INVESTMENT; LEARNING; MALE; MATHEMATICAL ANALYSIS; NORMAL HUMAN; PERCEPTRON; PREDICTION; PRIORITY JOURNAL; REINFORCEMENT; TASK PERFORMANCE;

EID: 69249229732     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.11.031     Document Type: Article

References (46)

1. Sutton R., and Barto A. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
2. Schultz W. Getting formal with dopamine and reward. Neuron 36 2 (2002) 241-263
3. C. Salum, A. da Silva, A. Pickering, Striatal dopamine in attentional learning: a computational model, Neurocomputing (1999) 26-27.
4. Ishii S., Shidara M., and Shibata K. A model to explain the emergence of reward expectancy neurons using reinforcement learning and neural network. Neurocomputing 69 10-12 (2006) 1327-1331
5. Erev I., and Roth A. Predicting how people play games: reinforcement learning in experimental games with unique, mixed strategy equilibria. The American Economic Review 88 4 (1998) 848-881
6. Camerer C., and Ho T. Experience-weighted attraction learning in games: a unifying approach. Econometrica 67 4 (1999) 827-874
7. Camerer C. Behavioral Game Theory: Experiments in Strategic Interaction (2003), Princeton University Press, Princeton, NJ
8. I. Erev, A. Roth, On the need for low rationality cognitive game theory: reinforcement learning in experimental games with unique mixed strategy equilibria, University of Pittsburgh (1996).
9. Lo A., and Repin D. The psychophysiology of real-time financial risk processing. Journal of Cognitive Neuroscience 14 3 (2002) 323-339
10. Tversky A., and Kahneman D. Advances in prospect theory: cumulative representation of uncertainty. Journal of Risk and Uncertainty 5 (1992) 297-323
11. Breiter H., Aharon I., Kahneman D., Dale A., and Shizgal P. Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30 2 (2001) 619-639
12. Knutson B., and Peterson R. Neurally reconstructing expected utility. Games and Economic Behavior 52 (2005) 305-315
13. E. Tsang, S. Martinez-Jaramillo, Computational finance, IEEE Computational Intelligence Society Newsletter (2004) 3-8.
14. Wong F. Time series forecasting using backpropagation neural networks. Neurocomputing 2 4 (1990) 147-159
15. Koza J. Genetic Programming (1992), Springer, Berlin
16. Gavrishchaka V., and Ganguli S. Volatility forecasting from multiscale and high-dimensional market data. Neurocomputing 55 1 (2003) 285-305
17. Thawornwong S., and Enke D. The adaptive selection of financial and economic variables for use with artificial neural networks. Neurocomputing 56 (2004) 205-232
18. S. Hayward, Setting up performance surface of an artificial neural network with genetic algorithm optimization: in search of an accurate and profitable prediction of stock trading, Evolutionary Computation, CEC2004, Congress, 2004.
19. M. Tanaka-Yamawaki, T. Motoyama, Predicting the tick-wise price fluctuations by means of evolutionary computation, Evolutionary Computation, CEC2004, Congress, 2004.
20. Kozma R., Wong D., Demirer M., and Freeman W. Learning intentional behavior in the K-model of the amygdala and entorhinal cortex with the cortico-hyppocampal formation. Neurocomputing 65 (2005) 23-30
21. Lee K., and Kwon D. Synaptic plasticity model of a spiking neural network for reinforcement learning. Neurocomputing 71 13-15 (2008) 3037-3043
22. Marchiori D., and Warglien M. Predicting human interactive learning by regret-driven neural networks. Science 319 5866 (2008) 1111
23. MacKay D. The evidence framework applied to classification networks. Neural Computation 4 5 (1992) 720-736
24. MacKay D. A practical Bayesian framework for backpropagation networks. Neural Computation 4 3 (1992) 448-472
25. Neal R. Bayesian Learning for Neural Networks (1996), Springer, Berlin
26. Lohrenz T., McCabe K., Camerer C., and Montague P. Neural signature of fictive learning signals in a sequential investment task. Proceedings of the National Academy of Sciences 104 22 (2007) 9493-9498
27. Shefrin H., and Statman M. The disposition to sell winners too early and ride losers too long: theory and evidence. The Journal of Finance 40 3 (1985) 777-790
28. Odean T. Are investors reluctant to realize their losses?. The Journal of Finance 53 5 (1998) 1775-1798
29. Locke P., and Mann S. Professional trader discipline and trade disposition star, open. Journal of Financial Economics 76 2 (2005) 401-444
30. Coval J., and Shumway T. Do behavioral biases affect prices?. The Journal of Finance 60 1 (2005) 1-34
31. Weber M., and Camerer C. The disposition effect in securities trading: an experimental analysis. Journal of Economic Behavior and Organization 33 2 (1998) 167-184
32. Shu P., Yeh Y., Chiu S., and Chen H. Are Taiwanese individual investors reluctant to realize their losses?. Pacific-Basin Finance Journal 13 2 (2005) 201-223
33. Bereby-Meyer Y., and Erev I. On learning to become a successful loser: a comparison of alternative abstractions of learning processes in the loss domain. Journal of Mathematical Psychology 42 2-3 (1998) 266-286
34. Geweke J. Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. Bayesian Statistics 4 (1992) 169-193
35. Engle R.F. Autoregressive conditional heteroscedasticity with estimates of variance of United Kingdom inflation. Econometrica 50 (1982) 987-1008
36. Bollerslev T. Generalized autoregressive conditional heteroskedasticity. Journal of Econometrics 31 (1986) 307-327
37. Broseta B. Adaptive learning and equilibrium selection in experimental coordination games: an ARCH (1) approach. Games and Economic Behavior 32 1 (2000) 25-50
38. Camerer C., Loewenstein G., and Prelec D. Neuroeconomics: how neuroscience can inform economics. Journal of Economic Literature 43 1 (2005) 9-64
39. Kohonen T. Self-Organizing Maps (2001), Springer, Berlin
40. Vesanto J., and Alhoniemi E. Clustering of the self-organizing map. IEEE Transactions on Neural Networks 11 3 (2000) 586-600
41. Carpenter G., and Grossberg S. The ART of adaptive pattern recognition by a self-organizing neural network. Computer 21 3 (1988) 77-88
42. Carpenter G., Grossberg S., and Rosen D. Fuzzy ART: fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks 4 6 (1991) 759-771
43. Lo A.W., and MacKinlay A.C. Stock market prices do not follow random walks: evidence from a simple specification test. Review of Financial Studies 1 (1988) 41-66
44. Jegadeesh N., and Titman S. Returns to buying winners and selling losers: implications for stock market efficiency. The Journal of Finance 48 1 (1993) 65-91
45. Fama E. Efficient capital markets: II. The Journal of Finance 46 5 (1991) 1575-1617
46. Fama E. Market efficiency, long-term returns, and behavioral finance. Journal of Financial Economics 49 3 (1998) 283-306