Convergence in human decision-making dynamics

Systems and Control Letters

Volumn 59, Issue 2, 2010, Pages 87-97

  Cao, Ming ^a   Stewart, Andrew ^b   Leonard, Naomi Ehrich ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b Princeton University   (United States)

Author keywords

Drift diffusion model; Explore vs. exploit; Human decision making; Robotic foraging; Two alternative forced choice task; Win stay, lose switch model

Indexed keywords

AGGREGATE BEHAVIOR; BEHAVIORAL ECONOMICS; BINARY DECISION; CONVERGENCE RESULTS; DRIFT-DIFFUSION MODEL; EVOLVING SYSTEMS; EXPLORE VS. EXPLOIT; HUMAN BEHAVIORS; HUMAN DECISION MAKING; HUMAN SUBJECTS; HUMAN SUPERVISORS; HUMAN-IN-THE-LOOP; MATCHING POINTS; TIME INTERVAL;

BEHAVIORAL RESEARCH; DIFFUSION; ROBOTICS;

DECISION MAKING;

EID: 75249089394     PISSN: 01676911     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sysconle.2009.12.002     Document Type: Article

References (33)

1. In: Murphey R., and Pardalos P.M. (Eds). Cooperative Control and Optimization (2002), Springer
2. In: Kumar V., Leonard N., and Morse A.S. (Eds). Cooperative Control (2005), Springer
3. In: Antsaklis P., and Baillieul J. (Eds). IEEE Transactions on Automatic Control: Special Issue on Networked Control Systems vol. 49 (2004), IEEE 9
4. In: Antsaklis P., and Baillieul J. (Eds). Proceedings of the IEEE: Special Issue on Technology of Networked Control Systems vol. 95 (2007), IEEE 1
5. R. Simmons, S. Singh, F. Heger, L. Hiatt, S. Koterba, N. Melchior, B. Sellner, Human-robot teams for large-scale assembly, in: Proc. NASA Science Technology Conference, 2007
6. T. Kaupp, A. Makarenko, Measuring human-robot team effectiveness to determine an appropriate autonomy level, in: Proc. IEEE Int. Conf. on Robotics and Automation, 2008
7. A. Steinfeld, T. Fong, D. Kaber, M. Lewis, J. Scholtz, A. Schultz, M. Goodrich, Common metrics for human-robot interaction, in: Proc. Human-Robot Interaction Conference, 2006
8. Alami R., Clodic A., Montreuil V., Sisbot E.A., and Chatila R. Task planning for human-robot interaction. Proc. Joint Conf. on Smart Objects and Ambient Intelligence (2005), ACM
9. Trafton J.G., Cassimatis N.L., Bugajska M.D., Brock D.P., Mintz F.E., and Schultz A.C. Enabling effective human-robot interaction using perspective-taking in robots. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 35 4 (2005) 460-470
10. Herrnstein R. Rational choice theory: Necessary but not sufficient. American Psychologist 45 (1990) 356-367
11. Montague P.R., and Berns G.S. Neural economics and the biological substrates of valuation. Neuron 36 (2002) 265-284
12. Bogacz R., McClure S.M., Li J., Cohen J.D., and Montague P.R. Short-term memory traces for action bias in human reinforcement learning. Brain Research 1153 (2007) 111-121
13. Li J., McClure S.M., King-Casas B., and Montague P.R. Policy adjustment in a dynamic economic game. PLoS One e103 (2006) 1-11
14. Egelman D.M., Person C., and Montague P.R. A computational role for dopamine delivery in human decision-making. Journal of Cognitive Neuroscience 10 (1998) 623-630
15. A. Nedic, D. Tomlin, P. Holmes, D.A. Prentice, J.D. Cohen, A simple decision task in a social context: Preliminary experiments and a model, in: Proc. of the 47th IEEE Conference on Decision and Control, 2008, pp. 1115-1120
16. B. Donmez, M.L. Cummings, H.D. Graham, Auditory decision aiding in supervisory control of multiple unmanned aerial vehicles. Human Factors: The Journal of the Human Factors and Ergonomics (in press), OnlineFirst, published 2009 as doi:10.1177/0018720809347106
17. K.C. Campbell Jr., W.W. Cooper, D.P. Greenbaum, L.A. Wojcik, Modeling distributed human decision-making in traffic flow management operations, in: 3rd USA/Europe Air Traffic Management R&D Seminar, Napoli, 2000
18. Herrnstein R. In: Rachlin H., and Laibson D.I. (Eds). The Matching Law: Papers in Psychology and Economics (1997), Harvard University Press, Cambridge, MA, USA
19. M. Cao, A. Stewart, N.E. Leonard, Integrating human and robot decision-making dynamics with feedback: Models and convergence analysis, in: Proc. of the 47th IEEE Conference on Decision and Control, 2008, pp. 1127-1132
20. L. Vu, K. Morgansen, Modeling and analysis of dynamic decision making in sequential two-choice tasks, in: Proc. of the 47th IEEE Conference on Decision and Control, 2008, pp. 1121-1126
21. Robbins H. Some aspects of the sequential design of experiments. Bulletin of American Mathematical Society 58 (1952) 527-535
22. Nowak M., and Sigmund K. A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game. Nature 364 (1993) 56-58
23. Bogacz R., Brown E., Moehlis J., Holmes P., and Cohen J.D. The physics of optimal decision making: A formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review 113 (2006) 700-765
24. Oksendal B.K. Stochastic Differential Equations: An Introduction with Applications (2003), Springer-Verlag, Berlin
25. Simen P., and Cohen J.D. Explicit melioration by a neural diffusion model. Brain Research 1299 (2009) 95-117
26. Montague P.R., Dayan P., and Sejnowski T.J. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. Journal of Neuroscience 16 (1996) 1936-1947
27. Sutton R.S., and Barto A.G. Reinforcement Learning (1998), MIT Press, Cambridge, MA
28. D. Baronov, J. Baillieul, Reactive exploration through following isolines in a potential field, in: Proc. of 2007 American Control Conference, 2007, pp. 2141-2146
29. Cortes J., Martinez S., Karatas T., and Bullo F. Coverage control for mobile sensing networks. IEEE Transactions on Robotics and Automation 20 (2004) 243-255
30. Ogren P., Fiorelli E., and Leonard N.E. Cooperative control of mobile sensor networks: Adaptive gradient climbing in a distributed environment. IEEE Transactions on Automatic Control 49 (2004) 1292-1302
31. Giraldeau L.A., and Caraco T. Social Foraging Theory (2000), Princeton University Press, Princeton, NJ, USA
32. Morand-Ferron J., Giraldeau L.A., and Lefebvre L. Wild carib grackles play a producer-scrounger game. Behavioral Ecology (2007) 916-921
33. C. Baldassano, N.E. Leonard, Explore vs. exploit: Task allocation for multi-robot foraging. Preprint. 2009. Available online http://www.princeton.edu/~naomi/publications.html