Integrating human and robot decision-making dynamics with feedback: Models and convergence analysis

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2008, Pages 1127-1132

  Cao, Ming ^a   Stewart, Andrew ^b   Leonard, Naomi Ehrich ^b  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

^b Princeton University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS; DECISION MAKING; DYNAMICS; FEEDBACK; ROBOTS;

BEHAVIORAL EXPERIMENT; COLLABORATIVE TASKS; CONVERGENCE ANALYSIS; DECISION-MAKING PROBLEM; HUMAN DECISION MAKING; HUMAN DECISION-MAKING MODEL; JOINT DECISION MAKING; SUB-OPTIMAL CHOICES;

BEHAVIORAL RESEARCH;

EID: 62949123656     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2008.4739103     Document Type: Conference Paper

References (17)

1. P. Antsaklis and J. Baillieul, editors. Proc. IEEE: Special Issue on Technology of Networked Control Systems, volume 95:1. IEEE, 2007.
2. C. Niessen and K. Eyferth. A model of the air traffic controller's picture. Safety Science, 37:187-202, 2001.
3. J.L. Burke, R.R. Murphy, E. Rogers, VJ. Lumelksy, and J. Scholtz. Final report for the DARPA/NSF interdisciplinary study on human-robot interaction. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 34:103-112, 2004.
4. J. G. Trafton, N. L. Cassimatis, M. D. Bugajska, D. P. Brock, F. E. Mintz, and A. C. Schultz. Enabling effective human-robot interaction using perspective-taking in robots. IEEE Tram. on Systems, Man, and Cybernetics, Part A: Systems and Humans, 35(4):460-470, 2005.
5. R. Herrnstein. Rational choice theory: necessary but not sufficient. American Psychologist, 45:356-367, 1990.
6. P. R. Montague and G. S. Berns. Neural economics and the biological substrates of valuation. Neuron, 36:265-284, 2002.
7. R. Bogacz, S. M. McClure, J. Li, J. D. Cohen, and P. R. Montague. Short-term memory traces for action bias in human reinforcement learning. Brain Research, 1153:111-121, 2007.
8. J. Li, S. M. McClure, B. King-Casas, and P. R. Montague. Policy adjustment in a dynamic economic game. PLoS One, el03:l-ll, 2006.
9. D. M. Egelman, C. Person, and P. R. Montague. A computational role for dopamine delivery in human decision-making. Journal of Cognitive Neuroscience, 10:623-630, 1998.
10. A. Nedic, D. Tomlin, P. Holmes, D.A. Prentice, and J.D. Cohen. A simple decision task in a social context: preliminary experiments and a model. In Proc. 47th IEEE Conf. Decision and Control, 2008.
11. R. Herrnstein. The Matching Law: Papers in Psychology and Economics. Harvard University Press, Cambridge, MA, USA, 1997. Edited by Howard Rachlin and David I. Laibson.
12. M. Cao, A. Stewart, and N.E. Leonard. Convergence in human decision-making dynamics and integration of humans with robots. http://www.princeton.edu/~ naomi/publications.html, 2008.
13. L. Vu and K. Morgansen. Modeling and analysis of dynamic decision making in sequential two-choice tasks. In Proc. 47th IEEE Conf. Decision and Control, 2008.
14. H. Robbins. Some aspects of the sequential design of experiments. Bulletin of American Mathematical Society, 58:527-535, 1952.
15. M. Nowak and K. Sigmund. A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game. Nature, 364:56-58, 1993.
16. C. Bernstein, A. Kacelnik, and J.R. Krebs. Individual decisions and the distribution of predators in a patchy environment. Journal of Animal Ecology, 57:1007-1026, 1988.
17. S.D. Fretwell and H.L. Lucas. On territorial behavior and other factors influencing habitat distribution in birds. Acta Bio., 19:16-36, 1970.