The feeling of action tendencies: On the emotional regulation of goal-directed behavior

Frontiers in Psychology

Volumn 2, Issue DEC, 2011, Pages

  Lowe, Robert ^a   Ziemke, Tom ^a  

^a UNIVERSITY OF SKÖVDE   (Sweden)

Author keywords

Action tendency; Feedback; Feeling; Goal directed behavior; Home ostasis; Neural dynamic representations; Prediction; Reinforcement

Indexed keywords

EID: 84867068428     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2011.00346     Document Type: Review

References (166)

1. Amari, S. (1977). Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27, 77-87.
2. Anderson, C. J. (2003). The psychology of doing nothing: forms of decision avoidance result from reason and emotion. Psychol. Bull. 129, 139-166.
3. Aristotle, N. (1984). Complete Works [Revised Oxford Translation in 2 Volumes, ed. J. Barnes]. Princeton, NJ: Princeton University Press.
4. Arnold, M. B. (1960). Emotion and Personality. New York: Columbia University Press.
5. Avila-Garcìa, O. (2004). Towards Emotional Modulation of Action Selection in Motivated Autonomous Robots. Ph.D. thesis, Department of Computer Science, University of Hertfordshire, Hatfield.
6. Avila-Garcìa, O., and Cañamero, L. (2005). "Hormonal modulation of perception in motivation-based action selection architectures," in Proceedings of Agents that Want and Like: Motivational and Emotional Roots of Cognition and Action, Symposium of the AISB'05 Convention, (Hatfield: University of Hertfordshire), 9-17.
7. Baldassarre, G. (2011). "What are intrinsic motivations? A biological perspective," in IEEE 10th International Conference on Development and Learning (ICDL), Frankfurt.
8. Baumeister, R. F., Vohs, K. D., DeWall, C. N., and Zhang, L. (2007). How emotion shapes behaviour: feedback, anticipation, and reflection, rather than direct causation. Pers. Soc. Psychol. Rev. 11, 167-203.
9. Bechara, A. (2004). The role of emotion in decision-making: evidence from neurological patients with orbitofrontal damage. Brain Cogn. 55, 30-40.
10. Bechara, A., and Damasio, A. R. (2005). The somatic marker hypothesis: a neural theory of economic decision. Games Econ. Behav. 52, 336-372.
11. Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7-15.
12. Bem, D. J. (1972). "Self-perception theory," in Advances in Experimental Social Psychology, Vol. 6, ed. L. Berkowitz (New York: Academic Press), 1-62.
13. Berkowitz, L. (2000). The Causes and Consequences of Feelings. Cambridge: Cambridge University Press. Boureau, Y.-L., and Dayan, P. (2010). Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacol. Rev. 1, 1-24.
14. Bradley, M. M. (2000). "Emotion and motivation," in Handbook of Psychophysiology, eds J. T. Cacioppo, L. G. Tassinary, and G. G. Berntson (New York: Cambridge University Press), 602-643.
15. Bradley, M. M., and Lang, P. J. (1994). Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25, 49-59.
16. Bradley, M. M., and Lang, P. J. (2000). "Measuring emotion: behavior, feeling, and physiology," in Cognitive Neuroscience of Emotion, eds R. D. Lane and L. Nadel (New York: Oxford University Press), 242-276.
17. Bradley, M. M., and Lang, P. J. (2007). "Emotion and motivation, "in Handbook of Psychophysiology, edsJ.T. Cacioppo, L. G. Tassinary, and G. Berntson (New York: Cambridge University Press), 581-607.
18. Cacioppo, J. T., Berntson, G. G., and Klein, D. J. (1992). What is an emotion? The role of somatovisceral afference, with special emphasis on somatovisceral "illusions." Rev. Pers. Soc. Psychol. 14, 63-98.
19. Cacioppo, J. T., Berntson, G. G., Larsen, J. T., Poehlmann, K. M., and Ito, T. A. (2000). "The psychophysiology of emotion," in The Handbook of Emotions, eds M. Lewis and J. M. Haviland-Jones (New York: Guildford Press), 173-192.
20. Camras, L. A. (2011). Differentiation, dynamical integration and functional emotional development. Emot. Rev. 3, 138-146.
21. Cañamero, D. (2003). "Designing emotions for activity selection," in Emotions in Humans and Artifacts, eds R. Trappl, P. Petta, and S. Payr (Cambridge MA: The MIT Press), 115-148.
22. Carstensen, L. L., Isaacowitz, D. M., and Charles, S. T. (1999). Taking time seriously:a theory of socioemotional selectivity. Am. Psychol. 54, 165-181.
23. Carver, C. S. (2003). Pleasure as a sign you can attend to something else: placing positive feelings within a general model of affect. Cogn. Emot. 17, 241-261.
24. Carver, C. S. (2005). Emotion theory is about more than affect and cognition: taking triggers and actions into account. Behav. Brain Sci. 28, 198-199.
25. Carver, C. S. (2006). Approach, avoidance, and the self-regulation of affect and action. Moitv. Emot. 30, 105-110.
26. Carver, C. S., and Harmon-Jones, E. (2009). Anger is an approach-related affect: evidence and implications. Psychol. Bull. 135, 183-204.
27. Carver, C. S., and Scheier, M. F. (1990). Origins and functions of positive and negative affect: a controlprocess view. Psychol. Rev. 97, 19-35.
28. Carver, C. S., and Scheier, M. F. (1998). On the Self-regulation of Behavior. Cambridge: Cambridge University Press.
29. Christie, I., and Friedman, B. (2004). Autonomic specificity of discrete emotion and dimensions of affective space a multivariate approach. Int. J. Psychophysiol. 51, 143-153.
30. Cools, R., Nakamura, K., and Daw, N. D. (2010). Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 36, 98-113.
31. Damasio, A. R. (1994). Descartes' Error: Emotion, Reason, and the Human Brain. New York: GP Putnam's Sons. Damasio, A. R. (1999). The Feeling of What Happens: Body, Emotion andthe Making of Consciousness. London: Vintage.
32. Damasio, A. R. (2003). Looking for Spinoza: Joy, Sorrow and the Feeling Brain. Orlando, FL: Harcourt.
33. Damasio, A. R. (2004). "Emotions and feelings: a neurobiological perspective," in Feelings and Emotions, eds A. S. R. Manstead, N. Frijda, and A. Fischer (Cambridge: Cambridge University Press), 49-57.
34. Damasio, A. R. (2010). Self Comes to Mind: Constructing the Conscious Brain. New York: Pantheon Books.
35. Davidson, R. J. (1993). Parsing affective space: perspectives from neuropsychology and psychophysiology. Neuropsychology 7, 464-475.
36. Davidson, R. J., Fox, A., and Kalin, N. H. (2007). "Neural bases of emotion regulation in nonhuman primates and humans," in Handbook of Emotion Regulation, ed. J. J. Gross (New York: The Guilford Press), 47-68.
37. Daw, N. D., Kakade, S., and Dayan, P. (2002). Opponent interactions between serotonin and dopamine. Neural Netw. 15, 603-616.
38. Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioural control. Nat. Neurosci. 8, 1704-1711.
39. Dayan, P., and Huys, Q. M. (2008). Serotonin, inhibition, and negative mood. PLoS Comput. Biol. 4, e4. doi:10.1371/journal.pcbi.0040004.
40. Dickinson, A., and Balleine, B. (1994). Motivational control of goaldirected action. Anim. Learn. Behav. 22, 1-18.
41. Downing, K. L. (2009). Predictive models in the brain. Connect. Sci. 21, 39-74.
42. Dretske, F. (1981). Knowledge and the Flow of Information. Cambridge: MIT Press.
43. Dretske, F. (1986). "Misrepresentation," in Belief: Form, Content and Function, ed. R. Bogdan (Oxford: Oxford University Press), 17-36.
44. Ekman, P. (1972). "Universals and cultural differences in facial expression of emotion, "in Nebraska Symposium on Motivation, ed. J. Cole Lincoln (Nebraska: University of Nebraska Press), 207-283.
45. Ekman, P. (2003). Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life. New York: Times Books. Ellsworth, P. C., and Scherer, K. R. (2003). "Appraisal processes in emotion," in Handbook of Affective Sciences, eds R. J. Davidson, H. Goldsmith, and K. R. Scherer (New York: Oxford University Press), 572-595.
46. Eyer, J., and Sterling, P. (1977). Stressrelated mortality and social organization. Rev. Radic. Polit. Econ. 9, 1-44.
47. Fanselow, M. S. (1994). Neural organization of the defensive behaviour system responsible for fear. Psychon. Bull. Rev. 1, 429-438.
48. Feldman-Barrett, L. (2006). Are emotions natural kinds? Perspect. Psychol. Sci. 1, 28-58.
49. Friedman, B. H. (2010). Feelings and the body: the Jamesian perspective on autonomic specificity of emotion. Biol. Psychol. 84, 283-293.
50. Frijda, N. H. (1986). The Emotions. Cambridge: Cambridge University Press.
51. Frijda, N. H. (1987). Comment on Oatley and Johnson-Laird's "Towards a cognitive theory of emotion." Cogn. Emot. 1, 51-58.
52. Frijda, N. H. (1995). "Emotions in robots," in Comparative Approaches to Cognitive Science, eds H. L. Roitblat and J.-A. Meyer (Cambridge, MA: The MIT Press), 501-516.
53. Frijda, N. H. (2004). "Emotions and action, "in Feelings and Emotions, eds A. S. R. Manstead, N. Frijda, and A. Fischer (Cambridge: Cambridge University Press), 158-173.
54. Frijda, N. H. (2007). The Laws of Emotion. London: Lawrence Erlbaum Associates.
55. Frijda, N. H. (2010). Impulsive action and motivation. Biol. Psychol. 84, 570-579.
56. Friston, K. J. (2002). Functional integration and inference in the brain. Prog. Neurobiol. 68, 113-143.
57. Friston, K. J. (2003). Learning and inference in the brain. Neural. Netw. 16, 1325-1352.
58. Friston, K. J., and Kiebel, S. (2009). Predictive coding under the free-energy principle. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 211-1221.
59. Gläscher, J., Daw, N., Dayan, P., and O'Doherty, J. P. (2010). States versus rewards: dissociable neural prediction error signals underlying modelbased and model-free reinforcement learning. Neuron 66, 585-595.
60. Granger, R. (2006). Engines of the brain: the computational instruction set of human cognition. Artif. Intell. Mag. 27, 15-32.
61. Gray, J. A. (1982). The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo-hippocampal System. New York, NY: Clarendon Press/Oxford University Press.
62. Gray, J. A., and McNaughton, N. (2000). The Neuropsychology of Anxiety. Oxford: Oxford University Press.
63. Gross, J. J. (ed.). (2007). Handbook of Emotion Regulation. NewYork:The Guilford Press.
64. Hawkins, J. (2004). On Intelligence. New York: Henry Holt and Company.
65. Hesslow, G. (2002). Conscious thought as simulation of behaviour and perception. Trends Cogn. Sci. (Regul. Ed.) 6, 242-247.
66. James, W. (1884). What is an emotion? Mind 9, 188-205.
67. James, W. (1890). The Principles of Psychology. New York: Dover.
68. Jeannerod, M. (1994). The representing brain: neural correlates of motor intention and imagery. Behav. Brain Sci. 17, 187-245.
69. Kilner, J. M., Friston, K. J., and Frith, D. (2007). Predictive coding: an account of the mirror neuron system. Cogn. Process. 8, 159-166.
70. Koole, S. L. (2009). The psychology of emotion regulation: an integrative review. Cogn. Emot. 23, 4-41.
71. Kreibig, S. D., Gendolla, G. H., and Scherer, K. R. (2010). The psychophysiological effects of emotional responding to goal attainment. Biol. Psychol. 84, 474-487.
72. Krieglmeyer, R., Deutsch, R., De Houwer, J., and De Raedt, R. (2010). Being moved: valence activates approach-avoidance behavior independently of evaluation and approach-avoidance intentions. Psychol. Sci. 21, 607-613.
73. Krueger, J., Wirtz, D., and Miller, D. T. (2005). Counterfactual thinking and the first instinct fallacy. J. Pers. Soc. Psychol. 88, 725-735.
74. Kuhl, J. (2008). Einführung in die Persönlichkeitspsychologie: 4. Coping [Introduction into Personality Psychology: 4. Coping]. Osnabrück: Lecture at the University of Osnabrück.
75. Laird, J. D. (2007). Feelings: The Perception of Self. New York: Oxford University Press.
76. Lang, P. (1995). The emotion probe: studies of motivation and attention. Am. Psychol. 50, 372-385.
77. Lang, P. J., and Bradley, M. M. (2010). Emotion and the motivational brain. Biol. Psychol. 84, 437-450.
78. Lang, P. J., Bradley, M. M., and Cuthbert, M. M. (1997). "Motivated attention: affect, activation and action, "in Attention and Orienting: Sensory and Motivational Processes, eds P. J. Lang, R. F. Simons, and M. T. Balaban (Hillsdale, NJ: Lawrence Erlbaum Associates), 97-135.
79. Larsen, J. T., Berntson, G. G., Poehlmann, K, M., Ito, T. A., and Cacioppo, J. T. (2008). "The psychophysiology of emotion," in The Handbook of Emotion, eds M. Lewis and J. M. Haviland-Jones (New York: Guildford Press).
80. Lazarus, R. S. (1984). On the primacy of cognition. Am. Psychol. 39, 124-129.
81. Lazarus, R. S. (1991). Emotion and Adaptation. NewYork:OxfordUniversity Press.
82. LeDoux, J. E. (1996). The Emotional Brain. NewYork: Simon & Schuster. Levenson, R. W. (2003). "Autonomic specificity and emotion," in Handbook of Affective Sciences, eds R. J. Davidson, K. R. Scherer, and H. H. Goldsmith (New York: Oxford University Press), 212-224.
83. Levenson, R. W. (2011). Basic emotion questions. Emot. Rev. 3, 379-386.
84. Levenson, R. W., Carstensen, L. L., Friesen, W. V., and Ekman, P. (1992). Emotion, physiology and expression in old age. Psychol. Aging 6, 28-35.
85. Leventhal, H. (1980). "Toward a comprehensive theory of emotion," in Advances in Experimental Social Psychology, ed. L. Berkowitz (London: Academic Press), 149-207.
86. Lewis, M. (2005). Bridging emotion theory and neurobiology through dynamic systems modeling. Behav. Brain Sci. 28, 169-194.
87. Löw, A., Lang, P. J., Smith, J. C., and Bradley, M. M. (2008). Both predator and prey: emotional arousal in threat and reward. Psychol. Sci. 19, 865-873.
88. Lowe, R., Herrera, C., Morse, T., and Ziemke, T. (2007). "The embodied dynamics of emotion, appraisal and attention," in Attention in Cognitive Systems: Theories and Systems from an Interdisciplinary Viewpoint, eds L. Paletta, and E. Rome (Berlin: Springer), 1-20.
89. Lowe, R., Montebelli, A., Ieropoulos, I., Greenman, J., Melhuish, C., and Ziemke, T. (2010a). "Grounding motivation in energy autonomy: a study of artificial metabolism constrained robot dynamics, "in Artificial Life XII, eds H. Fellermann, M. Dörr, M. Hanczyc, L. Laursen, S. Maurer, D. Merkle, P.-A. Monnard, K. Sty, and S. Rasmussen (Odense: The MIT Press), 725-732.
90. Lowe, R., Duran, B., and Ziemke, T. (2010b). "A dynamic field theoretic model of iowa gambling task performance," in IEEE 9th International Conference on Development and Learning (ICDL), Michigan, 297-304.
91. Lowe, R., Philippe, P., Montebelli, A., Morse, A., and Ziemke, T. (2008). "Affective modulation of embodied dynamics," in The Role of Emotion in Adaptive Behaviour and Cognitive Robotics, Electronic Proceedings of SAB Workshop, Osaka.
92. Lowe, R., and Ziemke, T. (2010). Towards a cognitive robotics methodology for reward-based decision-making: dynamical systems modelling of the Iowa Gambling Task. Connect. Sci. 22, 247-289.
93. Luciw, M., Graziano, V., Ring, M., and Schmidhuber, J. (2011). "Artificial curiosity with planning for autonomous perceptual and cognitive development," in IEEE 10th International Conference on Development and Learning (ICDL), Frankfurt.
94. Mauss, I. B., and Robinson, M. D. (2009). Measures of emotion: a review. Cogn. Emot. 23, 209-237.
95. McFarland, D. (2008). Guilty Robots, Happy Dogs. New York: Oxford University Press.
96. McFarland, D., and Bösser, T. (1993). Intelligent Behavior in Animals and Robots. The MIT Press.
97. McFarland, D., and Spier, E. (1997). Basic cycles, utility and opportunism in self-sufficient robots. Rob. Auton. Syst. 20, 179-190.
98. McNaughton, N., and Gray, J. A. (2000). Anxiolytic action on the behavioural inhibition system implies multiple types of arousal contribute to anxiety. J. Affect. Disord. 61, 1161-1161.
99. Mehrabian, A. (1996). Pleasurearousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr. Psychol. 14, 261-292.
100. Mehrabian, A. (1997). Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression. J. Psychopathol. Behav. Assess. 19, 331-357.
101. Mellers, B., Schwartz, A., and Ritov, I. (1999). Emotion-based choice. J. Exp. Psychol. Gen. 128, 332-345.
102. Mountcastle, V. B. (1978). "An organizing principle for cerebral function: the unit model and the distributed system," in The Mindful Brain, G. M. Edelman and V. B. Mountcastle (Cambridge, MA: The MIT Press), 7-50.
103. Mountcastle, V. B. (1998). Perceptual Neuroscience: The Cerebral Cortex. Cambridge, MA: Harvard University Press.
104. Niv, Y. (2009). Reinforcement learning in the brain. J. Math. Psychol. 53, 139-154.
105. Norris, C. J., Gollan, J., Berntson, G. G., and Cacioppo, J. T. (2010). The current status of research on the structure of evaluative space. Biol. Psychol. 84, 422-436.
106. Oatley, K., and Johnson-Laird, P. N. (1987). Towards a cognitive theory of emotions. Cogn. Emot. 1, 29-50.
107. Oatley, K., Keltner, D., and Jenkins, J. M. (2006). Understanding Emotions, 2nd Edn. Oxford: Blackwell Publishing.
108. Osgood, C. E., Suci, G. J., and Tannenbaum, P. H. (1957). The Measurement of Meaning. Urbana, IL: University of Illinois Press.
109. Oudeyer, P., and Kaplan, K. (2007). What is intrinsic motivation? a typology of computational approaches. Front. Neurorobot. 1:6. doi:10.3389/neuro.12.006.2007.
110. Panksepp, J. (1998). Affective Neuroscience. Oxford: Oxford University Press.
111. Panksepp, J. (2000). "The neurodynamics of emotions: an evolutionary neurodevelopmental view," in Emotion, Development, and Selforganization: Dynamic Systems Approaches to Emotional Development, eds M. D. Lewis and I. Granic (New York: Cambridge University Press), 236-264.
112. Panksepp, J. (2007). Emotional feelings originate below the neocortex: toward a neurobiology of the soul. Behav. Brain Sci. 30, 101-103.
113. Pessoa, L. (2008). On the relationship between emotion and cognition. Nat. Rev. Neurosci. 9, 148-158.
114. Pessoa, L. (2010). Emotion and cognition and the amygdala: from "what is it?" to "what's to be done?" Neuropsychologia 48, 3416-3429.
115. Prinz, J. J. (2004). Gut Reactions: A Perceptual Theory of Emotion. NewYork: Oxford University Press.
116. Prinz, J. J. (2005). Are emotions feelings? J. Conscious. Stud. 12, 9-25.
117. Prinz, W. (2007). Perception and action planning. Eur. J. Cogn. Psychol. 9, 129-154.
118. Quirk, G. J. (2007). "Prefrontalamygdala interactions in the regulation of fear," in Handbook of Emotion Regulation, ed. J. J. Gross (New York: The Guilford Press), 27-46.
119. Rescorla, R. A., and Wagner, A. R. (1972). "A theory of pavlovianconditioning: variations in the effectiveness of reinforcement and nonreinforcement," in Classical Conditioning II: Current Research and Theory, eds A. H. Black and W. F. Prokasy (New York: AppletonCentury-Crofts).
120. Rodriguez, A., Whitson, J., and Granger, R. (2004). Derivation and analysis of basic computational operations of thalamocortical circuits. J. Cogn. Neurosci. 16, 856-877.
121. Roesch, M. R., Calu, D. J., and Schoenbaum, G. (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10, 1615-1624.
122. Rolls, E. T. (1986). "A theory of emotion and its application to understanding the neural basis of emotion," in Emotions. Neural and Chemical Control, ed. Y. Oomura (Tokyo: Japan Scientific Societies Press), 325-344.
123. Rolls, E. T. (1999). The Brain and Emotion. Oxford: Oxford University Press.
124. Rolls, E. T. (2000). Précis of the brain and emotion. Behav. Brain Sci. 23, 177-234.
125. Rolls, E. T. (2005). Emotion Explained. Oxford: Oxford University Press.
126. Russell, J. A. (1980). A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161-1178.
127. Russell, J. A. (2003). Core affect and the psychological construction of emotion. Psychol. Rev. 110, 145-172.
128. Russell, J. A., and Mehrabian, A. (1977). Evidence for a three-factor theory of emotions. J. Res. Pers. 11, 273-294.
129. Samson, R. D., Frank, M. J., and Fellous, J.-M. (2010). Computational models of reinforcement learning: the role of dopamine as a reward signal. Cogn. Neurodyn. 4, 91-105.
130. Sandamirskaya, Y., Richter, M., and Schöner, G. (2011). "A neuraldynamic architecture for behavioural organization of an embodied agent," in IEEE 10th International Conference on Development and Learning (ICDL), Frankfurt.
131. Schachter, S., and Singer, J. E. (1962). Cognitive, social and physiological determinants of emotional state. Psychol. Rev. 69, 379-399.
132. Schauer, M., and Elbert, T. (2010). Dissociation following traumatic stress: etiology and treatment. J. Psychol. 218, 109-127.
133. Scherer, K. R. (1984). "On the nature and function of emotion: a component process approach," in Approaches to Emotion, eds K. R. Scherer and P. Ekman (Hillsdale, NJ: Erlbaum), 293-317.
134. Scherer, K. R. (2000). "Emotions as episodes of subsystem synchronization driven by non-linear appraisal processes, "in Emotion, Development, and Self-organization, eds M. D. Lewis and I. Granic (Cambridge: Cambridge University Press), 70-99.
135. Scherer, K. R. (2004). "Feelings integrate the central representation of appraisal-driven response organization in emotion," in Feelings and Emotions, eds A. S. R. Manstead, N. H. Frijda, and A. Fischer (Cambridge:Cambridge University Press), 136-157.
136. Scherer, K. R. (2009). Emotions are emergent processes: they require a dynamic computational architecture. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 3459-3474.
137. Schmidhuber, J. (1991). "Curious model-building control systems," in Proceedings of the International Joint Conference on Neural Networks, Singapore, Vol. 2, 1458-1463.
138. Schmidhuber, J. (2010). Formal theory of creativity, fun, and intrinsic motivation (1990-2010). IEEE Trans. Auton. Ment. Dev. 2, 230-247.
139. Schöner, G. (2008). "Dynamical systems approaches to cognition," in The Cambridge Handbook of Computational Psychology, ed. R. Sun (New York: Cambridge University Press), 101-125.
140. Schulkin, J. (2003). Rethinking Homeostasis: Allostatic Regulation in Physiology and Pathophysiology. Cambridge MA: MIT Press.
141. Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1-27.
142. Schultz, W. (2007). Multiple dopamine functions at different time courses. Annu.Rev.Neurosci.30, 259-288.
143. Seymour, B., O'Doherty, J. P., Dayan, P., Koltzenberg, M., Jones, A. K., Dolan, R. J., Friston, K. J., and Frackowlak, R. S. (2004). Temporal difference models describe higher-order learning in humans. Nature 429, 664-667.
144. Sherman, S., and Guillery, R. (2006). Exploring the Thalamus and its Role in Cortical Function. Cambridge, MA: The MIT Press.
145. Simon, H. A. (1967). Motivational and emotional controls of cognition. Psychol. Rev. 74, 29-39.
146. Sinha, R., Lovallo, W. R., and Parsons, O. A. (1992). Cardiovascular differentiation of emotions. Psychosom. Med. 54, 422-435.
147. Stemmler, G., Aue, T., and Wacker, J. (2007). Anger and fear: separable effects of emotion and motivational direction on somatovisceral responses. Int. J. Psychophysiol. 66, 141-153.
148. Stephens, C., Christie, I. C., and Friedman, B. H. (2010). Autonomic specificity of basic emotions: evidence from pattern classification analysis and cluster analysis. Biol. Psychol. 84, 463-473.
149. Sterling, P. (2004). "Principles of allostasis: optimal design, predictive regulation, pathophysiology and rational therapeutics," in Allostasis, Homeostasis, and the Costs of Adaptation, ed. J. Schulin (Cambridge: Cambridge University Press).
150. Suri, R. E. (2002). TD models of reward predictive responses in dopamine neurons. Neural Netw. 15, 523-533.
151. Suri, R. E., and Schultz, W. (1998). Dopamine-like reinforcement signal improves learning of sequential movements by neural network. Exp. Brain Res. 121, 350-354.
152. Sutton, R. S., and Barto, A. G. (1990). "Time-derivative models of Pavlovian reinforcement," in Learning and Computational Neuroscience: Foundation of Adaptive Networks, eds M. Gabriel and J. Moore (Cambridge, MA: MIT Press), 497-537.
153. Sutton, R. S., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: The MIT Press.
154. Thelen, E., Schöner, G., Scheier, C., and Smith, L. (2001). The dynamics of embodiment: a dynamic field theory of infant perseverative reaching. Behav. Brain Sci. 24, 1-86.
155. Toda, M. (1982). Man, Robot and Society. The Hague: Nijhoff.
156. Tomkins, S. S. (1962). Affect, Imagery, Consciousness. The Positive Affects, 1. New York, NY: Springer.
157. Tooby, J., and Cosmides, L. (2008). The evolutionary psychology of the emotions and their relationship to internal regulatory variables," in Handbook of Emotions, eds M. Lewis, J. M. Haviland-Jones, and L. F. Barrett (New York: Guilford), 114-137.
158. Van Hoof, J. A. R. A. M. (1972). "A structural analysis of the social behaviour of a semi-captive group of chimpanzees," in Social Communication and Movement, eds M. van Cranach and J. Vine (New York: Academic Press), 75-162.
159. Waldstein, S. R., Bachen, E. A., and Manuck, S. B. (1997). Active coping and cardiovascular reactivity: a multiplicity of influences. Psychosom. Med. 59, 620-625.
160. Watson, D., Wiese, D., Vaidya, J., and Tellegen, A. (1999). The two general activation systems of affect: structural findings, evolutionary considerations, and psychobiological evidence. J. Pers. Soc. Psychol. 76, 820-838.
161. Woods, S. C., and Ramsay, D. S. (2007). Homeostasis: beyond Curt Richter. Appetite 49, 388-398.
162. Wörgötter, F., and Porr, B. (2005). Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural. Comput. 17, 245-319.
163. Zajonc, R. B. (1980). Feeling and thinking: preferences need no inferences. Am. Psychol. 35, 151-175.
164. Zajonc, R. B. (1984). On the primacy of affect. Am. Psychol. 39, 117-123.
165. Ziemke, T. (2008). On the role of emotion in biological and robotic autonomy. Biosystems 91, 401-408.
166. Ziemke, T., and Lowe, R. (2009). On the role of emotion in embodied cognitive architectures: from organisms to robots. Cognit. Comput. 1, 104-117.