Inferring on the Intentions of Others by Hierarchical Bayesian Learning

PLoS Computational Biology

Volumn 10, Issue 9, 2014, Pages

  Diaconescu, Andreea O ^a   Mathys, Christoph ^a,b   Weber, Lilian A E ^a   Daunizeau, Jean ^b,c   Kasper, Lars ^a   Lomakina, Ekaterina I ^a,d   Fehr, Ernst ^a   Stephan, Klaas E ^a,b  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

^d ETH ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; DECISION MAKING;

BAYESIAN LEARNING; BEHAVIORAL DATA; COMPUTATIONAL MODELLING; HIERARCHICAL BAYESIAN; LEARNING TASKS; PIE CHART; PROBABILISTICS; REINFORCEMENT LEARNINGS; SOCIAL TRANSACTIONS; TIME VARYING;

REINFORCEMENT LEARNING;

ACCESS TO INFORMATION; ADULT; ARTICLE; BAYESIAN LEARNING; COGNITION; COOPERATION; DECISION MAKING; ECONOMIC ASPECT; GAME; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; INTENTION INFERENCE; MALE; MATHEMATICAL MODEL; MENTAL TASK; NORMAL HUMAN; PROCESS OPTIMIZATION; REINFORCEMENT; SELF REPORT; SOCIAL ADAPTATION; SOCIAL BEHAVIOR; SOCIAL INTERACTION; SOCIAL LEARNING; VOLUNTEER; BAYES THEOREM; BEHAVIOR; LEARNING; MOTIVATION; PSYCHOLOGICAL MODEL; YOUNG ADULT;

ADULT; BAYES THEOREM; DECISION MAKING; GAMES, EXPERIMENTAL; HUMANS; INTENTION; LEARNING; MALE; MODELS, PSYCHOLOGICAL; MOTIVATION; SOCIAL BEHAVIOR; YOUNG ADULT;

EID: 84907587191     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1003810     Document Type: Article

References (62)

1. King-Casas B, Tomlin D, Anen C, Camerer CF, Quartz SR, et al. (2005) Getting to Know You: Reputation and Trust in a Two-Person Economic Exchange. Science 308: 78–83.
2. Yoshida W, Dolan RJ, Friston KJ, (2008) Game Theory of Mind. PLoS Computational Biology 4: e1000254.
3. Amodio DM, Frith CD, (2006) Meeting of minds: the medial frontal cortex and social cognition. Nature Reviews Neuroscience 7: 268–277.
4. Frith CD, Frith U, (2006) The Neural Basis of Mentalizing. Neuron 50: 531–534.
5. Keysers C, Gazzola V, (2007) Integrating simulation and theory of mind: from self to social cognition. Trends in Cognitive Sciences 11: 194–196.
6. Canessa N, Alemanno F, Riva F, Zani A, Proverbio AM, et al. (2012) The neural bases of social intention understanding: the role of interaction goals. PLoS ONE 7: e42347.
7. Ciaramidaro A, Adenzato M, Enrici I, Erk S, Pia L, et al. (2007) The intentional network: how the brain reads varieties of intentions. Neuropsychologia 45: 3105–3113.
8. Van Overwalle F, Baetens K, (2009) Understanding others' actions and goals by mirror and mentalizing systems: a meta-analysis. Neuroimage 48: 564–584.
9. Baker CL, Saxe RR, Tenenbaum JB (2011) Bayesian theory of mind: Modeling joint belief-desire attribution. Proceedings of the thirty-second annual conference of the cognitive science society. pp. 2469–2474.
10. Goodman ND, Baker CL, Tenenbaum JB (2009) Cause and intent: Social reasoning in causal learning. Proceedings of the Thirty-First Annual Conference of the Cognitive Science Society. pp. 2759–2764.
11. Ullman TD, Baker CL, Macindoe O, Evans O, Goodman ND, et al. (2009) Help or Hinder: Bayesian Models of Social Goal Inference. NIPS. pp. 1874–1882.
12. Devaine M, Hollard G, Daunizeau J, (2014) Theory of Mind: Did Evolution Fool Us? PLoS ONE 9: e87619.
13. Xiang T, Ray D, Lohrenz T, Dayan P, Montague PR, (2012) Computational phenotyping of two-person interactions reveals differential neural response to depth-of-thought. PLoS Comput Biol 8: e1002841.
14. Behrens TEJ, Hunt LT, Woolrich MW, Rushworth MFS, (2008) Associative learning of social value. Nature 456: 245–U45.
15. Daunizeau J, den Ouden HEM, Pessiglione M, Kiebel SJ, Stephan KE, et al. (2010) Observing the Observer (I): Meta-Bayesian Models of Learning and Decision-Making. PLoS One 5: e15554.
16. Daunizeau J, den Ouden HEM, Pessiglione M, Kiebel SJ, Friston KJ, et al. (2010) Observing the Observer (II): Deciding When to Decide. PLoS One 5: e15555.
17. Huszár F, Noppeney U, Lengyel M (2010) Mind reading by machine learning: a doubly Bayesian method for inferring mental representations. Proceedings of the Thirty-Second Annual Conference of the Cognitive Science Society. pp. 2810–2815.
18. Lee MD, (2011) In praise of Ecumenical Bayes. Behavioral and Brain Sciences 34: 206–207.
19. Buchan NR, Croson RTA, Solnick S, (2008) Trust and gender: An examination of behavior and beliefs in the Investment Game. Journal of Economic Behavior & Organization 68: 466–476.
20. Cloninger CR, Svrakic DM, Przybeck TR, (1993) A psychobiological model of temperament and character. Archives of general psychiatry 50: 975–990.
21. Davis MH, (1983) Measuring individual differences in empathy: Evidence for a multidimensional approach. Journal of Personality and Social Psychology 44: 113–126.
22. Mathys C, Daunizeau J, Friston KJ, Stephan KE, (2011) A Bayesian foundation for individual learning under uncertainty. Front Hum Neurosci 5: 1–20.
23. Rescorla RA, Wagner AR (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement. New York: Appleton-Century-Crofts.
24. Vossel S, Mathys C, Daunizeau J, Bauer M, Driver J, et al. (2014) Spatial Attention, Precision, and Bayesian Inference: A Study of Saccadic Response Speed. Cereb Cortex 24: 1436–1450.
25. Iglesias S, Mathys C, Brodersen KH, Kasper L, Piccirelli M, et al. (2013) Hierarchical Prediction Errors in Midbrain and Basal Forebrain during Sensory Learning. Neuron 80: 519–530.
26. Doya K, Ishii S, Pouget A, Rao RPN (2011) Bayesian brain: probabilistic approaches to neural coding. Cambridge, Mass.: MIT Press.
27. Friston K, (2010) The free-energy principle: a unified brain theory? Nat Rev Neurosci 11: 127–138.
28. Griffiths TL, Kemp C, Tenenbaum JB (2008) Bayesian models of cognition. Cambridge handbook of computational cognitive modeling: 59–100.
29. Körding K, (2007) Decision Theory: What “Should” the Nervous System Do? Science 318: 606–610.
30. Tenenbaum JB, Kemp C, Griffiths TL, Goodman ND, (2011) How to Grow a Mind: Statistics, Structure, and Abstraction. Science 331: 1279–1285.
31. Montague PR, Hyman SE, Cohen JD, (2004) Computational roles for dopamine in behavioural control. Nature 431: 760–767.
32. Preuschoff K, Bossaerts P, (2007) Adding Prediction Risk to the Theory of Reward Learning. Annals of the New York Academy of Sciences 1104: 135–146.
33. Broyden CG, (1970) The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations. IMA J Appl Math 6: 76–90.
34. Fletcher R, (1970) A new approach to variable metric algorithms. The Computer Journal 13: 317–322.
35. Goldfarb D, (1970) A family of variable metric methods derived by variational means. Mathematics of computation 24: 23–26.
36. Shanno DF, (1970) Conditioning of quasi-Newton methods for function minimization. Mathematics of computation 24: 647–656.
37. Osborne MA, Garnett R, Roberts SJ (2009) Gaussian processes for global optimization. 3rd international conference on learning and intelligent optimization (LION3). pp. 1–15.
38. Hastings WK, (1970) Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57: 97–109.
39. Penny WD, Stephan KE, Daunizeau J, Rosa MJ, Friston KJ, et al. (2010) Comparing families of dynamic causal models. PLoS computational biology 6: e1000709.
40. MacKay DJ (2003) Information theory, inference and learning algorithms. Cambridge university press.
41. Stephan KE, Penny WD, Daunizeau J, Moran RJ, Friston KJ, (2009) Bayesian model selection for group studies. NeuroImage 46: 1004–1017.
42. Behrens TEJ, Hunt LT, Rushworth MFS, (2009) The Computation of Social Behavior. Science 324: 1160–1164.
43. Yoshida W, Seymour B, Friston KJ, Dolan RJ, (2010a) Neural Mechanisms of Belief Inference during Cooperative Games. J Neurosci 30: 10744–10751.
44. Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS, (2007) Learning the value of information in an uncertain world. Nat Neurosci 10: 1214–1221.
45. Hertwig R, Hoffrage U, Group AR (2012) Simple Heuristics in a Social World. Oxford University Press. 662 p.
46. Biele G, Rieskamp J, Krugel LK, Heekeren HR, (2011) The Neural Basis of Following Advice. Plos Biology 9: e1001089.
47. Charness G, Karni E, Levin D, (2013) Ambiguity attitudes and social interactions: An experimental investigation. J Risk Uncertain 46: 1–25.
48. Chow CC, Sarin RK, (2002) Known, Unknown, and Unknowable Uncertainties. Theory and Decision 52: 127–138.
49. Ellsberg D, (1961) Risk, Ambiguity, and the Savage Axioms. The Quarterly Journal of Economics 75: 643–669.
50. Soll JB, Larrick RP, (2009) Strategies for revising judgment: How (and how well) people use others' opinions. Journal of Experimental Psychology: Learning, Memory, and Cognition 35: 780–805.
51. Collins EC, Percy EJ, Smith ER, Kruschke JK, (2011) Integrating advice and experience: Learning and decision making with social and nonsocial cues. Journal of Personality and Social Psychology 100: 967–982.
52. Van Overwalle F, Heylighen F, (2006) Talking nets: A multiagent connectionist approach to communication and trust between individuals. Psychological Review 113: 606–627.
53. Lee MD, Dry MJ, (2006) Decision Making and Confidence Given Uncertain Advice. Cognitive Science 30: 1081–1095.
54. Kishida KT, Montague PR, (2012) Imaging Models of Valuation During Social Interaction in Humans. Biological Psychiatry 72: 93–100.
55. Bentall RP, Corcoran R, Howard R, Blackwood N, Kinderman P, (2001) Persecutory delusions: A review and theoretical integration. Clinical Psychology Review 21: 1143–1192.
56. Fett AK, Shergill SS, Joyce DW, Riedl A, Strobel M, et al. (2012) To trust or not to trust: the dynamics of social interaction in psychosis. Brain 135: 976–984.
57. Langdon R, Corner T, McLaren J, Ward PB, Coltheart M, (2006) Externalizing and personalizing biases in persecutory delusions: The relationship with poor insight and theory-of-mind. Behaviour Research and Therapy 44: 699–713.
58. King-Casas B, Sharp C, Lomax-Bream L, Lohrenz T, Fonagy P, et al. (2008) The Rupture and Repair of Cooperation in Borderline Personality Disorder. Science 321: 806–810.
59. Montague PR, Dolan RJ, Friston KJ, Dayan P, (2012) Computational psychiatry. Trends in Cognitive Sciences 16: 72–80.
60. Yoshida W, Dziobek I, Kliemann D, Heekeren HR, Friston KJ, et al. (2010b) Cooperation and heterogeneity of the autistic mind. The Journal of neuroscience 30: 8815–8818.
61. Stephan KE, Mathys CD, (2014) Computational Approaches to Psychiatry. Current Opinion in Neurobiology 25: 85–92.
62. Kass RE, Raftery AE, (1995) Bayes Factors. Journal of the American Statistical Association 90: 773–795.