Bayesian analysis of interleaved learning and response bias in behavioral experiments

Journal of Neurophysiology

Volumn 97, Issue 3, 2007, Pages 2516-2524

  Smith, Anne C ^a   Wirth, Sylvia ^b   Suzuki, Wendy A ^c   Brown, Emery N ^d,e  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b INSTITUT DES SCIENCES COGNITIVES   (France)

^c NEW YORK UNIVERSITY   (United States)

^d MASSACHUSETTS GENERAL HOSPITAL   (United States)

^e MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; BAYES THEOREM; BEHAVIORAL SCIENCE; COMPUTER PROGRAM; CONDITIONING; DENSITY; EMPIRICISM; EXPERIMENTAL STUDY; INTERMETHOD COMPARISON; LEARNING; MAZE TEST; MONTE CARLO METHOD; PRIORITY JOURNAL; PROBABILITY; STATISTICAL MODEL; STIMULUS RESPONSE; TASK PERFORMANCE;

BAYES THEOREM; BIAS (EPIDEMIOLOGY); COMPUTER SIMULATION; HUMANS; LEARNING; MODELS, BIOLOGICAL; MONTE CARLO METHOD;

EID: 33947169864     PISSN: 00223077     EISSN: 15221598     Source Type: Journal    
DOI: 10.1152/jn.00946.2006     Document Type: Article

References (39)

1. Barnes TD, Kubota Y, Hu D, Jin DZZ, Graybiel AM. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437: 1158-1161, 2005.
2. Busemeyer JR, Townsend JT. Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. Psychol Rev 101: 446-469, 1993.
3. Congdon P. Applied Bayesian Modeling. Chichester, UK: Wiley, 2003.
4. Dayan P, Kakade S, Montague PR. Learning and selective attention. Nat Neurosci 3: 1218-1223, 2000.
5. Ditterich J. Stochastic models of decisions about motion direction: behavior and physiology. Neural Netw 19: 981-1012, 2006.
6. Durbin J, Koopman SJ. Time Series Analysis by State-Space Methods. Oxford, UK: Oxford Univ. Press, 2001.
7. Estes WK. (Editor). Handbook of Learning and Cognitive Processes. New York: Wiley/Halsted Press, 1978.
8. Gallistel CR, Fairhurst S, Balsam P. The learning curve: implications of a quantitative analysis. Proc Natl Acad Sci USA 101: 12124-13131, 2004.
9. Gelman A, Rubin DB. Inference from iterative simulation using multiple sequences [with discussion]. Stat Sci 7: 457-511, 1992.
10. Gilks WR, Richardson S, Spiegelhalter DJ. Monte Carlo Markov Chain in Practice. New York: Chapman & Hall/CRC, 1996.
11. Jog MS, Kubota Y, Connolly CI, Hillegaart V, Graybiel AM. Building neural representations of habits. Science 286: 1745-1749, 1999.
12. Kakade S, Dayan P. Acquisition and extinction in autoshaping. Psychol Rev 109: 533-544, 2002.
13. Kass RE, Carlin BP, Gelman A, Neal RM. Markov Chain Monte Carlo in practice: a roundtable discussion. Am Stat 52: 93-100, 1998.
14. Kitagawa G, Gersh W. Smoothness Priors Analysis of Time Series. New York: Springer-Verlag, 1996.
15. Law JR, Flanery MA, Wirth S, Yanike M, Suzuki WA, Smith AC, Frank LM, Brown EN, Stark CEL. fMRI activity during the gradual acquisition and expression of paired-associate memory. J Neurosci 25: 5720-5729, 2005.
16. Luce RD, Bush RR, Galanter E. (Editors). Handbook of Mathematical Psychology. New York: Wiley, 1965.
17. Lunn DJ, Thomas A, Best N, Spiegelhalter D. WinBUGS - a Bayesian modeling framework: concepts, structure, and extensibility. Stat Comput 10: 325-337, 2000.
18. Murphy K, Mahdaviani M. MATBUGS software. http://www.cs.ubc.ca/ ~murphyk/Software/MATBUGS/matbugs.html, 2005.
19. Paton JJ, Belova MA, Morrison SE, Salzman CD. The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439: 865-870, 2006.
20. Ratcliff R, Rouder JN. A diffusion model account of masking in two-choice letter identification. J Exp Psychol Hum Percept Behav 26: 127-140, 2000.
21. Smith AC, Brown EN. Estimating a state-space model from point process observations. Neural Comput 15: 965-991, 2003.
22. Smith AC, Frank LM, Wirth S, Yanike M, Hu D, Kubota Y, Graybiel AM, Suzuki WE, Brown EN. Dynamic analysis of learning in behavioral experiments. J Neurosci 24: 447-461, 2004.
23. Smith AC, Stefani MR, Moghaddam B, Brown EN. Analysis and design of behavioral experiments to characterize population learning. J Neurophysiol 93: 1776-1792, 2005.
24. Smith PL. Psychophysically principled models of visual simple reaction time. Psychol Rev 102: 567-593, 1995.
25. Spiegelhalter DJ, Thomas A, Best N, Lunn D. WinBUGS v. 1.4.1. Imperial College and Medical Research Council (MRC), United Kingdom. http://www.mrc-bsu.cam.ac.uk/bugs/ [latest update], 2004.
26. Stefani MR, Moghaddam B. Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum. J Neurosci 23: 1-9, 2006.
27. Suppes P. A linear model for a continuum of responses. In: Studies in Mathematical Learning Theory, edited by Bush RR, Estes WK. Stanford, CA: Stanford Univ. Press, 1959, p. 400-414.
28. Suppes P. On deriving models in the social sciences. Math Comput Model 14: 21-28, 1990.
29. Suzuki WA, Brown EN. Behavioral and neurophysiological analysis of dynamic learning processes. Behav Cogn Neurosci Rev 4: 67-95, 2005.
30. Usher M, McClelland JL. The time course of perceptual choice: the leaky, competing accumulator model. Psychol Rev 108: 550-592, 2001.
31. Usher M, McClelland JL. Loss aversion and inhibition in dynamical models of multialternative choice. Psychol Rev 111: 757-769, 2004.
32. Verguts T, De Boeck P. A Rasch model for detecting learning while solving an intelligence test. Appl Psychol Measure 24: 151-162, 2000.
33. Verhelst ND, Glas CAW. A dynamic generalization of the Rasch model. Psychometrika 58: 395-415, 1995.
34. Williams ZM, Eskandar EN. Selective enhancement of associative learning by microstimulation of the anterior caudate. Nat Neurosci 9: 562-568, 2006.
35. Wirth S, Chiu C, Sharma VS, Avsar E, Smith AC, Scalon J, Brown EN, Suzuki WA. Analysis of hippocampal signals during learning of selective object-place associations. Program No. 776.1. Abstract Viewer/Itinerary Planner. Washington, DC: Society for Neuroscience, 2005, Online.
36. Wirth S, Yanike M, Frank LM, Smith AC, Brown EN, Suzuki WA. Single neurons in the monkey hippocampus and learning of new associations. Science 300: 1578-1584, 2003.
37. Wolbers T, Büchel C. Dissociable retrosplenial and hippocampal contributions to successful formation of survey representations. J Neurosci 25: 3333-3340, 2005.
38. Yoshida W, Ishii S. Resolution of uncertainty in prefrontal cortex. Neuron 50: 781-789, 2006.
39. Yu A, Dayan P. Expected and unexpected uncertainty: ACH and NE in the neocortex. In: Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, vol. 15, 2003.