Bayesian action & perception: Representing the world in the brain

Frontiers in Neuroscience

Volumn 8, Issue OCT, 2014, Pages

  Loeb, Gerald E ^a,b   Fishel, Jeremy A ^a  

^a SynTouch LLC   (United States)

^b Department of Biomedical Engineering University of Southern California ^*  (United States)

Author keywords

Affordance; Bayesian exploration; Perception; Somatosensory; Tactile sensing; Touch

Indexed keywords

ARTICLE; ASSOCIATIVE MEMORY; BAYES THEOREM; BAYESIAN EXPLORATION; BIOMIMETICS; CONNECTOME; DECISION MAKING; EXPLORATORY BEHAVIOR; HUMAN; MIRROR NEURON; NEUROSCIENCE; PERCEPTION; ROBOTICS; VISUAL INFORMATION;

EID: 84910058726     PISSN: 16624548     EISSN: 1662453X     Source Type: Journal    
DOI: 10.3389/fnins.2014.00341     Document Type: Article

References (108)

1. Ackerley, R., Hassan, E., Curran, A., Wessberg, J., Olausson, H., and McGlone, F. (2012). An fMRI study on cortical responses during active self-touch and passive touch from others. Front Behav Neurosci 6:51. doi: 10.3389/fnbeh.2012.00051
2. Adams, R. A., Shipp, S., and Friston, K. J. (2013). Predictions not commands: active inference in the motor system. Brain Structure and Function 218, 611-643. doi: 10.1007/s00429-012-0475-5
3. Alessandro, C., Carbajal, J. P., and d'Avella, A. (2013). A computational analysis of motor synergies by dynamic response decomposition. Front Computat Neurosci 7:191. doi: 10.3389/fncom.2013.00191
4. Amador, A., Perl, Y. S., Mindlin, G. B., and Margoliash, D. (2013). Elemental gesture dynamics are encoded by song premotor cortical neurons. Nature 495, 59-64. doi: 10.1038/nature11967
5. Avraham, G., Nisky, I., Fernandes, H. L., Acuna, D. E., Kording, K. P., Loeb, G. E., et al. (2012). Toward perceiving robots as humans: three handshake models face the turing-like handshake test. IEEE Trans. Haptics 5, 196-207. doi: 10.1109/TOH.2012.16
6. Bajcsy, R. (1988). Active perception. Proc. IEEE 76, 966-1005. doi: 10.1109/5.5968
7. Bayes, M., and Price, M. (1763). An essay towards solving a problem in the doctrine of chances. By the Late Rev. Mr. Bayes, F. R. S. Communicated by Mr. Price, in a Letter to John Canton, A. M. F. R. S. Philos. Trans. (1683-1775) 53, 370-418. doi: 10.1098/rstl.1763.0053
8. Beck, J. M., Ma, W. J., Kiani, R., Hanks, T., Churchland, A. K., Roitman, J., et al. (2008). Probabilistic population codes for bayesian decision making. Neuron 60, 1142-1152. doi: 10.1016/j.neuron.2008.09.021
9. Bitzer, S., Park, H., Blankenburg, F., and Kiebel, S. J. (2014). Perceptual decision making: drift-diffusion model is equivalent to a Bayesian model. Front. Hum. Neurosci. 8:102. doi: 10.3389/fnhum.2014.00102
10. Bonaiuto, J., and Arbib, M. A. (2010). Extending the mirror neuron system model, II: what did I just do? A new role for mirror neurons. Biol. Cybern. 102, 341-359. doi: 10.1007/s00422-010-0371-0
11. Bornstein, A. M., and Daw, N. D. (2011). Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Curr. Opin. Neurobiol. 21, 374-380. doi: 10.1016/j.conb.2011.02.009
12. Browatzki, B., Tikhanoff, V., Metta, G., Bulthoff, H., and Wallraven, C. (2012). "Active object recognition on a humanoid robot," in 2012 IEEE International Conference on Robotics and Automation (ICRA) (St. Paul, MN: IEEE), 2021-2028.
13. Casile, A. (2013). Mirror neurons (and beyond) in the macaque brain: an overview of 20 years of research. Neurosci. Lett. 540, 3-14. doi: 10.1016/j.neulet.2012.11.003
14. Chapman, C. E. (1994). Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. Can. J. Physiol. Pharmacol. 72, 558-570. doi: 10.1139/y94-080
15. Chapman, R. M., and Bragdon, H. R. (1964). Evoked responses to numerical and non-numerical visual stimuli while problem solving. Nature 203, 1155-1157.
16. Churchland, M. M., Afshar, A., and Shenoy, K. V. (2006). A central source of movement variability. Neuron 52, 1085-1096. doi: 10.1016/j.neuron.2006.10.034
17. Churchland, M. M., Cunningham, J. P., Kaufman, M. T., Ryu, S. I., and Shenoy, K. V. (2010). Cortical preparatory activity: representation of movement or first cog in a dynamical machine? Neuron 68, 387-400. doi: 10.1016/j.neuron.2010.09.015
18. Churchland, M. M., and Shenoy, K. V. (2007). Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. J. Neurophysiol. 97, 4235-4257. doi: 10.1152/jn.00095.2007
19. Cisek, P. (2007). Cortical mechanisms of action selection: the affordance competition hypothesis. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362, 1585-1599. doi: 10.1098/rstb.2007.2054
20. Cisek, P., and Kalaska, J. F. (2004). Neural correlates of mental rehearsal in dorsal premotor cortex. Nature 431, 993-996. doi: 10.1038/nature03005
21. Cohn, D. A., Ghahramani, Z., and Jordan, M. I. (1996). Active learning with statistical models. J. Artif. Intell. Res. 4, 129-145.
22. Crick, F. (1984). Function of the thalamic reticular complex: the searchlight hypothesis. Proc. Natl. Acad. Sci. U.S.A. 81, 4586-4590. doi: 10.1073/pnas.81.14.4586
23. Dallaire, P., Giguère, P., Émond, D., and Chaib-Draa, B. (2014). Autonomous tactile perception: a combined improved sensing and Bayesian nonparametric approach. Rob. Auton. Syst. 62, 422-435. doi: 10.1016/j.robot.2013.11.011
24. de Boissieu, F., Godin, C., Guilhamat, B., David, D., Serviere, C., and Baudois, D. (2009). "Tactile texture recognition with a 3-axial force MEMS integrated artificial finger," in Robotics: Science and Systems (Seattle, WA), 49-56.
25. Denzler, F., Derichs, C., Niemann, H., and Denzler, J. (2009). A framework for actively selecting viewpoints in object recognition. Int. J. Pattern Recogn. Artif. Intell. 23, 765-799. doi: 10.1142/S0218001409007351
26. di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., and Rizzolatti, G. (1992). Understanding motor events: a neurophysiological study. Exp. Brain Res. 91, 176-180. doi: 10.1007/BF00230027
27. Deutsch, D. (2012). Creative Blocks: The Very Laws of Physics Imply that Artificial Intelligence Must be Possible. What's Holding Us Up? Aeon. Available online at: http://aeon.co/magazine/technology/david-deutsch-artificial-intelligence/
28. Diamond, I. T. (1979). The subdivisions of neocortex: a proposal to revise the traditional view of sensory, motor, and association areas. Prog. Psychobiol. Physiol. Psychol. 8, 1-43.
29. Doya, K., and Kimura, M. (2009). "The basal ganglia and the encoding of value," in Neuroeconomics: Decision Making and the Brain, eds P. W. Glimcher, C. F. Camerer, E. Fehr, and R. A. Poldrack (London: Elsevier), 407-416.
30. Engel, A. K., Maye, A., Kurthen, M., and König, P. (2013). Where's the action? The pragmatic turn in cognitive science. Trends Cogn. Sci. 17, 202-209. doi: 10.1016/j.tics.2013.03.006
31. Ernst, M. O., and Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends Cogn. Sci. 8, 162-169. doi: 10.1016/j.tics.2004.02.002
32. Farwell, L. A., and Donchin, E. (1988). Taking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol. 70, 510-523. doi: 10.1016/0013-4694(88)90149-6
33. Fecteau, J. H., and Munoz, D. P. (2006). Salience, relevance, and firing: a priority map for target selection. Trends Cogn. Sci. 10, 382-390. doi: 10.1016/j.tics.2006.06.011
34. Fishel, J. A., and Loeb, G. E. (2012a). Bayesian exploration for intelligent identification of textures. Front. Neurorobot. 6:4. doi: 10.3389/fnbot.2012.00004
35. Fishel, J. A., and Loeb, G. E. (2012b). "Sensing tactile microvibrations with the BioTac - comparison with human sensitivity," in IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics (Rome), 1122-1127.
36. Fishel, J. A., Santos, V. J., and Loeb, G. E. (2008). A Robust Micro-Vibration Sensor for Biomimetic Fingertips. Scottsdale, AZ: IEEE.
37. Gallistel, C. R., Fairhurst, S., and Balsam, P. (2004). The learning curve: implications of a quantitative analysis. Proc. Natl. Acad. Sci. U.S.A. 101, 13124-13131. doi: 10.1073/pnas.0404965101
38. Ganguli, S., and Sompolinsky, H. (2012). Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis. Annu. Rev. Neurosci. 35, 485-508. doi: 10.1146/annurev-neuro-062111-150410
39. Gibson, E. J. (1988). Exploratory behavior in the development of perceiving, acting, and the acquiring of knowledge. Annu. Rev. Psychol. 39, 1-42. doi: 10.1146/annurev.ps.39.020188.000245
40. Gibson, J. (1977). "The theory of affordances," in Perceiving, Acting, and Knowing: Toward and Ecological Psychology, eds R. Shaw and J. Brandsford (Hillsdale, NJ: Lawrence Erlbaum Associates), 62-82.
41. Giguere, P., and Dudek, G. (2011). A simple tactile probe for surface identification by mobile robots. IEEE Trans. Rob. 27, 534-544. doi: 10.1109/TRO.2011.2119910
42. Gribble, P. L., Everling, S., Ford, K., and Mattar, A. (2002). Hand-eye coordination for rapid pointing movements. Exp. Brain Res. 145, 372-382. doi: 10.1007/s00221-002-1122-9
43. Hayward, V. (2008). A brief taxonomy of tactile illusions and demonstrations that can be done in a hardware store. Brain Res. Bull. 75, 742-752. doi: 10.1016/j.brainresbull.2008.01.008
44. Hebb, D. O. (1949). The Organization of Behavior. New York, NY: Wiley.
45. Helmholtz, H. (1867). Handbuch Der Physiologischen Optik. Leipzig: L. Voss.
46. Henson, C., Thirunarayan, K., and Sheth, A. (2011). An ontological approach to focusing attention and enhancing machine perception on the Web. Appl. Ontol. 6, 345-376.
47. Hinton, G. E. (2012). "A practical guide to training restricted boltzmann machines," in Neural Networks: Tricks of the Trade, eds G. Montavon, G. B. Orr, and K. R. Müller (Berlin: Springer), 599-619.
48. Horsman, C., Stepney, S., Wagner, R. C., and Kendon, V. (2014). When does a physical system compute? Proc. Math. Phys. Eng. Sci. 470:20140182. doi: 10.1098/rspa.2014.0182
49. Hsiao, K., Kaelbling, L. P., and Lozano-Pérez, T. (2010). "Task-driven tactile exploration," in Robotics: Science and Systems Conference (Zaragoza).
50. Isaacson, J. S., and Scanziani, M. (2011). How inhibition shapes cortical activity. Neuron 72, 231-243. doi: 10.1016/j.neuron.2011.09.027
51. Jamali, N., and Sammut, C. (2011). Majority voting: material classification by tactile sensing using surface texture. IEEE Trans. Rob. 27, 508-521. doi: 10.1109/TRO.2011.2127110
52. Johansson, R. S., and Flanagan, J. R. (2007). "Tactile sensory control of object manipulation in human," in Handbook of the Senses, Vol. 5, eds J. K. Somatosensation and E. Gardner (Elsevier, Amsterdam), 67-86.
53. Jones, L. A., and Lederman, S. J. (2006). Human Hand Function. Oxford: Oxford University Press. doi: 10.1093/acprof:oso/9780195173154.001.0001
54. Katz, D. (1925). 1989 The World of Touch. Transl. by L. E. Krueger. Hillsdale, NJ: Lawrence Erlbaum Associates) (Original work published in 1925).
55. Knill, D. C., and Pouget, A. (2004). The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27, 712-719. doi: 10.1016/j.tins.2004.10.007
56. Kurtzer, I. L., Pruszynski, J. A., and Scott, S. H. (2008). Long-latency reflexes of the human arm reflect an internal model of limb dynamics. Curr. Biol. 18, 449-453. doi: 10.1016/j.cub.2008.02.053
57. Kwisthout, J., Wareham, T., and van Rooij, I. (2011). Bayesian intractability is not an ailment that approximation can cure. Cogn. Sci. 35, 779-784. doi: 10.1111/j.1551-6709.2011.01182.x
58. Lederman, S. J. (1981). The perception of surface roughness by active and passive touch. Bull. Psychon. Soc. 18, 253-255. doi: 10.3758/BF03333619
59. Lepora, N. F., Martinez-Hernandez, U., and Prescott, T. J. (2013). "Active touch for robust perception under position uncertainty," in 2013 IEEE International Conference on Robotics and Automation (ICRA) (Karlsruhe: IEEE), 3020-3025.
60. Lindley, D. V. (1956). On a measure of the information provided by an experiment. Ann. Math. Stat. 27, 986-1005. doi: 10.1214/aoms/1177728069
61. Loeb, G. E. (2012). Optimal isn't good enough. Biol. Cybern. 106, 757-765. doi: 10.1007/s00422-012-0514-6
62. Loeb, G. E., Tsianos, G., Fishel, J., Wettels, N., and Schaal, S. (2011). Understanding haptics by evolving mechatronic systems. Prog. Brain Res. 192, 129-144. doi: 10.1016/B978-0-444-53355-5.00009-9
63. MacKay, D. G. (1990). "Perception, action, and awareness: a three-body problem," in Relationships Between Perception and Action, eds O. Neumann and W. Prinz (Berlin; Heidelberg: Springer), 269-303.
64. Makin, J. G., Fellows, M. R., and Sabes, P. N. (2013). Learning multisensory integration and coordinate transformation via density estimation. PLoS Comp. Biol. 9:e1003035. doi: 10.1371/journal.pcbi.1003035
65. Marques, H. G., Bharadwaj, A., and Iida, F. (2014). From spontaneous motor activity to coordinated behaviour: a developmental model. PLoS Comp. Biol. 10:e1003653. doi: 10.1371/journal.pcbi.1003653
66. Marr, D. (1982). Vision. New York, NY: W. H. Freeman & Co.
67. Melcher, D., and Kowler, E. (2001). Visual scene memory and the guidance of saccadic eye movements. Vision Res. 41, 3597-3611. doi: 10.1016/S0042-6989(01)00203-6
68. Melcher, T., Winter, D., Hommel, B., Pfister, R., Dechent, P., and Gruber, O. (2012). The neural substrate of the ideomotor principle revisited: evidence for asymmetries in action-effect learning. Neuroscience 231, 13-27.
69. Moreno-Bote, R., Knill, D. C., and Pouget, A. (2011). Bayesian sampling in visual perception. Proc. Natl. Acad. Sci. U.S.A. 108, 12491-12496. doi: 10.1073/pnas.1101430108
70. Morley, J. W., Goodwin, A. W., and Darian-Smith, I. (1983). Tactile discrimination of gratings. Exp. Brain Res. 49, 291-299. doi: 10.1007/BF00238588
71. Morrongiello, B. A., Humphrey, G. K., Timney, B., Choi, J., and Rocca, P. T. (1994). Tactual object exploration and recognition in blind and sighted children. Perception 23, 833-833. doi: 10.1068/p230833
72. Munoz, D. P., and Wurtz, R. H. (1992). Role of the rostral superior colliculus in active visual fixation and execution of express saccades. J. Neurophysiol. 67, 1000-1002.
73. Najemnik, J., and Geisler, W. S. (2005). Optimal eye movement strategies in visual search. Nature 434, 387-391. doi: 10.1038/nature03390
74. Neisser, U. (1976). Cognition and Reality. Principles and Implication of Cognitive Psychology. Neisser; San Francisco: WH Freeman nd Company.
75. Oddo, C. M., Controzzi, M., Beccai, L., Cipriani, C., and Carrozza, M. C. (2011). Roughness encoding for discrimination of surfaces in artificial active-touch. IEEE Trans. Rob. 27, 522-533. doi: 10.1109/TRO.2011.2116930
76. O'Regan, J. K., and Noë, A. (2001). A sensorimotor account of vision and visual consciousness. Behav. Brain Sci. 24, 939-973. doi: 10.1017/S0140525X01000115
77. Oztop, E., Kawato, M., and Arbib, M. A. (2013). Mirror neurons: functions, mechanisms and models. Neurosci. Lett. 540, 43-55. doi: 10.1016/j.neulet.2012.10.005
78. Pastor, P., Righetti, L., Kalakrishnan, M., and Schaal, S. (2011). "Online movement adaptation based on previous sensor experiences," in 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (San Francisco, CA: IROS), 365-371.
79. Perfiliev, S., Isa, T., Johnels, B., Steg, G., and Wessberg, J. (2010). Reflexive limb selection and control of reach direction to moving targets in cats, monkeys, and humans. J. Neurophysiol. 104, 2423-2432. doi: 10.1152/jn.01133.2009
80. Petrantonakis, P. C., and Poirazi, P. (2014). A compressed sensing perspective of hippocampal function. Front. Syst. Neurosci. 8:141. doi: 10.3389/fnsys.2014.00141
81. Prescott, T. J., Diamond, M. E., and Wing, A. M. (2011). Active touch sensing. Philos. Trans. R. Soc. Lond. B Biol. Sci. 366, 2989-2995. doi: 10.1098/rstb.2011.0167
82. Prut, Y., and Fetz, E. E. (1999). Primate spinal interneurons show pre-movement instructed delay activity. Nature 401, 590-594. doi: 10.1038/44145
83. Rao, R. P., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79-87. doi: 10.1038/4580
84. Raphael, G., Tsianos, G. A., and Loeb, G. E. (2010). Spinal-like regulator facilitates control of atwo-degree-of-freedom wrist. J. Neurosci. 30, 9431-9444. doi: 10.1523/JNEUROSCI.5537-09.2010
85. Reynolds, J. H., and Heeger, D. J. (2009). The normalization model of attention. Neuron 61, 168-185. doi: 10.1016/j.neuron.2009.01.002
86. Saal, H. P., Ting, J.-A., and Vijayakumar, S. (2010). "Active estimation of object dynamics parameters with tactile sensors," in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (Taipei: IEEE), 916-921.
87. Schneider, A., Sturm, J., Stachniss, C., Reisert, M., Burkhardt, H., and Burgard, W. (2009). "Object identification with tactile sensors using bag-of-features," in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2009 IROS (St. Louis, MO: IEEE), 243-248.
88. Scott, S. H. (2004). Optimal feedback control and the neural basis of volitional motor control. Nat. Rev. Neurosci. 5, 532-546. doi: 10.1038/nrn1427
89. Sinapov, J., Schenck, C., Staley, K., Sukhoy, V., and Stoytchev, A. (2014). "Grounding semantic categories in behavioral interactions: experiments with 100 objects," in Robotics and Autonomous Systems, Vol. 62, 632-645. doi: 10.1016/j.robot.2012.10.007
90. Sinapov, J., Sukhoy, V., Sahai, R., and Stoytchev, A. (2011). Vibrotactile recognition and categorization of surfaces by a humanoid robot. IEEE Trans. Rob. 27, 488-497. doi: 10.1109/TRO.2011.2127130
91. Smith, A., Chapman, C. E., Deslandes, M., Langlais, J.-S., and Thibodeau, M.-P. (2002). Role of friction and tangential force variation in the subjective scaling of tactile roughness. Exp. Brain Res. 144, 211-223. doi: 10.1007/s00221-002-1015-y
92. Smith, A. M., Basile, G., Theriault-Groom, J., Fortier-Poisson, P., Campion, G., and Hayward, V. (2009). Roughness of simulated surfaces examined with a haptic tool; effects of spatial period, friction, and resistance amplitude. Exp. Brain Res. 202, 33-43. doi: 10.1007/s00221-009-2105-x
93. Su, Z., Fishel, J. A., Yamamoto, T., and Loeb, G. E. (2012). Use of tactile feedback to control exploratory movements to characterize object compliance. Front. Neurorobot. 6:7. doi: 10.3389/fnbot.2012.00007
94. Tanaka, D., Matsubara, T., Ichien, K., and Sugimoto, K. (2014). Object Manifold Learning with Action Features for Active Tactile Object Recognition. Chicago, IL: IROS.
95. Thach, W. (2014). Does the cerebellum initiate movement? Cerebellum 13, 139-150. doi: 10.1007/s12311-013-0506-7
96. Thurber, J. (1939). The Secret Life of Walter Mitty. The New Yorker.
97. Tkach, D., Reimer, J., and Hatsopoulos, N. G. (2007). Congruent activity during action and action observation in motor cortex. J. Neurosci. 27, 13241-13250. doi: 10.1523/JNEUROSCI.2895-07.2007
98. Tsianos, G. A., Goodner, J., and Loeb, G. E. (2014). Useful properties of spinal circuits for learning and performing planar reaches. J. Neural Eng. 11:056006. doi: 10.1088/1741-2560/11/5/056006
99. Turing, A. M. (1950). Computing machinery and intelligence. Mind 59, 433-460. doi: 10.1093/mind/LIX.236.433
100. Valenza, N., Ptak, R., Zimine, I., Badan, M., Lazeyras, F., and Schnider, A. (2001). Dissociated active and passive tactile shape recognition: a case study of pure tactile apraxia. Brain 124, 2287-2298. doi: 10.1093/brain/124.11.2287
101. Verstynen, T., and Sabes, P. N. (2011). How each movement changes the next: an experimental and theoretical study of fast adaptive priors in reaching. J. Neurosci. 31, 10050-10059. doi: 10.1523/JNEUROSCI.6525-10.2011
102. Vigneswaran, G., Philipp, R., Lemon Roger, N., and Kraskov, A. (2013). M1 corticospinal mirror neurons and their role in movement suppression during action observation. Curr. Biol. 23, 236-243. doi: 10.1016/j.cub.2012.12.006
103. Wettels, N., Fishel, J., and Loeb, G. (2013). "Bayesian action & perception: representing the world in the brain," in The Human Hand as an Inspiration for Robot Hand Development, Vol. 95, eds R. Balasubramanian and V. Santos (Springer), 405-429.
104. Wettels, N., Santos, V. J., Johansson, R. S., and Loeb, G. E. (2008). Biomimetic tactile sensor array. Adv. Robot. 22, 829-849. doi: 10.1163/156855308X314533
105. Winocur, G., Moscovitch, M., and Bontempi, B. (2010). Memory formation and long-term retention in humans and animals: convergence towards a transformation account of hippocampal-neocortical interactions. Neuropsychologia 48, 2339-2356. doi: 10.1016/j.neuropsychologia.2010.04.016
106. Xu, D., Loeb, G. E., and Fishel, J. A. (2013). Tactile Identification of Objects using Bayesian Exploration. Karlsruhe: ICRA Karlsruhe.
107. Yarbus, A. L., and Riggs, L. A. (1967). Eye Movements and Vision. New York, NY: Plenum press.
108. Zhou, H., and Desimone, R. (2011). Feature-based attention in the frontal eye field and area V4 during visual search. Neuron 70, 1205-1217. doi: 10.1016/j.neuron.2011.04.032