Chunking dynamics: Heteroclinics in mind

Frontiers in Computational Neuroscience

Volumn 8, Issue MAR, 2014, Pages

  Rabinovich, Mikhail I ^a   Varona, Pablo ^b   Tristan, Irma ^a   Afraimovich, Valentin S ^c  

^a UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^b UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

^c INSTITUTO DE INVESTIGACIÓN EN COMUNICACIÓN ÓPTICA   (Mexico)

Author keywords

Chunking and superchunking; Cognition modeling principles; Cognitive dynamics; Hierarchical sequences; Low dimensionality of brain activity; Stable heteroclinic channel; Transient dynamics

Indexed keywords

BRAIN; CHAINS; NETWORK ARCHITECTURE;

BRAIN ACTIVITY; CHUNKING AND SUPERCHUNKING; COGNITIVE DYNAMICS; HIERARCHICAL SEQUENCES; MODEL PRINCIPLE; STABLE HETEROCLINIC CHANNEL; TRANSIENT DYNAMICS;

DYNAMICS;

ADAPTATION; ARTICLE; ARTIFICIAL NEURAL NETWORK; CHUNKING DYNAMICS; COGNITION; INFORMATION PROCESSING; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MENTAL PERFORMANCE; MENTAL TASK; MOLECULAR DYNAMICS; RELIABILITY; SENSITIVITY ANALYSIS; SHORT TERM MEMORY; SYNAPTIC TRANSMISSION;

EID: 84901367187     PISSN: None     EISSN: 16625188     Source Type: Journal    
DOI: 10.3389/fncom.2014.00022     Document Type: Article

References (77)

1. Afraimovich, V. S., Zhigulin, V. P., and Rabinovich, M. I. (2004). On the origin of reproducible sequential activity in neural circuits. Chaos 14, 1123. doi: 10.1063/1.1819625
2. Amari, S.-I. (1972). Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Trans. Comput. C-21, 1197-1206. doi: 10.1109/T-C.1972.223477
3. Ashwin, P., Field, M., Rucklidge, A. M., and Sturman, R. (2003). Phase resetting effects for robust cycles between chaotic sets. Chaos 13, 973-981. doi: 10.1063/1.1586531
4. Bahlmann, J., Schubotz, R. I., and Friederici, A. D. (2008). Hierarchical artificial grammar processing engages Broca's area. Neuroimage 42, 525-534. doi: 10.1016/j.neuroimage.2008.04.249
5. Bahlmann, J., Schubotz, R. I., Mueller, J. L., Koester, D., and Friederici, A. D. (2009). Neural circuits of hierarchical visuo-spatial sequence processing. Brain Res. 1298, 161-170. doi: 10.1016/j.brainres.2009.08.017
6. Bick, C., and Rabinovich, M. I. (2009). Dynamical origin of the effective storage capacity in the brain's working memory. Phys. Rev. Lett. 103:218101. doi: 10.1103/PhysRevLett.103.218101
7. Bick, C., and Rabinovich, M. I. (2010). On the occurrence of stable heteroclinic channels in Lotka-Volterra models. Dyn. Syst. 25, 1-14. doi: 10.1080/14689360903322227
8. Bor, D., and Seth, A. K. (2012). Consciousness and the prefrontal parietal network: insights from attention, working memory, and chunking. Front. Psychol. 3:1-14. doi: 10.3389/fpsyg.2012.00063
9. Botvinick, M. M. (2008). Hierarchical models of behavior and prefrontal function. Trends Cogn. Sci. 12, 201-208. doi: 10.1016/j.tics.2008.02.009
10. Bressler, S. L., and Kelso, J. A. S. (2001). Cortical coordination dynamics and cognition. Trends Cogn. Sci. 5, 26-36. doi: 10.1016/S1364-6613(00)01564-3
11. Bystritsky, A., Nierenberg, A. A., Feusner, J. D., and Rabinovich, M. (2012). Computational non-linear dynamical psychiatry: a new methodological paradigm for diagnosis and course of illness. J. Psychiatr. Res. 46, 428-435. doi: 10.1016/j.jpsychires.2011.10.013
12. Chekaf, M., and Matha, F. (2012). "Chunking memory span of categorizable objects, " in 53rd Annual Meeting of the Psychonomic Society (Minneapolis, MN: Psychonomic Society Publication).
13. Cheng, P. C. H., and Rojas-Anaya, H. (2003). "Writing out a temporal signal of chunks: patterns of pauses reflect the induced structure of written number sequences, " in Proceedings of the 27th Annual Conference of the Cognitive Science Society (Mahwah, NJ: Lawrence Erlbaum), 424-429.
14. Cheng, P. C.-H., and Rojas-Anaya, H. (2006). "A temporal signal reveals chunk structure in the writing of word phrases, " in Proceedings of the Twenty-Eighth Annual Conference of the Cognitive Science Society (Mahwah, NJ: Lawrence Erlbaum).
15. Clerget, E., Andres, M., and Olivier, E. (2013). Deficit in complex sequence processing after a virtual lesion of left BA45. PLoS ONE 8:e63722. doi: 10.1371/journal.pone.0063722
16. De Borda, J. C. (1781). Memoire sur les Elections au Scrutin. Paris: Academie Royale des Sciences.
17. Deco, G., and Rolls, E. T. (2005). Sequential memory: a putative neural and synaptic dynamical mechanism. J. Cogn. Neurosci. 17, 294-307. doi: 10.1162/0898929053124875
18. Dehaene, S., and Changeux, J. P. (1997). A hierarchical neuronal network for planning behavior. Proc. Natl. Acad. Sci. U.S.A. 94, 13293-13298. doi: 10.1073/pnas.94.24.13293
19. Dominey, P. F., Hoen, M., Blanc, J.-M., and Lelekov-Boissard, T. (2003). Neurological basis of language and sequential cognition: evidence from simulation, aphasia, and ERP studies. Brain Lang. 86, 207-225. doi: 10.1016/S0093-934X(02)00529-1
20. Engel, A. K., Fries, P., and Singer, W. (2001). Dynamic predictions: oscillations and synchrony in top-down processing. Nat. Rev. Neurosci. 2, 704-716. doi: 10.1038/35094565
21. Fadiga, L., Craighero, L., and D'Ausilio, A. (2009). Broca's area in language, action, and music. Ann. N.Y. Acad. Sci. 1169, 448-458. doi: 10.1111/j.1749-6632.2009.04582.x
22. Fingelkurts, A. A., and Fingelkurts, A. A. (2006). Timing in cognition and EEG brain dynamics: discreteness versus continuity. Cogn. Process. 7, 135-162. doi: 10.1007/s10339-006-0035-0
23. Friederici, A. D., Bahlmann, J., Friedrich, R., and Makuuchi, M. (2011). The neural basis of recursion and complex syntactic hierarchy. Biolinguistics 5, 87-104. Available online at:http://www.biolinguistics.eu/index.php/biolinguistics/article/view/170
24. Friston, K. J. (1997). Transients, metastability, and neuronal dynamics. Neuroimage 5, 164-171. doi: 10.1006/nimg.1997.0259
25. Friston, K. J. (2000). The labile brain. II. Transients, complexity and selection. Philos. Trans. R. Soc. Lond. B Biol. Sci. 355, 237-252. doi: 10.1098/rstb.2000.0561
26. Gobet, F., Lane, P. C. R., Croker, S., Cheng, P. C.-H., Jones, G., Oliver, I., et al. (2001). Chunking mechanisms in human learning. Trends Cogn. Sci. 5, 236-243. doi: 10.1016/S1364-6613(00)01662-4
27. Gros, C. (2007). Neural networks with transient state dynamics. New J. Phys. 9, 109. doi: 10.1088/1367-2630/9/4/109
28. Grossman, M. (1980). A central processor for hierarchically-structured material: evidence from broca's aphasia. Neuropsychologia 18, 299-308. doi: 10.1016/0028-3932(80)90125-6
29. Hek, G. (2010). Geometric singular perturbation theory in biological practice. J. Math. Biol. 60, 347-386. doi: 10.1007/s00285-009-0266-7
30. Huerta, R., and Rabinovich, M. (2004). Reproducible sequence generation in random neural ensembles. Phys. Rev. Lett. 93:238104. doi: 10.1103/PhysRevLett.93.238104
31. Ito, J., Nikolaev, A. R., and van Leeuwen, C. (2007). Dynamics of spontaneous transitions between global brain states. Hum. Brain Mapp. 28, 904-913. doi: 10.1002/hbm.20316
32. Jantzen, K. J., and Kelso, J. S. (2007). "Neural coordination dynamics of human sensorimotor behavior: a review, " in Handbook of Brain Connectivity, eds V. K. Jirsa and A. McIntosh (Berlin; Heidelberg: Springer), 421-461.
33. Jones, C. K. R. T. (1995). Geometric singular perturbation theory. Lect. Notes Math. 1609, 44-118. doi: 10.1007/BFb0095239
34. Kelso, J. A. S. (1995). Dynamic Patterns: The Self-Organization of Brain and Behavior. Cambridge, MA: The MIT Press.
35. Kiebel, S. J., von Kriegstein, K., Daunizeau, J., and Friston, K. J. (2009). Recognizing sequences of sequences. PLoS Comput. Biol. 5:e1000464. doi: 10.1371/journal.pcbi.1000464
36. Kleinfeld, D. (1986). Sequential state generation by model neural networks. Proc. Natl. Acad. Sci. U.S.A. 83, 9469-9473. doi: 10.1073/pnas.83.24.9469
37. Koch, I., Philipp, A. M., and Gade, M. (2006). Chunking in task sequences modulates task inhibition. Psychol. Sci. 17, 346-350. doi: 10.1111/j.1467-9280.2006.01709.x
38. Komarov, M. A., Osipov, G. V., and Burtsev, M. S. (2010). Adaptive functional systems: learning with chaos. Chaos20, 045119. doi: 10.1063/1.3521250
39. Krupa, M. (1997). Robust heteroclinic cycles. J. Nonlinear Sci. 7, 129-176. doi: 10.1007/BF02677976
40. Li, G., Ning, N., Ramanathan, K., He, W., Pan, L., and Shi, L. (2013). Behind the magical numbers: hierarchical chunking and the human working memory capacity. Int. J. Neural Syst. 23:1350019. doi: 10.1142/S0129065713500196
41. Li, K. Z. H., Blair, M., and Chow, V. S. M. (2010). Sequential performance in young and older adults: evidence of chunking and inhibition. Neuropsychol. Dev. Cogn. Sect. B Aging Neuropsychol. Cogn. 17, 270-295. doi: 10.1080/13825580903165428
42. Linkerhand, M., and Gros, C. (2013). Generating functionals for autonomous latching dynamics in attractor relict networks. Sci. Rep. 3:2042. doi: 10.1038/srep02042
43. Mathy, F., and Feldman, J. (2012). What's magic about magic numbers? Chunking and data compression in short-term memory. Cognition 122, 346-362. doi: 10.1016/j.cognition.2011.11.003
44. Meehan, T. P., and Bressler, S. L. (2012). Neurocognitive networks: findings, models, and theory. Neurosci. Biobehav. Rev. 36, 2232-2247. doi: 10.1016/j.neubiorev.2012.08.002
45. Miller, G. A. (1956). The magical number seven plus or minus two: some limits on our capacity for processing information. Psychol. Rev. 63, 81-97. doi: 10.1037/h0043158
46. Minai, A. A., Levy, W. B. (1993). "Sequence learning in a single trial, " in INNS World Congress on Neural Networks(Hillsdale, NJ: Erlbaum), 505-508.
47. Musso, M., Moro, A., Glauche, V., Rijntjes, M., Reichenbach, J., Büchel, C., et al. (2003). Broca's area and the language instinct. Nat. Neurosci. 6, 774-781. doi: 10.1038/nn1077
48. Nowotny, T., and Rabinovich, M. I. (2007). Dynamical origin of independent spiking and bursting activity in neural microcircuits. Phys. Rev. Lett. 98:128106. doi: 10.1103/PhysRevLett.98.128106
49. Oullier, O., and Kelso, J. A. S. (2006). Neuroeconomics and the metastable brain. Trends Cogn. Sci. 10, 353-354. doi: 10.1016/j.tics.2006.06.009
50. Ponzi, A., and Wickens, J. (2010). Sequentially switching cell assemblies in random inhibitory networks of spiking neurons in the striatum. J. Neurosci. 30, 5894-5911. doi: 10.1523/JNEUROSCI.5540-09.2010
51. Postlethwaite, C. M., and Dawes, J. H. P. (2005). Regular and irregular cycling near a heteroclinic network. Nonlinearity 18, 1477-1509. doi: 10.1088/0951-7715/18/4/004
52. Rabinovich, M., Huerta, R., and Laurent, G. (2008a). Neuroscience. Transient dynamics for neural processing. Science 321, 48-50. doi: 10.1126/science.1155564
53. Rabinovich, M., Tristan, I., and Varona, P. (2013). Neural dynamics of attentional cross-modality control. PLoS ONE 8:e64406. doi: 10.1371/journal.pone.0064406
54. Rabinovich, M., Volkovskii, A., Lecanda, P., Huerta, R., Abarbanel, H. D., and Laurent, G. (2001). Dynamical encoding by networks of competing neuron groups: winnerless competition. Phys. Rev. Lett. 87:68102. doi: 10.1103/PhysRevLett.87.068102
55. Rabinovich, M. I., Afraimovich, V. S., Bick, C., and Varona, P. (2012). Information flow dynamics in the brain. Phys. Life Rev. 9, 51-73. doi: 10.1016/j.plrev.2011.11.002
56. Rabinovich, M. I., Afraimovich, V. S., and Varona, P. (2010a). Heteroclinic binding. Dyn. Syst. An Int. J. 25, 433-442. doi: 10.1080/14689367.2010.515396
57. Rabinovich, M. I., Huerta, R., Varona, P., and Afraimovich, V. S. (2006). Generation and reshaping of sequences in neural systems. Biol. Cybern. 95, 519-536. doi: 10.1007/s00422-006-0121-5
58. Rabinovich, M. I., Huerta, R., Varona, P., and Afraimovich, V. S. (2008b). Transient cognitive dynamics, metastability, and decision making. PLoS Comput Biol 4:e1000072. doi: 10.1371/journal.pcbi.1000072
59. Rabinovich, M. I., Muezzinoglu, M. K., Strigo, I., and Bystritsky, A. (2010b). Dynamical principles of emotion-cognition interaction: mathematical images of mental disorders. PLoS ONE 5:e12547. doi: 10.1371/journal.pone.0012547
60. Rabinovich, M. I., and Varona, P. (2011). Robust transient dynamics and brain functions. Front. Comput. Neurosci. 5:24. doi: 10.3389/fncom.2011.00024
61. Ribas-Fernandes, J. J. F., Solway, A., Diuk, C., McGuire, J. T., Barto, A. G., Niv, Y., et al. (2011). A neural signature of hierarchical reinforcement learning. Neuron 71, 370-379. doi: 10.1016/j.neuron.2011.05.042
62. Rosenbaum, D. A., Kenny, S. B., and Derr, M. A. (1983). Hierarchical control of rapid movement sequences. J. Exp. Psychol. Hum. Percept. Perform. 9, 86-102. doi: 10.1037/0096-1523.9.1.86
63. Rosenberg, R. D., and Feigenson, L. (2013). Infants hierarchically organize memory representations. Dev. Sci. 16, 610-621. doi: 10.1111/desc.12055
64. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., and Foxe, J. J. (2007). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 17, 1147-1153. doi: 10.1093/cercor/bhl024
65. Russo, E., Namboodiri, V. M. K., Treves, A., and Kropff, E. (2008). Free association transitions in models of cortical latching dynamics. New J. Phys. 10:015008. doi: 10.1088/1367-2630/10/1/015008
66. Russo, E., and Treves, A. (2011). An uncouth approach to language recursivity. Biolinguistics 5, 133-150. Available online at: http://www.biolinguistics.eu/index.php/biolinguistics/article/view/186
67. Saari, D. G. (1995). Basic Geometry of Voting. Berlin: Springer. doi: 10.1007/978-3-642-57748-2
68. Sahin, N. T., Pinker, S., Cash, S. S., Schomer, D., and Halgren, E. (2009). Sequential processing of lexical, grammatical, and phonological information within Broca's area. Science 326, 445-449. doi: 10.1126/science.1174481
69. Sakai, K., Kitaguchi, K., and Hikosaka, O. (2003). Chunking during human visuomotor sequence learning. Exp. Brain Res. 152, 229-242. doi: 10.1007/s00221-003-1548-8
70. Schneider, D. W. (2007). Task-set inhibition in chunked task sequences. Psychon. Bull. Rev. 14, 970-976. doi: 10.3758/BF03194130
71. Sompolinsky, H., and Kanter, I. I. (1986). Temporal asociation in asymmetric neural networks. Phys. Rev. Lett. 57, 2861-2864. doi: 10.1103/PhysRevLett.57.2861
72. Stone, E., and Armbruster, D. (1999). Noise and O(1) amplitude effects on heteroclinic cycles. Chaos 9, 499-506. doi: 10.1063/1.166423
73. Tettamanti, M., and Weniger, D. (2006). Broca's area: a supramodal hierarchical processor? Cortex 42, 491-494. doi: 10.1016/S0010-9452(08)70384-8
74. Treves, A. (2005). Frontal latching networks: a possible neural basis for infinite recursion. Cogn. Neuropsychol. 22, 276-291. doi: 10.1080/02643290442000329
75. Tsuda, I. (2009). Hypotheses on the functional roles of chaotic transitory dynamics. Chaos 19, 015113. doi: 10.1063/1.3076393
76. Varona, P., Rabinovich, M. I., Selverston, A. I., and Arshavsky, Y. I. (2002). Winnerless competition between sensory neurons generates chaos: a possible mechanism for molluscan hunting behavior. Chaos 12, 672-677. doi: 10.1063/1.1498155
77. Venaille, A., Varona, P., and Rabinovich, M. I. (2005). Synchronization and coordination of sequences in two neural ensembles. Phys. Rev. E Stat. Nonlin. Soft. Matter Phys. 71:61909. doi: 10.1103/PhysRevE.71.061909