What's magic about magic numbers? Chunking and data compression in short-term memory

Cognition

Volumn 122, Issue 3, 2012, Pages 346-362

  Mathy, Fabien ^a   Feldman, Jacob ^b  

^a UNIVERSITÉ DE FRANCHE COMTÉ   (France)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

Capacity; Chunk; Chunking; Compression; Short term memory; Span

Indexed keywords

ARTICLE; DATA PROCESSING; HUMAN; PATTERN RECOGNITION; PRIORITY JOURNAL; SHORT TERM MEMORY; STIMULUS;

ADULT; DATA COMPRESSION; HUMANS; MEMORY, SHORT-TERM;

EID: 84855899455     PISSN: 00100277     EISSN: 18737838     Source Type: Journal    
DOI: 10.1016/j.cognition.2011.11.003     Document Type: Article

References (114)

1. Altmann G., Carter D. Lexical stress and lexical discriminability: Stressed syllables are more informative, but why?. Computer Speech & Language 1989, 3:265-275.
2. Anderson J.R., Bothell D., Lebiere C., Matessa M. An integrated theory of list memory. Journal of Memory and Language 1998, 38:341-380.
3. Anderson J.R., Matessa M. A production system theory of serial memory. Psychological Review 1997, 104:728-748.
4. Baddeley A. Working memory 1986, Oxford University Press, New York.
5. Baddeley A. The magical number seven: Still magic after all these years?. Psychological Review 1994, 101:353-356.
6. Baddeley A., Hitch G. Working memory. Recent advances in learning and motivation 1974, 647-667. Academic Press, New York, NY. G.H. Bower (Ed.).
7. Baddeley A., Thomson N., Buchanan M. Word length and the structure of short-term memory. Journal of Verbal Learning & Verbal Behavior 1975, 14:575-589.
8. Barouillet P., Bernardin S., Camos V. Time constraints and resource sharing in adults' working memory spans. Journal of Experimental Psychology: General 2004, 133:83-100.
9. Barouillet P., Bernardin S., Portrat S., Vergauwe E., Camos V. Time and cognitive load in working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2007, 33:570-585.
10. Baum E.B. What is thought? 2004, MIT Press, Massachusetts, MA.
11. Bennett C.H. Logical depth and physical complexity. The universal turing machine: A half-century survey 1995, 227-257. Springer-Verlag, New York, NY. R. Herken (Ed.).
12. Bower G.H., Winzenz D. Group structure, coding, and memory for digit series. Journal of Experimental Psychology 1969, 80:1-17.
13. Brady T.F., Konkle T., Alvarez G.A. Compression in visual working memory: Using statistical regularities to form more efficient memory representations. Journal of Experimental Psychology: General 2009, 138:487-502.
14. Broadbent D. The magic number seven after fifteen years. Studies in long-term memory 1975, Wiley, New York. A. Kennedy, A. Wilkes (Eds.).
15. Brown G.D.A., Neath I., Chater N. A temporal ratio model of memory. Psychological Review 2007, 114:539-576.
16. Brown G.D.A., Preece T., Hulme C. Oscillator-based memory for serial order. Psychological Review 2000, 107:127-181.
17. Bryant R. Graph-based algorithms for Boolean function manipulation. IEEE Transactions on Compilers 1986, C-35:8.
18. Burgess N., Hitch G. Memory for serial order: A network model of the phonological loop and its timing. Psychological Review 1999, 106:551-581.
19. Burtis P.J. Capacity increase and chunking in the development of short-term memory. Journal of Experimental Child Psychology 1982, 34:387-413.
20. Cabrera A. The" rational" number e: A functional analysis of categorization. Proceedings of the 17th annual conference of the cognitive science society 1995, Lawrence Erlbaum, Hillsdale, NJ. J.D. Moore, J.F. Lehman (Eds.).
21. Chase W.G., Simon H.A. Perception in chess. Cognitive Psychology 1973, 4:55-81.
22. Chater N., Vitányi P. Simplicity: A unifying principle in cognitive science. Trends in Cognitive Sciences 2003, 7(1):19-22.
23. Chekaf, M., & Mathy, F. (submitted for publication). Chunking memory span of objects varying in number, order and compressibility.
24. Chen Z., Cowan N. Chunk limits and length limits in immediate recall: A reconciliation. Journal of Experimental Psychology: Learning, Memory, and Cognition 2005, 31:1235-1249.
25. Chen Z., Cowan N. Core verbal working-memory capacity: The limit in words retained without covert articulation. Quarterly Journal of Experimental Psychology 2009, 62:1420-1429.
26. Cohen N., Sekuler R. Chunking and compound cueing of movement sequences: Learning, retention and transfer. Perceptual & Motor Skills 2010, 110:736-750.
27. Conway A.R., Kane M.J., Bunting M.F., Hambrick D.Z., Wilhelm O., Engle R.W. Working memory span tasks: A methodological review and user's guide. Psychonomic Bulletin & Review 2005, 12(5):769-786.
28. Cover T.M., Thomas J.A. Elements of information theory 1991, John Wiley, New York.
29. Cowan N. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences 2001, 24:87-185.
30. Cowan N. The magical mystery four: How is working memory capacity limited, and why?. Current Directions in Psychological Science 2010, 19:51-57.
31. Cowan N., Baddeley A.D., Elliott E.M., Norris J. List composition and the word length effect in immediate recall: A comparison of localist and globalist assumptions. Psychonomic Bulletin & Review 2003, 10:74-79.
32. Cowan N., Chen Z., Rouder J.N. Constant capacity in an immediate serial-recall task: A logical sequel to miller (1956). Psychological Science 2004, 15:634-640.
33. Cowan N., Day L., Saults J.S., Keller T.A., Johnson T., Flores L. The role of verbal output time in the effects of word length on immediate memory. Journal of Memory and Language 1992, 31:1-17.
34. Cowan N., Hismjatullina A., AuBuchon A.M., Saults J.S., Horton N., Leadbitter K. With development, list recall includes more chunks, not just larger ones. Developmental Psychology 2010, 46:1119-1131.
35. Crannell C.W., Parrish J.M. A comparison of immediate memory span for digits, letters, and words. Journal of Psychology: Interdisciplinary and Applied 1957, 44:319-327.
36. De Kleine E., Verwey W.B. Motor learning and chunking in dyslexia. Journal of Motor Behavior 2009, 41:331-337.
37. Dirlam D.K. Most efficient chunk sizes. Cognitive Psychology 1972, 3:255-359.
38. Engle R.W. Working memory capacity as executive attention. Current Directions in Psychological Science 2002, 11:19-23.
39. Ericsson K.A., Chase W., Faloon S. Acquisition of a memory skill. Science 1980, 208:1181-1182.
40. Ericsson K.A., Kintsch W. Long-term working memory. Psychological Review 1995, 102:211-245.
41. Estes W.K. An associative basis for coding and organization in memory. Coding processes in human memory 1972, 161-190. Winston, Washington, DC. A.W. Melton, E. Martin (Eds.).
42. Estes W.K. Phonemic coding and rehearsal in short-term memory for letter strings. Journal of Verbal Learning & Verbal Behavior 1973, 12(4):360-372.
43. Farrell S. Multiple roles for time in short-term memory: Evidence from serial recall of order and timing. Journal of Experimental Psychology: Learning, Memory, and Cognition 2008, 34:128-145.
44. Farrell S., Lewandowsky S. An endogenous distributed model of ordering in serial recall. Psychonomic Bulletin & Review 2002, 9:59-79.
45. Feldman J. Minimization of Boolean complexity in human concept learning. Nature 2000, 407:630-633.
46. Feldman J. How surprising is a simple pattern? Quantifying "eureka" Cognition 2004, 93:199-224.
47. Fountain S.B., Benson D.M. Chunking, rule learning, and multiple item memory in rat interleaved serial pattern learning. Learning and Motivation 2006, 37:95-112.
48. Gilchrist A.L., Cowan N., Naveh-Benjamin M. Investigating the childhood development of working memory using sentences: New evidence for the growth of chunk capacity. Journal of Experimental Child Psychology 2009, 104:252-265.
49. Gmeindl L., Walsh M., Courtney S. Binding serial order to representations in working memory: A spatial/verbal dissociation. Memory & Cognition 2011, 39:37-46.
50. Gobet F., Clarkson G. Chunks in expert memory: Evidence for the magical number four... or is it two?. Memory 2004, 12:732-747.
51. Gobet F., Lane P.C., Croker S., Cheng P.C.H., Jones G., Oliver I. Chunking mechanisms in human learning. Trends in Cognitive Sciences 2001, 5:236-243.
52. Hahn U., Chater N., Richardson L.B. Similarity as transformation. Cognition 2003, 87:1-32.
53. Halford G.S., Baker R., McCredden J.E., Bain J.D. How many variables can humans process?. Psychological Science 2005, 16:70-76.
54. Halford G.S., Wilson W.H., Phillips W. Processing capacity defined by relational complexity: Implications for comparative, developmental and cognitive psychology. Behavioral and Brain Sciences 1998, 21:803-831.
55. Henson R.N.A. Short-term memory for serial order: The start-end model. Cognitive Psychology 1998, 36:73-137.
56. Henson R.N.A., Norris D.G., Page M.P.A., Baddeley A.D. Unchained memory: Error patterns rule out chaining models of immediate serial recall. The Quarterly Journal of Experimental Psychology Section A: Human Experimental Psychology 1996, 49:80-115.
57. Hitch G., Burgess N., Towse J., Culpin V. Temporal grouping effects and working memory: The role of the phonological loop. Quarterly Journal of Experimental Psychology 1996, 49A:116-139.
58. Jonides J., Lewis R.L., Nee D.E., Lustig C.A., Berman M.G., Moore K.S. The mind and brain of short-term memory. Annual Review of Psychology 2008, 59:193-224.
59. Kintsch W., Caciopo J. Introduction to the 100th anniversary issue of the psychological review. Psychological Review 1994, 101:195-199.
60. Koch I., Philipp A.M., Gade M. Chunking in task sequences modulates task inhibition. Psychological Science 2006, 17:346-350.
61. Kolmogorov A.N. Three approaches to the quantitative definition of information. Problems of Information Transmission 1965, 1:1-7.
62. Lewandowsky S. Redintegration and response suppression in serial recall: A dynamic network model. International Journal of Psychology 1999, 34:434-446.
63. Lewandowsky S., Duncan M., Brown G.D.A. Time does not cause forgetting in short-term serial recall. Psychonomic Bulletin & Review 2004, 11:771-790.
64. Lewandowsky S., Murdock B.B. Memory for serial order. Psychological Review 1989, 96:25-57.
65. Li K.Z., Blair M., Chow V.S. Sequential performance in young and older adults: Evidence of chunking and inhibition. Aging Neuropsychology, and Cognition 2010, 17:270-295.
66. Li M., Vitányi P. An introduction to Kolmogorov complexity and its applications 1997, Spring Verlag, New York, NY.
67. Logan G.D. Working memory, task switching, and executive control in the task span procedure. Journal of Experimental Psychology: General 2004, 133:218-236.
68. Luck S.J., Vogel E.K. The capacity of visual working memory for features and conjunctions. Nature 1997, 390:279-281.
69. MacGregor J.N. Short-term memory capacity: Limitation or optimization?. Psychological Review 1987, 94:107-108.
70. Martin M. Memory span as a measure of individual differences in memory capacity. Memory & Cognition 1978, 6:194-198.
71. Mathy, F., & Varré, J. S. (submitted for publication). Retention-error patterns in serial-recall tasks revisited by bioinformatics.
72. Maylor E.A., Vousden J.I., Brown G.D.A. Adult age differences in short-term memory for serial order: Data and a model. Psychology and Aging 1999, 14:572-594.
73. McCormack T., Brown G.D.A., Vousden J.I., Henson R.N.A. Children's serial recall errors: Implications for theories of short-term memory development. Journal of Experimental Child Psychology 2000, 76:222-252.
74. Miller G.A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 1956, 63:81-97.
75. Miller G.A. Free recall of redundant strings of letters. Journal of Experimental Psychology 1958, 56:485-491.
76. Murdock B.B. The serial position effect of free recall. Journal of Experimental Psychology 1962, 64:482-488.
77. Nairne J.S. A feature model of immediate memory. Memory & Cognition 1990, 18:251-269.
78. Nairne J.S. Remembering over the short-term: The case against the standard model. Annual Review of Psychology 2002, 53:53-81.
79. Neath I., Nairne J.S. Word-length effects in immediate memory: Overwriting trace decay theory. Psychonomic Bulletin & Review 1995, 2:429-441.
80. Ng H.L., Maybery M.T. Grouping in short-term verbal memory: Is position coded temporally?. Quarterly Journal of Experimental Psychology 2002, 55:391-424.
81. Nickerson R.S. The production and perception of randomness. Psychological Review 2002, 109:330-357.
82. Oberauer K., Kliegl R. A formal model of capacity limits in working memory. Journal of Memory and Language 2006, 55:601-626.
83. O'Shea G., Clegg B.A. Stimulus and response chunking in the hebb digits task. Psychological Research 2006, 70:180-192.
84. Page M.P., Norris D. The primacy model: A new model of immediate serial recall. Psychological Review 1998, 105:761-781.
85. Perlman A., Pothos E.M., Edwards D.J., Tzelgov J. Task-relevant chunking in sequence learning. Journal of Experimental Psychology: Human Perception and Performance 2010, 36:649-661.
86. Perruchet P., Pacteau C. Synthetic grammar learning: Implicit rule abstraction or explicit fragmentary knowledge?. Journal of Experimental Psychology: General 1990, 119:264-275.
87. Perruchet P., Pacton S. Implicit learning and statistical learning: One phenomenon, two approaches. Trends in Cognitive Sciences 2006, 10:233-238.
88. Pothos E.M. An entropy model for artificial grammar learning. Frontiers in Psychology 2010, 1:16.
89. Pothos E.M., Chater N. A simplicity principle in unsupervised human categorization. Cognitive Science 2002, 26:303-343.
90. Pothos E.M., Wolff J.G. The simplicity and power model for inductive inference. Artificial Intelligence Review 2006, 26:211-225.
91. Pylyshyn Z., Storm R. Tracking multiple independent targets: Evidence for a parallel tracking mechanism. Spatial Vision 1988, 3:1-19.
92. Rissanen J. Modeling by shortest data description. Automatica 1978, 14:465-471.
93. Robinet V., Lemaire B. MDLChunker: A MDL-based model of word segmentation. Proceedings of the 31th annual conference of the cognitive science society 2009, 2866-2871. Cognitive Science Society, Austin, TX. N.A. Taatgen, H. van Rijn (Eds.).
94. Robinet V., Lemaire B., Gordon M.B. Mdlchunker: A mdl-based cognitive model of inductive learning. Cognitive Science 2011, 35:1207-1405.
95. Roodenrys S., Miller L.M. A constrained rasch model of trace redintegration in serial recall. Memory & Cognition 2008, 36(3):578-587.
96. Ryan J. Grouping and short-term memory: Different means and patterns of grouping. Quarterly Journal of Experimental Psychology 1969, 21:137-147.
97. Sargent J., Dopkins S., Philbeck J., Chichka D. Chunking in spatial memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 36:576-589.
98. Sayeki Y. Information seeking for object identification. Organizational Behavior and Human Performance 1969, 4:267-283.
99. Schöning U., Pruim R. Gems of theoretical computer science 1998, Springer, Berlin.
100. Servan-Schreiber E., Anderson J.R. Learning artificial grammars with competitive chunking. Journal of Experimental Psychology: Learning, Memory, and Cognition 1990, 16:592-608.
101. Shiffrin R.M., Nosofsky R.M. Seven plus or minus two: A commentary on capacity limitations. Psychological Review 1994, 101:357-361.
102. Simon H.A. How big is a chunk?. Science 1974, 183:482-488.
103. Stark K., Calfee R.C. Recoding strategies in short-term memory. Journal of Experimental Psychology 1970, 85:36-39.
104. St Clair-Thompson H., Sykes S. Scoring methods and the predictive ability of working memory tasks. Behavior Research Methods 2010, 42:969-975.
105. Suge R., Okanoya K. Perceptual chunking in the self-produced songs of bengalese finches (lonchura striata var. domestica). Animal Cognition 2010, 13:515-523.
106. Terrace H.S. Chunking by a pigeon in a serial learning task. Nature 1987, 325:149-151.
107. Terrace H.S. Chunking and serially organized behavior in pigeons, monkeys and humans. Avian visual cognition 2001, Comparative Cognition Press, Medford, MA, . R.G. Cook (Ed.).
108. Tulving E., Patkau J.E. Concurrent effects of contextual constraint and word frequency on immediate recall and learning of verbal material. Canadian Journal of Experimental Psychology 1962, 16:83-95.
109. Unsworth N., Engle R.W. On the division of short-term and working memory: An examination of simple and complex span and their relation to higher order abilities. Psychological Bulletin 2007, 133:1038-1066.
110. Wickelgren W.A. Size of rehearsal group and short-term memory. Journal of Experimental Psychology 1964, 68:413-419.
111. Wolff J.G. Information compression by multiple alignment, unification and search as a unifying principle in computing and cognition. Artificial Intelligence Review 2003, 19:193-230.
112. Zhang G., Simon H.A. Stm capacity for chinese words and idioms: Chunking and acoustical loop hypotheses. Memory & Cognition 1985, 13:193-201.
113. Zhang W., Luck S. Discrete fixed-resolution representations in visual working memory. Nature 2008, 453:233-236.
114. Ziv J., Lempel A. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory 1977, 23:337-343.