Encoder: A connectionist model of how learning to visually encode fixated text images improves reading fluency

Psychological Review

Volumn 111, Issue 3, 2004, Pages 617-639

  Martin, Gale L ^a,b,c  

^a MOTOROLA INC   (United States)

^b MOTOROLA INC   (United States)

^c NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 3042734505     PISSN: 0033295X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-295X.111.3.617     Document Type: Review

References (103)

1. Adams, M. J. (1981). What good is orthographic redundancy? In H. Singer & O. J. L. Tzeng (Eds.), Perception of print (pp. 198-221). Hillsdale, NJ: Erlbaum.
2. Altarriba, J., Kambe, G., Pollatsek, A., & Rayner, K. (2001). Semantic codes are not used in integrating information across eye fixations in reading: Evidence from fluent Spanish-English bilinguals. Perception & Psychophysics, 63, 875-900.
3. Andrews, S. (1992). Frequency and neighborhood effects on lexical access: Lexical similarity or orthographic redundancy? Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 234-254.
4. Ball, E. W., & Blachman, B. A. (1991). Does phoneme awareness training in kindergarten make a difference in early word recognition and developmental spelling? Reading Research Quarterly, 26, 49-66.
5. Balota, D. A., Pollatsek, A., & Rayner, K. (1985). The interaction of contextual constraints and parafoveal visual information in reading. Cognitive Psychology, 17, 364-390.
6. Baron, J., & Thurston, I. (1973). An analysis of the word superiority effect. Cognitive Psychology, 4, 207-228.
7. Baum, F. L. (1993). The wonderful wizard of Oz, Retrieved December 7, 1994, from http://promo.net/pg.
8. Behrmann, M., Shomstein, S., Black, S., & Barton, J. J. S. (2001). The eye movements of pure alexic patients during reading and non-reading tasks. Neuropsychologia, 39, 983-1002.
9. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford, England: Oxford University Press.
10. Blachman, B. A. (1984). Relationship of rapid naming ability and language analysis skills to kindergarten and first-grade reading achievement. Journal of Educational Psychology, 76, 610-622.
11. Bradley, J. (1994). xv: Interactive Image Display for the X Window System (Version 3.10a) [Computer software]. Bryn Mawr, PA: Author.
12. Brooks, L. (1977). Visual pattern in fluent word recognition. In A. S. Reber & D. C. Scarborough (Eds.), Toward a psychology of reading (pp. 143-181). Hillsdale, NJ: Erlbaum.
13. Coltheart, M., & Freeman, R. (1974). Case alternation impairs word identification. Bulletin of the Psychonomic Society, 3, 102-104.
14. Denker, J., Schwartz, D., Winner, B., Solla, S., Howard, R., Jackel, L., & Hopfield, J. (1987). Large automatic learning, rule extraction and generalization. Complex Systems, 1, 877-933.
15. Duda, R. O., & Hart, P. E. (1973). Pattern classification and scene analysis. New York: Wiley.
16. Eden, G. F., Stein, J. F., Wood, M. H., & Wood, F. B. (1993). Verbal and visual problems in reading disability. Journal of Learning Disabilities, 28, 272-290.
17. Ehri, L. C., & Wilce, L. S. (1987). Does learning to spell help beginners learn to read words? Reading Research Quarterly, 22, 47-65.
18. Forster, K. I. (1976). Accessing the mental lexicon. In R. J. Wales & E. Walker (Eds.), New approaches to language mechanisms (pp. 257-287). Amsterdam: North-Holland.
19. Forster, K. I., & Chambers, S. M. (1973). Lexical access and naming time. Journal of Verbal Learning and Verbal Behavior, 12, 627-635.
20. Geister, W. S., & Perry, J. S. (1999). Variable resolution displays for visual communication and simulation. The Society for Information Display, 30, 420-423.
21. Golden, R. M. (1986). A developmental neural model of visual word perception. Cognitive Science, 10, 241-276.
22. Harm, M. W., & Seidenberg, M. S. (1999). Phonology, reading acquisition, and dyslexia: Insights from connectionist models. Psychological Review, 106, 491-528.
23. Harm, M. W., & Seidenberg, M. S. (2004). Computing the meanings of words in reading: Cooperative division of labor between visual and phonological processes, Psychological Review, 111, 662-720.
24. Henderson, J. M., Dixon, P., Petersen, A., Twilley, L. C., & Ferreira, F. (1995). Evidence for the use of phonological representations during trans-saccadic word recognition. Journal of Experimental Psychology: Human Perception and Performance, 21, 82-97.
25. Henderson, J. M., & Ferreira, F. (1990). Effects of foveal processing difficulty on the perceptual span in reading: Implications for attention and eye movement control. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 417-429.
26. Henderson, L., & Chard, M. J. (1976). On the nature of the facilitation of visual comparisons by lexical membership. Bulletin of the Psychonomic Society, 7, 432-434.
27. Hertz, J., Krogh, A., & Palmer, R. G. (1991). Introduction to the theory of neural computation. Reading, MA: Perseus.
28. Howes, D., & Solomon, R. C. (1951). Visual duration threshold as a function of word probability. Journal of Experimental Psychology, 41, 401-410.
29. Hubel, D., & Wiesel, T. (1979). Brain mechanisms of vision. Scientific American, 241, 150-162.
30. Hyona, J., & Niemi, P. (1990). Eye movements during repeated reading of a text. Acta Psychologica, 73, 259-280.
31. Hyona, J., & Olson, R. K. (1995). Eye fixation patterns among dyslexic and normal readers: Effects of word length and word frequency. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 1430-1440.
32. Inhoff, A. W., & Rayner, K. (1986). Parafoveal word processing during eye fixations in reading: Effects of word frequency, Perception & Psychophysics, 40, 431-439.
33. Ishida, T., & Ikeda, M. (1989). Temporal properties of information extraction in reading studied by a text-mask replacement technique. Journal of the Optical Society A: Optics and Image Science, 6, 1624-1632.
34. Keeler, J., & Rumelhart, D. E. (1992). A self-organizing integrated segmentation and recognition neural network. In J. E. Moody, S. J. Hanson, & R. P. Lippman (Eds.), Advances in neural information processing systems (Vol. 4, pp. 496-503). San Mateo, CA: Morgan-Kaufman.
35. Kolers, P. A., & Katzman, M. T. (1966). Naming sequentially presented letters and words. Language and Speech, 9, 84-95.
36. LeCun, Y. (1989). Generalization and network design strategies (Tech. Rep. No. CRG-TR-89-4). Ontario, Canada: University of Toronto, Department of Computer Science.
37. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., & Jackel, L. (1990). Handwritten digit recognition with a back-propagation network. In D. Touretzky (Ed.), Advances in neural information processing systems (Vol. 2, pp. 396-404). San Mateo, CA: Morgan-Kaufmann.
38. Legge, G. E., Klitz, T. S., & Tjan, B. S. (1997). Mr. Chips: An ideal-observer model of reading. Psychological Review, 104, 524-553.
39. Liberman, I. Y., & Shankweiler, D. (1985). Phonology and the problems of learning to read and write. Remedial and Special Education, 6, 8-17.
40. Liberman, I. Y., Shankweiler, D., Fischer, F. W., & Carter, B. (1974). Explicit syllable and phoneme segmentation in the young child. Journal of Experimental Child Psychology, 18, 201-212.
41. Liberman, I. Y., Shankweiler, D., & Liberman, A. M. (1989). The alphabetic principle and learning to read. Phonology and reading disability, In D. Shankweiler & I. Y. Liberman (Eds.), Phonology and reading disability (pp. 1-31). Ann Arbor: University of Michigan Press.
42. Lima, S. D., & Inhoff, A. W. (1985). Lexical access during eye fixations in reading: Effects of word-initial letter sequence. Journal of Experimental Psychology: Human Perception and Performance, 11, 272-285.
43. Martin, G. (1993). Centered-object integrated segmentation and recognition of hand-printed characters. Neural Computation, 5, 419-429.
44. Martin, G. (1996). Human reading and the curse of dimensionality. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems 8: Proceedings of the 1995 conference (pp. 17-23). Cambridge, MA: MIT Press.
45. Martin, G. (1997). From image to word: A computational model of word recognition in reading. In M. G. Shafto & P. Langly (Eds.), Proceedings of the Nineteenth Annual Conference of the Cognitive Science Society, Stanford University, August 7-10, 1997 (pp. 496-501). Mahwah, NJ: Erlbaum.
46. Martin, G. L., & Pittman, J. A. (1991). Recognizing hand-printed letters and digits using backpropagation learning. Neural Computation, 3, 258-267.
47. Martin, G. L., Rashid, M., & Pittman, J. (1993). Integrated segmentation and recognition through exhaustive scans or learned saccadic jumps. International Journal of Pattern Recognition and Artificial Intelligence, 7, 831-847.
48. Martin, G. L., & Talley, J. (1995). Recognizing handwritten phrases from U. S. census forms by combining neural networks and dynamic programming, Journal of Artificial Neural Networks, 2, 167-193.
49. McCandliss, B. D., Cohen, L., & Dehaene, S. (2003). The visual word form area: Expertise for reading in the fusiform gyrus. Trends in Cognitive Sciences, 7, 293-299.
50. McClelland, J. L. (1976). Preliminary letter identification in the perception of words and non-words. Journal of Experimental Psychology: Human Perception and Performance, 2, 80-91.
51. McClelland, J., & Rumelhart, D. (1981). An interactive activation model of context effects in letter perception: I. An account of basic findings. Psychological Review, 88, 375-407.
52. McConkie, G. W., Kerr, P. W., Reddix, M. D., & Zola, D. (1988). Eye movement control during reading: I. The location of initial eye fixations. Vision Research, 28, 1107-1118.
53. McConkie, G. W., & Rayner, K. (1975). The span of the effective stimulus during a fixation in reading. Perception & Psychophysics, 17, 578-586.
54. McConkie, G. W., & Zola, D. (1979). Is visual information integrated across successive fixations in reading? Perception & Psychophysics, 25, 221-224.
55. McGinnies, E., Comer, P. B., & Lacey, O. L. (1952). Visual recognition thresholds as a function of word length and word frequency. Journal of Experimental Psychology, 44, 65-69.
56. Morton, J. (1969). Interaction of information in word recognition. Psychological Review, 76, 165-178.
57. Mozer, M. C. (1987). Early parallel processing in reading: A connectionist approach. In M. Coltheart (Ed.), Attention and performance XII: The psychology of reading (pp. 83-104). Hillsdale, NJ: Erlbaum.
58. Newman, E. B. (1966). Speed of reading when the span of letters is restricted. American Journal of Psychology, 79, 272-278.
59. O'Regan, J. K. (1989). Visual acuity, lexical structure, and eye movements in word recognition, In B. Elsendoorn & H. Bouma (Eds.), Working models of human perception (pp. 261-292). London: Academic Press.
60. Petersen, S. E., Fox, P. T., Snyder, A. Z., & Raichle, M. E. (1990, August 31). Activation of extrastriate and frontal cortical areas by visual words and word-like stimuli. Science, 249, 1041-1044.
61. Plaut, D. C., McClelland, J. L., Seidenberg, M., & Patterson, K. E. (1996). Understanding normal and impaired word reading: Computational principles in quasi-regular domains. Psychological Review, 103, 56-115.
62. Polk, T. A., & Farah, M. J. (2002). Functional MRI evidence for an abstract, not perceptual, word-form area. Journal of Experimental Psychology: General, 131, 65-72.
63. Pollatsek, A., Bolozky, S., Well, A. D., & Rayner, K. (1981). Asymmetries in the perceptual span for Israeli readers. Brain and Language, 14, 174-180.
64. Pollatsek, A., Lesch, M., Morris, R. K., & Rayner, K. (1992). Phonological codes are used in integrating information across saccades in word identification and reading. Journal of Experimental Psychology: Human Perception and Performance, 18, 148-162.
65. Pollatsek, A., & Rayner, K. (1989). Reading. In M. Posner (Ed.), Foundations of cognitive science (pp. 401-436). Cambridge, MA: MIT Press.
66. Pollatsek, A., Rayner, K., & Balota, D. A. (1986). Inferences about eye movement control from the perceptual span in reading. Perception & Psychophysics, 40, 123-130.
67. Posner, M. I., & Raichle, M. E. (1994). Images of mind. New York: Scientific American Library.
68. Radach, R., & Kempe, V. (1993). An individual analysis of initial fixation positions in reading. In G. d'Ydewalle & J. Van Rensbergen (Eds.), Perception and cognition: Advances in eye movement research (pp. 213-226). Amsterdam: North-Holland.
69. Rayner, K. (1975). The perceptual span and peripheral cues in reading. Cognitive Psychology, 7, 65-81.
70. Rayner, K. (1979). Eye guidance in reading: Fixation locations within words. Perception, 8, 21-30.
71. Rayner, K. (1985). The role of eye movements in learning to read and reading disability. Remedial and Special Education, 5, 53-60.
72. Rayner, K. (1986). Eye movements and the perceptual span in beginning and skilled readers. Journal of Experimental Child Psychology, 41, 211-236.
73. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372-422.
74. Rayner, K., Balota, D. A., & Pollatsek, A. (1986). Against parafoveal semantic preprocessing during eye fixations in reading. Canadian Journal of Psychology, 40, 473-483.
75. Rayner, K., & Duffy, S. A. (1986). Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity. Memory & Cognition, 14, 191-201.
76. Rayner, K., Inhoff, A. W., Morrison, R. E., Slowiaczek, M. L., & Bertera, J. H. (1981). Masking of foveal and parafoveal vision during eye fixations in reading. Journal of Experimental Psychology: Human Perception and Performance, 7, 167-179.
77. Rayner, K., Liversedge, S. P., White, S. J., & Vergilino-Perez, D. (2003). Reading disappearing text: Cognitive control of eye movements, Psychological Science, 14, 385-388.
78. Rayner, K., McConkie, G. W., & Zola, D. (1980). Integrating information across eye movements. Cognitive Psychology, 12, 206-226.
79. Rayner, K., & Pollatsek, A. (1987). Eye movements in reading: A tutorial review. In M. Coltheart (Ed.), Attention and performance XII: The psychology of reading (pp. 327-362). London: Erlbaum.
80. Rayner, K., Sereno, S. C., & Raney, G. E. (1996). Eye movement control in reading: A comparison of two types of models. Journal of Experimental Psychology: Human Perception and Performance, 22, 1188-1200.
81. Rayner, K., Well, A. D., & Pollatsek, A. (1980). Asymmetry of the effective visual field in reading. Perception & Psychophysics, 31, 537-550.
82. Rayner, K., Well, A. D., Pollatsek, A., & Bertera, J. H. (1982). The availability of useful information to the right of the fixation in reading. Perception & Psychophysics, 31, 537-550.
83. Reicher, G. (1969). Perceptual recognition as a function of meaningfulness of stimulus material. Journal of Experimental Psychology, 81, 274-280.
84. Reichle, E. D., Pollatsek, A., Fisher, D. L., & Rayner, K. (1998). Toward a model of eye movement control in reading. Psychological Review, 105, 125-157.
85. Reichle, E. D., Rayner, K., & Pollatsek, A. (1999). Eye-movement control in reading: Accounting for initial fixation locations and refixations within the E-Z Reader model. Vision Research, 39, 4403-4411.
86. Reichle, E. D., Rayner, K., & Pollatsek, A. (in press). The E-Z Reader model of eye movement control in reading: Comparisons to other models. Behavioral and Brain Sciences.
87. Rubenstein, H., Garfield, L., & Millikan, J. A. (1970). Homographic entries in the internal lexicon. Journal of Verbal Learning and Verbal Behavior, 9, 487-494.
88. Rumelhart, D., Hinton, G., & Williams, R. (1986). Learning internal representations by error propagation. In D. Rumelhart & J. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 318-363). Cambridge, MA: MIT Press.
89. Seidenberg, M. S., & McClelland, J. L. (1989). A distributed developmental model of word recognition and naming. Psychological Review, 96, 523-568.
90. Sereno, S. C., & Rayner, K. (2003). Measuring word recognition in reading: Eye movements and event-related potentials. Trends in Cognitive Sciences, 7, 489-493.
91. Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27, 379-423.
92. Smith, F., Lott, D., & Cronnel, B. (1969). The effect of type size and case alternation on word identification. American Journal of Psychology, 82, 248-253.
93. Solomon, R. L., & Postman, L. (1952). Frequency of usage as a determinant of recognition thresholds for words. Journal of Experimental Psychology, 43, 195-210.
94. Taylor, S. E. (1965). Eye movements while reading: Facts and fallacies. American Educational Research Journal, 2, 187-202.
95. Tunmer, W. E., Herriman, M. L., & Nesdale, A. R. (1988). Metalinguistic abilities and beginning reading. Reading Research Quarterly, 23, 134-155.
96. Underwood, N. R., & McConkie, G. W. (1985). Perceptual span for letter distinctions during reading. Reading Research Quarterly, 20, 153-162.
97. Valiant, L. G. (1984). A theory of the learnable. Communications of the ACM, 27, 1134-1142.
98. Vitu, F., O'Regan, J. K., & Mittau, M. (1990). Optimal landing position in reading isolated words and continuous text. Perception & Psychophysics, 47, 583-600.
99. Wagner, R. K., & Torgesen, J. K. (1987). The nature of phonological processing and its causal role in the acquisition of reading skills. Psychological Bulletin, 101, 192-212.
100. Wagner, R. K., Torgesen, J. K., Rashotte, C. A., Hecht, S A., Barker, T. A., Burgess, S. R., et al. (1997). Changing relations between phonological processing abilities and word-level reading as children develop from beginning to skilled readers: A 5-year longitudinal study. Developmental Psychology, 33, 468-479.
101. Weekes, B. S. (1997). Differential effects of number of letters on word and non-word naming latency. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 50(A), 439-456.
102. Wheeler, D. D. (1970). Processes in word recognition. Cognitive Psychology, 1, 59-85.
103. Young, A. W., & Ellis, A. W. (1985). Different methods of lexical access for words presented in the left and right visual hemifields. Brain and Language, 24, 326-358.