Cursive word recognition based on interactive activation and early visual processing models

International Journal of Neural Systems

Volumn 18, Issue 5, 2008, Pages 419-431

  Ruiz Pinales, Jose ^a   Jaime Rivas, Rene ^a   Lecolinet, Eric ^b   Castro Bleda, Maria Jose ^c  

^a UNIVERSITY OF GUANAJUATO   (Mexico)

^b Group for Neural Theory   (France)

^c UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

Author keywords

Convolutional neural networks; Feedforward model; Handwriting recognition; Interactive activation model; Reading models

Indexed keywords

CONVOLUTION; FEATURE EXTRACTION; FEEDFORWARD NEURAL NETWORKS; VEGETATION; VIDEO STREAMING; VISUAL COMMUNICATION; VOCABULARY CONTROL;

CONVOLUTIONAL NEURAL NETWORKS; FEEDFORWARD MODEL; HANDWRITING RECOGNITION; INTERACTIVE ACTIVATION MODEL; READING MODELS;

NEURAL NETWORKS;

ALGORITHM; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; HANDWRITING; HUMAN; IMAGE PROCESSING; METHODOLOGY; NERVE CELL NETWORK; PATTERN RECOGNITION; PHYSIOLOGY; READING; STANDARD; TIME; VISUAL CORTEX; VISUAL SYSTEM;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; HANDWRITING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; NERVE NET; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; PATTERN RECOGNITION, VISUAL; READING; TIME FACTORS; VISUAL CORTEX; VISUAL PATHWAYS;

EID: 55849091372     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065708001683     Document Type: Article

References (64)

1. A. L. Koerich, R. Sabourin and C. Y. Suen, Large vocabulary off-line handwritten word recognition: A Survey, Patt. Anal. and Appl. 6 (2) (2003) 97-121.
2. L. M. Lorigo and V. Govindaraju, Offline arablc handwriting recognition: A survey, IEEE Trans. on Patt. Anal. and Mach. Intell. 28 (5) (2006) 712-724.
3. S. Madvanath and V. Govindaraju, The role of holistic paradigms in handwritten word recognition, IEEE Trans. on Patt. Anal. and Mach. Intell. 23 (2) (2001) 149-164.
4. A. Vinciarelli, A survey on off-line cursive script recognition, Pattern Recognition 35 (7) (2002) 1433-1446.
5. J. J. Hull and S. N. Srihari, A computational approach to visual word Recognition: Hypothesis generation and testing, in Proc. of IEEE-CS Conference on Computer Vision and Pattern Recognition (1986) 156-161.
6. M. C. Mozer, Early parallel processing in reading: A connectionist approach, in Attention and Performance XII: The Psychology of Reading, ed. M. Coltheart (London: Erlbaum, 1987), pp. 83-104.
7. C. A. Higgins and P. E. Bramall, On-line handwriting recognition based on the human reading process, in Proc. Sixth Int'l. Conf. on Handwriting and Drawing (1993) 111-113.
8. E. LeColinet, Cursive script recognition by backward matching, in Proc. Sixth Int'l. Conf. on Handwriting and Drawing (1993) 89-91.
9. A. Guillevic, Unconstrained Handwriting Recognition Applied to the Processing of Bank Cheques, PhD thesis (Concordia University, Montreal, Canada, 1995).
10. M. Côté, E. LeColinet, M. Cheriet and C. Y. Suen, Automatic reading of cursive scripts using a reading model and perceptual concepts, Int. Journal on Doc. Anal. and Recog. 1 (1) (1998) 3-17.
11. Y. Lecun, L. Bottou, Y. Bengio and P. Haffner, Gradient-based learning applied to document recognition, Proc. of the IEEE 86 (11) (1998) 2278-2324.
12. D. Marr, Vision (New York: W. H. Freeman and Company, 1982).
13. D. Hubel and T. Wiesel, Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, Journal of Physiology 160 (1) (1962) 106-154.
14. D. Marr, The computation of lightness by the primate retina, Vision Research 14 (12) (1974) 1377-1388.
15. B. Julesz, Experiments in the visual perception of texture, Scientific American 232 (4) (1975) 34-43.
16. A. Treisman and G. Gelade, A feature integration theory of attention, Cognitive Psychology 12 (1) (1980) 97-136.
17. M. I. Posner and D. Presti, Selective attention and cognitive control, Trends in Neurosciences 10 (1) (1987) 13-17.
18. D. A. Allport, Visual Attention, in Foundations of Cognitive Science, M. I. Posner (ed.), (Cambridge, MA: MIT Press, 1989), pp. 631-682.
19. K. R. Cave and J. M. Wolfe, Modeling the role of parallel processing in visual search, Cognitive Psychology 22 (2) (1990) 225-271.
20. U. Neisser, Cognitive Psychology (New York: Appleton-Century- Crofts, 1967).
21. R. H. Haber and M. Hershenson, The Psychology of Visual Perception (New York: Holt, Rinehart and Wiston, 1973).
22. A. H. C. Van der Heijden, Selective Attention in Vision (London: Routledge, 1992).
23. J. L. McClelland and D. E. Rumelhart, An interactive activation model of context effects in letter perception: Part 1. An account of basic findings, Psychological R.eview 88 (5) (1981) 375-407.
24. R. A. Wilson and F. Keil, MIT Encyclopedia of Cognitive Sciences (Cambridge, MA: The MIT Press, 1999).
25. G. W. Yelland, Word recognition and lexical access, in Encylopedia of Language and Linguistics, A. Bowers (ed.), Vol. 4 (Edinburgh: Pergamon Press, 1994).
26. A. M. Jacobs and J. Grainger, Testing a semistochastic variant of the interactive activation model in different word recognition experiments, Journal of Experimental Psychology: Human Perception and Performance 18 (4) (1992) 1174-1188.
27. M. Coltheart and E. Davelaar, J. Jonasson and D. Besner, Access to the internal lexicon, in Attention and Performance VI (ed.) Domic, S. (Hillsdale. N.J.: Lawrence Erlbaum Associates, 1977).
28. J. Morton, Word Recognition, in Psycholinguistics: Vol. 2. Structures and Process (eds.) J. Morton, and J. C. Marshall (London: Paul Elek, 1979).
29. K. I. Forster, Accessing the mental lexicon, in New Approaches to Language Mechanisms (eds.) R. J. Wales and E. W. Walker (Amsterdam: North-Holland, 1976), pp. 257-287.
30. K. Paap, S. L. Newsome, J. E. McDonald and R. W. Schvaneveldt, An activation-verification model for letter and word recognition: the word superiority effect, Psychological Review 89 (5) (1982) 573-594.
31. M. Coltheart and K. Rastle, Serial processing in reading aloud: Evidence for dual-route models of reading, Journal of Experimental Psychology: Human Perception and Performance 20 (6) (1994) 1197-1211.
32. A. M. Jacobs and J. Grainger, Models of visual word recognition - Sampling the state of the art, Journal of Experimental Psychology: Human Perception and Performance 20 (6) (1994) 1311-1334.
33. S. Grossberg and G. O. Stone, Neural dynamics of word recognition and recall: Attentional priming, learning, and resonance, Psychological Review 93 (1) (1986) 46-74.
34. A. H. Kawamoto, Nonlinear dynamics in the resolution of lexical ambiguity: A parallel distributed processing account, Journal of Memory and Language 32 (4) (1993) 474-516.
35. M. S. Seidenberg and J. L. McClelland, A distributed developmental model of word recognition and naming, Psychological Review 96 (4) (1989) 523-568.
36. D. Besner and R. S. McCann, Word frequency and pattern distortion in visual word identification and production: An examination of four classes of models, in Attention and Performance XII: The psychology of reading, ed. M. Coltheart (Hillsdale, NJ: Erlbaum, 1987), pp. 201-219.
37. T. H. Carr and A. Pollatsek, Recognizing printed words: A look at current models, in Reading research: Advances in theory and practice 5 (eds.) D. Besner, T. G. Waller, and G. E. MacKinnon (Orlando, FL: Academic Press, 1985), pp. 1-82.
38. D. W. Massaro and M. M. Cohen, Integration versus interactive activation: The joint influence of stimulus and context in perception, Cognitive Psychology 23 (4) (1991) 558-614.
39. G. M. Reicher, Perceptual recognition as a function of meaningfulness of stimulus material, Journal of Experimental Psychology 81 (2) (1969) 275-280.
40. D. D. Wheeler, Processes in word recognition, Cognitive Psychology 1 (1) (1970) 59-85.
41. H. Rubenstein, L. Garfield and J. A. Millikan, Homographic entries in the internal lexicon, Journal of Verbal Learning and Verbal Behavior 9 (5) (1970) 487-494.
42. I. Taylor and M. M. Taylor, The Psychology of Reading (New York: Academic Press, 1983).
43. D. Scarborough, C. Cortese and H. Scarborough, Frequency and repetition effects in lexical memory, Journal of Experimental Psychology: Human Perception and Performance 3 (1) (1977) 1-17.
44. D. W. J. Corcoran and R. O. Rouse, An aspect of perceptual organization involved in reading typed and handwritten words, Quaterly J. of Exp. Psych. 22 (3) (1970) 526-530.
45. A. Treisman, Features and objects in visual processing, Scientific American 255 (5) (1986) 106-115.
46. D. Marr, Representing visual information - A computational approach, in Computer Vision Systems, eds. A. Hanson and E. Riseman (New York: Academic Press, 1978), pp. 61-80.
47. V. N. Vapnik, An overview of statistical learning theory, IEEE Transactions on Neural Networks 10 (5) (1999) 988-999.
48. G. Martin, M. Rashid and J. A. Pittman, Integrated segmentation and recognition through exhaustive scans or learned saccadic jumps, Int. Journal of Pattern Recognition and Artificial Intelligence 7 (4) (1993) 831-847.
49. J. Wang and J. Jean, Segmentation of merged characters by neural networks and shortest path, Pattern Recognition 27 (5) (1994) 649-658.
50. S. Lawrence, C. L. Giles, A. C. Tsoi and A. D. Back, Face recognition: A convolutional-network approach, IEEE Trans. Neural Networks 8 (1) (1997) 98-113.
51. C. Garcia and M. Delakis, Convolutional face finder: A neural architecture for fast and robust face detection, IEEE Trans. on Pattern Analysis and Machine Intelligence 26 (11) (2004) 1408-1423.
52. Y. LeCun and Y. Bengio, Convolutional networks for images, speech, and time-series, in Handbook of Brain Theory and Neural Nets (eds.) M. A. Arbib (Cambridge, MA: MIT Press, 1995), pp. 255-257.
53. C. Koch and T. Poggio, Multiplying with synapses and neurons, in Single Neuron Computation, (eds.) T. McKenna, J. Davis and S. F. Zornetzer (Boston: Academic Press, 1992), pp. 315-345.
54. Y. LeCun, B. E. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. E. Hubbard and L. D. Jackel, Handwritten digit recognition with a backpropagation network, in Neural Information Processing Systems 2 (ed.) D. Touretzky (San Mateo, CA: Morgan Kaufmann, 1989), 396-404.
55. H. Ney, On the probabilistic interpretation of neural network classifiers and discriminative training criteria, IEEE Trans. on Pattern Analysis and Machine Intelligence 17 (2) (1995) 107-119.
56. L. B. Almeida, A learning Rule for asynchronous perceptions with feedback in a combinatorial environment, in Proc. of IEEE Int. Conf. on Neural Networks (San Diego, 1987), pp. 609-618.
57. J. A. Hertz, A. Krogh and R. G. Paimer, Introduction to the Theory of Neural Computation (Redwood City, CA: Addison Wesley, 1991).
58. A. Hoekstra, M. A. Kraaijveld, D. deRidder and W. F. Schmidt, The Complete SPRLIB and ANNLIB (The Netherlands: Delft University of Technology, Pattern Recognition Group, 1996).
59. S. M. Weiss, Small sample error rate estimation for k-NN classifiers, IEEE Trans. on Patt. Anal. and Mach. Intell. 13 (3) (1991) 285-289.
60. R. Kohavi, A study of cross-validation and bootstrap for accuracy estimation and model selection, in Proc. Int. Joint Conf. on Artificial Intelligence (Montreal: Morgan Kaufmann, 1995), pp. 1137-1145.
61. J. M. Twomey and A. E. Smith, Bias and variance of validation methods for function approximation neural networks under conditions of sparse data, IEEE Transactions on Systems. Man, and Cybernetics: Part C 28 (3) (1998) 417-430.
62. D. E. Rumelhart and J. L. McClelland, An interactive activation model of context effects in letter perception: Part 2. The contextual enhancement effect and some tests and extensions of the model, Psychological Review 89 (1) (1982) 60-94.
63. J. H. Kim, K. K. Kim and C. Y. Suen, HMM-MLP hybrid model for cursive script recognition, Patt. Anal. and Appl. 3 (4) (2000) 314-324.
64. U. V. Marti and H. Bunke, The IAM-database: An English sentence database for offline handwriting recognition, Int. J. Doc. Anal. Recognit. 5 (1) (2002) 39-46.