Toward integrated scene text reading

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 2, 2014, Pages 375-387

  Weinman, Jerod J ^a   Butler, Zachary ^a   Knoll, Dugan ^a   Feild, Jacqueline ^b  

^a GRINNELL COLLEGE   (United States)

^b Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

baseline estimation; character recognition; cropped word recognition; discriminative semi Markov model; image binarization; Scene text recognition; skew detection; text guidelines; word normalization; word segmentation

Indexed keywords

BASELINE ESTIMATION; IMAGE BINARIZATION; SCENE TEXT; SEMI MARKOV MODEL; SKEW DETECTION; TEXT GUIDELINES; WORD NORMALIZATION; WORD RECOGNITION; WORD SEGMENTATION;

BENCHMARKING; COMPUTATIONAL LINGUISTICS; MARKOV PROCESSES;

CHARACTER RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DOCUMENTATION; IMAGE ENHANCEMENT; METHODOLOGY; NATURAL LANGUAGE PROCESSING; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; SYSTEM ANALYSIS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DATA INTERPRETATION, STATISTICAL; DOCUMENTATION; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SYSTEMS INTEGRATION;

EID: 84891621153     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.126     Document Type: Article

References (57)

1. R. Darnton, "The Library in the New Age," The New York Rev. of Books, vol. 55, June 2008.
2. V. Wu, R. Manmatha, and E.M. Riseman, "Textfinder: An Automatic System to Detect and Recognize Text in Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 11, pp. 1224-1229, Nov. 1999. (Pubitemid 32211200)
3. X. Chen, J. Yang, J. Zhang, and A. Waibel, "Automatic Detection and Recognition of Signs from Natural Scenes," IEEE Trans. Image Processing, vol. 13, no. 1, pp. 87-99, Jan. 2004.
4. X. Chen and A.L. Yuille, "Detecting and Reading Text in Natural Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 366-373, 2004.
5. B. Epshtein, E. Ofek, and Y. Wexler, "Detecting Text in Natural Scenes with Stroke Width Transform," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2963-2970, 2010.
6. L. Neumann and J. Matas, "Real-Time Scene Text Localization and Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 3538-3545, 2012.
7. S.M. Lucas, A. Panaretos, L. Sosa, A. Tang, S. Wong, and R. Young, "ICDAR 2003 Robust Reading Competitions," Proc. Int'l Conf. Document Analysis and Recognition, vol. 2, pp. 682-687, 2003.
8. J. Ohya, A. Shio, and S. Akamatsu, "Recognizing Characters in Scene Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 2, pp. 214-220, Feb. 1994.
9. C. Thillou, S. Ferreira, and B. Gosselin, "An Embedded Application for Degraded Text Recognition," Eurasip J. Applied Signal Processing, vol. 13, pp. 2127-2135, 2005. (Pubitemid 41781769)
10. J.J. Weinman and E. Learned-Miller, "Improving Recognition of Novel Input with Similarity," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 308-315, June 2006. (Pubitemid 44931345)
11. S.M. Lucas, "Text Locating Competition Results," Proc. Int'l Conf. Document Analysis and Recognition, pp. 80-85, 2005.
12. Z. Saidane, C. Garcia, and J.L. Dugelay, "The Image Text Recognition Graph (iTRG)," Proc. Int'l Conf. Multimedia and Expo, pp. 266-269, 2009.
13. K. Wang and S. Belongie, "Word Spotting in the Wild," Proc. European Conf. Computer Vision, Sept. 2010.
14. L. Neumann and J. Matas, "A Method for Text Localization and Recognition in Real-World Images," Proc. Asian Conf. Computer Vision, pp. 770-783, 2010.
15. T. Yamazoe, M. Etoh, T. Yoshimura, and K. Tsujino, "Hypothesis Preservation Approach to Scene Text Recognition with Weighted Finite-State Transducer," Proc. Int'l Conf. Document Analysis and Recognition, pp. 359-363, 2011.
16. K. Elagouni, C. Garcia, F. Mamalet, and P. Sébillot, "Combining Multi-Scale Character Recognition and Linguistic Knowledge for Natural Scene Text OCR," Proc. Int'l Workshop Document Analysis Systems, pp. 120-124, Mar. 2012.
17. A. Mishra, K. Alahari, and C.V. Jawahar, "Top-Down and Bottom-Up Cues for Scene Text Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2687-2694, 2012.
18. A. Shahab, F. Shafait, and A. Dengel, "ICDAR 2011 Robust Reading Competition Challenge 2: Reading Text in Scene Images," Proc. Int'l Conf. Document Analysis and Recognition, pp. 1491-1496, 2011.
19. K. Wang, B. Babenko, and S. Belongie, "End-to-End Scene Text Recognition," Proc. IEEE Int'l Conf. Computer Vision, pp. 1457-1464, 2011.
20. J.J. Weinman, E. Learned-Miller, and A. Hanson, "Scene Text Recognition Using Similarity and a Lexicon with Sparse Belief Propagation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 10, pp. 1733-1746, Oct. 2009.
21. P. Shivakumara, S. Bhowmick, B. Su, C.L. Tan, and U. Pal, "A New Gradient Based Character Segmentation Method for Video Text Recognition," Proc. Int'l Conf. Document Analysis and Recognition, pp. 126-130, 2011.
22. J.J. Weinman, E. Learned-Miller, and A. Hanson, "A Discriminative Semi-Markov Model for Robust Scene Text Recognition," Proc. Int'l Conf. Pattern Recognition, Dec. 2008.
23. J.J. Weinman, "Unified Detection and Recognition for Reading Text in Scene Images," PhD thesis, Univ. of Massachusetts Amherst, 2008.
24. S. Sarawagi and W.W. Cohen, "Semi-Markov Conditional Random Fields for Information Extraction," Advances in Neural Information Processing Systems, pp. 1185-1192, MIT Press, 2005.
25. J.D. Ferguson, "Variable Duration Models for Speech," Proc. Symp. Application of Hidden Markov Models to Text and Speech, pp. 143-179, 1980.
26. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-Based Learning Applied to Document Recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
27. X. Huang, A. Acero, and H.-W. Hon, Spoken Language Processing: A Guide to Theory, Algorithm, and System Development. Prentice Hall PTR, 2001.
28. C.-L. Liu, M. Koga, and H. Fujisawa, "Lexicon-Driven Segmentation and Recognition of Handwritten Character Strings for Japanese Address Reading," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 11, pp. 1425-1437, Nov. 2002. (Pubitemid 35421788)
29. H.I. Koo and N.I. Cho, "Text-Line Extraction in Handwritten Chinese Documents Based on an Energy Minimization Framework," IEEE Trans. Image Processing, vol. 21, no. 3, pp. 1169-1175, Mar. 2012.
30. Y.-F. Pan, X. Hou, and C.-L. Liu, "Text Localization in Natural Scene Images Based on Conditional Random Field," Proc. Int'l Conf. Document Analysis and Recognition, pp. 6-10, 2009.
31. H. Zhang, C. Liu, C. Yang, X. Ding, and K. Wang, "An Improved Scene Text Extraction Method Using Conditional Random Field and Optical Character Recognition," Proc. Int'l Conf. Document Analysis and Recognition, pp. 708-712, 2011.
32. J. Zhang and R. Kasturi, "Character Energy and Link Energy-Based Text Extraction in Scene Images," Proc. Asian Conf. Computer Vision, pp. 308-320, 2010.
33. K. Kita and T. Wakahara, "Binarization of Color Characters in Scene Images Using K-Means Clustering and Support Vector Machines," Proc. Int'l Conf. Pattern Recognition, pp. 3183-3186, 2010.
34. C. Zeng, W. Jia, and X. He, "An Algorithm for Colour-Based Natural Scene Text Segmentation," Proc. Fourth Int'l Workshop Camera-Based Document Analysis and Recognition, pp. 58-68, 2012.
35. M.S. Cho, J.-H. Seok, S. Lee, and J.H. Kim, "Scene Text Extraction by Superpixel CRFs Combining Multiple Character Features," Proc. Int'l Conf. Document Analysis and Recognition, pp. 1034-1038, 2011.
36. A. Mishra, K. Alahari, and C. Jawahar, "An MRF Model for Binarization of Natural Scene Text," Proc. Int'l Conf. Document Analysis and Recognition, pp. 11-16, 2011.
37. Z. Tu and S.-C. Zhu, "Image Segmentation by Data-Driven Markov Chain Monte Carlo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 657-673, May 2002. (Pubitemid 34550432)
38. J. Feild and E. Learned Miller, "Scene Text Recognition with Bilateral Regression," Technical Report UM-CS-2012-021, Univ. of Massachusetts-Amherst, Computer Science Research Center, Univ. of Massachusetts, 2012.
39. M.-K. Hu, "Visual Pattern Recognition by Moment Invariants," IRE Trans. Information Theory, vol. 8, no. 2, pp. 179-187, Feb. 1962.
40. P.M. Williams, "Bayesian Regularization and Pruning Using a Laplace Prior," Neural Computation, vol. 7, pp. 117-143, 1995.
41. J. Jung, S. Lee, M. Cho, and J. Kim, "Touch TT: Scene Text Extractor Using Touchscreen Interface," ETRI J., vol. 33, no. 1, pp. 78-88, 2011.
42. J.J. Hull, Document Image Skew Detection: Survey and Annotated Bibliography, vol. Document Analysis Systems II of Series in Machine Perception and Artificial Intelligence, pp. 40-64, 1998.
43. Y. Bengio and Y.L. Cun, "Word Normalization for On-Line Handwritten Word Recognition," Proc. Int'l Conf. Pattern Recognition, pp. 409-413, 1994.
44. T. Caesar, J.M. Gloger, and E. Mandler, "Estimating the Baseline for Written Material," Proc. Int'l Conf. Document Analysis and Recognition, vol. 1, pp. 382-385, Aug. 1995.
45. L. Neumann and J. Matas, "Text Localization in Real-World Images Using Efficiently Pruned Exhaustive Search," Proc. Int'l Conf. Document Analysis and Recognition, pp. 687-691, 2011.
46. D.J. MacKay, "Bayesian Interpolation," Neural Computation, vol. 4, pp. 415-448, 1992.
47. C. Jacobs, P.Y. Simard, P. Viola, and J. Rinker, "Text Recognition of Low-Resolution Document Images," Proc. Int'l Conf. Document Analysis and Recognition, pp. 695-699, 2005. (Pubitemid 46442414)
48. M.-Y. Chen, A. Kundu, and S.N. Srihari, "Variable Duration Hidden Markov Model and Morphological Segmentation for Handwritten Word Recognition," IEEE Trans. Image Processing, vol. 4, no. 12, pp. 1675-1688, Dec. 1995.
49. E.P. Simoncelli and W.T. Freeman, "The Steerable Pyramid: A Flexible Architecture for Multi-Scale Derivative Computation," Proc. Int'l Conf. Image Processing, vol. 3, pp. 444-447, 1995.
50. Q.-F. Wang, F. Yin, and C.-L. Liu, "Handwritten Chinese Text Recognition by Integrating Multiple Contexts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 8, pp. 1469-1481, Aug. 2012.
51. J.J. Weinman, "Typographical Features for Scene Text Recognition," Proc. Int'l Conf. Pattern Recognition, pp. 3987-3990, 2010.
52. S.M. Lucas, G. Patoulas, and A.C. Downton, "Fast Lexicon-Based Word Recognition in Noisy Index Card Images," Proc. Int'l Conf. Document Analysis and Recognition, vol. 1, pp. 462-466, 2003.
53. P.Y. Simard, D. Steinkraus, and J.C. Platt, "Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis," Proc. Int'l Conf. Document Analysis and Recognition, vol. 2, pp. 958-963, 2003.
54. C. Sutton and A. McCallum, "Piecewise Training for Structured Prediction," Machine Learning, vol. 77, nos. 2/3, pp. 165-194, 2009.
55. Y. LeCun, S. Chopra, R. Hadsell, M. Ranzato, and F. Huang, "A Tutorial on Energy-Based Learning," Predicting Structured Data, G. Bakir, T. Hofman, B. Schölkopf, A. Smola, and B. Taskar, eds., MIT Press, 2006.
56. C. Yi and Y. Tian, "Text String Detection from Natural Scenes by Structure-Based Partition and Grouping," IEEE Trans. Image Processing, vol. 20, no. 9, pp. 2594-2605, Sept. 2011.
57. J.L. McClelland and D.E. Rumelhart, "An Interactive Activation Model of Context Effects in Letter Perception: Part 1. An Account of Basic Findings," Psychological Rev., vol. 88, pp. 375-407, Sept. 1981.