Resolution enhancement of textual images: A survey of single image-based methods

IET Image Processing

Volumn 10, Issue 4, 2016, Pages 325-337

  Walha, Rim ^a,b   Drira, Fadoua ^a   Lebourgeois, Frank ^b   Alimi, Adel M ^a   Garcia, Christophe ^b  

^a UNIVERSITY OF SFAX   (Tunisia)

^b UNIVERSITÉ DE LYON   (France)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; IMAGE PROCESSING; PATTERN RECOGNITION;

HIGH QUALITY IMAGES; LOW RESOLUTION; MULTIPLE INPUTS; NATURAL IMAGES; REAL APPLICATIONS; RESOLUTION ENHANCEMENT; SINGLE IMAGES; SUPER RESOLUTION;

SURVEYS;

EID: 84961589052     PISSN: 17519659     EISSN: None     Source Type: Journal    
DOI: 10.1049/iet-ipr.2015.0334     Document Type: Review

References (78)

1. Baker, S., Kanade, T.: 'Limits on super-resolution and how to break them', IEE Trans. PAMI, 2002, 24, (9), pp. 1167-1183 (doi: 10.1109/TPAMI.2002.1033210)
2. Lin, Z., Shum, H.Y.: 'Fundamental limits of reconstruction-based superresolution algorithms under local translation', IEE Trans. PAMI, 2004, 26, (1), pp. 83-97 (doi: 10.1109/TPAMI.2004.1261081)
3. Chaudhuri, S.E.: 'Super-resolution imaging' (Springer, 2001)
4. Karimi, E., Kangarloo, K., Javadi, S.: 'Article: a survey on super-resolution methods for image reconstruction', Int. J. Comput. Appl., 2014, 90, (3), pp. 32-39
5. Nasrollahi, K., Moeslund, T.B.: 'Super-resolution: a comprehensive survey', Mach. Vis. Appl., 2014, 25, (6), pp. 1423-1468 (doi: 10.1007/s00138-014-0623-4)
6. van Ouwerkerk, J.D.: 'Image super-resolution survey', Image Vis. Comput., 2006, 24, (10), pp. 1039-1052 (doi: 10.1016/j.imavis.2006.02.026)
7. Jähne, B.: 'Digital image processing' (Springer, Berlin Heidelberg, 2005)
8. Zhou, J.Y., Lopresti, D., Sarkar, P.: 'Spatial sampling effects on scanned 2-d patterns', Adv. Vis. Form Anal.: Proceedings of the Third International Workshop in Visual Form, 1997, pp. 666-676
9. Sarkar, P., Nagy, G., Zhou, J.: 'Spatial sampling of printed patterns', IEE Trans. PAMI, 1998, 20, (3), pp. 344-351 (doi: 10.1109/34.667892)
10. Lopresti, D.P., Zhou, J., Nagy, G.: 'Spatial sampling effects in optical character recognition'. ICDAR, 1995, pp. 309-314
11. Einsele, F., Ingold, R.: 'A study of the variability of very low resolution characters and the feasibility of their discrimination using geometrical features'. Proc. Fourth World Enformatica Congress (WEC), 2005, pp. 213-217
12. Baird, H.S.: 'The state of the art of document image degradation modeling'. Proc. of Int. Workshop on Document Analysis Systems (DAS), 2000, pp. 1-16
13. Liang, J., Doermann, D.S., Li, H.: 'Camera-based analysis of text and documents: a survey', IJDAR, 2005, 7, (2-3), pp. 84-104 (doi: 10.1007/s10032-004-0138-z)
14. Einsele, F., Ingold, R., Hennebert, J.: 'A language-independent, open-vocabulary system based on hmms for recognition of ultra-low resolution words' (SAC, 2008)
15. Rashid, S.F., Shafait, F., Breuel, T.M.: 'An evaluation of hmm-based techniques for the recognition of screen rendered text'. ICDAR, 2011, pp. 1260-1264
16. Slimane, F., Kanoun, S., Hennebert, J.: 'A study on font-family and font-size recognition applied to Arabic word images at ultra-low resolution', PRL, 2013, 34, pp. 209-218 (doi: 10.1016/j.patrec.2012.09.012)
17. Ogawa, Y., Ariki, Y., Takiguchi, T.: 'Super-resolution by gmm based conversion using self-reduction image'. ICASSP, 2012, pp. 1285-1288
18. Dong, W., Zhang, L., Shi, G.: 'Nonlocally centralized sparse representation for image restoration', TIP, 2013, 22, (4), pp. 1620-1630
19. Hou, H., Andrews, H.C.: 'Cubic splines for image interpolation and digital filtering', IEEE Trans. Acoust. Speech Signal Process., 1978, 26, pp. 508-517 (doi: 10.1109/TASSP.1978.1163154)
20. Keys, R.G.: 'Cubic convolution interpolation for digital image processing', IEEE Trans. Acoust. Speech Signal Process., 1981, 29, pp. 1153-1160 (doi: 10.1109/TASSP.1981.1163711)
21. Schreiber, W.F.: 'Fundamentals of electronic imaging systems: some aspects of image processing' (Springer Series in Information Sciences, 1986)
22. Greenspan, H., Anderson, C.H., Akber, S.: 'Image enhancement by non-linear extrapolation in frequency space', TIP, 2000, 9, (6), pp. 2-13
23. Morse, B.S., Schwartzwald, D.: 'Image magnification using level set reconstruction'. ICCV, 2001, pp. 333-341
24. Battiato, S., Gallo, G., Stanco, F.: 'Smart interpolation by anisotropic diffusion'. ICIAP, 2003, pp. 572-577
25. Li, X., Orchard, M.T.: 'New edge-directed interpolation', TIP, 2001, 10, (10), pp. 1521-1527
26. Ben-Ezra, M., Lin, Z., Wilburn, B.: 'Penrose pixels super-resolution in the detector layout domain'. ICCV, 2007, pp. 1-8
27. Cheeseman, P.: 'Super-resolved surface reconstruction from multiple images' (NASA Ames Research Center, Moffett Field, 1994)
28. Irani, M., Peleg, S.: 'Motion analysis for image enhancement: resolution, occlusion, and transparency', J. Vis. Commun. Image Represent., 1993, 4, pp. 324-335 (doi: 10.1006/jvci.1993.1030)
29. Smelyansky, V.N., Cheeseman, P., Maluf, D.A.: 'Bayesian super-resolved surface reconstruction from images'. CVPR, 2000, pp. 1375-1382
30. Freeman, W.T., Pasztor, E.C.: 'Markov networks for super-resolution'. Technical Report TR-2000-08, MERL, Mitsubishi Electric Research Labs, 2000
31. Kim, K.I., Kwon, Y.: 'Example-based learning for single-image super-resolution'. DAGM Symp. on Pattern Recognition, 2008, pp. 456-465
32. Fattal, R.: 'Image upsampling via imposed edge statistics'. SIGGRAPH, 2007
33. Sun, J., Xu, Z., Shum, H.Y.: 'Image super-resolution using gradient profile prior'. CVPR 2008, Alaska, USA, 2008, IEEE Computer Society
34. Freeman, W.T., Jones, T.R., Pasztor, E.C.: 'Example-based super-resolution', IEEE Comput. Graph. Appl., 2002, 22, (2), pp. 56-65 (doi: 10.1109/38.988747)
35. Storkey, A.J.: 'Dynamic structure super-resolution', (NIPS, MIT Press, 2003), pp. 1295-1302
36. Mairal, J., Elad, M., Sapiro, G.: 'Sparse representation for color image restoration', TIP, 2008, 17, (1), pp. 53-69
37. Yang, S., Liu, Z., Wang, M.: 'Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction', Neurocomputing, 2011, 74, (17), pp. 3193-3203 (doi: 10.1016/j.neucom.2011.04.014)
38. Yang, S., Wang, M., Chen, Y.: 'Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding', TIP, 2012, 21, (9), pp. 4016-4028
39. Marquina, A., Osher, S.J.: 'Image super-resolution by tv-regularization and Bregman iteration', J. Sci. Comput., 2008, 37, (3), pp. 367-382 (doi: 10.1007/s10915-008-9214-8)
40. Yang, J., Wright, J., Huang, T.S.: 'Image super-resolution via sparse representation', TIP, 2010, 19, (11), pp. 2861-2873
41. Dong, W., Zhang, L., Shi, G.: 'Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization', TIP, 2011, 20, (7), pp. 1838-1857
42. Zhang, L., Wu, X.: 'An edge-guided image interpolation algorithm via directional filtering and data fusion', TIP, 2006, 15, (8), pp. 2226-2238
43. Wang, Z., Bovik, A.C., Sheikh, H.R.: 'Image quality assessment: from error visibility to structural similarity', TIP, 2004, 13, (4), pp. 600-612
44. Zhang, L., Zhang, D., Mou, X.: 'Fsim: a feature similarity index for image quality assessment', TIP, 2011, 20, (8), pp. 2378-2386
45. Pratt, W.K.: 'Digital image processing' (John Wiley & Sons Inc., New York, NY, USA, 1978 3rd edn),
46. Luong, H.Q., Philips, W.: 'Robust reconstruction of low-resolution document images by exploiting repetitive character behaviour', IJDAR, 2008, 11, (1), pp. 39-51 (doi: 10.1007/s10032-008-0068-2)
47. Thouin, P.D., Chang, C.I.: 'A method for restoration of low-resolution document images', IJDAR, 2000, 2, (4), pp. 200-210 (doi: 10.1007/s100320050006)
48. Park, J., Kwon, Y., Kim, J.H.: 'An example-based prior model for text image super-resolution'. ICDAR, 2005, pp. 374-378
49. Tipping, M.E., Bishop, C.M.: 'Bayesian image super-resolution'. NIPS, 2003, pp. 1303-1310
50. Pickup, L.C., Roberts, S.J., Zisserman, A.: 'A sampled texture prior for image super-resolution'. NIPS, 2003, pp. 1587-1594
51. Donaldson, K., Myers, G.K.: 'Bayesian super-resolution of text in video with a text-specific bimodal prior'. CVPR, 2005, vol. 1, pp. 1188-1195
52. Yan, Z., Lu, Y., Li, J.: 'Super resolution of text image by pruning outlier'. In: Lu, B.L., Zhang, L., Kwok, J.T. (Eds.): 'ICONIP (3)', 2011, vol. 7064, pp. 649-656
53. Casey, R.G., Friedman, T.D., Wong, K.Y.: 'Automatic scaling of digital print fonts', IBM J. Res. Dev., 1982, 26, (6), pp. 657-666 (doi: 10.1147/rd.266.0657)
54. Namane, A., Sid-Ahmed, M.A.: 'Character scaling by contour method', PAMI, 1990, 12, (6), pp. 600-606 (doi: 10.1109/34.56197)
55. Zheng, Y., Kang, X., Li, S.: 'Real-time document image super-resolution by fast matting'. DAS, 2014, pp. 232-236
56. Mancas-Thillou, C., Majid, M.: 'Super-resolution text using the Teager filter'. CBDAR, 2005, pp. 10-16
57. Ulichney, R., Troxel, D.E.: 'Scaling binary images with the telescoping template', PAMI, 1982, 4, (3), pp. 331-335 (doi: 10.1109/TPAMI.1982.4767254)
58. Thouin, P., Du, Y., Chang, C.I.: 'Low resolution expansion of gray scale text images using Gibbs-Markov random field model'. 2001 Symp. on Document Image Understanding Technology, Columbia, MD, 2001, pp. 41-47
59. Zhang, H., Yang, J., Zhang, Y.: 'Non-local kernel regression for image and video restoration'. ECCV, 2010, pp. 566-579
60. Hobby, J.D., Ho, T.K.: 'Enhancing degraded document images via bitmap clustering and averaging'. ICDAR, 1997, pp. 394-400
61. Bern, M.W., Goldberg, D.: 'Scanner-model-based document image improvement'. ICIP, 2000, pp. 582-585
62. Banerjee, J., Jawahar, C.V.: 'Super-resolution of text images using edge-directed tangent field'. Proc. of DAS, Washington, DC, USA, 2008, pp. 76-83
63. Kim, H.Y.: 'Binary operator design by k-nearest neighbor learning with application to image resolution increasing', Int. J. Imaging Syst. Technol., 2000, 11, (5), pp. 331-339 (doi: 10.1002/ima.1017)
64. Dalley, G., Freeman, W.T., Marks, J.: 'Single-frame text super-resolution: a Bayesian approach'. ICIP, 2004, pp. 3295-3298
65. Fan, W., Sun, J., Naoi, S., Minagawa, A.: 'Local consistency constrained adaptive neighbor embedding for text image super-resolution'. DAS, 2012, pp. 90-94
66. Chang, H., Yeung, D.Y., Xiong, Y.: 'Super-resolution through neighbor embedding'. CVPR, 2004, vol. 1, pp. 275-282
67. Tappen, M.F., Russell, B.C., Freeman, W.T.: 'Exploiting the sparse derivative prior for superresolution and image demosaicing'. Workshop on Statistical and Computational Theories of Vision, 2003
68. Walha, R., Drira, F., Lebourgeois, F.: 'Super-resolution of single text image by sparse representation'. DAR, 2012, pp. 22-29, DOI 10.1145/2432553.2432558
69. Caner, G., Haritaoglu, I.: 'Shape-dna: effective character restoration and enhancement for Arabic text documents'. ICPR, 2010, pp. 2053-2056
70. Walha, R., Drira, F., Lebourgeois, F.: 'Resolution enhancement of textual images via multiple coupled dictionaries and adaptive sparse representation selection', IJDAR, 2015, 18, (1), pp. 87-107 (doi: 10.1007/s10032-014-0235-6)
71. Walha, R., Drira, F., Lebourgeois, F.: 'Multiple learned dictionaries based clustered sparse coding for the super-resolution of single text image'. ICDAR, 2013, pp. 484-488
72. Walha, R., Drira, F., Lebourgeois, F.: 'A sparse coding based approach for the resolution enhancement and restoration of printed and handwritten textual images'. ICFHR, 2014, pp. 696-701
73. Shan, Q., Li, Z., Jia, J.: 'Fast image/video upsampling', ACM Trans. Graph., 2008, 27, (5), pp. 153:1-153:7 (doi: 10.1145/1409060.1409106)
74. Freeman, G., Fattal, R.: 'Image and video upscaling from local self-examples', ACM Trans. Graph., 2010, 28, (3), pp. 1-10
75. Walha, R., Drira, F., Lebourgeois, F.: 'Joint denoising and magnification of noisy low-resolution textual images'. ICDAR, 2015, pp. 871-875
76. Banerjee, J., Namboodiri, A.M., Jawahar, C.V.: 'Contextual restoration of severely degraded document images'. CVPR, 2009, pp. 517-524
77. Ohkura, A., Deguchi, D., Takahashi, T.: 'Low-resolution character recognition by video-based super-resolution'. ICDAR, 2009, pp. 191-195
78. Nayef, N., Chazalon, J., Gomez-Kramer, P.: 'Efficient example-based superresolution of single text images based on selective patch processing'. DAS, 2014, pp. 227-231