Image classification using multiscale information fusion based on saliency driven nonlinear diffusion filtering

IEEE Transactions on Image Processing

Volumn 23, Issue 4, 2014, Pages 1513-1526

  Hu, Weiming ^a   Hu, Ruiguang ^a   Xie, Nianhua ^a   Ling, Haibin ^b   Maybank, Stephen ^c  

^a INSTITUTE OF AUTOMATION   (China)

^b Temple University   (United States)

^c UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

image classification; multiscale information fusion; nonlinear diffusion; Saliency detection

Indexed keywords

CLASSIFICATION RATES; EXPERIMENTAL TEST; FOREGROUND FEATURES; MULTI-SCALE INFORMATIONS; MULTI-SCALE SPACE; NONLINEAR DIFFUSION; NONLINEAR DIFFUSION FILTERING; SALIENCY DETECTION;

CLASSIFICATION (OF INFORMATION); DIFFUSION; IMAGE SEGMENTATION; INFORMATION FUSION; STATISTICAL TESTS;

IMAGE CLASSIFICATION;

DIFFUSION; FACTUAL DATABASE; FLOWER; HUMAN; IMAGE PROCESSING; NONLINEAR SYSTEM; PROCEDURES; THEORETICAL MODEL;

DATABASES, FACTUAL; DIFFUSION; FLOWERS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, THEORETICAL; NONLINEAR DYNAMICS;

EID: 84896791554     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2303639     Document Type: Article

References (45)

1. Y. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning midlevel features for recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2559-2566.
2. C.-C. Chang and C.-J. Lin. (2001). LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/?cjlin/libsvm/
3. F. D'Almeida. (2003, Jul.). Nonlinear Diffusion Toolbox [Online]. Available: http://www.mathworks.cn/matlabcentral/fileexchange/3710-nonlinear- diffusion-toolbox
4. M. Everingham, A. Zisserman, C. K. I. Williams, L. van Gool, M. Allan, C. M. Bishop, et al., "The 2005 PASCAL visual object classes challenge," in Proc. 1st PASCAL Challenges Workshop, 2006, pp. 117-176. (Pubitemid 44029922)
5. C. Galleguillos, A. Rabinovich, and S. Belongie, "Object categorization using co-occurrence, location and appearance," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
6. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 221-228.
7. S. Goferman, L. Zelnik-Manor, and A. Tal, "Context-aware saliency detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2376-2383.
8. K. Grauman and T. Darrell, "The pyramid match kernel: Efficient learning with sets of features," J. Mach. Learn. Res., vol. 8, no. 4, pp. 725-760, Apr. 2007. (Pubitemid 46677049)
9. J. Harel, C. Koch, and P. Perona, "Graph-based visual saliency," in Proc. Annu. Conf. Neural Inf. Process. Syst., 2007, pp. 545-552.
10. G. Heitz and D. Koller, "Learning spatial context: Using stuff to find things," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 30-43.
11. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
12. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
13. S. Khan, J. van de Weijer, and M. Vanrell, "Top-down color attention for object recognition," in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 979-986.
14. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 2006, pp. 2169-2178. (Pubitemid 44931582)
15. H. Ling and S. Soatto, "Proximity distribution kernels for geometric context in category recognition," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
16. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, et al., "Learning to detect a salient object," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 35-367, Feb. 2011.
17. L. Marchesotti, C. Cifarelli, and G. Csurka, "A framework for visual saliency detection with applications to image thumb nailing," in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 2232-2239.
18. M. E. Nilsback and A. Zisserman, "Automated flower classification over a large number of classes," in Proc. Indian Conf. Comput. Vis., Graph. Image Process., Feb. 2008, pp. 722-729.
19. M.-E. Nilsback and A. Zisserman, "A visual vocabulary for flower classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 2. Jun. 2006, pp. 1447-1454. (Pubitemid 44931490)
20. P. Perona and J. Malik, "Scale-space and edge detection using anisotropic diffusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 7, pp. 629-639, Jul. 1990. (Pubitemid 20726016)
21. J. Shotton, J. Winn, C. Rother, and A. Criminisi, "Textonboost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 1-15. (Pubitemid 44029764)
22. M. Tahir, J. Kittler, K. Mikolajczyk, F. Yan, K. E. A. van de Sande, et al., "Visual category recognition using spectral regression and kernel discriminant analysis," in Proc. IEEE Int. Workshop Subspace, Kyoto, Japan, Jan. 2009, pp. 178-185.
23. R. Valenti, N. Sebe, and T. Gevers, "Image saliency by isocentric curvedness and color," in Proc. IEEE Int. Conf. Comput. Vis., Sep. 2010, pp. 2185-2192.
24. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek, "Evaluation of color descriptors for object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2010.
25. J. C. van Gemert, C. J. Veenman, A. W. M. Smeulders, and J. M. Geusebroek, "Visual word ambiguity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1271-1283, Jul. 2010.
26. M. Varma and D. Ray, "Learning the discriminative power invariance trade-off," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
27. D. Walther and C. Koch, "Modeling attention to salient proto-objects," Neural Netw., vol. 19, no. 9, pp. 1395-1407, 2006. (Pubitemid 44708603)
28. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3360-3367.
29. J. Weickert, "A review of nonlinear diffusion filtering," in Scale-Space Theory Compute Vision (Lecture Notes in Computer Science). New York, NY, USA: Springer-Verlag, 1997, pp. 1-28.
30. J. Weickert, B. Romeny, and M. A. Viergever, "Efficient and reliable schemes for nonlinear diffusion filtering," IEEE Trans. Image Process., vol. 7, no. 3, pp. 398-410, Mar. 1998. (Pubitemid 128745358)
31. N. Xie, H. Ling, W. Hu, and X. Zhang, "Use bin-ratio information for category and scene classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2313-2319.
32. J. Yang, K. Yu, and T. Huang, "Supervised translation invariant sparse coding," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3517-3524.
33. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local features and kernels for classification of texture and object categories: A comprehensive study," Int. J. Comput. Vis., vol. 73, no. 2, pp. 213-238, Jun. 2007. (Pubitemid 46181625)
34. M. M. Cheng, G. X. Zhang, N. J. Mitra, X. L. Huang, and S. M. Hu, "Global contrast based salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Dec. 2011, pp. 409-416.
35. F. Li, G. Lebanon, and C. Sminchisescu, "Chebyshev approximations to the histogram ?2 Kernel," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Apr. 2012, pp. 2424-2431.
36. Y. Chai, V. Lempitsky, and A. Zisserman, "BiCoS: A Bi-level cosegmentation method for image classification," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 2579-2586.
37. T. Judd, K. A. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE Int. Conf. Comput. Vis., Feb. 2009, pp. 2106-2113.
38. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, and S. Li, "Salient object detection: A discriminative regional feature integration approach," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2083-2090.
39. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, "Frequency- tuned salient region detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 1597-1604.
40. X.-H. Shen and Y. Wu, "A unified approach to salient object detection via low rank matrix recovery," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jan. 2012, pp. 853-860.
41. M.T. Mahmood and T.-S. Choi, "Nonlinear approach for enhancement of image focus volume in shape from focus," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2866-2873, May 2012.
42. M. R. Hajiaboli, M. O. Ahmad, and C. Wang, "An edge-adapting Laplacian kernel for nonlinear diffusion filters," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1561-1572, Apr. 2012.
43. P. Rodrigues and R. Bernardes, "3-D adaptive nonlinear complexdiffusion despeckling filter," IEEE Trans. Med. Imaging, vol. 31, no. 12, pp. 2205-2212, Dec. 2012.
44. B. Abdollahi, A. El-Baz, and A. A. Amini, "A multi-scale non-linear vessel enhancement technique," in Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., May 2011, pp. 3925-3929.
45. J. L. Wu, "Collaborative filtering on the netix prize dataset," Ph.D. dissertation, Dept. Comput Sci., Peking Univ., Beijing, China, 2010, pp. 82-85.