Hierarchical learning of tree classifiers for large-scale plant species identification

IEEE Transactions on Image Processing

Volumn 24, Issue 11, 2015, Pages 4172-4184

  Fan, Jianping ^a   Zhou, Ning ^a   Peng, Jiny ^b   Gao, Ling ^b  

^a University of North Carolina at Charlotte   (United States)

^b NORTHWEST UNIVERSITY   (China)

Author keywords

discriminative tree classifiers; Hierarchical multi task structural learning; inter level relationship constraint; large scale plant species identification; visual tree

Indexed keywords

ALGORITHMS; FORESTRY; IMAGE CODING; TREES (MATHEMATICS);

DISCRIMINATIVE TREE CLASSIFIERS; INTER-LEVEL RELATIONSHIP CONSTRAINT; PLANT SPECIES IDENTIFICATION; STRUCTURAL LEARNING; VISUAL TREE;

LEARNING ALGORITHMS;

ALGORITHMS; CLASSIFIERS; PLANTS; SPECIES IDENTIFICATION; TREES;

ALGORITHM; ARTIFICIAL INTELLIGENCE; CLASSIFICATION; PLANT;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLASSIFICATION; PLANTS;

EID: 84939496346     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2457337     Document Type: Article

References (75)

1. H. D. Harrington and L. W. Durrell, How to Identify Plants. Columbus, OH, USA: Ohio State Univ. Press, 1997.
2. J. S. Cope, D. Corney, J. Y. Clark, P. Remagnino, and P. Wilkin, Plant species identification using digital morphometrics: A review, Expert Syst. Appl., vol. 39, no. 8, pp. 7562-7573, 2012.
3. D. G. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
4. F. Mindru, T. Tuytelaars, L. Van Gool, and T. Moons, Moment invariants for recognition under changing viewpoint and illumination, Comput. Vis. Image Understand., vol. 94, nos. 1-3, pp. 3-27, 2004.
5. D. Zhang and G. Lu, Review of shape representation and description techniques, Pattern Recognit., vol. 37, no. 1, pp. 1-19, 2004.
6. M. J. Swain and D. H. Ballard, Color indexing, Int. J. Comput. Vis., vol. 7, no. 1, pp. 11-32, 1991.
7. G. Agarwal et al., First steps toward an electronic field guide for plants, Taxon, vol. 55, no. 3, pp. 597-610, 2006.
8. P. N. Belhumeur et al., Searching the worlds herbaria: A system for visual identification of plant species, in Proc. 10th ECCV, 2008, pp. 116-129.
9. N. Kumar et al., Leafsnap: A computer vision system for automatic plant species identification, in Proc. 12th ECCV, 2012, pp. 502-516.
10. F. Mokhtarian and S. Abbasi, Matching shapes with self-intersections: Application to leaf classification, IEEE Trans. Image Process., vol. 13, no. 5, pp. 653-661, May 2004.
11. H. Goeau et al., The ImageCLEF 2012 plant identification task, CLEF, Valencia, Spain, Sep. 2013.
12. S. A. Shearer and R. G. Holmes, Plant identification using color co-occurrence matrices, Trans. ASAE, vol. 33, no. 6, pp. 2037-2044, 1990.
13. J. Hemming and T. Rath, PA-Precision agriculture: Computer-visionbased weed identification under field conditions using controlled lighting, J. Agricult. Eng. Res., vol. 78, no. 3, pp. 233-243, 2001.
14. S. Abbasi, F. Mokhtarian, and J. Kittler, Reliable classification of chrysanthemum leaves through curvature scale space, in Scale-Space Theory in Computer Vision. Berlin, Germany: Springer-Verlag, 1997, pp. 284-295.
15. J. C. Neto, G. E. Meyer, D. D. Jones, and A. K. Samal, Plant species identification using elliptic Fourier leaf shape analysis, Comput. Electron. Agricult., vol. 50, no. 2, pp. 121-134, 2006.
16. J. Harnsomburana, J. M. Green, A. S. Barb, M. Schaeffer, L. Vincent, and C.-R. Shyu, Computable visually observed phenotype ontological framework for plants, BMC Bioinform., vol. 12, no. 1, p. 260, 2011.
17. T. Saitoh and T. Kaneko, Automatic recognition of wild flowers, in Proc. IEEE 15th ICPR, Aug. 2000, pp. 507-510.
18. M.-E. Nilsback and A. Zisserman, A visual vocabulary for flower classification, in Proc. IEEE CVPR, Jun. 2006, pp. 1447-1454.
19. Y. Rui, T. S. Huang, and S.-F. Chang, Image retrieval: Current techniques, promising directions, and open issues, J. Vis. Commun. Image Represent., vol. 10, no. 1, pp. 39-62, 1999.
20. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, Content-based image retrieval at the end of the early years, IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, Dec. 2000.
21. R. Datta, D. Joshi, J. Li, and J. Z. Wang, Image retrieval: Ideas, influences, and trends of the new age, ACM Comput. Surv., vol. 40, no. 2, 2008, Art. ID 5.
22. J. Fan, X. He, N. Zhou, J. Peng, and R. Jain, Quantitative characterization of semantic gaps for learning complexity estimation and inference model selection, IEEE Trans. Multimedia, vol. 14, no. 5, pp. 1414-1428, Oct. 2012.
23. T. Dean, M. A. Ruzon, M. Segal, J. Shlens, S. Vijayanarasimhan, and J. Yagnik, Fast, accurate detection of 100,000 object classes on a single machine, in Proc. IEEE CVPR, Jun. 2013, pp. 1814-1821.
24. B. Zhao and E. P. Xing, Sparse output coding for large-scale visual recognition, in Proc. IEEE CVPR, Jun. 2013, pp. 3350-3357.
25. H. Jegou, M. Douze, and C. Schmid, Improving bag-of-features for large scale image search, Int. J. Comput. Vis., vol. 87, no. 3, pp. 316-336, 2011.
26. J. Deng, J. Krause, A. C. Berg, and F.-F. Li, Hedging your bets: Optimizing accuracy-specificity trade-offs in large scale visual recognition, in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 3450-3457.
27. B. Zhao, F. Li, and E. P. Xing, Large-scale category structure aware image categorization, in Proc. Adv. NIPS, 2011, pp. 1251-1259.
28. T. Evgeniou, C. A. Micchelli, and M. Pontil, Learning multiple tasks with kernel methods, J. Mach. Learn. Res., vol. 6, pp. 615-637, Apr. 2005.
29. J. Fan, Y. Gao, and H. Luo, Integrating concept ontology and multitask learning to achieve more effective classifier training for multilevel image annotation, IEEE Trans. Image Process., vol. 17, no. 3, pp. 407-426, Mar. 2008.
30. A. Torralba, K. P. Murphy, and W. T. Freeman, Sharing features: Efficient boosting procedures for multiclass object detection, in Proc. IEEE Comput. Soc. Conf. CVPR, Jun./Jul. 2004, pp. II-762-II-769.
31. A. Esuli, T. Fagni, and F. Sebastiani, TreeBoost.MH: A boosting algorithm for multi-label hierarchical text categorization, in Proc. 12th Int. Conf. SPIRE, 2006, pp. 13-24.
32. R. K. Ando and T. Zhang, A framework for learning predictive structures from multiple tasks and unlabeled data, J. Mach. Learn. Res., vol. 6, pp. 1817-1853, Dec. 2005.
33. S. Thrun and L. Pratt, Eds., Learning to Learn. Norwell, MA, USA: Kluwer, 1997.
34. S. Dumais and H. Chen, Hierarchical classification of Web content, in Proc. 23rd Annu. Int. ACM SIGIR Conf., 2000, pp. 256-263.
35. L. Cai and T. Hofmann, Hierarchical document categorization with support vector machines, in Proc. 13th ACM CIKM, 2004, pp. 78-87.
36. G.-R. Xue, D. Xing, Q. Yang, and Y. Yu, Deep classification in largescale text hierarchies, in Proc. 31st Annu. Int. ACM SIGIR, 2008, pp. 619-626.
37. R. M. Neal and B. Shahbaba, Improving classification when a class hierarchy is available using a hierarchy-based prior, Bayesian Anal., vol. 2, no. 1, pp. 221-237, 2007.
38. D. Koller and M. Sahami, Hierarchically classifying documents using very few words, in Proc. 14th ICML, 1997, pp. 170-178.
39. A. McCallum, R. Rosenfeld, T. M. Mitchell, and A. Y. Ng, Improving text classification by shrinkage in a hierarchy of classes, in Proc. 15th ICML, 1998, pp. 359-367.
40. S. Gopal, Y. Yang, B. Bai, and A. Niculescu-Mizil, Bayesian models for large-scale hierarchical classification, in Proc. Adv. NIPS, 2012, pp. 2411-2419.
41. O. Dekel, J. Keshet, and Y. Singer, Large margin hierarchical classification, in Proc. 21st ICML, 2004, p. 27.
42. J. Wang, X. Shen, and W. Pan, On large margin hierarchical classification with multiple paths, J. Amer. Statist. Assoc., vol. 104, no. 487, pp. 1213-1223, 2009.
43. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and F.-F. Li, ImageNet: A large-scale hierarchical image database, in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 248-255.
44. J. Fan, Y. Gao, and H. Luo, Hierarchical classification for automatic image annotation, in Proc. 30th Annu. Int. ACM SIGIR, 2007, pp. 111-118.
45. M. Naphade et al., Large-scale concept ontology for multimedia, IEEE Multimedia, vol. 13, no. 3, pp. 86-91, Jul./Sep. 2006.
46. M. Marszalek and C. Schmid, Constructing category hierarchies for visual recognition, in Proc. 10th ECCV, 2008, pp. 479-491.
47. D. Nister and H. Stewenius, Scalable recognition with a vocabulary tree, in Proc. IEEE CVPR, Jun. 2006, pp. 2161-2168.
48. G. Griffin and P. Perona, Learning and using taxonomies for fast visual categorization, in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
49. S. Bengio, J. Weston, and D. Grangier, Label embedding trees for large multi-class tasks, in Proc. Adv. NIPS, 2010, pp. 163-171.
50. E. Bart, I. Porteous, P. Perona, and M. Welling, Unsupervised learning of visual taxonomies, in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
51. J. Deng, S. Satheesh, A. C. Berg, and F. Li, Fast and balanced: Efficient label tree learning for large scale object recognition, in Proc. Adv. NIPS, 2011, pp. 567-575.
52. B. Liu, F. Sadeghi, M. Tappen, O. Shamir, and C. Liu, Probabilistic label trees for efficient large scale image classification, in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 843-850.
53. J. Sivic, B. C. Russell, A. Zisserman, W. T. Freeman, and A. A. Efros, Unsupervised discovery of visual object class hierarchies, in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
54. T. Gao and D. Koller, Discriminative learning of relaxed hierarchy for large-scale visual recognition, in Proc. IEEE ICCV, Nov. 2011, pp. 2072-2079.
55. J. Shi and J. Malik, Normalized cuts and image segmentation, IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
56. D. Comaniciu and P. Meer, Mean shift: A robust approach toward feature space analysis, IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
57. M. Boutell and J. Luo, Beyond pixels: Exploiting camera metadata for photo classification, Pattern Recognit., vol. 38, no. 6, pp. 935-946, 2005.
58. C. Siagian and L. Itti, Rapid biologically-inspired scene classification using features shared with visual attention, IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 2, pp. 300-312, Feb. 2007.
59. Y. Ma and H.-J. Zhang, Contrast-based image attention analysis by using fuzzy growing, in Proc. 11th ACM Multimedia, 2003, pp. 374-381.
60. C. Rother, V. Kolmogorov, and A. Blake, GrabCut: Interactive foreground extraction using iterated graph cuts, ACM Trans. Graph., vol. 23, no. 3, pp. 309-314, 2004.
61. D. M. Witten and R. Tibshirani, A framework for feature selection in clustering, J. Amer. Statist. Assoc., vol. 105, no. 490, pp. 713-726, 2010.
62. J. G. Dy and C. E. Brodley, Feature selection for unsupervised learning, J. Mach. Learn. Res., vol. 5, pp. 845-889, Dec. 2004.
63. M. H. C. Law, M. A. T. Figueiredo, and A. K. Jain, Simultaneous feature selection and clustering using mixture models, IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1154-1166, Sep. 2004.
64. V. Roth and T. Lange, Feature selection in clustering problems, in Proc. Adv. NIPS, 2004, pp. 473-480.
65. M. Dash and H. Liu, Feature selection for clustering, in Knowledge Discovery and Data Mining. Current Issues and New Applications. Berlin, Germany: Springer-Verlag, 2000.
66. A. J. Smola, S. V. N. Vishwanathan, and Q. V. Le, Bundle methods for machine learning, in Proc. Adv. NIPS, 2008, pp. 1377-1384.
67. C. Teo, S. V. N. Vishwanathan, A. J. Smola, and Q. V. Le, Bundle methods for regularized risk minimization, J. Mach. Learn. Res., vol. 11, pp. 311-365, Mar. 2010.
68. Y. Wang and D. Forsyth, Large multi-class image categorization with ensembles of label trees, in Proc. IEEE ICME, Jul. 2013, pp. 1-6.
69. A. Borji, D. N. Sihite, and L. Itti, Salient object detection: A benchmark, in Computer Vision (Lecture Notes in Computer Science), LNCS 7573. Berlin, Germany: Springer-Verlag, 2012, pp. 414-429.
70. H. Jiang, J. Wang, Z. Yuan, Y. Wu, N. Zheng, and S. Li, Salient object detection: A discriminative regional feature integration approach, in Proc. IEEE CVPR, Jun. 2013, pp. 2083-2090.
71. M.-M. Cheng, G.-X. Zhang, N. J. Mitra, X. Huang, and S.-M. Lu, Global contrast based salient region detection, in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 409-416.
72. M.-M. Cheng, N. J. Mitra, X. Huang, P. H. S. Torr, and S.-M. Hu, Global contrast based salient region detection, IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 3, pp. 569-582, Mar. 2015.
73. M.-M. Cheng, J. Warrell, W.-Y. Lin, S. Zheng, V. Vineet, and N. Crook, Efficient salient region detection with soft image abstraction, in Proc. IEEE ICCV, Dec. 2013, pp. 1529-1536.
74. F. Perazzi, P. Krahenbuhl, Y. Pritch, and A. Hornung, Saliency filters: Contrast based filtering for salient region detection, in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 733-740.
75. L. Breiman, Random forests, Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001.