How deep learning extracts and learns leaf features for plant classification

Pattern Recognition

Volumn 71, Issue , 2017, Pages 1-13

  Lee, Sue Han ^a   Chan, Chee Seng ^a   Mayo, Simon Joseph ^b   Remagnino, Paolo ^c  

^a UNIVERSITY OF MALAYA   (Malaysia)

^b ROYAL BOTANIC GARDENS   (United Kingdom)

^c KINGSTON UNIVERSITY   (United Kingdom)

Author keywords

Deep learning; Feature visualisation; Plant recognition

Indexed keywords

EDUCATION; EXTRACTION; FEATURE EXTRACTION; METADATA; NEURAL NETWORKS;

CONVOLUTIONAL NEURAL NETWORK; DISCRIMINATIVE POWER; FEATURE EXTRACTION TECHNIQUES; HIGHER-LEVEL ABSTRACTION; HYBRID-FEATURE EXTRACTION; PLANT CLASSIFICATION; PLANT IDENTIFICATION SYSTEMS; PLANT RECOGNITION;

DEEP LEARNING;

EID: 85023164668     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2017.05.015     Document Type: Article

References (55)

1. Govaerts, R., How many species of seed plants are there?. Taxon 50:4 (2001), 1085–1090.
2. Nagendra, H., Rocchini, D., High resolution satellite imagery for tropical biodiversity studies: the devil is in the detail. Biodivers. Conserv. 17:14 (2008), 3431–3442.
3. Qi, L., Yang, Q., Bao, G., Xun, Y., Zhang, L., A dynamic threshold segmentation algorithm for cucumber identification in greenhouse. International Congress on Image and Signal Processing, 2009, 1–4.
4. Zhang, S., Lei, Y., Dong, T., Zhang, X.-P., Label propagation based supervised locality projection analysis for plant leaf classification. Pattern Recognit. 46:7 (2013), 1891–1897.
5. Wu, S.G., Bao, F.S., Xu, E.Y., Wang, Y.-X., Chang, Y.-F., Xiang, Q.-L., A leaf recognition algorithm for plant classification using probabilistic neural network. IEEE International Symposium on Signal Processing and Information Technology, 2007, 11–16.
6. Joly, A., Goëau, H., Glotin, H., Spampinato, C., Bonnet, P., Vellinga, W.-P., Planqué, R., Rauber, A., Palazzo, S., Fisher, B., et al. LifeCLEF 2015: multimedia life species identification challenges. Experimental IR Meets Multilinguality, Multimodality, and Interaction, 2015, Springer, 462–483.
7. Kumar, N., Belhumeur, P.N., Biswas, A., Jacobs, D.W., Kress, W.J., Lopez, I.C., Soares, J.V., Leafsnap: a computer vision system for automatic plant species identification. ECCV, 2012, Springer, 502–516.
8. Hall, D., McCool, C., Dayoub, F., Sunderhauf, N., Upcroft, B., Evaluation of features for leaf classification in challenging conditions. 2015 IEEE Winter Conference on Applications of Computer Vision, 2015, 797–804.
9. Kalyoncu, C., Toygar, Ö., Geometric leaf classification. Comput. Vision Image Understanding 133 (2015), 102–109.
10. A. Kadir, L.E. Nugroho, A. Susanto, P.I. Santosa, Leaf classification using shape, color, and texture features, arXiv: 1401.4447 (2013).
11. Neto, J.C., Meyer, G.E., Jones, D.D., Samal, A.K., Plant species identification using elliptic fourier leaf shape analysis. Comput. Electron. Agric. 50:2 (2006), 121–134.
12. Mouine, S., Yahiaoui, I., Verroust-Blondet, A., Advanced shape context for plant species identification using leaf image retrieval. Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, 2012, 49.
13. Xiao, X.-Y., Hu, R., Zhang, S.-W., Wang, X.-F., Hog-based approach for leaf classification. Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence, 2010, Springer, 149–155.
14. Naresh, Y., Nagendraswamy, H., Classification of medicinal plants: an approach using modified LBP with symbolic representation. Neurocomputing 173 (2016), 1789–1797.
15. Tang, Z., Su, Y., Er, M.J., Qi, F., Zhang, L., Zhou, J., A local binary pattern based texture descriptors for classification of tea leaves. Neurocomputing 168 (2015), 1011–1023.
16. Cope, J.S., Remagnino, P., Barman, S., Wilkin, P., Plant texture classification using Gabor co-occurrences. International Symposium on Visual Computing, 2010, Springer, 669–677.
17. Charters, J., Wang, Z., Chi, Z., Tsoi, A.C., Feng, D.D., EAGLE: a novel descriptor for identifying plant species using leaf lamina vascular features. ICME-Workshop, 2014, 1–6.
18. Larese, M.G., Namías, R., Craviotto, R.M., Arango, M.R., Gallo, C., Granitto, P.M., Automatic classification of legumes using leaf vein image features. Pattern Recognit. 47:1 (2014), 158–168.
19. Chaki, J., Parekh, R., Plant leaf recognition using shape based features and neural network classifiers. Int. J. Adv. Comput. Sci. Appl., 2(10), 2011.
20. Du, J.-X., Wang, X.-F., Zhang, G.-J., Leaf shape based plant species recognition. Appl. Math. Comput. 185:2 (2007), 883–893.
21. Aakif, A., Khan, M.F., Automatic classification of plants based on their leaves. Biosyst. Eng. 139 (2015), 66–75.
22. Zhao, C., Chan, S.S., Cham, W.-K., Chu, L., Plant identification using leaf shapes – a pattern counting approach. Pattern Recognit. 48:10 (2015), 3203–3215.
23. Cope, J.S., Remagnino, P., Classifying plant leaves from their margins using dynamic time warping. International Conference on Advanced Concepts for Intelligent Vision Systems, 2012, Springer, 258–267.
24. Ma, L.-H., Zhao, Z.-Q., Wang, J., ApLeafis: an android-based plant leaf identification system. International Conference on Intelligent Computing, 2013, 106–111.
25. Backes, A.R., Bruno, O.M., Plant leaf identification using multi-scale fractal dimension. International Conference on Image Analysis and Processing, 2009, Springer, 143–150.
26. Rashad, M., El-Desouky, B., Khawasik, M.S., Plants images classification based on textural features using combined classifier. Int. J. Comput. Sci. Inf. Technol. 3:4 (2011), 93–100.
27. Olsen, A., Han, S., Calvert, B., Ridd, P., Kenny, O., In situ leaf classification using histograms of oriented gradients. International Conference on Digital Image Computing, 2015, 1–8.
28. Beghin, T., Cope, J.S., Remagnino, P., Barman, S., Shape and texture based plant leaf classification. International Conference on Advanced Concepts for Intelligent Vision Systems, 2010, Springer, 345–353.
29. Chaki, J., Parekh, R., Bhattacharya, S., Plant leaf recognition using texture and shape features with neural classifiers. Pattern Recognit. Lett. 58 (2015), 61–68.
30. Grinblat, G.L., Uzal, L.C., Larese, M.G., Granitto, P.M., Deep learning for plant identification using vein morphological patterns. Comput. Electron. Agric. 127 (2016), 418–424.
31. Lee, S.H., Chan, C.S., Wilkin, P., Remagnino, P., Deep-plant: plant identification with convolutional neural networks. IEEE International Conference on Image Processing, 2015, 452–456.
32. Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. NIPS, 2012, 1097–1105.
33. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, T. Darrell, Decaf: a deep convolutional activation feature for generic visual recognition, arXiv: 1310.1531 (2013).
34. Dong, C., Loy, C.C., He, K., Tang, X., Learning a deep convolutional network for image super-resolution. ECCV, 2014, Springer, 184–199.
35. Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T., Caffe: convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM international conference on Multimedia, 2014, ACM, 675–678.
36. Zeiler, M.D., Fergus, R., Visualizing and understanding convolutional networks. ECCV, 2014, Springer, 818–833.
37. Yang, J., Yu, K., Gong, Y., Huang, T., Linear spatial pyramid matching using sparse coding for image classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2009, 1794–1801.
38. Roth-Nebelsick, A., Uhl, D., Mosbrugger, V., Kerp, H., Evolution and function of leaf venation architecture: a review. Ann. Bot. 87:5 (2001), 553–566.
39. Candela, H., Martınez-Laborda, A., Luis Micol, J., Venation pattern formation in Arabidopsis thaliana vegetative leaves. Dev. Biol. 205:1 (1999), 205–216.
40. Runions, A., Fuhrer, M., Lane, B., Federl, P., Rolland-Lagan, A.-G., Prusinkiewicz, P., Modeling and visualization of leaf venation patterns. ACM Trans. Graph. 24:3 (2005), 702–711.
41. Clarke, J., Barman, S., Remagnino, P., Bailey, K., Kirkup, D., Mayo, S., Wilkin, P., Venation pattern analysis of leaf images. Advances in Visual Computing, 2006, Springer, 427–436.
42. Cope, J.S., Remagnino, P., Barman, S., Wilkin, P., The extraction of venation from leaf images by evolved vein classifiers and ant colony algorithms. Advanced Concepts for Intelligent Vision Systems, 2010, Springer, 135–144.
43. Mullen, R.J., Monekosso, D., Barman, S., Remagnino, P., Wilkin, P., Artificial ants to extract leaf outlines and primary venation patterns. Ant Colony Optimization and Swarm Intelligence, 2008, Springer, 251–258.
44. Ellis, B., Daly, D.C., Hickey, L.J., Johnson, K.R., Mitchell, J.D., Wilf, P., Wing, S.L., Manual of leaf architecture. 190, 2009, Cornell University Press Ithaca.
45. Reyes, A.K., Caicedo, J.C., Camargo, J.E., Fine-tuning deep convolutional networks for plant recognition. Working Notes of CLEF 2015 Conference, 2015.
46. Sladojevic, S., Arsenovic, M., Anderla, A., Culibrk, D., Stefanovic, D., Deep neural networks based recognition of plant diseases by leaf image classification. Comput. Intell. Neurosci., 2016, 1–11.
47. C. Ashley, D. Alexandre, D. Stewart, H. Gerard, L. Simon, M. John, Plant recognition: Bringing deep learning to iOS(2014).
48. K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition, arXiv: 1409.1556 (2014).
49. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A., Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, 1–9.
50. K. Zhang, M. Sun, T.X. Han, X. Yuan, L. Guo, T. Liu, Residual networks of residual networks: multilevel residual networks, arXiv: 1608.02908 (2016).
51. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C.L., Microsoft coco: common objects in context. ECCV, 2014, Springer, 740–755.
52. B. Zhou, A. Khosla, A. Lapedriza, A. Torralba, A. Oliva, Places:an image database for deep scene understanding, arXiv: 1610.02055 (2016).
53. Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., Fei-Fei, L., Large-scale video classification with convolutional neural networks. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2014, 1725–1732.
54. R. Krishna, Y. Zhu, O. Groth, J. Johnson, K. Hata, J. Kravitz, S. Chen, Y. Kalantidis, L.-J. Li, D.A. Shamma, et al., Visual genome: connecting language and vision using crowdsourced dense image annotations, arXiv: 1602.07332 (2016).
55. A. Berg, J. Deng, L. Fei-Fei, Large scale visual recognition challenge 2010, 2010,.