Toward Good Practices for Fine-Grained Maize Cultivar Identification with Filter-Specific Convolutional Activations

IEEE Transactions on Automation Science and Engineering

Volumn 15, Issue 2, 2018, Pages 430-442

  Lu, Hao ^a   Cao, Zhiguo ^a   Xiao, Yang ^a   Fang, Zhiwen ^a   Zhu, Yanjun ^a  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Convolutional neural network (CNN); fine grained visual categorization (FGVC); Fisher vector (FV); maize cultivar identification; mutual information (MI)

Indexed keywords

BANDPASS FILTERS; CHEMICAL ACTIVATION; COMPUTER VISION; CROPS; ENCODING (SYMBOLS); NEURAL NETWORKS;

AGRICULTURAL SYSTEM; CONVOLUTIONAL NEURAL NETWORK; CULTIVAR IDENTIFICATION; ENCODING MECHANISM; GAUSSIAN COMPONENTS; STATE-OF-THE-ART APPROACH; TEXTUAL DIFFERENCE; VISUAL CATEGORIZATION;

CONVOLUTION;

EID: 84994304881     PISSN: 15455955     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASE.2016.2616485     Document Type: Article

References (54)

1. N. K. Korir et al., "Plant variety and cultivar identification: Advances and prospects, " Critical Rev. Biotechnol., vol. 33, no. 2, pp. 111-125, 2013.
2. X. Wang, T.-K. Huang, and J. Schneider, "Active transfer learning under model shift, " in Proc. Int. Conf. Mach. Learn. (ICML), 2014, pp. 1305-1313.
3. X. Wang and J. Schneider, "Flexible transfer learning under support and model shift, " in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2014, pp. 1898-1906.
4. X. Chen, Y. Xun, W. Li, and J. Zhang, "Combining discriminant analysis and neural networks for corn variety identification, " Comput. Electron. Agricult., vol. 71, no. 1, pp. S48-S53, Apr. 2010.
5. A. Pourreza, H. Pourreza, M.-H. Abbaspour-Fard, and H. Sadrnia, "Identification of nine Iranian wheat seed varieties by textural analy-sis with image processing, " Comput. Electron. Agricult., vol. 83, pp. 102-108, Apr. 2012.
6. F. Kurtulmuş and H. Ünal, "Discriminating rapeseed varieties using computer vision and machine learning, " Expert Syst. Appl., vol. 42, no. 4, pp. 1880-1891, Mar. 2015.
7. K. Yamamoto, S. Ninomiya, Y. Kimura, A. Hashimoto, Y. Yoshioka, and T. Kameoka, "Strawberry cultivar identification and quality evaluation on the basis of multiple fruit appearance features, " Comput. Electron. Agricult., vol. 110, pp. 233-240, Jan. 2015.
8. F. Kurtulmuş and I. Kavdir, "Detecting corn tassels using computer vision and support vector machines, " Expert Syst. Appl., vol. 41, no. 16, pp. 7390-7397, Nov. 2014.
9. H. Lu, Z. Cao, Y. Xiao, Z. Fang, Y. Zhu, and K. Xian, "Fine-grained maize tassel trait characterization with multi-view representations, " Comput. Electron. Agricult., vol. 118, pp. 143-158, Oct. 2015.
10. B. Kehoe, S. Patil, P. Abbeel, and K. Goldberg, "A survey of research on cloud robotics and automation, " IEEE Trans. Autom. Sci. Eng., vol. 12, no. 2, pp. 398-409, Apr. 2015.
11. M. E. Nilsback and A. Zisserman, "Automated flower classification over a large number of classes, " in Proc. 6th Indian Conf. Comput. Vis., Graph., Image Process. (ICVGIP), Dec. 2008, pp. 722-729.
12. A. Angelova, S. Zhu, and Y. Lin, "Image segmentation for large-scale subcategory flower recognition, " in Proc. IEEE Workshop Appl. Comput. Vis. (WACV), Jan. 2013, pp. 39-45.
13. P. N. Belhumeur et al., "Searching the world's herbaria: A system for visual identification of plant species, " in Proc. Eur. Conf. Comput. Vis. (ECCV), vol. 5305, 2008, pp. 116-129.
14. N. Kumar et al., "Leafsnap: A computer vision system for automatic plant species identification, " in Proc. Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 502-516.
15. C. Wah, S. Branson, P. Welinder, P. Perona, and S. Belongie, "The Caltech-UCSD birds-200-2011 dataset, " Dept. Elect. Eng., California Inst. Technol., Pasadena, CA, USA, Tech. Rep. CNS-TR-2011-001, 2011.
16. T. Berg, J. Liu, S. W. Lee, M. L. Alexander, D. W. Jacobs, and P. N. Belhumeur, "Birdsnap: Large-scale fine-grained visual catego-rization of birds, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 2019-2026.
17. W. Li and D. Song, "Automatic bird species detection from crowd sourced videos, " IEEE Trans. Autom. Sci. Eng., vol. 11, no. 2, pp. 348-358, Apr. 2014.
18. A. Khosla, N. Jayadevaprakash, B. Yao, and F.-F. Li, "Novel dataset for fine-grained image categorization, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Colorado Springs, CO, USA, Jun. 2011, pp. 1-2.
19. O. M. Parkhi, A. Vedaldi, A. Zisserman, and C. V. Jawahar, "Cats and dogs, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog-nit. (CVPR), Jun. 2012, pp. 3498-3505.
20. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, "ImageNet: A large-scale hierarchical image database, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 248-255.
21. A. Vedaldi et al., "Understanding objects in detail with fine-grained attributes, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog-nit. (CVPR), Jun. 2014, pp. 3622-3629.
22. T.-Y. Lin, A. RoyChowdhury, and S. Maji, "Bilinear CNN models for fine-grained visual recognition, " in Proc. Int. Conf. Comput. Vis. (ICCV), Dec. 2015, pp. 1449-1457.
23. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 2012, pp. 1097-1105.
24. F. Perronnin and C. Dance, "Fisher kernels on visual vocabularies for image categorization, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2007, pp. 1-8.
25. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005.
26. L. Xiao, "Dual averaging methods for regularized stochastic learning and online optimization, " J. Mach. Learn. Res., vol. 11, pp. 2543-2596, Oct. 2010.
27. H. Lu, Z. Cao, Y. Xiao, Z. Fang, and Y. Zhu, "Fine-grained maize cultivar identification using filter-specific convolutional activations, " in Proc. Int. Conf. Image Process. (ICIP), Sep. 2016, pp. 3718-3722.
28. N. Zhang, J. Donahue, R. Girshick, and T. Darrell, "Part-based R-CNNs for fine-grained category detection, " in Proc. Eur. Conf. Com-put. Vis. (ECCV), 2014, pp. 834-849.
29. T. Xiao, Y. Xu, K. Yang, J. Zhang, Y. Peng, and Z. Zhang, "The application of two-level attention models in deep convolutional neural network for fine-grained image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 842-850.
30. Y. Zhang et al., "Weakly supervised fine-grained categorization with part-based image representation, " IEEE Trans. Image Process., vol. 25, no. 4, pp. 1713-1725, Apr. 2016.
31. A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, "CNN features off-the-shelf: An astounding baseline for recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2014, pp. 512-519.
32. L. Liu, C. Shen, and A. van den Hengel, "The treasure beneath convolutional layers: Cross-convolutional-layer pooling for image classification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 4749-4757.
33. M. Cimpoi, S. Maji, and A. Vedaldi, "Deep filter banks for texture recognition and segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 3828-3836.
34. K. He, X. Zhang, S. Ren, and J. Sun, "Spatial pyramid pooling in deep convolutional networks for visual recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 9, pp. 1904-1916, Sep. 2015.
35. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik, "Hypercolumns for object segmentation and fine-grained localization, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2015, pp. 447-456.
36. Y. Gao, O. Beijbom, N. Zhang, and T. Darrell, "Compact bilinear pooling, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2016.
37. F. Perronnin, Y. Liu, J. Sanchez, and H. Poirier, "Large-scale image retrieval with compressed Fisher vectors, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3384-3391.
38. Y. Zhang, J. Wu, and J. Cai, "Compact representation for image classification: To choose or to compress?" in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 907-914.
39. M. D. Zeiler and R. Fergus, "Visualizing and understanding convo-lutional networks, " in Proc. Eur. Conf. Comput. Vis. (ECCV), 2014, pp. 818-833.
40. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2014, pp. 1-12.
41. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " CoRR, vol. abs/1409.1556, 2014.
42. D. G. Lowe, "Object recognition from local scale-invariant features, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), vol. 2, Sep. 1999, pp. 1150-1157.
43. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1, Jun. 2005, pp. 886-893.
44. J. Sánchez, F. Perronnin, T. Mensink, and J. Verbeek, "Image classification with the Fisher vector: Theory and practice, " Int. J. Comput. Vis., vol. 105, no. 3, pp. 222-245, Dec. 2013.
45. B. A. Olshausen and D. J. Field, "Emergence of simple-cell receptive field properties by learning a sparse code for natural images, " Nature, vol. 381, no. 6583, pp. 607-609, 1996.
46. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification, " J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Aug. 2008.
47. B. J. Frey and D. Dueck, "Clustering by passing messages between data points, " Science, vol. 315, no. 5814, pp. 972-976, Feb. 2007.
48. T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971-987, Jul. 2002.
49. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Locality-constrained linear coding for image classification, " in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3360-3367.
50. A. Vedaldi and K. Lenc, "MatConvNet: Convolutional neural networks for MATLAB, " in Proc. ACM Int. Conf. Multimedia, 2015, pp. 689-692.
51. A. Vedaldi and B. Fulkerson, "VLFeat: An open and portable library of computer vision algorithms, " in Proc. ACM Int. Conf. Multimedia, 2010, pp. 1469-1472.
52. K. Chatfield, V. S. Lempitsky, A. Vedaldi, and A. Zisserman, "The devil is in the details: An evaluation of recent feature encoding methods, " in Proc. Brit. Mach. Vis. Conf. (BMVC), Sep. 2011, pp. 76.1-76.12.
53. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
54. X. Liu, T. Xia, J. Wang, and Y. Lin, "Fully convolutional attention localization networks: Efficient attention localization for fine-grained recognition, " CoRR, vol. abs/1603.06765, 2016.