Learning Neural Bag-of-Features for Large-Scale Image Retrieval

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 47, Issue 10, 2017, Pages 2641-2652

  Passalis, Nikolaos ^a   Tefas, Anastasios ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Bag of features (BoFs) representation; information retrieval; neural networks; retrieval oriented optimization

Indexed keywords

BACKPROPAGATION; ENCODING (SYMBOLS); INFORMATION RETRIEVAL; NEURAL NETWORKS; RADIAL BASIS FUNCTION NETWORKS; SIGNAL ENCODING;

ACCUMULATION LAYERS; BAG OF FEATURES; FEATURE DISTRIBUTION; IMAGE REPRESENTATIONS; RADIAL BASIS FUNCTION(RBF); SPATIAL SEGMENTATION; STATE-OF-THE-ART TECHNIQUES; STORAGE REQUIREMENTS;

IMAGE RETRIEVAL;

EID: 85028353728     PISSN: 21682216     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2017.2680404     Document Type: Article

References (54)

1. M. S. Lew, N. Sebe, C. Djeraba, and R. Jain, "Content-based multimedia information retrieval: State of the art and challenges," ACM Trans. Multimedia Comput. Commun. Appl., vol. 2, no. 1, pp. 1-19, 2006.
2. Y. Guo, L. Zhang, Y. Hu, X. He, and J. Gao, "MS-Celeb-1M: A dataset and benchmark for large-scale face recognition," in Proc. Eur. Conf. Computer Vis. (ECCV 2016), 2016, pp. 87-102.
3. L. Wolf, T. Hassner, and I. Maoz, "Face recognition in unconstrained videos with matched background similarity," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, 2011, pp. 529-534.
4. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva, "Learning deep features for scene recognition using places database," in Proc. Adv. Neural Inf. Process. Syst., Montreal, QC, Canada, 2014, pp. 487-495.
5. F. M. Anuar, R. Setchi, and Y.-K. Lai, "Semantic retrieval of trademarks based on conceptual similarity," IEEE Trans. Syst., Man, Cybern., Syst., vol. 46, no. 2, pp. 220-233, Feb. 2016.
6. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105.
7. D. Rafailidis and P. Daras, "The TFC model: Tensor factorization and tag clustering for item recommendation in social tagging systems," IEEE Trans. Syst., Man, Cybern., Syst., vol. 43, no. 3, pp. 673-688, May 2013.
8. N. Zheng, S. Song, and H. Bao, "A temporal-topic model for friend recommendations in Chinese microblogging systems," IEEE Trans. Syst., Man, Cybern., Syst., vol. 45, no. 9, pp. 1245-1253, Sep. 2015.
9. H. Jégou, M. Douze, and C. Schmid, "Improving bag-of-features for large scale image search," Int. J. Comput. Vis., vol. 87, no. 3, pp. 316-336, 2010.
10. B. Kulis and K. Grauman, "Kernelized locality-sensitive hashing for scalable image search," in Proc. IEEE Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 2130-2137.
11. J. Wang, W. Liu, S. Kumar, and S.-F. Chang, "Learning to hash for indexing big data-A survey," Proc. IEEE, vol. 104, no. 1, pp. 34-57, Jan. 2016.
12. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos," in Proc. IEEE Int. Conf. Comput. Vis., Nice, France, 2003, pp. 1470-1477.
13. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. New York, NY, USA, 2006, pp. 2169-2178.
14. Y.-G. Jiang, C.-W. Ngo, and J. Yang, "Towards optimal bag-of-features for object categorization and semantic video retrieval," in Proc. ACM Int. Conf. Image Video Retrieval, Amsterdam, The Netherlands, 2007, pp. 494-501.
15. D. G. Lowe, "Object recognition from local scale-invariant features," in Proc. IEEE Int. Conf. Comput. Vis., vol. 2. 1999, pp. 1150-1157.
16. Z. Wu, Q. Ke, J. Sun, and H.-Y. Shum, "Scalable face image retrieval with identity-based quantization and multireference reranking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 10, pp. 1991-2001, Oct. 2011.
17. C. Wang, Y. Wang, and Z. Zhang, "Patch-based bag of features for face recognition in videos," in Proc. Biometric Recognit., vol. 7701. Guangzhou, China, 2012, pp. 1-8.
18. S. Yang, G. Bebis, Y. Chu, and L. Zhao, "Effective face recognition using bag of features with additive kernels," J. Electron. Imag., vol. 25, no. 1, 2016, Art. no. 013025.
19. N. Passalis and A. Tefas, "Spatial bag of features learning for large scale face image retrieval," in Proc. INNS Conf. Big Data, 2016, pp. 8-17.
20. J. Wan, G. Guo, and S. Z. Li, "Explore efficient local features from RGB-D data for one-shot learning gesture recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 8, pp. 1626-1639, Aug. 2016.
21. J. Wan, Q. Ruan, W. Li, and S. Deng, "One-shot learning gesture recognition from RGB-D data using bag of features," J. Mach. Learn. Res., vol. 14, no. 1, pp. 2549-2582, 2013.
22. M. Riley, E. Heinen, and J. Ghosh, "A text retrieval approach to contentbased audio retrieval," in Proc. Int. Conf. Music Inf., 2008, pp. 295-300.
23. A. Iosifidis, A. Tefas, and I. Pitas, "Multidimensional sequence classification based on fuzzy distances and discriminant analysis," IEEE Trans. Knowl. Data Eng., vol. 25, no. 11, pp. 2564-2575, Nov. 2013.
24. S. Lazebnik and M. Raginsky, "Supervised learning of quantizer codebooks by information loss minimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 7, pp. 1294-1309, Jul. 2009.
25. X.-C. Lian, Z. Li, B.-L. Lu, and L. Zhang, "Max-margin dictionary learning for multiclass image categorization," in Proc. Eur. Conf. Comput. Vis., Heraklion, Greece, 2010, pp. 157-170.
26. W. Zhang, A. Surve, X. Fern, and T. Dietterich, "Learning non-redundant codebooks for classifying complex objects," in Proc. Annu. Int. Conf. Mach. Learn., Montreal, QC, Canada, 2009, pp. 1241-1248.
27. A. Iosifidis, A. Tefas, and I. Pitas, "Discriminant bag of words based representation for human action recognition," Pattern Recognit. Lett., vol. 49, pp. 185-192, Nov. 2014.
28. N. Passalis and A. Tefas, "Entropy optimized feature-based bag-of-words representation for information retrieval," IEEE Trans. Knowl. Data Eng., vol. 28, no. 7, pp. 1664-1677, Jul. 2016.
29. E. M. Voorhees, "The cluster hypothesis revisited," in Proc. Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retrieval, Montreal, QC, Canada, 1985, pp. 188-196.
30. T. Li, S. Duan, J. Liu, L. Wang, and T. Huang, "A spintronic memristorbased neural network with radial basis function for robotic manipulator control implementation," IEEE Trans. Syst., Man, Cybern., Syst., vol. 46, no. 4, pp. 582-588, Apr. 2016.
31. K. Z. Mao and G.-B. Huang, "Neuron selection for RBF neural network classifier based on data structure preserving criterion," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1531-1540, Nov. 2005.
32. Theano Development Team, "Theano: A Python framework for fast computation of mathematical expressions," unpublished paper, 2016. [Online]. Available: https://arxiv.org/abs/1605.02688
33. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features (SURF)," Comput. Vis. Image Understanding, vol. 110, no. 3, pp. 346-359, 2008.
34. G. B. Huang and C. K. Siew, "Extreme learning machine with randomly assigned RBF kernels," Int. J. Inf. Technol., vol. 11, no. 1, pp. 16-24, 2005.
35. L. L. C. Kasun, Y. Yang, G.-B. Huang, and Z. Zhang, "Dimension reduction with extreme learning machine," IEEE Trans. Image Process., vol. 25, no. 8, pp. 3906-3918, Aug. 2016.
36. C. D. Manning, P. Raghavan, and H. Schütze, Introduction to Information Retrieval, vol. 1. Cambridge, U.K.: Cambridge Univ. Press, 2008
37. L. Zhang, Z. Wang, T. Mei, and D. D. Feng, "A scalable approach for content-based image retrieval in peer-to-peer networks," IEEE Trans. Knowl. Data Eng., vol. 28, no. 4, pp. 858-872, Apr. 2016.
38. M. Tzelepi and A. Tefas, "Relevance feedback in deep convolutional neural networks for content based image retrieval," in Proc. 9th Hellenic Conf. Artif. Intell. (SETN), Thessaloniki, Greece, May 2016, pp. 1-7.
39. J. Wan et al., "CSMMI: Class-specific maximization of mutual information for action and gesture recognition," IEEE Trans. Image Process., vol. 23, no. 7, pp. 3152-3165, Jul. 2014.
40. X. Wang, B. Wang, X. Bai, W. Liu, and Z. Tu, "Max-margin multipleinstance dictionary learning," in Proc. Int. Conf. Mach. Learn., Atlanta, GA, USA, 2013, pp. 846-854.
41. M. Jiu, C. Wolf, C. Garcia, and A. Baskurt, "Supervised learning and codebook optimization for bag-of-words models," Cogn. Comput., vol. 4, no. 4, pp. 409-419, 2012.
42. N. Passalis and A. Tefas, "Neural bag-of-features learning," Pattern Recognit., vol. 64, pp. 277-294, Apr. 2017.
43. Y.-L. Boureau, F. Bach, Y. LeCun, and J. Ponce, "Learning mid-level features for recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, 2010, pp. 2559-2566.
44. Y. Kuang, M. Byröd, and K. Aström, "Supervised feature quantization with entropy optimization," in Proc. IEEE Int. Conf. Comput. Vis. Workshops (ICCV Workshops), Barcelona, Spain, 2011, pp. 1386-1393.
45. Y. Kuang, K. Aström, L. Kopp, M. Oskarsson, and M. Byröd, "Optimizing visual vocabularies using soft assignment entropies," in Proc. Asian Conf. Comput. Vis., 2011, pp. 255-268.
46. E. Bingham and H. Mannila, "Random projection in dimensionality reduction: Applications to image and text data," in Proc. ACM Int. Conf. Knowl. Disc. Data Min., San Francisco, CA, USA, 2001, pp. 245-250.
47. D. Kingma and J. Ba, "Adam: A method for stochastic optimization," unpublished paper, 2014. [Online]. Available: https://arxiv.org/abs/1412.6980
48. H. Jégou, M. Douze, C. Schmid, and P. Pérez, "Aggregating local descriptors into a compact image representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, USA, 2010, pp. 3304-3311.
49. F. S. Samaria and A. C. Harter, "Parameterisation of a stochastic model for human face identification," in Proc. IEEE Workshop Appl. Comput. Vis., Sarasota, FL, USA, 1994, pp. 138-142.
50. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
51. K.-C. Lee, J. Ho, and D. J. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 684-698, May 2005.
52. A. Quattoni and A. Torralba, "Recognizing indoor scenes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA, 2009, pp. 413-420.
53. Y. Jia and T. Darrell, "Heavy-tailed distances for gradient based image descriptors," in Proc. Adv. Neural Inf. Process. Syst., Granada, Spain, 2011, pp. 397-405.
54. L. Wolf, T. Hassner, and Y. Taigman, "Descriptor based methods in the wild," presented at the Real Life Images Workshop Eur. Conf. Comput. Vis., Marseilles, France, 2008.