A review of codebook models in patch-based visual object recognition

Journal of Signal Processing Systems

Volumn 68, Issue 3, 2012, Pages 333-352

  Ramanan, Amirthalingam ^a,b   Niranjan, Mahesan ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b UNIVERSITY OF JAFFNA   (Sri Lanka)

Author keywords

Bag of features; Cluster analysis; Object recognition; SIFT; Visual codebook

Indexed keywords

CLASSIFICATION (OF INFORMATION); CLUSTER ANALYSIS; FEATURE EXTRACTION; QUALITY CONTROL; VECTOR SPACES;

BAG-OF-FEATURES; CODEBOOK CONSTRUCTIONS; COMPUTATIONAL BOTTLENECKS; SIFT; STATE-OF-THE-ART PERFORMANCE; TRADITIONAL APPROACHES; VISUAL CODEBOOK; VISUAL OBJECT RECOGNITION;

OBJECT RECOGNITION;

EID: 84879984805     PISSN: 19398018     EISSN: 19398115     Source Type: Journal    
DOI: 10.1007/s11265-011-0622-x     Document Type: Review

References (64)

1. Agarwal, S., Awan, A., & Roth, D. (2004). Learning to detect objects in images via a sparse, part-based representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 1475-1490.
2. Agarwal, A., & Triggs, B. (2006). Hyperfeatures-Multilevel local coding for visual recognition. In Proceedings of the European conference on computer vision (ECCV'06) (pp. 30- 43). Berlin: Springer.
3. Bay, H., Ess, A., Tuytelaars, T., & Gool, L. V. (2008). SURF: Speeded up robust features. Computer Vision and Image Understanding, 110, 346-359.
4. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3(3), 993-1022.
5. Brank, J., Grobelnik, M., Milic-Frayling, N., & Mladenic, D. (2002). Interaction of feature selection methods and linear classification models. In Proceedings of the ICML-02 workshop on text learning, forthcoming.
6. Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5-32.
7. Canny, J. (1986). A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8, 544-567.
8. Comaniciu, D., & Meer, P. (2002). Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 603- 619.
9. Csurka, G., Dance, C. R., Fan, L., Willamowski, J., & Bray, C. (2004). Visual categorization with bags of keypoints. In Workshop on statistical learning in computer vision, ECCV'04 (pp. 1-22).
10. Deng, H., Zhang, W., Mortensen, E., Dietterich, T., &Shapiro, L. (2007). Principal curvature-based region detector for object recognition. In Proceedings of the conference on computer vision and pattern recognition (CVPR'07) (pp. 1-8).
11. Dorko, G., Schmid, C., & Lear, P. (2005). Object class recognition using discriminative local features. Technical report, RR-5497, INRIA-Rhone-Alpes.
12. Farquhar, J. D. R., Szedmak, S., Meng, H., & Shawe-Taylor, J. (2005). Improving "bag-of-keypoints" image categorisation: Generative models and PDF-kernels. In LAVA report. U.K.: University of Southampton.
13. Fei-Fei, L., & Perona, P. (2005). A Bayesian hierarchical model for learning natural scene categories. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR'05) (Vol. 2, pp. 524-531).
14. Grauman, K., & Darrell, T. (2005). The pyramid match kernel: Discriminative classification with sets of image features. In Proceedings of the tenth IEEE international conference on computer vision (ICCV'05) (Vol. 2, pp. 458- 1465).
15. Harris, C., & Stephens, M. (1988). A combined corner and edge detector. In Proceedings of Alvey vision conference (pp. 147-151).
16. Jain, A. K., Murty, M. N., & Flynn, P. J. (1999). Data clustering: A review. ACM Computing Surveys, 31, 264-323.
17. Joachims, T. (1998). Text categorization with support vector machines: Learning with many relevant features. In Proceedings of the European conference on machine learning (ECML'98) (pp. 137-142).
18. Juan, L., & Gwun, O. (2009). A comparison of SIFT, PCASIFT and SURF. International Journal of Image Processing, 3, 143-152.
19. Jurie, F., & Triggs, B. (2005). Creating efficient codebooks for visual recognition. In Proceedings of the tenth IEEE international conference on computer vision (ICCV'05) (Vol. 1, pp. 604-610).
20. Kadir, T., & Brady, M. (2001). Saliency, scale and image description. International Journal of Computer Vision, 45(2), 83-105.
21. Ke, Y., & Sukthankar, R. (2004). PCA-SIFT: A more distinctive representation for local image descriptors. In Proceedings of the conference on computer vision and pattern recognition (CVPR'04) (pp. 511-517).
22. Kim, S., & Kweon, I.-S. (2006). Biologically motivated perceptual feature: Generalized robust invariant feature. In Proceedings of the Asian conference on computer vision (ACCV'06) (pp. 305-314).
23. Kim, S., & Kweon, I.-S. (2007). Object categorization robust to surface markings using entropy-guided codebook. In IEEE workshop on applications of computer vision (p. 22).
24. Larios, N., Deng, H., Zhang, W., Sarpola, M., Yuen, J., Paasch, R., et al. (2007). Automated insect identification through concatenated histograms of local appearance features. Machine Vision and Applications, 19(2), 105- 123.
25. Larlus,D.,&Jurie, F. (2006). Latentmixture vocabularies for object categorization. In Proceedings of the British machine vision conference (BMVC'06) (pp. 959-968).
26. Lazebnik, S., Schmid, C., & Ponce, J. (2005). A maximum entropy framework for part-based texture and object recognition. In Proceedings of the IEEE international conference on computer vision (ICCV'05) (Vol. 1, pp. 832-838).
27. Lazebnik, S., Schmid, C., & Ponce, J. (2005). A sparse texture representation using local affine regions. IEEE Transac tions on Pattern Analysis and Machine Intelligence, 27, 1265- 1278.
28. Lazebnik, S., Schmid, C., & Ponce, J. (2006). Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In IEEE conference on computer vision and pattern recognition (CVPR'06) (pp. 2169-2178).
29. Leibe, B., Leonardis, A., & Schiele, B. (2008). Robust object detection with interleaved categorization and segmentation. International Journal of Computer Vision, 77(1-3), 259- 289.
30. Leibe, B., & Schiele, B. (2003). Interleaved object categorization and segmentation. In Proceedings of the British machine vision conference (BMVC'03) (pp. 759-768).
31. Li, X., Chen, S.-C., Shyu, M.-L., Li, S.-T., & Furht, B. (2002). A novel hierarchical approach to image retrieval using color and spatial information. In Proceedings of the third IEEE Pacif ic rim conference on multimedia: PCM '02 (pp. 175- 182). London: Springer.
32. Li, T., Mei, T., & Kweon, I.-S. (2008). Learning optimal compact codebook for efficient object categorization. In IEEE workshop on applications of computer vision (pp. 1-6).
33. Lowe, D. (1999). Object recognition from local scaleinvariant features. In The proceedings of the seventh IEEE international conference on computer vision (ICCV'99) (Vol. 2, pp. 1150-1157).
34. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60, 91-110.
35. Mart́nez-Mũoz, G., Zhang, W., Payet, N., Todorovic, S., Larios, N., Yamamuro, A., et al. (2009). Dictionary-free categorization of very similar objects via stacked evidence trees. In Proceedings of the IEEE conference in computer vision and pattern recognition (CVPR'09) (pp. 549-556).
36. Matas, J., Chum, O., Urban, M., & Pajdla, T. (2002). Robust wide baseline stereo from maximally stable extremal regions. In British machine vision conference (BMVC'02) (Vol. 1, pp. 384-393).
37. Mikolajczyk, K., Leibe, B., & Schiele, B. (2006). Multiple object class detection with a generative model. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR'06) (Vol. 1, pp. 26-36).
38. Mikolajczyk, K., & Schmid, C. (2001). Indexing based on scale invariant interest points. In Proceedings of the 8th IEEE international conference on computer vision (ICCV'01) (pp. 525-531).
39. Mikolajczyk, K., & Schmid, C. (2002). An affine invariant interest point detector. In Proceedings of the European conference on computer vision (ECCV'02) (pp. 128-142). Berlin: Springer.
40. Mikolajczyk, K., & Schmid, C. (2005). A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 1615-1630.
41. Moosmann, F., Triggs, B., & Jurie, F. (2007). Fast discriminative visual codebooks using randomized clustering forests. In Neural information processing systems (NIPS'07) (pp. 985- 992).
42. Nister, D., & Stewenius, H. (2006). Scalable recognition with a vocabulary tree. IEEE Computer Society Conference on Computer, 2, 2161-2168.
43. Perronnin, F. (2008). Universal and adapted vocabularies for generic visual categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 1243- 1256.
44. Peterson, G., & Barney, H. (1952). Control methods used in a study of the vowels. Journal of the Acoustical Society of America, 24, 175-184.
45. Platt, J. C. (1991). A resource-allocating network for function interpolation. Neural Computation, 3, 213-225.
46. Platt, J. C. (1999). Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Advances in large margin classif iers (pp. 61-74). Cambridge: MIT Press.
47. Platt, J. C., Cristianini, N., & Shawe-Taylor, J. (2000). Large margin DAGs for multiclass classification. In Advances in neural information processing systems (NIPS'00) (Vol. 12, pp. 547-553).
48. Quelhas, P., Monay, F., Odobez, J.-M., Gatica-Perez, D., &Tuytelaars, T. (2007). A thousand words in a scene. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(9), 1575-1589.
49. Quinlan, J. R. (1993). C4.5: Programs for machine learning. San Mateo: Morgan Kaufmann.
50. Ramanan, A., & Niranjan, M. (2010). A one-pass resourceallocating codebook for patch-based visual object recognition. In IEEE international workshop on machine learning for signal processing (MLSP'10) (pp. 35-40).
51. Rubner, Y., Tomasi, C., & Guibas, J. (1998). A metric for distributions with applications to image databases. In Proceedings of the IEEE international conference on computer vision (ICCV'98).
52. Sivic, J., & Zisserman, A. (2003). Video google: A text retrieval approach to object matching in videos. In Proceedings of the ninth IEEE international conference on computer vision (ICCV'03) (pp. 1470-1478).
53. Sudderth, E. B., Torralba, A., Freeman, W. T., & Willsky, A. S. (2008). Describing visual scenes using transformed objects and parts. International Journal of Computer Vision, 77(1-3), 291-330.
54. Tishby, N., Pereira, F. C., & Bialek, W. (1999). The information bottleneck method. In The 37th annual allerton conference on communication, control, and computing (pp. 368- 377).
55. Tuytelaars, T., & Mikolajczyk, K. (2008). Local invariant feature detectors: A survey. Now Publishers Inc.
56. van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2008). Evaluation of color descriptors for object and scene recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR'08).
57. Wang, L. (2007). Toward a discriminative codebook: Codeword selection across multi-resolution. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR'07) (pp. 1-8).
58. Wang, L., Zhou, L., & Shen, C. (2008). A fast algorithm for creating a compact and discriminative visual codebook. In Proceedings of the tenth European conference on computer vision (ECCV'08) (pp. 719-732). LNCS 5305.
59. Winn, J., Criminisi, A., & Minka, T. (2005). Object categorization by learned universal visual dictionary. In Proceedings of the tenth IEEE international conference on computer vision (ICCV'05) (Vol. 2, pp. 1800-1807).
60. Wu, J., & Rehg, J. (2009). Beyond the Euclidean dstance: Creating effective visual codebooks using the histogram intersection kernel. In Proceedings of the IEEE international conference on computer vision (ICCV'09).
61. Wu, J., & Rehg, J. (2009). CENTRIST: A visual descriptor for scene categorization. Technical report, GIT-GVU-09-05, GVU Center, Georgia Institute of Technology.
62. Yang, L., Jin, R., Sukthankar, R., & Jurie, F. (2008). Unifying discriminative visual codebook generation with classifier training for object category recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR'08) (pp. 1-8).
63. Zhang, J., Marszalek, M., Lazebnik, S., & Schmid, C. (2007). Local features and kernels for classification of texture and object categories: A comprehensive study. International Journal of Computer Vision, 73, 213-238.
64. Zhang, W., Surve, A., Fern, X., & Dietterich, T. (2009). Learning non-redundant codebooks for classifying complex objects. In Proceedings of the 26th international conference on machine learning (ICML'09).