Sparse coding and classifier ensemble based multi-instance learning for image categorization

Signal Processing

Volumn 93, Issue 1, 2013, Pages 1-11

  Song, Xiangfa ^a   Jiao, L C ^a   Yang, Shuyuan ^a   Zhang, Xiangrong ^a   Shang, Fanhua ^a  

^a XIDIAN UNIVERSITY   (China)

Author keywords

Classifier ensemble; Image categorization; Multi instance learning; Sparse coding

Indexed keywords

BASIS VECTOR; CLASSIFICATION ACCURACY; CLASSIFICATION PERFORMANCE; CLASSIFIER ENSEMBLES; COMPONENT CLASSIFIERS; DATA SETS; DIFFERENT SIZES; FEATURE VECTORS; IMAGE CATEGORIZATION; LEARNING METHODS; LEARNING PROBLEM; LINEAR COMBINATIONS; MULTI-INSTANCE LEARNING; SPARSE CODING; SPARSE REPRESENTATION;

CLASSIFICATION (OF INFORMATION); SUPPORT VECTOR MACHINES;

IMAGING SYSTEMS;

EID: 84866376560     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2012.07.029     Document Type: Review

References (55)

1. O. Maron, A.L. Ratan, Multiple-instance learning for natural scene classification, in: Proceedings of International Conference on Machine Learning, 1998, pp. 341-349.
2. T.G. Dietterich, R.H. Lathrop, and T. Lozano-Perez Solving the multiple instance problem with axis-parallel rectangles Artificial Intelligence 89 1-2 1997 31 71
3. S. Scott, J. Zhang, J. Brown, On generalized multiple instance learning, Technical Report UNL-CSE-2003-5, Department of Computer Science and Engineering, University of Nebraska, Lincoln, NE, 2003.
4. N. Weidmann, E. Frank, and B. Pfahringer A two-level learning method for generalized multi-instance problem Lecture Notes in Artificial Intelligence 2837 2003 468 579
5. Y. Chen, and J.Z. Wang Image categorization by learning and reasoning with regions Journal of Machine Learning Research 5 8 2004 913 939
6. Y. Chen, J. Bi, and J.Z. Wang MILES: multiple-instance learning via embedded instance selection IEEE Transactions on Pattern Analysis and Machine Intelligence 28 12 2006 1931 1947
7. Z.-H. Zhou, and M.-L. Zhang Multi-instance multi-label learning with application to scene classification Advances in Neural Information Processing Systems 2006 1609 1616
8. C. Yang, T. Lozano-Pérez, Image database retrieval with multiple-instance learning techniques, in: Proceedings of IEEE Conference on Data Engineering, 2000, pp. 233-243.
9. Q. Zhang, W. Yu, S.A. Goldman, et al., Content-based image retrieval using multiple-instance learning, in: Proceedings of International Conference on Machine Learning, 2002, pp. 682-689.
10. W.-J. Li, D.-Y. Yeung, Localized content-based image retrieval through evidence region identification, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1666-1673.
11. D.-X. Li, J.-Y. Peng, and Z. Li LSA based multi-instance learning algorithm for image retrieval Signal Processing 91 8 2011 1993 2000
12. S. Andrews, I. Tsochantaridis, and T. Hofmann Support vector machines for multiple instance learning Advances in Neural Information Processing Systems 2003 561 568
13. P. Viola, J. Platt, and C. Zhang Multiple instance boosting for object detection Advances in Neural Information Processing Systems 2006 1419 1426
14. O. Maron, and T. Lozano-Pérez A framework for multiple-instance learning Advances in Neural Information Processing Systems 1998 570 576
15. Q. Zhang, and S.A. Goldman EM-DD: an improved multiple-instance learning technique Advances in Neural Information Processing Systems 2002 1073 1080
16. A. Dempster, N. Laird, and D. Rubin Maximum likelihood from incomplete data via the EM algorithm Journal of the Royal Statistical Society B 39 1 1977 1 38
17. P. Gehler, O. Chapelle, Deterministic annealing for multiple-instance learning, in: Proceedings of International Conference on Artificial Intelligence and Statistics, 2007, pp. 123-130.
18. T. Gärtner, A. Flach, A. Kowalczyk, et al., Multi-instance kernels, in: Proceedings of International Conference on Machine Learning, 2002, pp. 179-186.
19. J. Kwok, P.M. Cheung, Marginalized multi-instance kernels, in: Proceedings of International Joint Conference on Artificial Intelligence, 2007, pp. 901-906.
20. C. Yang, M. Dong, J. Hua, Region-based image annotation using asymmetrical support vector machine-based multiple instance learning, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 2057-2063.
21. Z.-H. Zhou, J.-M. Xu, On the relation between multi-instance learning and semi-supervised learning, in: Proceedings of International Conference on Machine Learning, 2007, pp. 1167-1174.
22. Z.-H. Zhou, Y.-Y. Sun, Y.-F. Li, Multi-instance learning by treating instances as non-i.i.d. samples, in: Proceedings of International Conference on Machine Learning, 2009, pp. 1249-1256.
23. Z.-H. Zhou, and M.-L. Zhang Solving multi-instance problems with classifier ensemble based on constructive clustering Knowledge and Information System 11 2 2007 155 170
24. Z.-H. Zhou, M.-L. Zhang, and S.-J. Huang Multi-instance multi-label learning Artificial Intelligence 176 1 2011 2291 2320
25. Z.-H. Zhou, Multi-instance learning: a survey. Technical Report, AI Lab, Department of Computer Science & Technology, Nanjing University, Nanjing, China, 2004.
26. F. James, and E. Frank A review of multi-instance learning assumptions The Knowledge Engineering Review 25 1 2010 1 25
27. H. Lee, A. Battle, and R. Raina Efficient sparse coding algorithms Advances in Neural Information Processing Systems 2006 801 808
28. R. Raina, A. Battle, H. Lee, et al., Self-taught learning: transfer learning from unlabeled data, in: Proceedings of International Conference on Machine Learning, 2007, pp. 759-766.
29. J. Mairal, F. Bach, and J. Ponce Supervised dictionary learning Advances in Neural Information Processing Systems 2009 1033 1040
30. J. Yang, K. Yu, Y. Gong, et al., Linear spatial pyramid matching using sparse coding for image classification, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1794-1801.
31. Y.-L. Boureau, F. Bach, Y. LeCun, et al., Learning mid-level features for recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 2559-2566.
32. B.A. Olshausen, and D.J. Field Emergence of simple-cell receptive field properties by learning a sparse code for natural images Nature 381 6583 1996 607 609
33. B.A. Olshausen, and D.J. Field Sparse coding with an over complete basis set: a strategy employed by V1? Vision Research 37 23 1996 3311 3325
34. M. Elad, and M. Aharon Image denoising via sparse and redundant representations over learned dictionaries IEEE Transactions on Image Processing 54 12 2006 3736 3745
35. W.-S. Dong,X. Li, L. Zhang, et al., Sparsity-based image denoising via dictionary learning and structural clustering, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2011, pp. 457-464.
36. Y.-M. He, T. Gan, and W.-F. Chen Multi-stage image denoising based on correlation coefficient matching and sparse dictionary pruning Signal Processing 92 1 2012 139 149
37. J. Mairal, M. Elad, and G. Sapiro Sparse representation for color image restoration IEEE Transactions on Image Processing 17 1 2008 53 69
38. J. Mairal, F. Bach, and J. Ponce Online learning for matrix factorization and sparse coding Journal of Machine Learning Research 11 1 2010 19 60
39. R. Tibshirani Regression shrinkage and selection via the Lasso Journal of the Royal Statistical SocietyB 58 1 1996 267 288
40. B. Efron, T. Hastie, and I. Johnstone Least angle regression Annals of Statistics 32 2 2004 407 499
41. J. Friedman, T. Hastie, and H. Hölfling Pathwise coordinate optimization Annals of Applied Statistics 1 2 2007 302 332
42. T.T. Wu, and K. Lange Coordinate descent algorithms for Lasso penalized regression Annals of Applied Statistics 2 1 2008 224 244
43. SPAMS (SPArse Modeling Software) is an Optimization Toolbox, 〈 http://www.di.ens.fr/willow/SPAMS 〉 2010.
44. M. Aharon, M. Elad, and A. Bruckstein K-SVD: an algorithm for designing over complete dictionaries for sparse representation IEEE Transactions on Signal Processing 54 11 2006 4311 4322
45. T. Serre, L. Wolf, and S. Bileschi Robust object recognition with cortex-like mechanisms IEEE Transactions on Pattern Analysis and Machine Intelligence 29 3 2007 411 426
46. T. Dietterich Ensemble methods in machine learning Lecture Notes in Computer Science 1857 2000 1 15
47. R. Polikar Ensemble based systems in decision making IEEE Circuits and Systems Magazine 6 3 2006 21 45
48. J.Z. Wang, J. Li, and G. Wiederhold SIMPLIcity: semantics-sensitive integrated matching for picture libraries IEEE Transactions on Pattern Analysis and Machine Intelligence 23 9 2001 947 963
49. A. Gersho Asymptotically optimum block quantization IEEE Transactions on Information Theory 25 4 1979 373 380
50. R. Zhang, and Z. Zhang A robust color object analysis approach to efficient image retrieval EURASIP Journal on Applied Signal Processing 6 2004 871 885
51. C.-C. Chang, C.-J. Lin, LIBSVM: A Library for Support Vector Machines, 〈http://www.csie.ntu.edu.tw/cjlin/libsvm〉 2001.
52. G. Csurka, C.R. Dance, L. Fan, et al., Visual categorization with bags of key points, in: Proceedings of Workshop Statistical Learning in Computer Vision, 2004, pp. 59-74.
53. Z.-H. Zhou, and M.-L. Zhang Ensembles of multi-instance learners Lecture Notes in Artificial Intelligence 2837 2003 492 502
54. Z.-H. Zhou, J. Wu, and W. Tang Ensemble neural networks: many could be better than all Artificial Intelligence 137 1-2 2002 239 263
55. D.E. Goldberg Genetic Algorithms in Search, Optimization, and Machine Learning 1989 Addison-Wesley Boston, MA