Adaptive neighborhood granularity selection and combination based on margin distribution optimization

Information Sciences

Volumn 249, Issue , 2013, Pages 1-12

  Zhu, Pengfei ^a,b   Hu, Qinghua ^a,c  

^a TIANJIN UNIVERSITY   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^c Key Laboratory Systems Biotechnology   (China)

Author keywords

Ensemble learning; Granular computing; Granularity; Margin distribution; Neighborhood rough set

Indexed keywords

ADAPTIVE NEIGHBORHOOD; ATTRIBUTE REDUCTION; CLASSIFICATION LEARNING; ENSEMBLE LEARNING; EXPERIMENTAL ANALYSIS; GRANULARITY; MARGIN DISTRIBUTIONS; NEIGHBORHOOD ROUGH SETS;

GRANULAR COMPUTING; OPTIMIZATION;

ROUGH SET THEORY;

EID: 84883202893     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.06.012     Document Type: Article

References (43)

1. Y. Du, Q. Hu, P. Zhu, and P. Ma Rule learning for classification based on neighborhood covering reduction Information Sciences 181 2011 5457 5467
2. Y. Freund, R. Schapire, A desicion-theoretic generalization of on-line learning and an application to boosting, in: Computational Learning Theory, Springer, 1995, pp. 23-37.
3. R. Gilad-Bachrach, A. Navot, N. Tishby, Margin based feature selection-theory and algorithms, in: Proceedings of the Twenty-First International Conference on Machine Learning, ACM, 2004, p. 43.
4. B. Heisele, P. Ho, T. Poggio, Face recognition with support vector machines: global versus component-based approach, in: ICCV 2001, vol. 2, IEEE, 2001, pp. 688-694.
5. Q. Hu, W. Pan, S. An, P. Ma, and J. Wei An efficient gene selection technique for cancer recognition based on neighborhood mutual information International Journal of Machine Learning and Cybernetics 1 2010 63 74
6. Q. Hu, D. Yu, J. Liu, and C. Wu Neighborhood rough set based heterogeneous feature subset selection Information Sciences 178 2008 3577 3594
7. Q. Hu, D. Yu, and Z. Xie Neighborhood classifiers Expert Systems with Applications 34 2008 866 876
8. Q. Hu, D. Yu, and Z. Xie Numerical attribute reduction based on neighborhood granulation and rough approximation Journal of Software 19 2008 640 649
9. Q. Hu, P. Zhu, Y. Yang, and D. Yu Large-margin nearest neighbor classifiers via sample weight learning Neurocomputing 74 2011 656 660
10. S. Kim, K. Koh, M. Lustig, S. Boyd, and D. Gorinevsky An interior-point method for large-scale l1-regularized least squares IEEE Journal of Selected Topics in Signal Processing 1 2007 606 617
11. M. Kryszkiewicz Rough set approach to incomplete information systems Information Sciences 112 1998 39 49
12. Y. Liao, and V. Vemuri Use of k-nearest neighbor classifier for intrusion detection1 Computers & Security 21 2002 439 448
13. G. Lin, J. Liang, and Y. Qian Multigranulation rough sets: from partition to covering Information Sciences 2013
14. D.J. Newman, S. Hettich, C.L. Blake, C.J. Merz, UCI Repository of Machine Learning Databases, University of California, Department of Information and Computer Science, Irvine, CA, 1998. .
15. Z. Pawlak Rough set approach to knowledge-based decision support European Journal of Operational Research 99 1997 48 57
16. W. Pedrycz Granular Computing: An Emerging Paradigm vol. 70 2001 Physica Verlag
17. W. Pedrycz Granular Computing: Analysis and Design of Intelligent Systems vol. 13 2013 CRC Press
18. Y. Qian, J. Liang, Y. Yao, and C. Dang Mgrs: a multi-granulation rough set Information Sciences 180 2010 949 970
19. A. Radzikowska, and E. Kerre A comparative study of fuzzy rough sets Fuzzy Sets and Systems 126 2002 137 155
20. J. Ramsey Tests for specification errors in classical linear least-squares regression analysis Journal of the Royal Statistical Society, Series B (Methodological) 31 1969 350 371
21. G. Ratsch, T. Onoda, and K. Muller Soft margins for adaboost Machine Learning 42 2001 287 320
22. S. Rosset, J. Zhu, and T. Hastie Boosting as a regularized path to a maximum margin classifier The Journal of Machine Learning Research 5 2004 941 973
23. R. Schapire, Y. Freund, P. Bartlett, and W. Lee Boosting the margin: a new explanation for the effectiveness of voting methods The Annals of Statistics 26 1998 1651 1686
24. J. Shawe-Taylor, N. Cristianini, Robust bounds on generalization from the margin distribution, in: 4th European Conference on Computational Learning Theory, Citeseer, 1998.
25. C. Shen, and H. Li Boosting through optimization of margin distributions IEEE Transactions on Neural Networks 21 2010 659 666
26. C. Shen, and H. Li On the dual formulation of boosting algorithms IEEE Transactions on Pattern Analysis and Machine Intelligence 2010 2216 2231
27. X. Tan, S. Chen, Z. Zhou, and F. Zhang Face recognition from a single image per person: a survey Pattern Recognition 39 2006 1725 1745
28. T. Van Gestel, J. Suykens, B. Baesens, S. Viaene, J. Vanthienen, G. Dedene, B. De Moor, and J. Vandewalle Benchmarking least squares support vector machine classifiers Machine Learning 54 2004 5 32
29. S. Wang, X. Li, S. Zhang, J. Gui, and D. Huang Tumor classification by combining pnn classifier ensemble with neighborhood rough set based gene reduction Computers in Biology and Medicine 40 2010 179 189
30. D.R. Wilson, and T.R. Martinez Improved heterogeneous distance functions Journal of Artificial Intelligence Research 6 1997 1 34
31. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma Robust face recognition via sparse representation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2009 210 227
32. W. Wu, and Y. Leung Theory and applications of granular labelled partitions in multi-scale decision tables Information Sciences 181 2011 3878 3897
33. W. Wu, J. Mi, and W. Zhang Generalized fuzzy rough sets Information Sciences 151 2003 263 282
34. W. Wu, and W. Zhang Neighborhood operator systems and approximations Information Sciences 144 2002 201 217
35. Z. Xie, Y. Xu, Q. Hu, and P. Zhu Margin distribution based bagging pruning Neurocomputing 85 2012 11 19
36. A. Yang, S. Sastry, A. Ganesh, and Y. Ma Fast l1-minimization algorithms and an application in robust face recognition: a review ICIP 2010 1849 IEEE pp. 1849-1852
37. Y. Yao Relational interpretations of neighborhood operators and rough set approximation operators Information Sciences 111 1998 239 259
38. Y. Yao, Granular computing: basic issues and possible solutions, in: Proceedings of the 5th Joint Conference on Information Sciences, vol. 1, Citeseer, 2000, pp. 186-189.
39. Y. Yao, and Granular computing Computer Science 31 2004 4 10
40. X. Zhao, Q. Hu, Y. Lei, and M. Zuo Vibration-based fault diagnosis of slurry pump impellers using neighbourhood rough set models Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science 224 2010 995 1006
41. P. Zhu, L. Zhang, Q. Hu, S. Shiu, Multi-scale patch based collaborative representation for face recognition with margin distribution optimization, in: ECCV 2012, vol. 7572, 2012, pp. 822-835.
42. W. Zhu Topological approaches to covering rough sets Information Sciences 177 2007 1499 1508
43. W. Zhu, and F. Wang Reduction and axiomization of covering generalized rough sets Information Sciences 152 2003 217 230