Feature ranking by weighting and ISE criterion of nonparametric density estimation

Journal of Applied Sciences

Volumn 9, Issue 6, 2009, Pages 1014-1024

  Wang, Xiaoming ^a   Wang, Shitong ^a,b  

^a JIANGNAN UNIVERSITY   (China)

^b ZHEJIANG UNIVERSITY   (China)

Author keywords

Dimensionality reduction; ISE criterion; Non parametric Parzen window density estimation; Unsupervised learning

Indexed keywords

DENSITY ESTIMATOR; DIMENSIONALITY REDUCTION; EXPLORATORY DATA ANALYSIS; FEATURE REDUCTION; INTEGRATED SQUARED ERRORS; ISE CRITERION; NONPARAMETRIC DENSITY ESTIMATION; PARZEN WINDOWS;

PATTERN RECOGNITION; UNSUPERVISED LEARNING;

MAXIMUM LIKELIHOOD ESTIMATION;

EID: 67649586444     PISSN: 18125654     EISSN: 18125662     Source Type: Journal    
DOI: 10.3923/jas.2009.1014.1024     Document Type: Article

References (26)

1. Andonie, R. and A. Cataron. 2005. Feature ranking using supervised neural gas and informational energy. Proceedings of International Joint Conference on Neural Networks. July 31-Aug. 4, Montreal, Canada, pp: 1269-1273.
2. Basak, J., R.K. De and S.K. Pal, 1998. Unsupervised feature selection usinga neuro fuzzy approach. Pattern Recognition Lett., 19: 997-1006.
3. Bezdck., J.C., 1981. Pattern Recognition with Fuzzy Objective Function Algoritms. 1st Edn., Plenum Press, New York, ISBN: 0306406713.
4. Biesiada, J., W. Duch. A. Kachel, K. Maczka and S. Palucha, 2005. Feature ranking methods based on information entropy with par/en windows. Proceedings of the 9th International Conference on Res. in Electrotechnology and Applied Informatics (REI), Aug. 3I-Sep. 3, Katowice-Krakow, Poland, pp: 109-119.
5. Bishop, C., 1995. Neural Networks for Pattern Recognition. 1st Edn. Oxford University Press, USA, ISBN-13: 978-0198538646.
6. Blake, C.L. and CJ. Merz, 1998. UC1 Repository of Machine Learning Databases. 1st Edn., University of California, Irvine, CA.
7. Bojer, T., S. Hammer, D. Schunk and K.T.V. Toschanowitz, 2001. Relevance determination in learning vector quantization. Proceedings of the European Symposium on Artificial Neural Networks (ESANN), Apr. 2001, D-Side Publications, pp: 271-276
8. Cataron, A. and R. Andonie, 2004. Energy generalized LVQ with relevance factors. Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN, July 2004, IEEE Computer Society, pp: 1421-1426.
9. Chang, C.C. and CJ. Lin, 2001. LIBSVM: A library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
10. Dash, M., H. Liu and J. Yao, 1997. Dimensionality Reduction of Unsupervised Data. Newport Beach. Proceedings of 9th IEEE International Conference Tools with Artificial Intelligence, Nov. 1997, IEEE Computer Society, pp: 532-539.
11. Dunn, J.C., 1973. A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J. Cyber., 3: 32-57.
12. Dy, J.G. and C.E. Bradley, 2004. Feature selection for unsupervised learning. J. Mach. Learning Res., 5: 845-889.
13. Girolami, M. and H. Chao, 2003. Probability density estimation from optimally condensed data samples. Probability density estimation from optimally condensed data samples. IEEE Trans. Pattern Anal. Mach. Intell., 25: 1253-1264.
14. Guyon, I. and A. Elisseeff, 2003. An introduction to variable and feature selection. J. Mach. Learn. Res., 3: 1157-1182.
15. Hammer, B., C. Information, M. Strickert and T. Villmann, 2005. Supervised neural gas with general similarity measure. Neural Process. Lett., 21: 21-44.
16. Huang, D. and T. Chow, 2003. Searching optimal feature subset using mutual information. Proceedings of the Eur. Symposium on Artificial Neural Networks (ESANN), Aug. 2003, d-side publications, pp: 161-166.
17. Kira, K. and L. Rendell, 1992. A practical approach to feature selection. Proceedings of the 9th Int. Workshop on Machine Learning, July 1992, California: Morgan Kaufmann, pp: 249-256.
18. Kononenko, I., 1994, Estimating aliributes: Analysis and extension of RELIEF. Proceedings of Eur. Conference on Machine Learning, Aug. 1994, Springer Berlin, pp: 171-182.
19. Law, M.H., A. Jain and M. Figueiredo, 2002. Feature selection in mixture-based clustering. Proceedings of Advances in Neural Information Processing Systems, Dec. 2002, The MIT Press, pp: 609-616.
20. Morita, M., R. Sabourin, F. Bortolozzi and CY. Suen, 2003. Unsupervised feature selection using multi objective genetic algorithms for handwritten word recognition. International Conference on Document Anal, and Recognition (ICDAR), August, IEEE Computer Society pp: 666-671.
21. Principe, J., D. Xu and L Fisher, 2000- Information Theoretic Learning. In: Unsupervised Adaptive Filtering, Haykin, S- (Ed.). Wiley, New York, ISBN: 0471294128.
22. Richard, O.D., 2000. Pattern Classification. 2nd Edn., Wiley Interscience, New York, ISBN: 978-0-471-05669-0.
23. Song, F.X., X.M. Gao, S.H. Liu and J.Y. Yang, 2005. Dimensionality reduction with less loss in statistical pattern recognition. Chinese J. Computer, No. 11 (In Chinese).
24. Torkkola, K., 2003. Feature extraction by non-parametric mutual information maximization. J. Mach. Learning Res., 3: 1415-1438.
25. Wang, H., D. Bell and F. Murtagh, 1999. Axiomatic approach to feature subset selection based on relevance. IEEE Trans. Pattern Anal. Mach. Intell., 21: 271-277
26. Wang, ST., F.L. Chung and F.S. Xiong, 2008. A novel image thresholding method based on Parzen window estimate. Pattern Recognit., 41: 117-129.