Energy supervised relevance neural gas for feature ranking

Neural Processing Letters

Volumn 32, Issue 1, 2010, Pages 59-73

  Caţaron, Angel ^a   Andonie, Rǎzvan ^a,b  

^a TRANSILVANIA UNIVERSITY OF BRASOV   (Romania)

^b CENTRAL WASHINGTON UNIVERSITY   (United States)

Author keywords

Feature ranking; Learning Vector Quantization; Neural Gas; Pattern classification

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFICATION TASKS; FEATURE RANKING; INPUT FEATURES; INPUT PATTERNS; KERNEL METHODS; LEARNING VECTOR QUANTIZATION; NEURAL GAS; PATTERN CLASSIFICATION;

VECTOR QUANTIZATION;

EID: 77955286812     PISSN: 13704621     EISSN: 1573773X     Source Type: Journal    
DOI: 10.1007/s11063-010-9143-z     Document Type: Article

References (40)

1. Andonie R, Caţaron A (2004) An informational energy LVQ approach for feature ranking. In: Proceedings of the European Symposium on Artificial Neural Networks (ESANN 2004), Bruges, Belgium, pp 471-476
2. Andonie R, Caţaron A (2005) Feature ranking using supervised neural gas and informational energy. In: Proceedings of International Joint Conference on Neural Networks (IJCNN2005), Montreal, Canada, July 31-August 4, pp 1269-1273
3. R Andonie F Petrescu 1986 Interacting systems and informational energy Found Control Eng 11 53 59 0621.94006 876585
4. Asuncion A, Newman DJ (2007) UCI machine learning repository. University of California, Irvine, School of Information and Computer Sciences. Available: http://mlearn.ics.uci.edu/MLRepository.html, 2007
5. R. Battiti 1994 Using mutual information for selecting features in supervised neural network training IEEE Trans Neural Netw 5 537 550 10.1109/72.298224
6. Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, New York
7. Breiman L (1996) Bias, variance and arcing classifiers. Tec. Report 460, Statistics department, University of California, April 1996
8. Bojer T, Hammer B, Schunk D, von Toschanowitz KT (2001) Relevance determination in learning vector quantization. In: Proceedings of the European Symposium on Artificial Neural Networks (ESANN 2001), Bruges, Belgium, pp 271-276
9. Bottou L, Cun YL (2004) Large scale online learning. In: Thrun S, Saul L, Schölkopf B (eds) Advances in neural information processing systems 16. MIT Press, Cambridge, MA
10. S Cang D Partridge 2004 Feature ranking and best subset using mutual information Neural Comput Appl 13 175 184 10.1007/s00521-004-0400-9
11. Caţaron A, Andonie R (2004) Energy generalized LVQ with relevance factors. In: Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN 2004, Budapest, Hungary
12. Caţaron A, Andonie R (2005) Informational energy kernel for LVQ. In: Dutch W et al (eds) ICANN 2005, Lecture Notes in Computer Science, vol 3697. Springer-Verlag, Berlin, pp 601-606
13. TWS Chow D Huang 2005 Estimating optimal feature subsets using efficient estimation of high- dimensional mutual information IEEE Trans Neural Netw 16 213 224 10.1109/TNN.2004.841414
14. Duch W, Wieczorek T, Biesiada J, Blachnik M (2004) Comparison of feature ranking methods based on information entropy. In: Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN 2004, Budapest, Hungary, pp 1415-1419
15. Duda RO, Hart PE, Stork DG (2001) Pattern classification. John Wiley and Sons Inc., New York
16. Estévez PA, Tesmer M, Perez CA, Zurada JM. Normalized mutual information feature selection. IEEE Trans Neural Netw 20:189-201
17. X Fu L Wang 2003 Data reduction dimensionality with application to simplifying RBF network structure and improving classification performance IEEE Trans Syst Man Cybern B Cybern 3 399 409
18. C Furlanello M Serafini S Merler G Jurman 2003 An accelerated procedure for recursive feature ranking on microarray data Neural Netw 16 641 648 10.1016/S0893-6080(03)00103-5
19. García-Laencina PJ, Sancho-Gómez J-L, Figueiras-Vidal AR, Verleysen M (2008) K-nearest neighbours based on mutual information for incomplete data classification. In: Proceedings of the European Symposium on Artificial Neural Networks (ESANN 2008), Bruges, Belgium, pp 37-42
20. V Gómez-Verdejo M Verleysen J Fleury 2009 Information-theoretic feature selection for functional data classification Neurocomputing 72 3580 3589 10.1016/j.neucom.2008.12.035
21. Guiaşu S (1977) Information theory with applications. McGraw Hill, New York
22. I Guyon A Elisseeff 2003 An introduction to variable and feature selection J Mach Learn Res 3 1157 1182 1102.68556 10.1162/153244303322753616
23. B Hammer T Villmann 2002 Generalized relevance learning vector quantization Neural Netw 15 1059 1068 10.1016/S0893-6080(02)00079-5
24. B Hammer M Strickert T Villmann 2005 Supervised neural gas with general similarity measure Neural Process Lett 21 1 21 44 10.1007/s11063-004-3255-2
25. Kira K, Rendell LA (1992) A practical approach to feature selection. In: Proceedings of the 9th international conference on machine learning. Morgan Kaufmann, pp 249-256
26. Kohonen T (2000) Self-organizing maps. Springer-Verlag, Berlin
27. T Lehn-Schiøler A Hegde D Erdogmus JC Principe 2005 Vector quantization using information theoretic concepts Nat Comput Int J 4 39 51 10.1007/s11047-004-9619-8
28. Liu, H, Motoda, H (eds) (2008) Computational methods of feature selection. Chapman & Hall/CRC, Boca Raton
29. TM Martinetz SG Berkovich SG Schulten 1993 Neural-gas network for vector quantization and its application to time-series prediction IEEE Trans Neural Netw 4 558 569 10.1109/72.238311
30. O Onicescu 1966 Theorie de l'information. Energie informationelle C R Acad Sci Paris Ser A-B 263 841 842 0143.41206 229478
31. Principe JC, Xu D, Fisher JW III (2000) Information-theoretic learning. In: Haykin S (eds) Unsupervised adaptive filtering. Wiley, New York
32. I Purcaru 1987 Considerations on the definition of a good measure of unilateral dependence Stud Cerc Mat 39 56 59 0638.60025 902143
33. Schneider P, Biehl M, Hammer B (2007) Relevance matrices in LVQ. In: Proceedings of the European Symposium on Artificial Neural Networks (ESANN 2007), Bruges, Belgium, pp 37-42
34. Y Sun 2007 Iterative RELIEF for feature weighting: algorithms, theories, and applications IEEE Trans Pattern Anal Mach Intell 29 1035 1051 10.1109/TPAMI.2007.1093
35. Tesmer M, Estevez PA (2004) AMIFS: adaptive feature selection by using mutual information. In: Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN 2004), Budapest, Hungary, 25-29 July, 2004
36. Torkkola K (2002) On feature extraction by mutual information maximization. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing, Orlando, FL
37. K Torkkola 2003 Feature extraction by non parametric mutual information maximization J Mach Learn Res 3 1415 1438 1102.68638 10.1162/153244303322753742 2020765
38. JCA van der Lubbe Y Boxma DE Bockee 1984 A generalized class of certainty and information measures Inf Sci 32 187 215 0553.94005 10.1016/0020-0255(84) 90034-3
39. Verleysen M, Rossi F, Franois D (2009) Advances in feature selection with mutual information, In: Biel M et al (eds) Similarity-based clustering. Lecture Notes in Artificial Intelligence, vol 5400. Springer, Berlin, pp 52-69
40. HL Wei SA Billings 2007 Feature subset selection and ranking for data dimensionality reduction IEEE Trans Pattern Anal Mach Intell 29 162 166 10.1109/TPAMI.2007.250607