An improved multiple fuzzy NNC system based on mutual information and fuzzy integral

International Journal of Machine Learning and Cybernetics

Volumn 2, Issue 1, 2011, Pages 25-36

  Wang, Li Juan ^a  

^a GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Fuzzy integral and fuzzy measure; Multiple classifier system; Mutual information; Nearest neighbor classifier; Target perturbation

Indexed keywords

ATTRIBUTE BAGGING; COMBINATION METHOD; COMPONENT CLASSIFIERS; CURSE OF DIMENSIONALITY; DATA SETS; DENSITY VALUE; EXPERIMENTAL COMPARISON; FEATURE SELECTION; FINAL DECISION; FUZZY INTEGRAL; FUZZY MEASURES; FUZZY NEAREST NEIGHBOR CLASSIFIER; MAJORITY VOTING RULES; MULTIPLE CLASSIFIER SYSTEM; MUTUAL INFORMATIONS; NEAREST NEIGHBOR CLASSIFIER; NUMBER OF COMPONENTS; RANDOM METHODS; SIMPLE METHOD; SUB-PROBLEMS; SYSTEM-BASED;

FEATURE EXTRACTION; FUZZY SYSTEMS; IONOSPHERE;

INTEGRAL EQUATIONS;

EID: 79952984615     PISSN: 18688071     EISSN: 1868808X     Source Type: Journal    
DOI: 10.1007/s13042-010-0006-8     Document Type: Article

References (25)

1. Ludmila I (2004) Kuncheva, combining pattern classifiers: methods and algorithms, wiles.
2. Saranlm A, Demirekler M (2001) On output independence and complementariness in rank-based multiple classifer decision systems. Pattern Recogn 34: 2319-2330.
3. Zhou ZH (2005) Ensembling local learners through multimodal perturbation. IEEE Trans SMC Part B 35(4): 725-735.
4. Breiman L (1996) Bagging predictors. Mach Learn 24(2): 123-140.
5. Freund Y, Schapire RE (1995) A decision-theoretic generalization of online learning and an application to boosting. Proceedings of the 2nd European conference on computational learning theory, Barcelona, Spain, pp 23-37.
6. Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8): 832-844.
7. Brylla R, Gutierrez-Osunab R, Queka F (2003) Attribute bagging: improving accuracy of classifer ensembles by using random feature subsets. Pattern Recogn 36: 1291-1302.
8. Langley P, Iba W. Average-case analysis of a nearest neighbor algorithm. Proceedings of the thirteenth international joint.
9. Bay SD (1998) Combining nearest neighbor classifiers through multiple feature subsets. In: Proceedings of the 15th international conference on machine learning, Madison, WI, pp 37-45.
10. García-Pedrajas N, Ortiz-Boyer D (2009) Boosting k-nearest neighbor classifier by means of input space projection. Expert Syst Appl 36(7): 10570-10582.
11. Oza NC, Tumer K (2001) Input decimation ensembles: decorrelation through dimensio-nality reduction, 2nd international workshop on multiple classifier systems. In: Kittler J, Roli F (eds) Lecture notes in computer science. 2096: 238-247.
12. Chow TWS, Huang D (2005) Estimating optimal feature subsets using efficient estimation of high-dimensional mutual information. IEEE Trans Neural Netw 16(1): 213-224.
13. Batttiti R (1994) Using mutual information for selecting features in supervised neural net learning. IEEE Trans Neural Netw 5(4): 537-550.
14. Kwak N, Choi CH (2002) Input feature selection for classification problems. IEEE Trans Neural Netw 13(1): 143-159.
15. Kwak N, Choi CH (2002) Input feature selection by mutual information based on parzen window. IEEE Trans PAMI 24(12): 1667-1671.
16. Huang J, Cai Y, Xu X (2007) A hybrid genetic algorithm for feature selection wrapper based on mutual information. Pattern Recogn Lett 28(13): 1825-1844.
17. François D, Rossib F, Wertza V, Verleysen M (2007) Resampling methods for parameter-free and robust feature selection with mutual information. Neurocomputing 70(7-9): 1276-1288.
18. Liu HW, Sun JG, Liu L, Zhang HJ (2009) Feature selection with dynamic mutual information. Pattern Recogn 42(7): 1330-1339.
19. Wang ZY, Klir GJ (1992) Fuzzy measure theory. Plenum Press, New York.
20. Keller JM, sborn OJ (1996) Training the fuzzy integral. J Approx Reason 15: 1-24.
21. Wang ZY, Leung KS, Wang J (1999) A genetic algorithm for determining nonadditive set functions in information fusion. Fuzzy Sets Syst 102(3): 463-469.
22. Wang J, Wang ZY (1997) Using neural networks to determine Sugeno measures by statics. Neural Netw 10(1): 183-195.
23. Hu BG, Wang Y (2008) Evaluation criteria based on mutual information for classifications including rejected class. Acta Automatica Sin 34(11): 1396-1403.
24. Wang LJ (2006) Combination of multiple K-NNCs by Fuzzy integral. Proceedings of the fifth international conference on machine learning and cybernetics, pp 1774-1778.
25. Sungeno M (1997) Fuzzy measures and fuzzy integrals-a survey. In: Gupta MM, Saridis GN, Gaines BR (eds) Fuzzy automata and decision processes. North-Holland, Amsterdam, pp 89-102.