Input decimated ensembles

Pattern Analysis and Applications

Volumn 6, Issue 1, 2003, Pages 65-77

  Tumer, Kagan ^a   Oza, Nikunj C ^a  

^a NASA AMES RESEARCH CENTER   (United States)

Author keywords

Classification; Combining classifier; Correlation reduction; Dimensionality reduction; Ensembles; Feature selection

Indexed keywords

EID: 0038808753     PISSN: 14337541     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10044-002-0181-7     Document Type: Article

References (52)

1. Breiman L (1996) Bagging predictors. Machine Learning 24(2): 123-140
2. Dietterich TG (2000) Ensemble methods in machine learning. In: Kittler J, Roli F (eds) Proceedings First International Workshop on Multiple Classifier Systems 1-15
3. Wolpert DH (1992) Stacked generalization. Neural Networks 5:241-259
4. Jacobs R (1995) Method for combining experts' probability assessments. Neural Computation 7(5):867-888
5. Meir R (1995) Bias, variance, and the combination of estimators; the case of least linear squares. In: Tesauro G, Touretzky DS, Leen TK (eds) Advances in Neural Information Processing Systems-7, MIT Press 295-302
6. Opitz DW, Shavlik JW (1996) Actively searching for an effective neural network ensemble. Connection Science, Special Issue on Combining Artificial Neural Networks: Ensemble Approaches 8(3 & 4):337-354
7. Tumer K, Ghosh J (1996) Error correlation and error reduction in ensemble classifiers. Connection Science, Special Issue on Combining Artificial Neural Networks: Ensemble Approaches 8(3 & 4):385-404
8. Freund Y, Schapire R (1996) Experiments with a new boosting algorithm. Proceedings 13th International Conference on Machine Learning 148-156
9. Jolliffe IT (1986) Principal Component Analysis, Springer-Verlag
10. Partridge M, Calvo RA (1998) Fast dimensionality reduction and simple pca. Intelligent Data Analysis 2:203-214
11. Ho TK (1998) The random space method for constructing decision forests. IEEE Trans Patt Anal Machine Intell 20(8):832-844
12. Oza NC, Tumer K (2001) Input decimated ensembles: Decorrelation through dimensionality reduction. In: Kittler J, Roli F (eds) Proceedings Second International Workshop on Multiple Classifier Systems, Springer 238-249
13. Tumer K, Ghosh J (1996) Analysis of decision boundaries in linearly combined neural classifiers. Patt Recogn 29(2):341-348
14. Tumer K, Oza NC (1999) Decimated input ensembles for improved generalization. Proceedings International Joint Conference on Neural Networks
15. Dietterich TG (1988) Machine learning research: four current directions. AI Magazine 18(4):97-136
16. Blake C, Keogh E, Merz CJ (1998) UCI repository of machine learning databases URL: http://www.ics.uci.edu/̃mlearn/MLRepository.html
17. Prechelt L (1994) PROBEN1 - A set of benchmarks and benchmarking rules for neural network training algorithms. Technical Report 21/94, Fakultdt ffir Informatik, Universitdt Karlsruhe, D-76128 Karlsruhe, Germany, September 1994. Anonymous FTP:/pub/papers/techreports/1994/1994-21.ps.Z on ftp.ira.uka.de
18. Devijver PA, Kittler J (1982) Pattern Recognition: A Statistical Approach, Prentice-Hall
19. Duda RO, Hart PE, Stork DG (2001) Pattern Classification, 2nd ed., Wiley
20. Fukunaga K (1990) Introduction to Statistical Pattern Recognition, 2nd ed., Academic Press
21. Berger JO (1985) Statistical Decision Theory and Bayesian Analysis. 2nd Ed, Springer
22. Richard MD, Lippmann RP (1991) Neural network classifiers estimate Bayesian a posteriori probabilities. Neural Computation 3(4):461-483
23. Tumer K, Ghosh J (1996) Estimating the Bayes error rate through classifier combining. Proceedings International Conference on Pattern Recognition, Vienna, Austria IV:695-699
24. Dietterich TG, Bakiri G (1995) Solving multiclass learning problems via errorcorrecting output codes. J Artif Intell Res 2:263-286
25. Merz CJ (1999) A principal component approach to combining regression estimates. Machine Learning 36:9-32
26. Opitz DW, Shavlik JW (1996) Generating accurate and diverse members of a neural-network ensemble. In: Touretzky DS, Mozer MC, Hasselmo ME (eds) Advances in Neural Information Processing Systems-8, MIT Press 535-541
27. Sirlantzis K, Fairhurst MC, Hoque MS (2001) Genetic algorithms for multi-classifier system configuration: A case study in character recognition. In: Kittler J, Roli F (eds) Proceedings Second International Workshop on Multiple Classifier Systems, Springer 99-108
28. Rosen B (1996) Ensemble learning using decorrelated neural networks. Connection Science, Special Issue on Combining Artificial Neural Networks: Ensemble Approaches 8(3 & 4):373-384
29. Krogh A, Vedelsby J (1995) Neural network ensembles, cross validation and active learning. In: Tesauro G, Touretzky DS, Leen TK (eds) Advances in Neural Information Processing Systems-7, MIT Press 231-238
30. Bishop CM (1995) Neural Networks for Pattern Recognition. Oxford University Press
31. Hyvarinen A (1999) Survey on independent component analysis. Neural Comput Surv 2:94-128
32. de Ridder D, Duin RPW (1997) Sammon's mapping using neural networks: A comparison. Patt Recogn Lett 18:1307-1316
33. Kambhatla N, Leen TK (1994) Fast non-linear dimension reduction. In: Cowan JD, Tesauro G, Alspector J (eds) Advances in Neural Information Processing Systems-6, Morgan Kaufmann 152-153
34. Kambhatla N, Leen TK (1997) Dimension reduction by local principal component analysis. Neural Computation 9:1493
35. Oja E (1983) Subspace Methods of Pattern Recognition, Research Studies Press, UK
36. Oja E (1992) Pricipal components, minor components, and linear neural networks. Neural Networks 5:927-936
37. Sammon Jr JR (1969) A nonlinear mapping for data structure analysis. IEEE Trans Comput 18:401-409
38. Ramanujam N, Mitchell MF, Mahadevan A, Thomsen S, Malpica A, Wright T, Atkinson N, Richards-Kortum R (1996) Development of a multivatirate statistical algorithm to analyze human cervical tisue fluorescence spectra acquired in vivo. Lasers in Surgery and Med 19:46-62
39. Short N (2000) Remote sensing tutorial URL: http://rst.gsfc.nasa.gov/starthere.html
40. Battiti R (1994) Using mutual information for selecting features in supervised neural net learning. IEEE Trans Neural Networks 5(4):537-550
41. Blum A, Langley P (1997) Selection of relevant features and examples in machine learning. Artif Intell 97:245-272
42. Bollacker KD, Ghosh J (1996) Linear feature extractors based on mutual information. Proceedings 13th International Conference on Pattern Recognition IV:720-724
43. Cherkauer KJ (1996) Human expert-level performance on a scientific image analysis task by a system using combined artificial neural networks. Working Notes of the AAAI Workshop on Integrating Multiple Learned Models 15-21
44. Domingos P (1997) Context-sensitive feature selection for lazy learners. Artif Intell Rev 11:227-253
45. John GH, Kohavi R, Pfleger K (1994) Irrelevant features and the subset selection problem. Proceedings International Conference on Machine Learning (ICML-94) 121-129
46. Langley P (1994) Selection of relevant features in machine learning. Proceedings AAAI Fall Symposium on Relevance
47. Kumar S, Crawford M, Ghosh J (1999) A versatile framework for labelling imagery with a large number of classes. Proceedings International Joint Conference on Neural Networks (IJCNN-99)
48. Denser L, Middleton D (1979) On the classification of underwater acoustic signals: An environmentally adaptive approach. Acoust Soc Am 65:438-443
49. Ghosh J, Denser L, Beck S (1992) A neural network based hybrid system for detection, characterization and classification of short-duration oceanic signals, IEEE J Ocean Eng 17(4):351-363
50. Combes JM, Grossman A, Tchamitchian Ph (eds.) (1989) Wavelets: Time Frequency Methods and Phase Space, Springer-Verlag
51. Noordewier MO, Towell GG, Shavlik JW (1991) Training knowledge-based neural networks to recognize genes in DNA sequences. In: Lippmann RP, Moody JE, Touretzky DS (eds) Advances in Neural Information Processing Systems-3, Morgan Kaufmann 530-536
52. Tumer K, Ghosh J (1999) Linear and order statistics combiners for pattern classification. In: Sharkey AJC (ed) Combining Artificial Neural Nets: Ensemble and Modular Multi-net Systems, Springer 127-162