Decision manifolds - A supervised learning algorithm based on self-organization

IEEE Transactions on Neural Networks

Volumn 19, Issue 9, 2008, Pages 1518-1530

  Pölzlbauer, Georg ^a   Lidy, Thomas ^a   Rauber, Andreas ^a  

^a VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Decision surface estimation; Self organizing maps (SOMs); Supervised learning

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); CLASSIFIERS; COMPUTATIONAL METHODS; CONFORMAL MAPPING; KETONES; LEARNING SYSTEMS; MAPS; SELF ORGANIZING MAPS; SUPERVISED LEARNING; TOPOLOGY;

CLASSIFICATION BOUNDARY; CLASSIFICATION RESULTS; COMPUTATIONALLY EFFICIENT; DECISION SURFACE ESTIMATION; DECISION SURFACES; LABELED DATA; MODEL SELECTIONS; NEURAL CLASSIFIERS; NON-LINEAR MANIFOLDS; REAL-WORLD DATA SETS; SELF ORGANIZATIONS; SELF-ORGANIZING MAPS (SOMS); SEPARATING HYPERPLANES; SUPERVISED LEARNING ALGORITHM; TOPOLOGICAL CONSTRAINTS; VOTING SCHEMES;

LEARNING ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; DECISION SUPPORT SYSTEM; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DECISION SUPPORT TECHNIQUES; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 52149118432     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.2000449     Document Type: Article

References (43)

1. S. Kulkarni, G. Lugosi, and S. Venkatesh, "Learning pattern classification - A survey," IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2178-2206, Oct. 1998.
2. T. Kohonen, Self-Organizing Maps, 3rd ed. New York: Springer-Verlag, 2001.
3. J. B. Tenenbaum, V. de Silva, and J. C. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 5500, pp. 2319-2323, 2000.
4. L. K. Saul and S. T. Roweis, "Think globally, fit locally: Unsupervised learning of low dimensional manifolds," J. Mach. Learn. Res., vol. 4, pp. 119-155, 2003.
5. W. S. Torgerson, "Multidimensional scaling: I. Theory and method," Psychometrika, vol. 17, pp. 401-419, 1952.
6. M. Vlachos, C. Domeniconi, D. Gunopulos, G. Kollios, and N. Koudas, "Non-linear dimensionality reduction techniques for classification and visualization," in Proc. 8th ACM SIGKDD Int. Conf. Knowl. Disc. Data Mining, 2002, pp. 645-651.
7. X. Geng, D.-C. Zhan, and Z.-H. Zhou, "Supervised nonlinear dimensionality reduction for visualization and classification," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 35, no. 6, pp. 1098-1107, Dec. 2005.
8. P. D. Wasserman, Advanced Methods in Neural Computing. New York: Van Nostrand Reinhold, 1993.
9. D. De Ridder, O. Kouropteva, O. Okun, M. Pietikainen, and R. Duin, "Supervised locally linear embedding," in Joint International Conference on Artificial Neural Networks ICANN/ICONIP, ser. Lecture Notes in Computer Science 2714. Berlin, Germany: Springer-Verlag, 2003, pp. 333-341.
10. J. G. Wen, L. Jiang, and N. R. Shadbolt, "Clustering-based nonlinear dimensionality reduction on manifold," in Pacific Rim International Conference on Artificial Intelligence, ser. Lecture Notes in Artificial Intelligence 4099. Berlin, Germany: Springer-Verlag, 2006, pp. 444-453.
11. G. Wen, L. Jiang, and N. R. Shadbolt, "Using graph algebra to optimize neighborhood for isometric mapping," in Proc. Int. Joint Conf. Artif. Intell., 2007, pp. 2398-2403.
12. V. D. Silva and J. B. Tenenbaum, "Global versus local methods in nonlinear dimensionality reduction," in Neural Inf. Process. Syst. 2003, pp. 705-712.
13. S. T. Roweis, L. K. Saul, and G. E. Hinton, "Global coordination of local linear models," in Neural Inf. Process. Syst., 2001, pp. 889-896.
14. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer-Verlag, 2001.
15. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
16. L. Breiman, "Random forests," Mach. Learn., vol. 45, pp. 5-32, 2001.
17. J. Sklansky and L. Michelotti, "Locally trained piecewise linear classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 2, no. 2, pp. 101-111, Feb. 1980.
18. L. Bottou and V. Vapnik, "Local learning algorithms," Neural Comput., vol. 4, no. 6, pp. 888-900, 1992.
19. J. Cerquides and R. L. de Mántaras, "Robust Bayesian linear classifier ensembles," in Proc. Eur. Conf. Mach. Learn., 2005, pp. 72-83.
20. F. Fernandez and P. Isasi, "Local feature weighting in nearest prototype classification," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 40-53, Jan. 2008.
21. R. A. Jacobs and M. I. Jordan, "Hierarchical mixtures of experts and the EM algorithm," Neural Comput., vol. 6, pp. 181-214, 1994.
22. R. Khoussainov, A. Hess, and N. Kushmerick, "Ensembles of biased classifiers," in Proc. Int. Conf. Mach. Learn., 2005, pp. 425-432.
23. J. Vesanto and E. Alhoniemi, "Clustering of the self-organizing map," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 586-600, May 2000.
24. S. Wu and T. W. S. Chow, "PRSOM: A new visualization method by hybridizing multidimensional scaling and self-organizing map," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1362-1380, Nov. 2005.
25. J. Vesanto, "SOM-based data visualization methods," Intell. Data Anal., vol. 3, no. 1, pp. 111-126, 1999.
26. G. Pölzlbauer, M. Dittenbach, and A. Rauber, "Advanced visualization of self-organizing maps with vector fields," Neural Netw., vol. 19, no. 6-7, pp. 911-922, Jul.-Aug. 2006, doi: 10.1016/j.neunet.2006.05.013.
27. S. Kaski, T. Honkela, K. Lagus, and T. Kohonen, "WEBSOM - Self-organizing maps of document collections," Neurocomputing, vol. 21, pp. 101-117, 1998.
28. M. Milano, P. Koumoutsakos, and J. Schmidhuber, "Self-organizing nets for optimization," IEEE Trans. Neural Netw., vol. 15, no. 3, pp. 758-765, May 2004.
29. J. Laaksonen, M. Koskela, and E. Oja, "PicSOM - Self-organizing image retrieval with MPEG-7 content descriptors," IEEE Trans. Neural Netw. vol. 13, no. 4, pp. 841-853, Jul. 2002.
30. E. Berglund and J. Sitte, "The parameterless self-organizing map algorithm," IEEE Trans. Neural Netw., vol. 17, no. 2, pp. 305-316, Mar. 2006.
31. C.-C. Hsu, "Generalizing self-organizing map for categorical data," IEEE Trans. Neural Netw., vol. 17, no. 2, pp. 294-304, Mar. 2006.
32. A. Rauber, D. Merkl, and M. Dittenbach, "The growing hierarchical self-organizing map: Exploratory analysis of high-dimensional data," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1331-1341, Nov. 2002.
33. Y. Linde, A. Buzo, and R. M. Gray, "An algorithm for vector quantizer design," IEEE Trans. Commun., vol. COM-28, no. 1, pp. 84-95, Jan. 1980.
34. J. A. Hartigan and M. A. Wong, "A K-means clustering algorithm," Appl. Statist., vol. 28, pp. 100-108, 1979.
35. J. Vesanto, J. Himberg, E. Alhoniemi, and J. Parhankangas, "Self-organizing map in Matlab: The SOM toolbox," in Proc. Matlab DSP Conf., 1999, pp. 35-40.
36. T. Kohonen, "The self-organizing map," Neurocomputing, vol. 21, pp. 1-6, 1998.
37. F. Rosenblatt, "The perceptron: A probabilistic model for information storage and organization in the brain," Psychol. Rev., vol. 65, no. 6, pp. 386-408, 1958.
38. T. Villmann and J. C. Claussen, "Investigation of magnification control in self-organizing maps and neural gas," Neural Comput., vol. 18, no. 2, pp. 446-469, 2006.
39. E. Merenyi, A. Jain, and T. Villmann, "Explicit magnification control of self-organizing maps for "forbidden" data," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 786-797, May 2007.
40. K. Woods, W. P. Kegelmeyer, and K. Bowyer, "Combination of multiple classifiers using local accuracy estimates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 4, pp. 405-410, Apr. 1997.
41. H.-U. Bauer and T. Villmann, "Growing a hypercubical output space in a self-organizing feature map," IEEE Trans. Neural Netw., vol. 8, no. 2, pp. 218-226, Mar. 1997.
42. S. L. Salzberg, "On comparing classifiers: Pitfalls to avoid and a recommended approach," Data Mining Knowl. Disc., vol. 1, no. 3, pp. 317-328, 1997.
43. T. M. Martinetz and K. J. Schulten, "A "neural-gas" network learns topologies," in Proc. Int. Conf. Artif. Neural Netw., 1991, pp. 397-402.