Stochastic organization of output codes in multiclass learning problems

Neural Computation

Volumn 13, Issue 5, 2001, Pages 1065-1102

  Utschick, Wolfgang ^a   Weichselberger, Werner ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; LEARNING; NERVE CELL NETWORK; PHYSIOLOGY; PROBABILITY; STATISTICAL MODEL; STATISTICS;

ALGORITHMS; LEARNING; LIKELIHOOD FUNCTIONS; MODELS, NEUROLOGICAL; NERVE NET; NEURAL NETWORKS (COMPUTER); PROBABILITY; STOCHASTIC PROCESSES;

EID: 0035350036     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/08997660151134334     Document Type: Article

References (37)

1. Anand, R., Mehrotra, K., Mohan, C. K., & Ranka, S. (1995). Efficient classification for multiclass problems using modular neural networks. IEEE Transactions on Neural Networks, 6, 117-124.
2. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Clarendon Press.
3. Blake, C., Keogh, E., & Merz, C. J. (1998). UCI repository of machine learning databases. University of California, Irvine, Department of Information and Computer Sciences. Available online at: http://www.ics.uci.edu/~mlearn/ mlrepository.html.
4. Breiman, L. (1996). Bagging predictors. Machine Learning, 24, 123-140.
5. Cortes, C., & Vapnik, V. N. (1995). Support-vector networks. Machine Learning, 20, 273-297.
6. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B, 39, 1-38.
7. Dietterich, T. G., & Bakiri, G. (1995). Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2, 263-286.
8. Duda, R. O., & Hart, P. E. (1973). Pattern classification and scene analysis. New York: Wiley.
9. Eigenmann, R., & Nossek, J. A. (1998). Classification based on first-order multivariable polynomials. In Proceedings of the International Workshop on Advanced Black-Box Techniques for Nonlinear Modeling: Theory and Applications, Leuven (pp. 7-12).
10. Fletcher, R. (1980). Practical methods of optimization. New York: Wiley.
11. Friedman, J. H. (1996). Another approach to polychotomous classification. Available online at: http://www-stat.stanford.edu/~jhf.
12. Gareth, J., & Hastie, T. (1997). Error coding and PaCT's. Winning paper in the ASA student paper competition for the Statistical Computing Section, Available online at: http: //playfair.Stanford.EDU/~trevor/ASA/winners.html.
13. Gill, P. E., Murray, W., & Wright, M. H. (1981). Practical optimization. Orlando, FL: Academic Press.
14. Goemans, M. X., & Williamson, D. P. (1995). Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming. Journal of the Association for Computing Machinery, 42, 1115-1145.
15. Guruswami, V., & Sahai, A. (1999). Multiclass learning, boosting, and error-correcting codes. In Proceedings of the International Conference on Computational Learning Theory.
16. Hofmann, T., Puzicha, J., & Buhmann, M. (1998). Unsupervised texture segmentation in a deterministic annealing framework. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 803-818.
17. Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. V. (1983). Optimization by simulated annealing. Science, 220, 671-680.
18. Kressel, U., & Schürmann, J. (1997). Pattern classification techniques based on function approximation. In H. Bunke & P. S. P. Wang (Eds.), Handbook on optical character recognition and document analysis (Vol. 2, pp. 49-78). Singapore: World Scientific.
19. Mayoraz, E., & Moreira, M. (1996). On the decomposition of polychotomies into dichotomies (Tech. Rep. No. IDIAP-RR 96-08). Dalle Molle Institute for Perceptive Artificial Intelligence (IDIAP).
20. McLachlan, G., & Krishnan, T. (1997). The EM algorithm and extensions. New York: Wiley.
21. Miller, D., Rao, A. V., Rose, K., & Gersho, A. (1996). A global optimization technique for statistical classifier design. IEEE Transactions on Signal Processing, 44, 3108-3122.
22. Moon, T. K. (1996). The expectation-maximization algorithm. IEEE Signal Processing Magazine, 47-60.
23. Puzicha, J., Hofmann, T., & Buhmann, J. M. (1997). Deterministic annealing: Fast physical heuristics for real-time optimization of large systems. In Proceedings of the Fifteenth IMACS World Conference on Scientific Computation, Modelling and Applied Mathematics, Berlin.
24. Redner, R. A., & Walker, H. F. (1984). Mixture densities, maximum likelihood and the EM algorithm. SIAM Review, 26, 195-239.
25. Richard, M. D., & Lippmann, R. P. (1991). Neural network classifiers estimate Bayesian a posteriori probabilities. Neural Computation, 3, 461-483.
26. Ripley, B. D. (1996). Pattern recognition and neural networks. Cambridge: Cambridge University Press.
27. Rojas, R. (1996). A short proof of the posterior probability property of classifier neural networks. Neural Computation, 8, 41-43.
28. Rose, K. (1992). Vector quantization by deterministic annealing. IEEE Transactions on Information Theory, 38, 1249-1257.
29. Rose, K. (1998). Deterministic annealing for clustering, compression, classification, regression, and related optimization problems. Proceedings of the IEEE, 86, 2210-2239.
30. Ruck, D. W., Rogers, S. K., Kabrinsky, M., Oxley, M. E., & Suter, B. W. (1990). The multilayer perceptron as an approximation to a Bayes optimal discriminant function. IEEE Transactions on Neural Networks, 1, 296-298.
31. Rumelhart, D. E., & McClelland, J. L. (1986). Learning internal representations by error propagation. In D. E. Rumelhart, J. L. McClelland, & the PDP Group (Eds.), Parallel distributed processing (Vol. 1, pp. 318-362). Cambridge, MA: MIT Press.
32. Schäffler, S. (1995). Unconstrained global optimization using stochastic integration. Optimization, 35.
33. Schapire, R. E. (1997). Using output codes to boost multiclass learning problems. In Proceedings of the Fourteenth International Conference on Machine Learning (pp. 313-321).
34. Schölkopf, B. (1997). Support vector learning. Munich: Oldenbourg-Verlag.
35. Schürmann, J. (1996). Pattern classification: A unified view of statistical and neural approaches. New York: Wiley.
36. Utschick, W. (1998). Error-correcting classification based on neural networks. Aachen: Shaker.
37. Werbos, P. (1974). Beyond regression: New tools for prediction and analysis in the behavioral sciences. Unpublished doctoral dissertation, Harvard University.