Committee machines

Handbook of Neural Network Signal Processing

Volumn , Issue , 2001, Pages 5-1-5-18

  Tresp, Volker ^a  

^a SIEMENS AG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85037997203     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (43)

1. Sharkey, A.J.C., Combining Artificial Neural Nets, Springer-Verlag, New York, 1999.
2. Rehfuss, S., Wu, L., and Moody, J., Trading with committees: a comparative study, in Neural Networks in the Capital Markets, Refenes, A., Abu-Mostafa, Y., Moody, J., and Weigend, A., Eds., World Scientific, London, 1996.
3. Granger, C.W.J., Combining forecasts twenty years later, Journal Forecasting, 8, 167, 1989.
4. Bernardo, J.M. and Smith, A.F.M., Bayesian Theory, JohnWiley & Sons, New York, 1993.
5. Quinlan, J.R., Thirteenth National Conference on Artificial Intelligence (AAAI-96), AAAI Press, 1996.
6. Meir, R., Bias, variance and the combination of least squares estimators, in Advances in Neural Information Processing Systems 7, Tesauro, G., Touretzky, D.S., and Leen, T.K., Eds., MIT Press, Cambridge, MA, 1995, 295.
7. Taniguchi, M. and Tresp, V., Averaging regularized estimators, Neural Computation, 9, 1163, 1997.
8. Breiman, L., Combining predictors, in Combining Artificial Neural Nets, Sharkey, A.J.C., Ed., Springer-Verlag, New York, 1999, 31.
9. Perrone, M.P., Improving regression estimates: averaging methods for variance reduction with extensions to general convex measure optimization, Ph.D. thesis, Brown University, 1993.
10. Krogh, A. and Vedelsby, J., Neural network ensembles, cross validation, and active learning, in Advances in Neural Information Processing Systems 7, Tesauro, G., Touretzky, D.S., and Leen, T.K., Eds., MITP ress, Cambridge, MA, 1995, 231.
11. Dietterich, T.G., An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting and randomization, Machine Learning, 40, 130, 2000.
12. Breiman, L., Randomizing outputs to increase prediction accuracy, Machine Learning, 40, 229, 2000.
13. Raviv, Y. and Intrator, N., Variance reduction via noise and bias constraints, in Combining Artificial Neural Nets, Sharkey, A.J.C., Ed., Springer-Verlag, New York, 1999, 31.
14. Friedman J., Hastie T., and Tibshirani, R., Additive logistic regression: a statistical view of boosting, Annals of Statistics, 38(2):337, 2000.
15. Schapire, R.E., The strength of weak learnability, Machine Learning, 5, 197, 1990.
16. Freund, Y. and Schapire, R.E., Experiments with a new boosting algorithm, in Machine Learning: Proceedings of the Thirteenth International Conference, 148, 1996.
17. Zemel, R.S. and Pitassi, T., Agradient-based boosting algorithm for regression problems, in Advances in Neural Information Processing Systems 13, Leen, T.K., Dietterich, T.G., and Tresp, V., Eds., MIT Press, Cambridge, MA, 2001, 696.
18. Schapire, R.E., Freund, Y., Bartlett, P., and Lee, W.S. Boosting the margin: a new explanation for the effectiveness of voting methods, The Annals of Statistics, 26(2):1651, 1998.
19. Drucker, H., Boosting neural networks, in Combining Artificial Neural Nets, Sharkey, A.J.C., Ed., Springer-Verlag, New York, 1999, 51.
20. Rätsch, G., Onoda, T., and Müller, K.R., Regularizing AdaBoost, in Advances in Neural Information Processing Systems 11, Kearns, M.S., Solla, S.A., and Cohn, D.A., Eds., MITP ress, Cambridge, MA, 1999, 564.
21. Rätsch, G., Schölkopf, B., Smola, A., Müller, K.R., Onoda, T., and Mika, A., ν-Arc: ensemble learning in the presence of noise, in Advances in Neural Information Processing Systems 12, Solla, S.A., Leen, T.K., and Müller, K.R., Eds., MIT Press, Cambridge, MA, 2000, 561.
22. Schapire, R.E. and Singer, Y., Improved boosting algorithms using confidence-rated predictions, in Proceedings of the Eleventh Annual Conference on Computational Learning Theory, 1998.
23. Breiman, L., Predicting games and arcing algorithms, TR. 504, Statistics Department, University of California, December, 1997.
24. Mason, L., Baxter, J., Bartlett, P., and Frean, M., Boosting algorithms as gradient descent, in Advances in Neural Information Processing Systems 12, Solla, S.A., Leen, T.K., and Müller, K.R., Eds., MIT Press, Cambridge, MA, 2000, 512.
25. Wolpert, D.H., Stacked generalization, Neural Networks, 5, 241, 1992.
26. Jacobs, R.A., Jordan, M.I., Nowlan, S.J., and Hinton, J.E., Adaptive mixtures of local experts, Neural Computation, 3, 79, 1991.
27. Neuneier, R.F., Hergert, W., Finnof, W., and Ormoneit, D., Estimation of conditional densities: a comparison of approaches, Proceedings of ICANN*94, 1, 689, 1994.
28. Bishop, C.M., Neural Networks for Pattern Recognition, Clarendon Press, Oxford, UK, 1995.
29. Haykin, S., Neural Networks, a Comprehensive Foundation, 2nd ed., Prentice-Hall, Englewood Cliffs, NJ, 1999.
30. Tresp, V., Mixtures of Gaussian processes, in Advances in Neural Information Processing Systems 13, Leen, T.K., Dietterich, T.G., and Tresp, V., Eds., MIT press, Cambridge, MA, 2001, 654.
31. Jordan, M.I. and Jacobs, R.A., Hierarchical mixtures of experts and the EM algorithm, Neural Computation, 6, 181, 1994.
32. Tresp, V., Hollatz, J., and Ahmad, S., Network structuring and training using rule-based knowledge, in Advances in Neural Information Processing Systems 5, Giles, C.L., Hanson, S.J., and Cowan J.D., Eds., Morgan Kaufman, San Mateo, CA, 1993, 871.
33. Tresp, V. and Taniguchi, M., Combining estimators using non-constant weighting functions, in Advances in Neural Information Processing Systems 7, Tesauro, G., Touretzky, D.S., and Leen, T.K., Eds., MITP ress, Cambridge, MA, 1995, 419.
34. Tresp, V., Hollatz, J., and Ahmad, S., Representing probabilistic ruleswith networks of Gaussian basis functions, Machine Learning, 27, 173, 1997.
35. Xu, L., Jordan, M.I., and Hinton, G.E., An alternative model for mixtures of experts, in Advances in Neural Information Processing Systems 7, Tesauro, G., Touretzky, D.S., and Leen, T.K., Eds., MIT Press, Cambridge, MA, 1995, 633.
36. Hofmann, R. and Tresp, V., Discovering structure in continuous variables using Bayesian networks, in Advances in Neural Information Processing Systems 8, Touretzky, D.S., Mozer, M.C., and Hasselmo, M.E., Eds., MITP ress, Cambridge, MA, 1996, 500.
37. Brashers-Krug, T., Shadmehr, R., Todorov, E., and Jacobs, R., Catastrophic inference in human motor learning, in Advances in Neural Information Processing Systems 7, Tesauro, G., Touretzky, D.S., and Leen, T.K., Eds., MIT Press, Cambridge, MA, 1995, 19.
38. Jacobs, R. and Tanner, M., Mixtures of X, in Combining Artificial Neural Nets, Sharkey, A.J.C., Ed., Springer-Verlag, New York, NY, 1999, 267.
39. Tresp, V., The Bayesian committee machine, Neural Computation, 12, 2000.
40. Tresp, V., The generalized Bayesian committee machine, Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD-2000, 130, 2000.
41. Schwaighofer, A. and Tresp, V., The Bayesian committee support vector machine, Proceedings of the Eleventh International Conference on Artificial Intelligence, ICANN, 2001.
42. Ormoneit, D. and Tresp, V., Averaging, maximum penalized likelihood and Bayesian estimation for improving Gaussian mixture probability density estimates, IEEE Transactions on Neural Networks, 9, 639, 1998.
43. Smyth, P. and Wolpert, D., Stacked density estimation, in Advances in Neural Information Processing Systems 10, Jordan, M.I., Kearns, M.J., and Solla, A.S., Eds., MITP ress, Cambridge, MA, 1998, 668.