On the use of localized gating in mixture of experts networks

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 3390, Issue , 1998, Pages 24-35

  Ramamurti, Viswanath ^a   Ghosh, Joydeep ^b  

^a SBC Technology Resources Inc   (United States)

^b The University of Texas at Austin   (United States)

Author keywords

Confidence intervals; Generalization; Mixture of experts; Modular network; Structural adaptation

Indexed keywords

ARTIFICIAL INTELLIGENCE; MIXTURES;

CONFIDENCE INTERVAL; GENERALIZATION; MIXTURE OF EXPERTS; MODULAR NETWORK; STRUCTURAL ADAPTATION;

NETWORK ARCHITECTURE;

EID: 85076977233     PISSN: 0277786X     EISSN: 1996756X     Source Type: Conference Proceeding    
DOI: 10.1117/12.304812     Document Type: Conference Paper

References (15)

1. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton. Adaptive mixtures of local experts. Neural Computation, 3:79-87, 1991.
2. M. I. Jordan and R. A. Jacobs. Hierarchical mixture of experts and the EM algorithm. Neural Computation, 6:181-214, 1994.
3. V. Ramamurti and J. Ghosh. Advances in using hierarchical mixture of experts for signal classification. In Proceedings of ICASSP 96, pages 3569-3572, 1996.
4. S. R. Waterhouse and A. J. Robinson. Classification using hierarchical mixture of experts. In Neural Networks for Signal Processing IV: Proceedings of the IEEE Workshop, pages 177-186. IEEE Press, New York, 1994.
5. L. Xu, M. I. Jordan, and G. E. Hinton. An alternative model for mixture of experts. In G. Tesauro, D. S. Touretzky, and T. K. Leen, editors, Advances in Neural Information Processing Systems 7, pages 633-640. The MIT Press, 1995.
6. V. Ramamurti and J. Ghosh. Structural adaptation in mixture of experts. In Proceedings of ICPR 96, Track D, pages 704-708, 1996.
7. L. Prechelt. PROBEN1 - A set of benchmarks and benchmarking rules for neural network training algorithms. Technical Report 21/94, Fakultät für Informatik, Universität Karlsruhe, D-76128 Karlsruhe, Germany, September 1994. Anonymous FTP:/pub/papers/techreports/1994/1994-21.ps. Z on ftp.ira.uka.de.
8. Y. Shin and J. Ghosh. Ridge polynomial networks. IEEE Trans. Neural Networks, 6:610-622, May 1995.
9. R. O. Duda and P. E. Hart. Pattern Classification and Scene Analysis. Wiley, New York, 1973.
10. Hans G. C. Traven. A neural network approach to statistical pattern classification by "semiparametric" estimation of probability density functions. IEEE Transactions on Neural Networks, 2(3):366-377, May 1991.
11. S. Haykin. Adaptive Filter Theory. Englewood Cliffs, NJ: Prentice-Hall, 1991.
12. V. Ramamurti and J. Ghosh. Flexible modular architecture for changing environments. In Dagli, Akay, Chen, Fernandez, and Ghosh, editors, Intelligent Engineering Systems Through Artificial Neural Networks, volume 6, pages 5-10. ASME Press, 1996.
13. V. Ramamurti and J. Ghosh. Structurally adaptive modular networks for non-stationary environments. IEEE Transactions on Neural Networks, Submitted December 1996.
14. J. H. Friedman. An overview of predictive learning and function approximation. In V. Cherkassky, J. H. Friedman, and H. Wechsler, editors, From Statistics to Neural Networks, Proc. NATO/ASI Workshop. Springer Verlag, 1994.
15. V. Ramamurti and J. Ghosh. Regularization and error bars for the mixture of experts network. In Proceedings of the IEEE 1997 International Conference on Neural Networks., pages 221-225. IEEE Press, 1997.