Matrix logarithm parametrizations for neural network covariance models

Neural Networks

Volumn 12, Issue 2, 1999, Pages 299-308

  Williams, Peter M ^a  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

Author keywords

Covariance models; Matrix exponential; Matrix logarithm; Regularization

Indexed keywords

MATHEMATICAL MODELS; MATRIX ALGEBRA; NORMAL DISTRIBUTION;

COVARIANCE MODELS; MATRIX LOGARITHM;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYES THEOREM; COVARIANCE; PREDICTION; PRIORITY JOURNAL; STATISTICAL ANALYSIS; STATISTICAL CONCEPTS; STATISTICAL MODEL;

EID: 0033104417     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(98)00130-0     Document Type: Article

References (24)

1. Baldi, P., & Chauvin, Y. (1996). Hybrid modeling, HMM/NN architectures and protein applications. Neural Computation, 8, 1541-1565.
2. Barndorff-Nielsen, O., & Blæsild, P. (1983). Hyperbolic distributions. In S. Kotz & N. L. Johnson (Eds.), (pp. 700). Encyclopedia of statistical sciences, 3. New York: Wiley.
3. Berger, J. O. (1985). Statistical decision theory and Bayesian analysis. New York: Springer.
4. Bernardo, J. M., & Smith, A. F. M. (1994). Bayesian theory. Chichester: Wiley.
5. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Oxford University Press.
6. Bishop, C. M., & Legleye, C. (1995). Estimating conditional probability densities for periodic variables. In G. Tesauro & D. Tourektzky & T. Leen (Eds.), (pp. 641). Advances in neural information processing systems, 7. Cambridge, MA: MIT Press.
7. Buntine, W. L., & Weigend, A. S. (1991). Bayesian back-propagation. Complex Systems, 5, 603-643.
8. Chiu, T. Y. M., Leonard, T., & Tsui, K.-W. (1996). The matrix-logarithmic covariance model. Journal of the American Statistical Association, 91 (433), 198-210.
9. Fukunaga, K. (1990). Introduction to statistical pattern recognition. II. Boston: Academic Press.
10. Ghahramani, Z., & Jordan, M. I. (1994). Supervised learning from incomplete data via an EM approach. In J. D. Cowan, G. Tesauro & J. Alspector (Eds.), Advances in neural information processing systems, 6. (pp. 120). Los Altos, CA: Morgan Kaufmann.
11. Golub, G. H., & Van Loan, C. F. (1989). Matrix computations. II. Baltimore, MD: Johns Hopkins University Press.
12. Horn, H. R., & Johnson, C. R. (1985). Matrix analysis. Cambridge: Cambridge University Press.
13. Kendall, M. G. (1980). Multivariate analysis. II. London: Charles Griffin and Co Ltd.
14. Leonard, T., & Hsu, J. S. J. (1992). Bayesian inference for a covariance matrix. Annals of Statistics, 20 (4), 1669-1696.
15. MacKay, D. J. C. (1992). A practical Bayesian framework for backpropagation networks. Neural Computation, 4 (3), 448-472.
16. Najfeld, I., & Havel, T. F. (1995). Derivatives of the matrix exponential and their computation. Advances in Applied Mathematics, 16, 321-375.
17. Nix, D. A., & Weigend, A. S. (1995). Learning local error bars for nonlinear regression. In G. Tesauro & D. S. Touretzky & T. K. Leen (Eds.), (pp. 489). Advances in neural information processing systems, 7. Cambridge, MA: MIT Press.
18. Pinheiro, J. C., & Bates, D. M. (1996). Unconstrained parametrizations for variance-covariance matrices. Statistics and Computing, 6, 289-296.
19. Press, W. H., Flannery, B. P., Teukolsky, S. A., & Vetterling, W. T. (1992). Numerical recipes in C. II. Cambridge: Cambridge University Press.
20. Ripley, B. D. (1996). Pattern recognition and neural networks. Cambridge: Cambridge University Press.
21. Williams, P. M. (1993). Improved generalization and network pruning using adaptive Laplace regularization. In: Proceedings of the third IEE international conference on artificial neural networks (pp. 76-80). London: Institution of Electrical Engineers.
22. Williams, P. M. (1995). Bayesian regularization and pruning using a Laplace prior. Neural Computation, 7, 117-143.
23. Williams, P. M. (1996). Using neural networks to model conditional multivariate densities. Neural Computation, 8, 843-854.
24. Williams, P. M. (1998). Modelling seasonality and trends in daily rainfall data. In M. I. Jordan & M. J. Kearns & S. A. Solla (Eds.), (pp. 985). Advances in neural information processing systems, 10. Cambridge, MA: MIT Press.