An effective Bayesian neural network classifier with a comparison study to support vector machine

Neural Computation

Volumn 15, Issue 8, 2003, Pages 1959-1989

  Liang, Faming ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0041825287     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/08997660360675107     Document Type: Article

References (45)

1. Bahar, I., Atilgan, A. R., Jemigan, R. L., & Erman, B. (1997). Understanding the recognition of protein structural classes by amino acid composition. Proteins: Struc., Func., and Genetics, 29, 172-185.
2. Bennett, K. P., & Mangasarian, O. L. (1992). Robust linear programming discrimination of two linearly inseparable sets. Optimization Methods and Software, 1, 23-34.
3. Bertsekas, D. P. (1995). Nonlinear programming. Belmont, MA: Athenas Scientific.
4. Boser, B., Guyon, I., & Vapnik, V. (1992). A training algorithm for optimal margin classifiers. In Fifth Annual Conference on Computational Learning Theory (pp. 142-152). San Mateo, CA: Morgan Kaufmann.
5. Breiman, L. (2002). Statistical modeling - the two cultures. Statistical Science, 16, 199-215.
6. Brown, M. P. S., Grundy, W. N., Lin, D., Cristianini, N., Sugnet, C. W., Furey, T. S., M. A. Jr., & Haussler, D. (2000). Knowledge-based analysis of microarray gene expression data by using support vector machines. Proc. Natl. Acad. Sci, USA, 97, 262-267.
7. Chang, C. C., & Lin, C. J. (2001). Training v-support vector classifiers: Theory and algorithms. Neural Computation, 13, 2119-2147.
8. Chou, K. C. (1999). A key driving force in determination of protein structure classes. Biochem. Biophys. Res, Commun., 264, 216-224.
9. Chou, K. C. (2001). Review: Prediction of protein structural classes and subcellular location. Current Protein and Peptide Science, 1, 171-208.
10. Cortes, C., & Vapnik, V. (1995). Support vector networks. Machine Learning, 20, 273-297.
11. Ding, C. H. Q., & Dubchak, I. (2001). Multi-class protein fold recognition using support vector machines and neural networks. Bioinformatics, 17, 349-358.
12. Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification (2nd ed.). New York: Wiley.
13. Fletcher, R. (1987). Practical methods of optimization (2nd ed.). New York: Wiley.
14. Gelman, A., Roberts, R. O., & Gilks, W. R. (1996). Efficient metropolis jumping rules. In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian Statistics, 5. New York: Oxford University Press.
15. Geyer, C. J. (1991). Markov chain Monte Carlo maximum likelihood. In E. M. Keramigas (Ed.), Computing science and statistics: Proceedings of the 23rd Symposium on the Interface (pp. 153-163). Seattle: Interface Foundation.
16. Geyer, C. J., & Thompson, E. A. (1995). Annealing Markov chain Monte Carlo with applications to ancestral inference. J. Amer. Statist. Assoc., 90, 909-920.
17. Green, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika, 82, 711-732.
18. Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97-109.
19. Hukushima, K., & Nemoto, K. (1996) Exchange Monte Carlo method and application to spin glass simulations. J. Phys. Soc. Jpn., 65, 1604-1608.
20. Husmeier, D., Penny, W. D., & Roberts, S. J. (1999). An empirical evaluation of Bayesian sampling with hybrid Monte Carlo for training neural network classifiers. Neural Networks, 12, 677-705.
21. Kass, R. E., & Vaidyanathan, S. (1992). Approximate Bayesian factors and orthogonal parameters, with applications to testing equality of two binomial proportions. /. Royal Statist. Soc., B, 129-144.
22. Knerr, S., Personnaz, L., & Dreyfus, G. (1990). Single-layer learning revisited: A stepwise procedure for building and training a neural network. In J. Fogelman (Ed.), Neurocomputing: Algorithms, architectures and applications. Berlin: Springer-Verlag.
23. Krogh, A., & Vedelsby, J. (1995). Neural network ensembles, cross validation, and active learning. In J. D. Cowan, D. Touretzky, & J. Alspector (Eds.), Advances in neural information processing systems, 7. Cambridge, MA: MIT Press.
24. Levitt, M., & Chothia, C. (1976). Structural patterns in globular proteins. Nature, 261, 552-557.
25. p model sampling and change point problem. Statistica Sinica, 10, 317-342.
26. MacKay, D. J. C. (1992). A practical Bayesian framework for backprop networks. Neural Computation, 4, 448-472.
27. Mangasarian, O. L., & Wolberg, W. H. (1990). Cancer diagnosis via linear programming. SIAM News, 23, 1-18.
28. Markowetz, F., Edler, L., & Vingron, M. (2002). Support vector machines for protein fold class prediction (Tech. Rep.). Berlin: Max-Planck-Institute for Molecular Genetics, Computational Molecular Biology.
29. Mercer, J. (1909). Functions of positive and negative type, and their connection with the theory of integral equations. Transactions of the London Philospohical Society A, 209, 819-835.
30. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953). Equation of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1091.
31. Müller, P. (1993). Alternatives to the Gibbsa sampling scheme (Tech. Rep.). Durham, NC: Institute of Statistics and Decision Sciences, Duke University.
32. Neal, R. M. (1996). Bayesian learning for neural networks. New York: SpringerVerlag.
33. Perrone, M. P., & Cooper, L. N. (1993). When networks disagree: Ensemble methods for hybrid neural networks. In R. J. Mammone (Ed.), Neural networks for speech and image processing. London: Chapman-Hall.
34. Platt, J. C., Cristianini, N., & Shawe-Taylor, J. (2000). Large margin DAGs for multiclass classification. In S. A. Solla, T. K. Leen, & K.-R. Müller (Eds.), Advances in neural information processing systems, 12 (pp. 547-553). Cambridge, MA: MIT Press.
35. Raftery, A.E., Madigan, D., & Hoeting, J.A. (1997). Bayesain model averaging for linear regression models. J. Amer. Statist. Assoc., 92, 179-191.
36. Ripley, B. D. (1994). Flexible nonlinear approaches to classification. In J. H. Friedman & H. Wechsler (Eds.), From statistics to neural networks: Theory and pattern recognition applications. Berlin: Springer-Verlag.
37. Robert, C. P., & Casella, G. (1999). Monte Carlo statistical methods. New York: Springer-Verlag.
38. Rosen, B. E. (1996). Ensemble learning using decorrelated neural networks. Connection Science, 3, 373-384.
39. Rumelhart, D., Hinton, G., & Williams, J. (1986). Learning internal representations by error propagation. In D. Rumelhart & J. McClelland (Eds.), Parallel distributed processing (pp. 318-362). Cambridge, MA: MIT Press.
40. Smith, A. F. M., & Roberts, G. O. (1993). Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods (with discussion). J. Royal Statist. Soc. B, 55, 3-23.
41. Sollich, P. (2002). Bayesian methods for support vector machines: Evidence and predictive class probabilities. Machine Learning, 46, 21-52.
42. Thodberg, H. H. (1996). A review of Bayesian neural networks with an application to near infrared spectroscopy. IEEE Transactions on Neural Networks, 7, 56-72.
43. Weigend, A. S., Huberman, B. A., & Rumelhart, D. E. (1990). Predicting the future: A connectionist approach. Int. J. Neural Syst., 1, 193-209.
44. Weston, J., & Watkins, C. (1998). Multi-class support vector machines (Tech. Rep. CSD-TR-98-04). Egham, Surrey: Royal Holloway, University of London.
45. White, H. (1992). Artificial neural networks: Approximation and learning theory. Cambridge, MA: Blackwell.