New Nonleast-Squares Neural Network Learning Algorithms for Hypothesis Testing

IEEE Transactions on Neural Networks

Volumn 6, Issue 3, 1995, Pages 596-609

  Pados, Dimitris A ^a   Papantoni Kazakos, P ^a  

^a UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; BACKPROPAGATION; COMPUTER SIMULATION; ERRORS; LEARNING SYSTEMS; NEURAL NETWORKS; OPTIMIZATION; PROBABILITY;

BAYES OPTIMAL DESIGN; HYPOTHESIS TESTING; NEYMAN-PEARSON APPROACH; PERCEPTRON LEARNING; PERFORMANCE CRITERIA;

LEARNING ALGORITHMS;

EID: 0029304589     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.377966     Document Type: Article

References (20)

1. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. I, Foundations. Cambridge, MA: MIT Press, 1986.
2. P.J. Werbos, “Backpropagation through time: What it does and how to do it,” in Proc. IEEE, vol. 78, no. 10, Oct. 1990.
3. E. Barnard and D. Casasent, “A comparison between criterion functions for linear classifiers, with an application to neural nets,” IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 1030-1041, Sept./Oct. 1989.
4. D. Ruck, S. Rogers, M. Kabrisky, M. Oxley, and B. Suter, “The multilayer perceptron as an approximation to a Bayes optimal discriminant function,” IEEE Trans. Neural Networks, vol. 1, pp. 296-298, Dec. 1990.
5. E. Wan, “Neural network classification: A Bayesian interpretation,” IEEE Trans. Neural Networks, vol. 1, pp. 303-305, Dec. 1990.
6. F. Kanaya and S. Miyake, “Bayes statistical behavior and valid generalization of pattern classifying neural networks,” IEEE Trans. Neural Networks, vol. 2, pp. 471-475, July 1991.
7. E. Barnard, “Comments on ' ‘Bayes statistical behavior and valid generalization of pattern classifying neural networks,’ “ IEEE Trans. Neural Networks, vol. 3, pp. 1026-1027, Nov. 1992.
8. H. L. Van Trees, Detection, Estimation and Modulation Theory. New York: Wiley, 1968.
9. D. Kazakos and P. Papantoni-Kazakos, Detection and Estimation. New York: Computer Science Press, 1990.
10. H. Robbins and S. Monro, “A stochastic approximation method,” Ann. Math. Stat., vol. 22, pp. 400-407, 1951.
11. J. Kiefer and J. Wolfowitz, “Stochastic estimation of the maximum of a regression function,” Ann. Math. Stat., vol. 23, pp. 462-466, 1952.
12. H. White, “Some asymptotic results for learning in single hidden-layer feedforward network models,” J. Amer. Statis. Assoc., vol. 84, no. 408, pp. 1003-1013, Dec. 1989.
13. I. Y. Hoballah and P. K. Varshney, “Distributed Bayesian signal detection,” IEEE Trans. Inform. Theory, vol. 35, pp. 995-1000, Sept. 1989.
14. K. Halford, D. Kazakos, D. Pados, and P. Papantoni-Kazakos, “Neural networks with feedback in binary hypothesis testing,” in Proc. IEEE Int. Conf Syst., Man, Cybern., Charlottesville, VA, Oct. 1991.
15. F. Rosenblatt, Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms. Washington, DC: Spartan, 1962.
16. M. Minsky and S. Papert, Perceptrons. Cambridge, MA: MIT Press, 1969.
17. J. R. Blum, “Approximation methods which converge with probability one,” Ann. Math. Stat., vol. 25, pp. 737-744, 1954.
18. D. J. Sakrison, “A continuous Kiefer-Wolfowitz procedure for random processes,” Ann. Math. Stat., vol. 35, pp. 590-599, 1964.
19. L. D. Davisson and S. C. Schwartz, “Analysis of a decision-directed receiver with unknown priors,” IEEE Trans. Inform. Theory, vol. 16, pp. 270-276, May 1970.
20. D. Kazakos and L. D. Davisson, “An improved decision-directed detector,” IEEE Trans. Inform. Theory, vol. 26, pp. 113-116, Jan. 1980.