Minimum mean square estimation and neural networks

Neurocomputing

Volumn 13, Issue 1, 1996, Pages 59-74

  Manry, Michael T ^a   Apollo, Steven J ^b   Yu, Qiang ^c  

^a University of Texas   (United States)

^b Lockheed Fort Worth Company   (United States)

^c WorldCom Inc   (United States)

Author keywords

Cramer Rao bounds; Minimum mean square estimation; Multilayer perceptron; Parameter estimation

Indexed keywords

COMPUTER SIMULATION; ERRORS; ESTIMATION; MATHEMATICAL TECHNIQUES; MATHEMATICAL TRANSFORMATIONS; PROGRAM PROCESSORS;

CRAMER-RAO BOUNDS; ESTIMATION ERROR; MAXIMUM LIKELIHOOD ESTIMATOR; MINIMUM MEAN SQUARE ESTIMATION; MULTILAYER PERCEPTRON;

NEURAL NETWORKS;

ARTICLE; CONTROLLED STUDY; HUMAN; MATHEMATICAL ANALYSIS; NERVE CELL NETWORK; NONHUMAN; PERCEPTION; PRIORITY JOURNAL;

EID: 0030245917     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/0925-2312(95)00101-8     Document Type: Article

References (29)

1. [1] P. Werbos, Beyond regression: New tools for prediction and analysis in the behavioral sciences, Ph.D. dissertation, Committee on Appl. Math., Harvard Univ., Cambridge, MA, Nov. 1974.
2. [2] Y-H Pao, Adaptive Pattern Recognition and Neural Networks, (Addison-Wesley, New York, 1989).
3. [3] D.E. Rumelhart, G.E. Hinton and R.J. Williams, Learning internal representations by error propagation, in D.E. Rumelhart and J.L. McClelland (Eds.), Parallel Distributed Processing, Vol. I (Cambridge, MA, MIT Press, 1986).
4. [4] T. Kohonen, G. Barna and R. Chrisley, Statistical pattern recognition with neural networks: Benchmarking studies, IEEE Int. Conf. on Neural Networks, San Diego, CA, Vol. 1 (1989) 61-68.
5. [5] D.W. Ruck, S.K. Rogers et al., The multilayer perceptron as an approximation to a Bayes optimal discriminant function, IEEE Trans. Neural Networks 1 (Dec. 1990) 296-298.
6. [6] E.A. Wan, Neural network classification: A Bayesian interpretation, IEEE Trans. Neural Networks 1 (1990) 303-305.
7. [7] G. Cybenko, "Approximations by superpositions of a sigmoidal function, Math. Contrl. Signals Syst. 2 (1989) 303-314.
8. [8] E. Hartman, J. D. Keeler and J.M. Kowalski, Layered neural networks with Gaussian hidden units as universal approximations, Neural Computation 2 (1990).
9. [9] Mu-Song Chen and M.T. Manry, Back-propagation representation theorem using power series, in Proc. IJCNN Vol. I (1990) 643-648.
10. [10] J. Wray and G.G.R. Green, Neural networks, approximation theory, and finite precision computation, Neural Networks 8 (1) (1995) 31-37.
11. [11] A.R. Barron, Approximation and estimation bounds for artificial neural networks, Machine Learning 14 (1994) 115-133.
12. [12] H.L. Van Trees, Detection, Estimation, and Modulation Theory-Part I (New York, NY, Wiley, 1968).
13. [13] G. Govind and P.A. Ramamoorthy, Multi-layered neural networks and Volterra series: the missing link, Proc. Int. Conf. on Systems Engineering, Pittsburgh, PA (August 1990).
14. [14] T.M. Jelonek and James P. Reilly, Maximum likelihood estimation for direction of arrival using a nonlinear optimizing neural network, Int. Joint Conf. on Neural Networks, vol. I, (1990) 253-258.
15. [15] S.J. Apollo, M.T. Manry, L.S. Allen and W.D. Lyle, Optimality of transforms for parameter estimation, Conf. Record Twenty-Sixth Annual Asilomar Conf. on Signals, Systems, and Computers (Oct. 1992) vol. 1, pp. 294-298.
16. [16] M.S. Dawson, J. Olvera, A.K. Fung and M.T. Manry, Inversion of surface parameters using fast learning neural networks, Proc. IGARSS'92, Houston, Texas (May 1992) vol. II, pp. 910-912.
17. [17] M.S. Dawson, A.K. Fung and M.T. Manry, Surface parameter retrieval using fast learning neural networks, Remote Sensing Rev., 7 (1993) 1-18.
18. [18] M.T. Manry, X. Guan, S.J. Apollo, L.S. Allen, W.D. Lyle and W. Gong, Output weight optimization for the multi-layer perceptron, Conf. Record of the Twenty-Sixth Annual Asilomar Conf. on Signals, Systems, and Computers (Oct. 1992) vol 1, pp. 502-506.
19. [19] M.T. Manry, S.J. Apollo, L.S. Allen, W.D. Lyle, W. Gong, M.S. Dawson and A.K. Fung, Fast Training of Neural Networks for Remote Sensing, Remote Sensing Rev. 9 (1994) 77-96.
20. [20] X. Jiang, Mu-Song Chen, M.T. Manry, M.S. Dawson and A.K. Fung, Analysis and optimization of neural networks for remote sensing, Remote Sensing Rev. 9 (1994) 97-114.
21. [21] A. Khotanzad, R-C Hwang and D. Maratuklam, Hourly load forecasting by neural networks, presented at the IEEE PES Winter Meeting, Columbus, Ohio (Feb. 1993).
22. [22] K. Liu, S. Subbarayan; R.R. Shoults, M.T. Manry, C. Kwan, F.L. Lewis and J. Naccarino, Comparison of very short-term load forecasting techniques, IEEE Trans. Power Systems, to appear.
23. [23] A. Papoulis, Probability, Random Variables, and Stochastic Processes (McGraw-Hill, New York, 1965).
24. [24] D.F. Elliot and K.R. Rao, Fast Transforms: Algorithms, Analyses, Applications (Academic Press, 1982).
25. [25] W.H. Press, B.P. Flannery, S.A. Teukolsky and W.T. Vetterling, Numerical Recipes in C - The Art of Scientific Computing, second ed. (Cambridge, MA, Cambridge University Press, 1994).
26. [26] M.D. Srinath and P.K. Rajasekaran, An Introduction to Statistical Signal Processing with Applications Wiley, 1979.
27. [27] S.A. Barton, A matrix method for optimizing a neural network, Neural Computation 3 (3) (Fall 1991) 450-459.
28. [28] M.A. Sartori and P.J. Antsaklis, A simple method to derive bounds on the size and to train multilayer neural networks, IEEE Trans. Neural Networks 2 (4) (July 1991) 467-471.
29. [29] F. Biegler-Konig and F. Barmann, A learning algorithm for multilayered neural networks based on linear least squares problems, Neural Networks 6 (1) (1993) 127-131.