The weight decay backpropagation for generalizations with missing values

Annals of Operations Research

Volumn 78, Issue , 1998, Pages 165-187

  Gupta, Amit ^a   Lam, Monica ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

Backpropagation; Neural networks; Weight decay

Indexed keywords

EID: 0032363670     PISSN: 02545330     EISSN: 15729338     Source Type: Journal    
DOI: 10.1023/a:1018945915940     Document Type: Article

References (34)

1. M.L. Beale and R.J.A. Little, Missing values in multivariate analysis, Journal of the Royal Statistical Society B 37(1975)129-45.
2. A. Blumer, A. Ehrenfeucht, M.K. Warmuth and D. Haussler, Occam's razor, Information Processing Letters 24(1987)377-380.
3. S.F. Buck, A method of estimation of missing values in multivariate data suitable for use with an electronic computer, Journal of the Royal Statistical Society B 22(1960)302-306.
4. K. Chakraborty, K. Mehrotra, C.K. Mohan and S. Ranka, Forecasting the behavior of multivariate time series using neural networks, Neural Networks 5(1992)961-970.
5. Y. Chauvin, A back-propagation algorithm with optimal use of hidden units, in: Advances in Neural Information Processing Systems I, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, 1988, pp. 519-526.
6. F.L. Chung and T. Lee, A node pruning algorithm for backpropagation networks, International Journal of Neural Systems 3(1992)301-314.
7. E. Collins, S. Ghosh and C. Scofield, An application of a multiple neural-network learning system to emulation of mortgage underwriting judgments, in: Proceedings of the IEEE International Conference on Neural Networks, Vol. 2, 1988, pp. 459-466.
8. G. Cybenko, Approximation by superpositions of a sigmoidal function, Mathematics of Control, Signals, and Systems 2(1989)303-314.
9. S. Dutta and S. Shekhar, Bond-rating: A non-conservative application of neural networks, in: Proceedings of the IEEE International Conference on Neural Networks, Vol. 2, 1988, pp. 443-450.
10. S.E. Fahlman and C. Lebiere, The cascade-correlation learning architecture, in: Advances in Neural Information Processing Systems II, D.S. Touretzky, ed., Morgan Kaufmann, San Mate, 1990, pp. 524-532.
11. A. Gupta and M. Lam, A neural net approach for estimating missing values in multivariate analysis, in: Proceedings of the 1993 National Meeting of the Decision Sciences Institute, Vol. 2, Washington, DC, 1993, pp. 708-710.
12. S.J. Hanson and L. Pratt, A comparison of different biases for minimal network construction with back-propagation, in: Advances in Neural Information Processing Systems I, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, 1988, pp. 177-185.
13. J. Hertz, A. Krogh and R. Palmer, Introduction to the Theory of Neural Computation, Addison-Wesley, Redwood City, 1991.
14. G.E. Hinton, Learning distributed representations of concepts, in: Proceedings of the 8th Annual Conference of the Cognitive Science Society, Amherst, 1986, pp. 1-12.
15. K. Hornik, M. Stinchcombe and H. White, Multilayer feedforward networks are universal approximators, Neural Networks 2(1989)359-366.
16. J.R. Jang, Self-learning fuzzy controllers based on temporal backpropagation, IEEE Transactions on Neural Networks 3(1992)714-723.
17. A.H. Kramer and A. Sangiovanni-Vincentelli, Efficient parallel learning algorithms for neural networks, in: Advances in Neural Information Processing Systems I, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, 1988, pp. 40-48.
18. W.J. Krzanowski, Principles of Multivariate Analysis, Oxford Science Publications, New York, 1990.
19. Y. Le Cun, B. Boser, J.S. Denker, D. Henderson, R.E. Hubbard and L.D. Jackel, Handwritten digit recognition with a backpropagation network, in: Advances in Neural Information Processing Systems II, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, 1990, pp. 396-404.
20. G.L. Martin and J.A. Pittmann, Recognizing hand-printed letters and digits, in: Advances in Neural Information Processing Systems II, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, 1990, pp. 405-414.
21. T.M. Mitchell, The need for biases in learning generalization, in: Readings in Machine Learning, J.W. Shavlik and T.G. Dietterich, eds., Morgan Kaufmann, San Mateo, 1990, pp. 184-191.
22. M.C. Mozer and P. Smolensky, Skeletonization: A technique for trimming the fat from a network via relevance assessment, in: Advances in Neural Information Processing Systems I, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, 1990, pp. 107-115.
23. P.M. Murphy and D.W. Aha, UCI Repository of Machine Learning Databases, University of California-Irvine, Department of Information and Computer Science, 1992.
24. J. A. Ou, The information content of nonearnings accounting numbers as earnings predictors, Journal of Accounting Research 28(1990)144-163.
25. E.P. Patuwo, M.Y Hu and M.S. Hung, Two-group classification using neural networks, Decision Sciences 24(1993)825-845.
26. J.R. Quinlan and R.L. Rivest, Inferring decision trees using the minimum description length principle, Information and Computation 80(1989)227-248.
27. D.E. Rumelhart, G. Hinton and R. Williams, Learning internal representation by error propagation, in: Parallel Distributed Processing, D.E. Rumelhart and J. McClelland, eds., MIT Press, Cambridge MA, 1986, pp. 318-362.
28. L.M. Salchenberger, E.M. Cinar and N.A. Lash, Neural networks: A new tool for predicting thrift failures, Decision Sciences 23(1992)899-916.
29. R. Scalettar and A. Zee, Emergence of grandmother memory in feedforward networks: Learning with noise and forgetfulness, in: Connectionist Models and Their Implications: Readings from Cognitive Science, D. Waltz and J.A. Feldman, eds., Ablex, Norwood, 1988, pp. 309-332.
30. T.J. Sejnowski, B.P. Yuhas, M.H. Goldstein, Jr. and R.E. Jenkino, Combining visual and acoustic speech signals with a neural network improves intelligibility, in: Advances in Neural Information Processing Systems II, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, 1990, pp. 232-239.
31. J. Sietsma and R.J.F. Dow, Neural net pruning - why and how, in: IEEE International Conference on Neural Networks I, IEEE, New York, 1988, pp. 325-333.
32. K.Y. Tam and M.L. Kiang, Managerial applications of neural networks: The case of bank failure predictions, Management Science 38(1992)926-947.
33. A.S. Weigend, D.E. Rumelhart and B.A. Huberman, Generalization by weight elimination with application to forecasting, in: Advances in Neural Information Processing Systems III, R.P. Lippmann, J.E. Moody and D.S. Touretzky, eds., Morgan Kaufmann, San Mateo, 1991, pp. 875-882.
34. Y. Yoon, G. Swales, Jr. and T.M. Margavio, A comparison of discriminant analysis versus artificial neural networks, Journal of Operational Research Society 44(1993)51-60.