Simple unit-pruning with gain-changing training

Neural Networks for Signal Processing - Proceedings of the IEEE Workshop

Volumn , Issue , 2001, Pages 153-162

  Suzuki, Kenji ^a   Horiba, Isao ^a   Sugie, Noboru ^b  

^a AICHI PREFECTURAL UNIVERSITY   (Japan)

^b MEIJO UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; BRAIN; GAIN CONTROL; MEDICAL IMAGING; PROBLEM SOLVING; SPURIOUS SIGNAL NOISE;

GAIN-CHANGING TRAINING;

NEURAL NETWORKS;

EID: 0035784067     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. M.R. Banham and A.K. Katsaggelos, "Digital image restoration," IEEE Signal Processing Magazine, vol. 14, no. 2, pp. 24-41, March 1997.
2. J.C. Brailean, R.P. Kleihorst, S. Efstratiadis, A.K. Katsaggelos and R.L. Lagendijk, "Noise reduction filters for dynamic image sequences: A review," Proceedings of IEEE, vol. 83, no. 9, pp. 1270-1291, Sept. 1995.
3. G. Castellano, A.M. Fanelli and M. Pelillo, "An iterative pruning algorithm for feedforward neural networks," IEEE Trans. Neural Networks, vol. 8, no. 3, pp. 519-531, May 1997.
4. Y. Chanvin, "A back-propagation algorithm with optimal use of hidden units," in D.S. Touretzky (ed.), Advances in Neural Information Processing, 1989, vol. 1, pp. 519-526.
5. Y.L. Cun, J.S. Denker and S.A. Solla, "Optimal brain damage," in D.S. Touretzky (ed.), Advances in Neural Information Processing, 1990, vol. 2, pp. 598-605.
6. D.B. Fogel, "An information criterion for optimal neural network selection," IEEE Trans. Neural Networks, vol. 2, no. 5, pp. 490-497, 1991.
7. M. Hagiwara, "Novel back propagation algorithm for reduction of hidden units and acceleration of convergence using artificial selection," in Proc. Int. Joint Conf. Neural Networks, Jun. 1990, vol. II, pp. 625-630.
8. M. Ishikawa, "Structural learning with forgetting," Neural Networks, vol. 9, no. 3, pp. 509 521, 1996.
9. C. Ji, R.R. Snapp and D. Psaltis, "Generalizing smoothness constraints from discrete samples," Neural Computation, vol. 2, no. 1, pp. 188-197, 1990.
10. T. Kurita, "A method to determine the number of hidden units of three layered neural networks by information criteria," Trails. IEICE D-II, vol. J73-D-II, no. 11, pp. 1872-1878, 1990.
11. N. Murata, S. Yoshizawa and S. Amari, "Network information criterion - Determining the number of hidden units for an artificial neural network model," IEEE Trans. Neural Networks, vol. 5, no. 6, pp. 865-872, 1994.
12. S.J. Nowlan and G.E. Hinton, "Simplifying neural networks by soft weight-sharing," Neural Computation, vol. 4, no. 4, pp. 473-493, 1992.
13. D.E. Rumelhart, G.E. Hinton and R.J. Williams, Learning internal representations by error propagation, MA: MIT Press, vol. 1 of Parallel Distributed Processing, chap. 8, pp. 318-362, 1986.
14. J. Sietsma and R.J.F. Dow, "Creating artificial neural networks that generalize," Neural Networks, vol. 4, no. 1, pp. 67-69, 1991.
15. K. Suzuki, I. Horiba and N. Sugie, "Designing the Optimal Structure of a Neural Filter," in Proc. IEEE Int. Workshop Neural Networks for Signal Processing, Cambridge, UK, Aug. 1998, pp. 323-332.
16. K. Suzuki, I. Horiba and N. Sugie, "Efficient approximation of a neural filter for quantum noise removal in X-ray images," in Y.-H. Hu et al. (eds.), Proc. IEEE Int. Workshop Neural Networks for Signal Processing IX, Madison, WI, Aug. 1999, pp. 370-379.
17. K. Suzuki, I. Horiba and N. Sugie, "A Simple Neural Network Pruning Algorithm with Application to Filter Synthesis," Neural Processing Letters, vol. 13, no. 1, pp. 43-53, Feb. 2001.
18. K. Suzuki, I. Horiba, N. Sugie and M. Nanki, "Noise reduction of medical X-ray image sequences using a neural filter with spatiotemporal inputs," in Proc. Int. Sympo. Noise Reduction for Imaging & Commu. Systems, Tokyo, Japan, Nov. 5998, pp. 85-90.
19. K. Suzuki, I. Horiba, N. Sugie and M. Nanki, "A Recurrent Neural Filter for Reducing Noise in Medical X-ray Image Sequences," in Proc. Int. Conf. Neural Information Processing, Kitakyushu, Japan, Oct. 1998, vol. 1, pp. 157-160.
20. V.N. Vapnik, Statistical Learning Theory, Adaptive and Learning Systems for Signal Processing, Communications, and Control, New York: John Wiley & Sons, 1998.
21. A.S. Weigend, D.E. Rumelhart and B.A. Huberman, "Generalization by weight-elimination applied to currency exchange rate prediction," in Proc. Int. Joint Conf. Neural Networks, Seattle, WA, 1991, vol. 1, pp. 837-841.
22. L. Yin, J. Astola and Y. Neuvo, "A new class of nonlinear filters - Neural filters," IEEE Trans. Signal Processing, vol. 41, no. 3, pp. 1201-1222, March 1993.
23. L. Yin, J. Astola and Y. Neuvo, "Adaptive multistage weighted order statistic filters based on the back propagation algorithm," IEEE Trans. Signal Processing, vol. 42, pp. 419-422, Feb. 1994.