A stable learning algorithm for block-diagonal recurrent neural networks: Application to the analysis of lung sounds

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 36, Issue 2, 2006, Pages 242-254

  Mastorocostas, Paris A ^a   Theocharis, John B ^b  

^a TECHNOLOGICAL EDUCATIONAL INSTITUTE OF SERRES   (Greece)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Block diagonal recurrent neural network; Constrained optimization; Lung sound analysis; Stable learning

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; CONSTRAINT THEORY; IDENTIFICATION (CONTROL SYSTEMS); OPTIMIZATION; RECURRENT NEURAL NETWORKS;

BLOCK-DIAGONAL RECURRENT NEURAL NETWORK; CONSTRAINED OPTIMIZATION; LUNG SOUND ANALYSIS; STABLE LEARNING;

LEARNING ALGORITHMS;

ABNORMAL RESPIRATORY SOUND; ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EVALUATION; FUZZY LOGIC; HUMAN; LUNG DISEASE; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SOUND DETECTION;

ALGORITHMS; DIAGNOSIS, COMPUTER-ASSISTED; FUZZY LOGIC; HUMANS; LUNG DISEASES; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; RESPIRATORY SOUNDS; SENSITIVITY AND SPECIFICITY; SOUND SPECTROGRAPHY;

EID: 33645007052     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.856722     Document Type: Article

References (26)

1. R. J. Williams and D. Zisper, "A learning algorithm for continually running fully recurrent neural networks," Neural Comput., vol. 1, pp. 270-280, 1989.
2. B. A. Pearlmutter, "Gradient calculations for dynamic recurrent neural networks: A survey," IEEE Trans. Neural Netw., vol. 6, 1995.
3. G. V. Puskorius and L. A. Feldkamp, "Neurocontrol of nonlinear dynamical systems with kalman fitter-trained recurrent networks," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 279-297, Mar. 1994.
4. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Netw., vol. 1, no. 1, pp. 4-27, Mar. 1990.
5. E. B. Kosmatopoulos, M. M. Polycarpou, M. A. Christodoulou, and P. A. Ioannou, "Higher-order neural network structures for identification of dynamical systems," IEEE Trans. Neural Netw., vol. 6, no. 2, pp. 422-431, Mar. 1995.
6. S. Santini, A. Del Bimbo, and R. Jain, "Block-structured recurrent neural networks," Neural Netw., vol. 8, no. 1, pp. 135-147, 1995.
7. A. C. Tsoi and A. D. Back, "Locally recurrent globally feedforward networks: A critical review of architectures," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 229-239, Mar. 1994.
8. P. S. Sastry, G. Santharam, and K. P. Unnikrishnan, "Memory neuron networks for identification and control of dynamical systems," IEEE Trans. Neural Netw., vol. 5, no. 2, pp. 306-319, Mar. 1994.
9. S. C. Sivakumar, W. Robertson, and W. J. Phillips, "On-line stabilization of block-diagonal recurrent neural networks," IEEE Trans. Neural Netw., vol. 10, no. 1, pp. 167-175, Jan. 1999.
10. L. Jin and M. M. Gupta, "Globally asymptotical stability of discrete-time analog neural networks," IEEE Trans. Neural Netw., vol. 7, no. 4, pp. 1024-1031, Jul. 1996.
11. L. Jin, P. N. Nikiforuk, and M. M. Gupta, "Absolute stability conditions for discrete-time recurrent neural networks," IEEE Trans. Neural Netw., vol. 5, no. 6, pp. 954-963, Nov. 1994.
12. L. Jin and M. M. Gupta, "Stable dynamic backpropagation learning in recurrent neural networks," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1321-1334, Nov. 1999.
13. A. E. Bryson, Jr. and W. F. Denham, "A steepest-ascent method for solving optimum programming problems," J. Appl. Mechan., vol. 29, pp. 247-257, 1962.
14. P. A. Mastorocostas and J. B. Theocharis, "A recurrent fuzzy neural model for dynamic system identification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 2, pp. 176-190, Apr. 2002.
15. D. Karras and S. Perantonis, "An efficient constrained training algorithm for feedforward networks," IEEE Trans. Neural Netw., vol. 6, no. 6, pp. 1420-1434, Nov. 1995.
16. C.-C. Ku and K. Y. Lee, "Diagonal recurrent neural networks for dynamic systems control," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 144-156, Jan. 1995.
17. C. F. Juang and C. T. Lin, "A recurrent self-organizing neural fuzzy inference system," IEEE Trans. Neural Netw., vol. 10, no. 4, pp. 828-845, Jul. 1999.
18. R. L. Murphy, S. K. Holford, and W. C. Knowler, "Visual lung sound characterization by time-expanded waveform analysis," New Eng. J. Med., vol. 296, pp. 968-971, 1977.
19. M. Ono, K. Arakawa, M. Mori, T. Sugimoto, and H. Harashima, "Separation of fine crackles from vesicular sounds by a nonlinear digital filter," IEEE Trans. Biomed. Eng., vol. 36, no. 2, pp. 286-291, Feb. 1989.
20. L. J. Hadjileontiadis and S. M. Panas, "Separation of discontinuous adventitious sounds from vesicular sounds using a wavelet-based filter," IEEE Trans. Biomed. Eng., vol. 44, no. 12, pp. 1269-1281, Dec. 1997.
21. Y. A. Tolias, L. J. Hadjileontiadis, and S. M. Panas, "A fuzzy rule-based system for real-time separation of crackles from vesicular sounds," in Proc. 19th Int. Conf. IEEE Engineering in Medicine and Biology Society-EMBS'97, Chicago, IL, 1997, pp. 1115-1118.
22. J. S. R. Jang, "ANFIS: Adaptive network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May-Jun. 1993.
23. P. A. Mastorocostas, Y. A. Tolias, J. B. Theocharis, L. J. Hadjileontiadis, and S. M. Panas, "An orthogonal least squares-based fuzzy filter for real-time analysis of lung sounds," IEEE Trans. Biomed. Eng., vol. 47, no. 9, pp. 1165-1176, Sept. 2000.
24. S. S. Kraman, Lung Sounds: An Introduction to the Interpretation of the Auscultatory Finding, American College of Chest Physicians, Northbrook, IL, audio tape, 1993.
25. S Lehrer, Understanding Lung Sounds, Saunders, Philadelphia, PA, audio tape, 1993.
26. A. G. Tilikian and M. B. Conover, Understanding Heart Sounds and Murmurs With an Introduction to Lung Sounds, Saunders, Philadelphia, PA, audio tape, 1993.