Principles of adaptive filters and self-learning systems

Advanced Textbooks in Control and Signal Processing

Volumn , Issue 9781852339845, 2005, Pages 1-380

  Zaknich, Anthony ^a,b  

^a MURDOCH UNIVERSITY   (Australia)

^b UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE FILTERING;

SELF LEARNING SYSTEM;

ADAPTIVE FILTERS;

EID: 84971402333     PISSN: 14392232     EISSN: 25103814     Source Type: Book Series    
DOI: None     Document Type: Chapter

References (151)

1. Applebaum SP, Chapman DJ (1976) Adaptive arrays with main beam constraints. IEEE Transactions on Antennas and Propagation. Vol. AP-24, 650-662.
2. Åström KJ, Wittenmark B (1995) Adaptive control. Addison-Wesley.
3. Bendat JS, Piersol AG (1971) Random data: Analysis and measurement procedures. Wiley-Interscience.
4. Benesty J, Gansler T, Morgan DR, Sondhi MM, Gay SL (2001) Advances in network and acoustic echo cancellation. Springer.
5. Benesty J, Huang Y, Editors (2003) Adaptive signal processing: Applications to real-world problems. Springer.
6. Bishop CS (1995) Neural networks for pattern recognition. Clarendon Press.
7. Box GEP, Jenkins GM (1970) Time series analysis forecasting and control. Holden-Day, San Francisco, 423-428.
8. Bozic SM (1994) Digital and Kalman Filtering. E. Arnold.
9. Brandstein M, Ward D, Editors (2001) Microphone arrays. Springer.
10. Bräunl T (2003) Embedded Robotics: Mobile robotic design and applications with embedded systems. Springer.
11. Bremaud P (2002), Mathematical principles of signal processing. Springer.
12. th March.
13. Burns B (1996) Training artificial neural networks with genetic algorithms to play games. Honour Thesis, The Department of Electrical and Electronic Engineering, The University of Western Australia.
14. Capon J (1969) High-resolution frequency-wavenumber spectrum analysis. Proceedings of the IEEE, 57:1408-1418.
15. Chen CH (1988) Signal processing handbook. Marcel Dekker Inc.
16. Cherkassky V, Mulier F. (1998) Learning from data. John Wiley and Sons, Inc.
17. Coley DA (1999) An introduction to genetic algorithms for scientists and engineers. World Scientific Publishing.
18. th April, 297-301.
19. Cross PA (1981) The computation of position at sea. The Hydrographic Journal, 20:7-16.
20. Cross PA (1982) Prediction, filtering and smoothing of offshore navigation data. The Hydrographic Journal, 25:5-16.
21. Cross PA (1983) Advanced least squares applied to position fixing. Department of Land Surveying, North East London Polytechnic, Working paper No. 6, 205pp.
22. Cross PA (1987) Kalman filtering and its application to offshore position-fixing. The Hydrographic Journal, 44:19-25.
23. Darwin C (1859) On the origin of species by means of natural selection, or preservation of favoured races in the struggle for life. John Murray, London
24. Diniz PSR (1997) Adaptive filtering: Algorithms and practical implementation. Kluwer Academic Publishers.
25. Durbin J (1960) The fitting of time-series models. Rev. Inst. Statist., 28:233-243.
26. Eberhart R, Dobbins B (1990) Neural network PC tools: A practical guide. Academic Press.
27. Falconer DD, Ljung L (1978) Application of fast Kalman estimation to adaptive equalization. IEEE Transactions on Communications, COM-26:1439-1446.
28. Fogel LR, Owens AJ, Walsh MJ (1966) Artificial intelligence through simulated evolution. John Wiley & Sons, New York.
29. Frisch R (1934) Statistical confluence analysis by means of complete regression systems. University of Oslo, Economic Institute, Publication n. 5 ed.
30. Gabel R, Roberts R (1987) Signals and linear systems. Third Edition, John Wiley and Sons.
31. Garas J (2000) Adaptive 3D sound systems. Kluwer Academic.
32. th Asilomar Conference on Signals Systems and Computers, 1:673-675.
33. Gelfand SB, Ravishankar CS (1993) A tree-structured piecewise linear adaptive filter. IEEE Transactions on Information Theory, 39:6:1907-1922.
34. Gershenfeld N (1999) The Nature of mathematically modelling. Cambridge University Press.
35. Godard DN (1974) Channel equalization using a Kalman filter for fast data transmission. IBM J. Res. Dev. 18:267-273.
36. Gold B, Morgan N (2000) Speech and audio signal processing: Processing and perception of speech and music. John Wiley & Sons Inc.
37. Golub GH, Van Loan CF (1983) Matrix computations. John Hopkins University Press.
38. Gupta MM, Rao DH, Editors (1994) Neuro-control systems. IEEE Press.
39. ∞ optimality of the LMS algorithm. IEEE Transactions on Signal Processing, 44:267-280.
40. Hassoun MH (1995) Fundamentals of artificial neural networks. MIT Press.
41. Hayes MH (1996) Statistical digital signal processing and modelling. John Wiley & Sons, Inc.
42. Haykin S (1994) Neural networks, a comprehensive foundation. Macmillan College Publishing Co. Inc.
43. Haykin S (1996) Adaptive filter theory. Prentice-Hall.
44. Haykin S (1999) Neural networks, a comprehensive foundation. Second Edition, Upper Saddle River, NJ, Prentice-Hall Inc.
45. Haykin S, Kosko B, Editors (2001), Intelligent Signal Processing. Wiley-IEEE Press, First Edition.
46. Haykin S, Van Veen B (1999) Signals and systems. John Wiley and Sons, Inc.
47. Hebb DO (1949) The organization of behaviour. Wiley.
48. Hecht-Nielson R (1990) Neurocomputing. Addison-Wesley Pub. Co.
49. Heredia A, Arce GR (2000) Nonlinear filters based on combinations of piecewise polynomials with compact support. IEEE Transactions on Signal Processing, 48:10:2850-2863.
50. Hinton G, Sejnowski TJ, Editors (1999) Unsupervised learning: Foundations of neural computation. The MIT Press.
51. Hlawatsch F (1998) Time-frequency analysis and synthesis of linear signal spaces. Kluwer Academic Publishers.
52. Holland JH (1962) Outline for a logical theory of adaptive systems. Journal of the Association for Commuting Machinery.
53. Holland JH (1995) Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence. The MIT Press (First Edition 1975).
54. Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, 79:2554-2558.
55. Hopfield JJ (1984) Neurons with graded response have collective computational properties like those of two state neurons. Proceedings of the National Academy of Sciences, 81:3088-3092.
56. James W (1890) Psychology (Briefer Course). Holt.
57. Kailath T, Editor, (1977) Linear least-squares estimation. Benchmark Papers in Electrical Engineering and Computer Science, Prentice-Hall, Englewood Cliffs, N.J.
58. Kalman RE (1960) A new approach to linear filtering and prediction problems. Transactions of the ASME, Journal of Basic Engineering, 82: 35-45.
59. Kalman RE, Bucy RS (1961) New results in linear filtering and prediction theory. Transactions of ASME, J. Basic Eng., 83:95-108.
60. Kammler DW (2000) A first course in Fourier analysis. Prentice Hall.
61. Kartalpoulos SV (1996) Understanding neural Networks and Fuzzy Logic. IEEE Press.
62. Kohonen T (1990) Self-organising map. Proceedings of the IEEE, 78:1464-1480.
63. Kolmogorov AN (1939) Sur 1’interpolation et extrapolation des suites stationaries. C. R. Acad. Sci. Paris 208:2043-2045. (English translation in (Kailath 1977))
64. Koza JR (1992) Genetic programming: On the programming of computers by means of natural selection. MIT Press, Cambridge, MA.
65. Koza JR, Bennett FH, Andre D, M A (1996) Four problems for which a computer program evolved by genetic programming is competitive with human performance. Proceedings of the 1996 IEEE International Conference on Evolutionary Computing, 20-22 May:1-10.
66. Koza JR, Keane MA, Streeter MJ, Mydlowec W, Yu J, Lanza G (2003) Genetic programming: Routine human-competitive machine intelligence. Kluwer Academic Publishers.
67. Krein MG (1945) On a problem of extrapolation of A. N. Kolmogorov. C. R. (Dokl.) Akad. Nauk SSSR, 46:306-309. (Reproduced in (Kailath 1977))
68. Kurzweil R (1999) The age of spiritual machines: When computers exceed human intelligence. Allen and Unwin.
69. st August:561-563.
70. Lawson CL, Hanson RJ (1974) Solving least squares problems. Prentice-Hall.
71. st August:569-572.
72. Levine WS, Editor (1996) The control handbook. CRC Press and IEEE Press, 847- 857, Petros I, Model reference adaptive control.
73. Levinson N (1947) The Wiener RMS (root mean square) error criterion in filter design and prediction. Journal of Math. Phys, 25:261-278.
74. Lim JS, Oppenheim AV (1988) Advanced topics in signal processing. Prentice Hall Signal Processing Series.
75. Loy NJ (1988), An engineer’s guide to FIR digital filters. Prentice-Hall.
76. Lucky RW (1965) Automatic equalization for digital communications. Bell Syst. Tech. J., 44:547-588.
77. Makhoul J (1977) Stable and efficient methods for linear prediction. IEEE Transactions on Acoustics, Speech, and Signal Processing, ASSP-25:423-428.
78. Mamdani (1974) Applications of fuzzy logic algorithms for control of a simple dynamic plant. Proceedings of the IEE, 121:12:1585-1588.
79. Marks II RJ, Editor (1994) Fuzzy logic technology and applications. IEEE TAB.
80. Mathews JJ (1991) Adaptive polynomial filters. IEEE Signal Processing Magazine, 8:3:10-26.
81. Mattavelli M, Vesin JM, Amaldi E, Gruter R, (1996) A new approach to piecewise linear modelling of time series. IEEE Digital Signal Processing Workshop Proceedings, 502-505.
82. McCulloch JL, Pitts WA (1943) A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematics and Biophysics, 5:115-133.
83. McWhirter JG (1983) Recursive least-squares minimization using a systolic array. Proceedings of SPIE, Real-Time Signal Processing VI, Vol. 1152, San Diego, California.
84. Miller AR (1981) Pascal programs, for scientists and engineers. Sybex.
85. Mitchell TM (1997) Machine learning. McGraw-Hill.
86. Moody J, Darken C (1989) Fast learning in networks of locally-tuned processing units. Neural Computation, 1:2:281-294.
87. Morgan DR, Thi J (1995) A delayless subband filter. IEEE Transactions on Signal Processing, 43:1819-1830.
88. Mukaidono M (2001) Fuzzy logic for beginners. World Scientific Publishing.
89. Nadaraya EA (1964) On estimating regression. Theory Probability Applications, 9: 141-142.
90. Oppenheim AV, Schafer RW (1975) Digital signal processing. Prentice-Hall.
91. Parker DB (1985) Learning-logic. M.I.T. Cen. Computational Res. Economics Management Sci., Cambridge, MA, TR-47.
92. Plackett RL (1950) Some theorems in least squares. Biometrika, 37:149.
93. Poularikas A, Editor in Chief (1996) The transforms and applications handbook. CRC and IEEE Press.
94. Powell MJD (1985) Radial basis functions for multivariate interpolation: A review. Technical Report DAMPT 1985/NA12, Department of Applied Mathematics and Theoretical Physics, Cambridge University, England.
95. Press WH, Flannery BP, Teukolsky SA, Vetterling WT (1986) Numerical recipes: The art of scientific computing. Cambridge University Press.
96. Principe JC, Euliano NR, Lefebvre WC (1999) Neural and adaptive systems: Fundamentals through simulations. John Wiley and Sons, Inc.
97. Proakis JG, Manolakis DG (1996) Digital signal processing. Prentice-Hall.
98. Rabiner LR, Gold B (1975) Theory and application of digital signal processing. Prentice-Hall.
99. Robbins H, Munro S (1951) A stochastic approximation method. Ann. Math. Stat., 22:400-407.
100. Robinson EA. (1964) Wavelet composition of time series, in econometric model building. Edited by H. O. Wold. North-Holland, Amsterdam, 37-106.
101. Rosenblatt F (1958) The perceptron: A probabilistic model for information storage and organization in the brain. Psychoanalytic Review, 65:386-408.
102. Rumelhart DE, Hinton DE, Williams RJ (1986) Learning representation by backpropagating errors. Nature 323(9), 533-536.
103. Sayed AH, Kailath T (1994) A state-space approach to adaptive digital filters. IEEE Signal Processing Magazine 11:18-60.
104. Schalkoff RJ (1997) Artificial neural networks. McGraw-Hill.
105. Shynk JJ (1992) Frequency-domain and multirate adaptive filtering. IEEE Signal Processing Magazine, 9:1:14-37.
106. Simani S, Fantuzzi C, Rovatti R, Beghelli S (2000) Non-linear dynamic modelling in noisy environment using multiple model approach. Proceedings of the American Control Conference, 4:2332-2336.
107. Special issue on fuzzy and neural networks. IEEE Communications Magazine, September, 1992.
108. Specht DF (1988) Probabilistic neural networks for classification, mapping, or associative memory, IEEE Conference on Neural Networks, San Diego, July, 1:525-532.
109. Specht DF (1990) Probabilistic neural networks. International Neural Network Society, Neural Networks, 3:109-118.
110. Specht DF (1991) A general regression neural network. IEEE Transactions on Neural Networks, 2:6:568-576.
111. Stanley WD, Dougherty GR, Dougherty R (1984) Digital signal processing. Reston Publishing Company.
112. Stergiopoulos S (2001) Advanced signal processing handbook – Theory and implementation for radar, sonar, and medical imaging real-time systems. CRC Press.
113. Sutton RS, Barto AG (1999) Reinforcement learning: An introduction. The MIT Press.
114. Tanaka K (1997) An introduction to fuzzy logic for practical applications. Springer.
115. Turing AM (1950) Computing machinery and intelligence. Mind, LIX:433-460.
116. Urick RJ (1983) Principles of underwater sound. Third Edition, McGraw-Hill Book Company.
117. Van Den Boss A (1971) Alternative interpretation of maximum entropy spectral analysis. IEEE Transactions on Information Theory, IT-17:493-494.
118. Vapnik VN (1998) Statistical learning theory. Wiley.
119. Vapnik VN (2000) The nature of statistical learning theory. Springer-Verlag, Second Edition.
120. Vaseghi SG (1996) Advanced signal processing and digital noise reduction. Wiley and Teubner.
121. Verselinovic P, Leenaerts D (1996) A method for automatic generation of piecewise linear models. Proceedings of the 1996 IEEE International Symposium on Circuits and Systems “Connecting the World,” 3:24-27.
122. Watson GS (1964) Smooth regression analysis. Sankhya Series A, 26:359-372.
123. Werbos PJ (1974) Beyond regression: new tools for prediction and analysis in the behavioural sciences. PhD dissertation, Committee on Appl. Math., Harvard Univ., Cambridge, M. A., November.
124. Werbos PJ (1990) Backpropagation through time: What it does and how it to do it. Proceedings of the IEEE, Vol. 78, No. 10.
125. Whitaker HP, Yamron J, Kezer A (1958) A design of model reference adaptive control systems for aircraft. Report R-164, Instrument Laboratory, Massachusetts Institute of Technology, Cambridge.
126. Widrow B, Hoff ME (1960) Adaptive switching circuits. WESTCON Convention, Record Part IV, 96-104.
127. Widrow B, et al. (1967) Adaptive antenna systems. Proceedings of the IEEE, 55:2143-2159.
128. Widrow B, Glover, McCook, Hauritz, Williams, Hearn, et al. (1975) Adaptive noise cancelling: Principles and applications. Proceedings of the IEEE, 63:12:1692-1716.
129. Widrow B, Stearns S (1985) Adaptive signal processing. Englewood Cliffs, NJ: Prentice Hall.
130. Widrow B, Winter R (1988) Neural networks for adaptive filtering and adaptive pattern recognition. IEEE Computer, March:25-39.
131. Wiener N (1949) Extrapolation, interpolation, and smoothing of stationary time series, with engineering applications. MIT Press, Cambridge, Mass.
132. Wiener N (1958) Nonlinear problems in random theory. Wiley, New York.
133. Yen J, Langari R, Zadeh LA (1995) Industrial applications of fuzzy logic and intelligent systems. IEEE Press.
134. Young J, Zaknich A, Attikiouzel Y (2001) Center reduction algorithm for the Modified Probabilistic Neural Network equalizer. IEEE International Joint Conference on Neural Networks (IJCNN), Washington, DC, USA, 1966-1970.
135. Yule GU (1927) On a method of investigating periodicities in disturbed series, with special reference to Wolfer’s sunspot numbers. Philos. Trans. Royal Soc. London, A226:267-298.
136. Zadeh L (1965) Fuzzy sets. Inform. Control, 8:338-353.
137. rd December, 152-156.
138. rd December, 1699-1702.
139. Zaknich A, Attikiouzel Y (1995b) Application of the modified probabilistic neural network to the enhancement of noisy short wave radio time and Morse code signals. Australian Journal of Intelligent Information Processing Systems (AJIIPS), 2:3:9-14.
140. Zaknich A (1997) Characterisation of aluminium hydroxide particles from the Bayer process using neural network and Bayesian classifiers. IEEE Transactions on Neural Networks, 8:4:919-931.
141. Zaknich A, deSilva CJ (1997) Adaptive learning schemes for the modified probabilistic neural network. Proceedings of the IEEE Third International Conference on Algorithms and Architectures for Parallel Processing, Melbourne, Australia, 597-610.
142. Zaknich A, Baker SK (1998) A real-time system for the characterisation of sheep feeding phases from acoustic signals of jaw sounds. Australian Journal of Intelligent Information Processing Systems (AJIIPS), 5:2:103-110.
143. Zaknich, A (1998) Introduction to the modified probabilistic neural network for general signal processing applications. IEEE Transactions on Signal Processing, 46:7:1980-1990.
144. Zaknich A, Attikiouzel Y (2000) A tuneable approximate piecewise linear model derived from the modified probabilistic neural network. IEEE Signal Processing Workshop on Neural Networks for Signal Processing (NNSP), Sydney, Australia, 1:45-53.
145. Zaknich A (2003a) Neural networks for intelligent signal processing. World Scientific Publishing, Series on Advanced Biology and Logic-Based Intelligence, Vol. 4.
146. Zaknich A (2003b) A practical sub-space adaptive filter. Neural Networks, 16:5/6:833-839.
147. Zaknich A (2003c) An integrated sensory-intelligent system for underwater acoustic signal-processing applications. IEEE Journal of Oceanic Engineering, 28:4:750-759.
148. Zaknich A (2004) A loudspeaker response model using tuneable approximate piecewise linear regression. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary, 4:2711-2716.
149. Zames G (1981) Feedback and optimal sensitivity: model reference transformations, multiplicative seminorms, and approximate inverses. IEEE Trans. Autom. Control, AC-26:301-320.
150. Zeidler JR (1990) Performance analysis of LMS adaption filters. Proceedings of the IEEE, 78:12:1781-1806.
151. Zelniker G, Taylor F (1994) Advanced digital signal processing: Theory and applications. Marcel Dekker.