Adaptive fuzzy filtering in a deterministic setting

IEEE Transactions on Fuzzy Systems

Volumn 17, Issue 4, 2009, Pages 763-776

  Kumar, Mohit ^a   Stoll, Norbert ^b   Stoll, Regina ^b  

^a Center for Life Science Automation   (Germany)

^b UNIVERSITY OF ROSTOCK   (Germany)

Author keywords

Adaptive filtering algorithms; Bregman divergences; P norm; Sugeno fuzzy models

Indexed keywords

ADAPTIVE FILTERING ALGORITHMS; ADAPTIVE FUZZY; BREGMAN DIVERGENCES; ESTIMATION OF PROCESS; FUZZY MODELS; MACHINE LEARNING LITERATURE; MATHEMATICAL FRAMEWORKS; NONLINEAR LMS; ON-LINE ESTIMATION; ONLINE MACHINES; P-NORM; PROCESS VARIABLES; REAL-WORLD APPLICATION; SEMILINEAR; STANDARD TOOLS; SUGENO FUZZY MODELS;

ADAPTIVE ALGORITHMS; ADAPTIVE FILTERING; ADAPTIVE FILTERS; PARAMETER ESTIMATION; ROBOT LEARNING; SIGNAL PROCESSING;

LEARNING ALGORITHMS;

EID: 68849109187     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2008.924331     Document Type: Article

References (42)

1. M. Kumar, K. Thurow, N. Stoll, and R. Stoll, "Robust fuzzy mappings for QSAR studies," Eur. J. Med. Chem., vol. 42, no. 5, pp. 675-685, 2007.
2. M. Kumar, M. Weippert, R. Vilbrandt, S. Kreuzfeld, and R. Stoll, "Fuzzy evaluation of heart rate signals formental stress assessment," IEEE Trans. Fuzzy Syst., vol. 15, no. 5, pp. 791-808, Oct. 2007.
3. A. H. Sayed, Fundamentals of Adaptive Filtering. New York: Wiley, 2003.
4. S. Haykin, Adaptive Filter Theory, 3rd ed. New York: Prentice-Hall, 1996.
5. ∞ optimality of the LMS algorithm," IEEE Trans. Signal Process., vol. 44, no. 2, pp. 267-280, Feb. 1996.
6. N. R. Yousef and A. H. Sayed, "A unified approach to the steady-state and tracking analyses of adaptive filters," IEEE Trans. Signal Process., vol. 49, no. 2, pp. 314-324, Feb. 2001.
7. T. Y. Al-Naffouri and A. H. Sayed, "Transient analysis of adaptive filters with error nonlinearities," IEEE Trans. Signal Process., vol. 51, no. 3, pp. 653-663, Mar. 2003.
8. T. Y. Al-Naffouri and A. H. Sayed, "Adaptive filters with error nonlinearities: Mean-square analysis and optimum design," EURASIP J. Appl. Signal Process., vol. 2001, no. 4, pp. 192-205, 2001.
9. J. Kivinen,M. K.Warmuth, and B. Hassibi, "The p-norm generalization of the LMS algorithm for adaptive filtering," IEEE Trans. Signal Process., vol. 54, no. 5, pp. 1782-1793, May 2006.
10. C. Gentile, "The robustness of the p-norm algorithms," Mach. Learning, vol. 53, no. 3, pp. 265-299, 2003.
11. J. S. R. Jang, C. T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence Upper Saddle River, NJ: Prentice-Hall, 1997.
12. J. Abonyi, L. Nagy, and F. Szeifert, "Adaptive fuzzy inference system and its application in modelling and model based control," Chem. Eng. Res. Des., vol. 77, pp. 281-290, Jun. 1999.
13. P. P. Angelov and D. P. Filev, "An approach to online identification of Takagi-Sugeno fuzzy models," IEEE Trans. Syst., Man Cybern. B, Cybern., vol. 34, no. 1, pp. 484-498, Feb. 2004.
14. M. J. Er, Z. Li, H. Cai, and Q. Chen, "Adaptive noise cancellation using enhanced dynamic fuzzy neural networks," IEEE Trans. Fuzzy Syst., vol. 13, no. 3, pp. 331-342, Jun. 2005.
15. C.-F. Juang and C.-T. Lin, "Noisy speech processing by recurrently adaptive fuzzy filters," IEEE Trans. Fuzzy Syst., vol. 9, no. 1, pp. 139-152, Feb. 2001.
16. ∞ optimality criteria for LMS and backpropagation," in Advance Neural Information Process Systems, vol. 6, J. D. Cowan, G. Tesauro, and J. Alspector, Eds. San Mateo, CA: Morgan Kaufmann, Apr. 1994, pp. 351-359.
17. W. Yu and X. Li, "Fuzzy identification using fuzzy neural networks with stable learning algorithms," IEEE Trans. Fuzzy Syst., vol. 12, no. 3, pp. 411-420, Jun. 2004.
18. M. Kumar, N. Stoll, and R. Stoll, "An energy gain bounding approach to robust fuzzy identification," Automatica, vol. 42, no. 5, pp. 711-721, May 2006.
19. M. Kumar, R. Stoll, and N. Stoll, "Deterministic approach to robust adaptive learning of fuzzy models," IEEE Trans. Syst., Man. Cybern. B, Cybern., vol. 36, no. 4, pp. 767-780, Aug. 2006.
20. K. S. Azoury and M. K. Warmuth, "Relative loss bounds for on-line density estimation with the exponential family of distributions," Mach. Learning, vol. 43, no. 3, pp. 211-246, Jun. 2001.
21. L. Bregman, "The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming," USSR Comp. Math. Phys., vol. 7, pp. 200-217, 1967.
22. J. Kivinen and M. K.Warmuth, "Relative loss bounds formultidimensional regression problems," Mach. Learning, vol. 45, no. 3, pp. 301-329, 2001.
23. M. Collins, R. E. Schapire, and Y. Singer, "Logistic regression, Adaboost and Bregman distances," Mach. Learning, vol. 48, pp. 253-285, 2002.
24. N. Murata, T. Takenouchi, T. Kanamori, and S. Eguchi, "Information geometry of u-boost and Bregman divergence," Neural Comput., vol. 16, no. 7, pp. 1437-1481, 2004.
25. B. Taskar, S. Lacoste-Julien, and M. I. Jordan, "Structured prediction, dual extragradient and Bregman projections," J. Mach. Learning Res. vol. 7, pp. 1627-1653, 2006.
26. A. Banerjee, S. Merugu, I. S. Dhillon, and J. Ghosh, "Clustering with Bregman divergences," J. Mach. Learning Res., vol. 6, pp. 1705-1749, 2005.
27. R. Nock and F. Nielsen, "On weighting clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 8, pp. 1223-1235, Aug. 2006.
28. A. Banerjee, X. Guo, and H. Wan, "On the optimality of conditional expectation as a Bregman predictor," IEEE Trans. Inf. Theory, vol. 51, no. 7, pp. 2664-2669, Jul. 2005.
29. J. Kivinen and M. K. Warmuth, "Additive versus exponentiated gradient updates for linear prediction," Inf. Comput., vol. 132, no. 1, pp. 1-64, Jan. 1997.
30. C. L. Lawson and R. J. Hanson, Solving Least Squares Problems. Philadelphia, PA: SIAM, 1995.
31. D. P. Helmbold, J. Kivinen, andM. K.Warmuth, "Relative loss bounds for single neurons," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1291-1304, Nov. 1999.
32. P. Auer, M. Hebster, and M. K. Warmuth, "Exponentially many local minima for single neurons," in Advance Neural Information Process Systems, vol. 8, D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Eds. Cambridge, MA: MIT Press, Jun. 1996, pp. 316-322.
33. N. Cesa-Bianchi, P. M. Long, and M. K.Warmuth, "Worst-case quadratic loss bounds for prediction using linear functions and gradient descent," IEEE Trans. Neural Netw., vol. 7, no. 3, pp. 604-619, May 1996.
34. P. Auer,N. Cesa-Bianchi, and C.Gentile, "Adaptive and self-confident online learning algorithms," J. Comput. Syst. Sci., vol. 64, no. 1, pp. 48-75, Feb. 2002.
35. S. Kumar, M. Kumar, R. Stoll, and U. Kragl, "Handling uncertainties in toxicity modelling using a fuzzy filter," SAR QSAR Environ. Res., vol. 18, no. 7/8, pp. 645-662, Dec. 2007.
36. P. Lindskog, "Fuzzy identification from a grey box modeling point of view," in Fuzzy Model Identification: Sel. Approaches, H. Hellendoorn and D. Driankov, Eds. Berlin, Germany: Springer-Verlag, 1997.
37. M. Burger, H. Engl, J. Haslinger, and U. Bodenhofer, "Regularized data-driven construction of fuzzy controllers," J. Inverse Ill-Posed Problems, vol. 10, pp. 319-344, 2002.
38. M. Kumar, R. Stoll, and N. Stoll, "Robust adaptive fuzzy identification of time-varying processes with uncertain data. Handling uncertainties in the physical fitness fuzzy approximation with real world medical data: An application," Fuzzy Optim. Decis. Making, vol. 2, pp. 243-259, Sep. 2003.
39. M. Kumar, R. Stoll, and N. Stoll, "Regularized adaptation of fuzzy inference systems. Modelling the opinion of a medical expert about physical fitness: An application," Fuzzy Optim. Decis. Making, vol. 2, pp. 317-336, Dec. 2003.
40. M. Kumar, R. Stoll, and N. Stoll, "Robust solution to fuzzy identification problem with uncertain data by regularization. Fuzzy approximation to physical fitness with real world medical data: An application," Fuzzy Optim. Decis. Making, vol. 3, no. 1, pp. 63-82, Mar. 2004.
41. M. Kumar, R. Stoll, and N. Stoll, "Robust adaptive identification of fuzzy systems with uncertain data," Fuzzy Optim. Decis. Making, vol. 3, no. 3, pp. 195-216, Sep. 2004.
42. M. Kumar, R. Stoll, and N. Stoll, "A robust design criterion for interpretable fuzzy models with uncertain data," IEEE Trans. Fuzzy Syst., vol. 14, no. 2, pp. 314-328, Apr. 2006.