GT2FC: An online growing interval type-2 self-learning fuzzy classifier

IEEE Transactions on Fuzzy Systems

Volumn 22, Issue 4, 2014, Pages 999-1018

  Bouchachia, Abdelhamid ^a   Vanaret, Charlie ^b  

^a BOURNEMOUTH UNIVERSITY   (United Kingdom)

^b ENAC   (France)

Author keywords

Growing Gaussian mixture models (2G2M); online learning (OL); online optimization; semi supervised learning; type 2 fuzzy rule systems

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); FUZZY RULES; FUZZY SYSTEMS; OBJECT RECOGNITION; ONLINE SYSTEMS; SUPERVISED LEARNING;

GAUSSIAN MIXTURE MODEL; ONLINE LEARNING; ONLINE OPTIMIZATION; SEMI-SUPERVISED LEARNING; TYPE-2 FUZZY;

E-LEARNING;

EID: 84905584890     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2013.2279554     Document Type: Article

References (50)

1. P. Angelov, "An approach for fuzzy rule-base adaptation using on-line clustering," Int. J. Approx. Reason., vol. 35, no. 3, pp. 275-289, 2004.
2. P. Angelov and X. Zhou, "Evolving fuzzy-rule-based classifiers from data streams," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1462-1475, Dec.2008.
3. O. Arandjelovic and R. Cipolla, "Incremental learning of temporally coherent Gaussian mixture models," in Proc. 16th Brit. Mach. Vis. Conf., 2005, pp. 759-768.
4. A. Bilgin, J. Dooley, L. Whittington, H. Hagras, M. Henson, C. Wagner, A. Malibari, A. Al-Ghamdi, M. Alhaddad, and D. Alghazzawi, "Dynamic profile-selection for zslices based type-2 fuzzy agents controlling multiuser ambient intelligent environments," in Proc. IEEE Int. Conf. Fuzzy Syst., 2012, pp. 1-8.
5. A. Bouchachia, "An evolving classification cascade with self-learning," Evolv. Syst., vol. 1, pp. 143-160, 2010.
6. A. Bouchachia, "Fuzzy classification in dynamic environments," Soft Comput., vol. 15, no. 5, pp. 1009-1022, 2011.
7. A. Bouchachia, "Incremental learning with multi-level adaptation," Neurocomputing, vol. 74, no. 11, pp. 1785-1799, 2011.
8. A. Bouchachia and R. Mittermeir, "Towards fuzzy incremental classifiers," Soft Comput., vol. 11, no. 2, pp. 193-207, 2006.
9. G. Castellano, A. Fanelli, and C. Mencar, "Mining diagnostic rules using fuzzy clustering," in Advances in Fuzzy Clustering and its Applications.New York, NY, USA: Wiley, 2007, pp. 211-226.
10. O. Castillo and M. Patricia, Type-2 Fuzzy Logic: Theory and Applications, (Series: Studies in fuzziness and soft computing). New York, NY, USA: Springer-Verlag, vol. 223, 2008.
11. S. Coupland, J. Wheeler, and M. Gongora, "A generalised type-2 fuzzy logic system embedded board and integrated development environment," in Proc. IEEE Int. Conf. Fuzzy Syst., 2008, pp. 681-687.
12. R. De, N. Pal, and S. Pal, "Feature analysis: Neural network and fuzzy set theoretic approaches," Pattern Recog., vol. 30, no. 10, pp. 1579-1590, 1997. (Pubitemid 127420850)
13. J. de Barros and L. Dexter, "On-line identification of computationally undemanding evolving fuzzy models," Fuzzy Sets Syst., vol. 158, no. 16, pp. 1997-2012, 2007.
14. A. Declercq and J. Piater, "Online learning of Gaussian mixture models- A two-level approach," in Proc. 3rd Int. Conf. Comput. Vis. Theory Appl., 2008, pp. 605-611.
15. A. Dempster, M. Laird, and D. Rubin, "Maximum likelihood for incomplete data via the EM algorithm (with discussion)," J. Roy. Statist. Soc., vol. 39, pp. 1-38, 1977.
16. F. Doctor, H. Hagras, and V. Callaghan, "A type-2 fuzzy embedded agent to realise ambient intelligence in ubiquitous computing environments," Inf. Sci., vol. 171, no. 4, pp. 309-334, 2005. (Pubitemid 40467139)
17. A. Frank and A. Asuncion. (2010). UCI machine learning repository [Online]. Available:http://archive.ics.uci.edu/ml
18. M. Gacto and Alcalá, R., F. Herrera, "Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures," Inf. Sci., vol. 181, no. 20, pp. 4340-4360, 2011.
19. R. Gross, J. Yang, and A. Waibel, "Growing Gaussian mixture models for pose invariant face recognition," in Proc. IEEE Int. Conf. Pattern Recog., 2000, pp. 1088-1091.
20. H. Hagras, F. Doctor, A. Lopez, and V. Callaghan, "An incremental adaptive life long learning approach for type-2 fuzzy embedded agents in ambient intelligent environments," IEEE Trans. Fuzzy Syst., vol. 15, no. 1, pp. 41-55, Feb. 2007. (Pubitemid 46444303)
21. P. Hall and Y. Hicks, "A method to add Gaussian mixture models," Univ.Bath, Bath, U.K., Tech. Rep. CSBU-2004-03, 2004.
22. J. Jang, C. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Englewood Cliffs, NJ, USA: Prentice-Hall, 1996.
23. C.-F. Juang and Y.-W. Tsao, "A self-evolving interval type-2 fuzzy neural network with online structure and parameter learning," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1411-1424, Dec. 2008.
24. N. Karnik and J. Mendel, "Operations on type-2 fuzzy sets," Fuzzy Sets Syst., vol. 122, no. 2, pp. 327-348, 2001. (Pubitemid 32590558)
25. A. Klose and J. Schneider, "Semi-supervised induction of fuzzy rules applied to image segmentation," in Proc. Joint 9th Int. Fuzzy Syst. Assoc., World Congr. 20th North Amer. Fuzzy Inf. Process. Soc. Int. Conf., 2001, vol. 3, pp. 1425-1430.
26. A. Krone and T. Slawinski, "Data-based extraction of unidimensional fuzzy sets for fuzzy rule generation," in Proc. IEEEWorld Congr. Comput.Intell., IEEE Int. Conf. Fuzzy Syst., 1998, pp. 1032-1037.
27. D. Lee, "Effective Gaussian mixture learning for video background subtraction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 827-832, May 2005. (Pubitemid 40608416)
28. C. Leondes, Fuzzy Theory Systems: Techniques and Applications, (Series Systems Series). New York, NY, USA: Academic, 1999.
29. E. Lughofer, Evolving Fuzzy Systems-Methodologies, Advanced Concepts and Application, (Series) Studies in Fuzziness and Soft Computing.New York, NY, USA: Springer-Verlag, 2011.
30. U. Mahmood, A. Al-Jumaily, and M. Al-Jaafreh, "Type-2 fuzzy classification of blood pressure parameters," in Proc. 3rd Int. Conf. Intell. Sens., Sens. Netw. Inf., 2007, pp. 595-600.
31. C. Mencar, G. Castellano, and A. Fanelli, "Distinguishability quantification of fuzzy sets," Inf. Sci., vol. 177, no. 1, pp. 130-149, 2007. (Pubitemid 44556694)
32. A. Mencattini, M. Salmeri, and R. Lojacono, "Estimation of uncertainty in measurement by means of type-2 fuzzy variables," in Proc. IEEE Int.Conf. Fuzzy Syst., 2007, pp. 1-6.
33. J. Mendel, "Uncertainty, fuzzy logic, and signal processing," Signal Process., vol. 80, pp. 913-933, 2000.
34. J. Mendel, "Type-2 fuzzy sets and systems," IEEE Comput. Intell. Mag., vol. 2, no. 1, pp. 20-29, Feb. 2007.
35. J. M. Mendel, "On km algorithms for solving type-2 fuzzy set problems," IEEE Trans. Fuzzy Syst., vol. 21, no. 3, pp. 426-446, Jun. 2013.
36. R. Neal and G. Hinton, "A view of the EM algorithm that justifies incremental, sparse, and other variants," in Learning in GraphicalModels.Norwell, MA, USA: Kluwer, 1999, pp. 355-368.
37. N. Radford and G. Hinton, "A view of the EM algorithm that justifies incremental, sparse, and other variants," in Learning in GraphicalModels.New York, NY, USA: MIT Press, 1999, pp. 355-368.
38. S. Roberts, C. Holmes, and D. Denison, "Minimum-entropy data partitioning using reversible jump Markov chain monte carlo," IEEE Trans.Pattern Anal. Mach. Intell., vol. 23, no. 8, pp. 909-914, Aug. 2001. (Pubitemid 32780018)
39. Z. Sahel, A. Bouchachia, and B. Gabrys, "Adaptive mechanisms for classification problems with drifting data," in Proc. 11th Int. Conf. Knowl.- Based Intell. Inf. Eng. Syst., 2007, pp. 419-426.
40. S. Salzberg, "A nearest hyperrectangle learning method," Mach. Learn., vol. 6, pp. 277-309, 1991.
41. M. Sato and S. Ishii, "On-line EM algorithm for the normalized Gaussian network," Neural Comput., vol. 12, no. 2, pp. 407-432, 2000.
42. D. Schnitzer, F. Arthur, W. Gerhard, and G. Martin, "Islands of Gaussians: The self organizing map and Gaussian music similarity features," in Proc.11th Int. Soc. Music Inf. Retriev. Conf., 2010, pp. 327-332.
43. M. Song and H. Wang, "Highly efficient incremental estimation of Gaussian mixturemodels for online data stream clustering," in Intelligent Computing: Theory and Applications. Bellingham, WA, USA: SPIE, 2005, pp. 174-183. (Pubitemid 41537974)
44. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. Comput. Vis. Pattern Recog., IEEE Comput.Soc. Conf., 1999, vol. 2, pp. 246-252.
45. C. Stauffer and W. Grimson, "Learning patterns of activity using realtime tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 747-757, Aug. 2000.
46. A. Tsymbal, "The problem of concept drift: Definitions and related work," Dept. of Comput. Sci., Trinity College, Dublin, Ireland, Tech. Rep. TCDCS- 2004-15, 2004.
47. C. Wagner and H. Hagras, "An approach for the generation and adaptation of zslices based general type-2 fuzzy sets from interval type-2 fuzzy sets to model agreement with application to intelligent environments," in Proc.IEEE Int. Conf. Fuzzy Syst, 2010, pp. 1-8.
48. G.-D. Wu and P.-H. Huang, "A vectorization-optimization-method-based type-2 fuzzy neural network for noisy data classification," IEEE Trans.Fuzzy Syst., vol. 21, no. 1, pp. 1-15, Feb. 2013.
49. Z. Yang and M. Zwolinski, "Mutual information theory for adaptive mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 4, pp. 396-403, Apr. 2001. (Pubitemid 32416303)
50. D. Zhai and J. Mendel, "Computing the centroid of a general type-2 fuzzy set by means of the centroid-flow algorithm," IEEE Trans. Fuzzy Syst., vol. 19, no. 3, pp. 401-422, Jun. 2011.