Fuzzy DBN with rule-based knowledge representation and high interpretability

Proceedings of the 2017 12th International Conference on Intelligent Systems and Knowledge Engineering, ISKE 2017

Volumn 2018-January, Issue , 2017, Pages 1-7

  Zhang, Xiongtao ^a   Pan, Xingguang ^a,b   Wang, Shitong ^a  

^a JIANGNAN UNIVERSITY   (China)

^b GUIZHOU MINZU UNIVERSITY   (China)

Author keywords

DBN; interpretability; TSK fuzzy system; TSK DBN

Indexed keywords

CLASSIFICATION (OF INFORMATION); CLUSTERING ALGORITHMS; FUZZY CLUSTERING; FUZZY INFERENCE; FUZZY RULES; INTELLIGENT SYSTEMS; KNOWLEDGE REPRESENTATION; MEMBERSHIP FUNCTIONS;

CLASSIFICATION ACCURACY; DEEP BELIEF NETWORK (DBN); INTERPRETABILITY; INTERPRETABLE RULES; REMAINING USEFUL LIVES; RULE-BASED KNOWLEDGE; TSK FUZZY SYSTEM; TSK-DBN;

LEARNING SYSTEMS;

EID: 85047763717     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISKE.2017.8258762     Document Type: Conference Paper

References (37)

1. Zhaohong Deng, Choi Kup-Sze, Fu-lai Chung, and Shitong Wang, "Scalable TSK Fuzzy Modeling for Very Large Datasets Using Minimal-Enclosing-Ball Approximation," IEEE Transactions on Fuzzy Systems, vol.19, no.2, pp.210-226, Apr.2011.
2. Zhaohong Deng, Longbing Cao, Yizhang Jiang and Shitong Wang, "Minimax Probability TSK Fuzzy System Classifier: A More Transparent and Highly Interpretable Classification Model," IEEE Transactions on Fuzzy Systems, vol.23, no.4, pp.813-826, Apr.2015.
3. Yue Deng, Zhiquan Ren, You Yong Kong, Feng Bao and Qionghai Dai, "A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification," IEEE Transactions on Fuzzy Systems, vol.19, no.2, pp.210-226, June.2016.
4. C. L. Philip Chen, Chun-Yang Zhang, Long Chen, Member, IEEE, and Min Gan," Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning," IEEE Transactions on Fuzzy Systems, vol.23 no.6, pp.2163-2173, DECEMBER.2015.
5. Ta Zhou, Fu-lai Chung, and Shitong Wang," Deep TSK Fuzzy Classifier with Stacked Generalization and Triplely Concise Interpretability Guarantee for Large Data," IEEE Transactions on Fuzzy Systems, vol.23, no.4, pp.813-826, August.2016.
6. Jacek M. Leski, "Fuzzy (c + p)-Means Clustering and Its Application to a Fuzzy Rule-Based Classifier: Toward Good Generalization and Good Interpretability," IEEE Transactions on Fuzzy Systems, vol. 23, no. 4, August. 2015
7. Hisao Ishibuchi, Yusuke Nojima. "Dicsuccions on Interpretability of Fuzzy Systems using Simple Examples", IFSA-EUSFLAT 2009, 1649-1654
8. Chia-Feng Juang, Chi-You Chen, "Data-Driven Interval Type-2 Neural Fuzzy System With High Learning Accuracy and Improved Model Interpretability", IEEE Transactions on Cybernetics, VOL. 43, NO. 6, DECEMBER 2013,1781-1795
9. Yu-Jun Zheng, Wei-Guo, "Airline Passenger Profiling Based on Fuzzy Deep Machine Learning", IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
10. Shusen Zhou, Q Chen, X Wang, "Fuzzy deep belief networks for semi-supervised sentiment classification", Neurocomputing,131(2014) 312-322
11. Di Wu, Lionel Pigou, Pieter-Jan Kindermans, Nam Do-Hoang Le, Ling Shao, Joni Dambre, and Jean-Marc Odobez, "Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 38, NO. 8, AUGUST 2016, 1583-1597
12. J. J. Buckley and Y. Hayashi, "Fuzzy neural networks: A survey," Fuzzy sets and systems, vol. 66, no. 1, pp. 1-13, 1994.
13. C.-T. Lin, C.-M. Yeh, S.-F. Liang, J.-F. Chung, and N. Kumar, "Support vector-based fuzzy neural network for pattern classification," Fuzzy Systems, IEEE Transactions on, vol. 14, no. 1, pp. 31-41, 2006
14. Shiqian Wu, Meng Joo Er, Yang Gao, "A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks", IEEE TRANSACTIONS ON FUZZY SYSTEMS, VOL. 9, NO. 4, AUGUST 2001
15. Yoichi Hayashi, "A Neural Expert System with Automated Extraction of Fuzzy If-Then Rules and Its Application to Medical Diagnosis", Advances in Neural Information Processing System 3(NIPS 1990)
16. Andrew Hoblitzell, Meghna Babbar-Sebens, Snehasis Mukhopadhyay, "Fuzzy and deep learning approaches for user modeling in wetland design", 2016 IEEE International Conference on Systems, Man, and Cybernetics(SMC)
17. Angelica I. Aviles, Samar M. Alsaleh, Eduard Montseny, Pilar Sobrevilla, Alicia Casals, "A Deep-Neuro-Fuzzy Approach for Estimating the Interaction Forces in Robotic Surgery", 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), 1113-1119,2016
18. K. Torkkola, "Feature extraction by non parametric mutual information maximization," The Journal of Machine Learning Research, vol. 3, pp.1415-1438, 2003
19. O. Chapelle, B. Scholkopf, A. Zien, "Semi-supervised Learning", MIT Press, USA,2006
20. L.A. Zadeh, "Fuzzy sets", Inf. Control 8 (1965) 338-353
21. G. Purushothaman, N.B. Karayiannis, "Quantum neural networks (qnn's):inherently fuzzy feedforward neural networks", IEEE Trans. Neural Networks 8 (1997) 679-693.
22. D. Rutkowska, "Neuro-fuzzy Architectures and Hybrid Learning", Physica Verlag, New York, 2002.
23. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its application to modeling and control," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, no. 1, pp. 116-132, Jan. 1985
24. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference systems, "IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May 1993.
25. L. X. Wang, "Adaptive Fuzzy Systems And Control: Design And Stability Analysis". Upper Saddle River, NJ: Prentice-Hall, 1994.
26. J. Yen, L. Wang, and C. W. Gillespie, "Improving the interpretability of TSK fuzzy models by combining global learning and local learning," IEEE Trans. Fuzzy Syst., vol. 6, no. 4, pp. 530-537, Aug. 1998.
27. M. F. Azeem, M. Hanmandlu, and N. Ahmad, "Generalization of adaptive neuro-fuzzy inference systems," IEEE Trans. Neural Netw., vol. 11, no. 6, pp. 1332-1346, Nov. 2000
28. V. Vapnik, "The Nature of Statistical Learning Theory". Berlin, Germany:Springer, 1995
29. Yoshua Bengio, Aaron Courville, and Pascal Vincent, "Representation Learning: A Review and New Perspectives", IEEE Transactions on Pattern ANALYSIS AND MACHINE INTELLIGENCE, vol. 35, no. 8, August 2013
30. N. Le Roux and Y. Bengio, "Representational power of restricted boltzmann machines and deep belief networks," Neural computation, vol. 20, no. 6, pp. 1631-1649, 2008
31. J.-W. Liu, G.-H. Chi, and X.-L. Luo, "Contrastive divergence learning for the restricted boltzmann machine," in Natural Computation (ICNC),2013 Ninth International Conference on, pp. 18-22, IEEE, 2013.
32. A. Fischer and C. Igel, "Training restricted boltzmann machines: an introduction," Pattern Recognition, vol. 47, no. 1, pp. 25-39, 2014
33. Y. Bengio, P. Lamblin, D. Popovici, H. Larochelle, et al., "Greedy layer-wise training of deep networks," Advances in neural information processing systems, vol. 19, p. 153, 2007.
34. G.E. Hinton and R.R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol.313, no.5786, pp.504-507, 2006.
35. G.E. Hinton, "A Practical Guide to Training Restricted Boltzmann Machines," http://learning.cs.toronto.edu, Aug.2010.
36. G.E. Hinton, S. Osindero and Y.W. The, "A faster learning algorithm for deep belief nets," Neural Comput, vol.1, no.7, pp.1527-1544, 2006
37. Wang Shitong and Korris Fu-Lai Chung, "On Least Learning Machine", Journal of Jiangnan University (Natual Science Edition), vol.9, pp.505-510, Feb.2010