Fuzzy Restricted Boltzmann Machine for the Enhancement of Deep Learning

IEEE Transactions on Fuzzy Systems

Volumn 23, Issue 6, 2015, Pages 2163-2173

  Chen, C L Philip ^a   Zhang, Chun Yang ^a,b   Chen, Long ^a   Gan, Min ^c  

^a UNIVERSITY OF MACAU   (Macao)

^b FUZHOU UNIVERSITY   (China)

^c HEFEI UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Deep learning; fuzzy deep networks; fuzzy restricted Boltzmannmachine; image classification; image inpainting; restricted Boltzmann machine (RBM)

Indexed keywords

ARTIFICIAL INTELLIGENCE; CHARACTER RECOGNITION; FREE ENERGY; FUZZY LOGIC; FUZZY SETS; IMAGE CLASSIFICATION; IMAGE PROCESSING; IMAGE RECOGNITION; LEARNING SYSTEMS; PATTERN RECOGNITION; SPEECH RECOGNITION; VIDEO SIGNAL PROCESSING;

DEEP LEARNING; FREE ENERGY FUNCTION; FUZZY RESTRICTED BOLTZMANNMACHINE; HANDWRITTEN DIGIT; IMAGE INPAINTING; PROCESS OF LEARNING; RESTRICTED BOLTZMANN MACHINE; ROBUSTNESS PROPERTIES;

LEARNING ALGORITHMS;

EID: 84959506269     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2015.2406889     Document Type: Article

References (37)

1. P. Smolensky, Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Cambridge, MA, USA: MIT Press, 1986, pp. 194-281.
2. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks," Adv. Neural Inform. Process. Syst., vol. 19, pp. 153-160, 2007.
3. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006.
4. R. Salakhutdinov and G. Hinton, "An efficient learning procedure for deep Boltzmann machines," Neural Comput., vol. 24, no. 8, pp. 1967-2006, 2012.
5. R. Salakhutdinov, J. Tenenbaum, and A. Torralba, "Learning with hierarchical-deep models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1958-1971, Aug. 2013.
6. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
7. J. Schmidhuber, "Multi-column deep neural networks for image classification," in Proc. IEEE Conf. Comput. Vision Pattern Recog., 2012, pp. 3642-3649.
8. P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion," J. Mach. Learning Res., vol. 11, pp. 3371-3408, 2010.
9. Y. Bengio, A. Courville, and P. Vincent, "Representation learning: A review and new perspectives," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1798-1828, Aug. 2013.
10. R. Salakhutdinov and G. Hinton, "Replicated softmax: An undirected topic model," Adv. Neural Inform. Process. Syst., vol. 22, pp. 1607-1614, 2010.
11. Y. Bengio, "Learning deep architectures for AI," Foundations Trends Mach. Learning, vol. 2, no. 1, pp. 1-127, 2009.
12. G. Hinton, "A practical guide to training restricted Boltzmann machines," Dept. Comput. Sci., Univ. Toronto, Toronto, ON, Canada, Tech. Rep. UTML TR 2010-003, 2010.
13. N. Wang, J. Melchior, and L. Wiskott, "Gaussian-binary restricted Boltzmann machines on modeling natural image statistics," arXiv preprint arXiv:1401.5900, 2014.
14. G. W. Taylor, G. E. Hinton, and S. T. Roweis, "Two distributed-state models for generating high-dimensional time series," J. Mach. Learning Res., vol. 12, pp. 1025-1068, 2011.
15. K. H. Cho, T. Raiko, and A. Ilin, "Gaussian-Bernoulli deep Boltzmann machine," in Proc. Int. Conf. Neural Netw., Aug. 2013, pp. 1-7.
16. R. Salakhutdinov, A. Mnih, and G. Hinton, "Restricted Boltzmann machines for collaborative filtering," in Proc. 24th Int. Conf.Mach. Learning, 2007, pp. 791-798.
17. G.W. Taylor,G. E.Hinton, and S.Roweis, "Modeling human motion using binary latent variables," in Advances in Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2007, pp. 1345-1352.
18. I. Sutskever and G. E. Hinton, "Learning multilevel distributed representations for high-dimensional sequences," in Proc. Int. Conf. Artificial Intell. Statist., 2007, pp. 548-555.
19. H.-F.Wang and R.-C. Tsaur, "Insight of a fuzzy regression model," Fuzzy Sets Syst., vol. 112, no. 3, pp. 355-369, 2000.
20. P.-Y. Hao and J.-H. Chiang, "Fuzzy regression analysis by support vector learning approach," IEEE Trans. Fuzzy Syst., vol. 16, no. 2, pp. 428-441, Apr. 2008.
21. A. Fischer and C. Igel, "Training restricted Boltzmann machines: An introduction," Pattern Recog., vol. 47, no. 1, pp. 25-39, 2014.
22. C.-Y. Zhang and C. Chen, "An automatic setting for training restricted Boltzmann machine," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2014, pp. 4037-4041.
23. M. Aoyagi, "Learning coefficient in bayesian estimation of restricted Boltzmann machine," J. Algebraic Statist., vol. 4, no. 1, pp. 31-58, 2013.
24. M. Aoyagi and K. Nagata, "Learning coefficient of generalization error in Bayesian estimation and Vandermonde matrix-type singularity," Neural Comput., vol. 24, no. 6, pp. 1569-1610, 2012.
25. G. J. Klir and B. Yuan, Fuzzy Sets and Fuzzy Logic: Theory and Applications. Englewood Cliffs, NJ, USA: Prentice-Hall, 1995.
26. S. Dutta and M. Chakraborty, "Fuzzy relation and fuzzy function over fuzzy sets: A retrospective," Soft Comput., vol. 19, no. 1, pp. 99-112, 2014.
27. J. J. Buckley, Fuzzy Probabilities: New Approach and Applications. New York, NY, USA: Springer, 2009.
28. W. Pedrycz, A. Skowron, and V. Kreinovich, Handbook of Granular Computing. New York, NY, USA: Wiley, 2008.
29. W. A. Lodwick and J. Kacprzyk, Fuzzy Optimization: Recent Advances and Applications. New York, NY, USA: Springer, 2010.
30. N. N. Karnik and J. M. Mendel, "Centroid of a type-2 fuzzy set," Inform. Sci., vol. 132, no. 14, pp. 195-220, 2001.
31. O. Castillo and P. Melin, Type-2 Fuzzy Logic: Theory and Applications. New York, NY, USA: Springer, 2008.
32. G. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Comput., vol. 14, no. 8, pp. 1771-1800, 2002.
33. M. A. Carreira-Perpinan and G. E. Hinton, "On contrastive divergence learning," in Proc. 10th Int. workshop artificial intelligence and statistics, NP: Society for Artificial Intelligence and Statistics, 2005, pp. 33-40.
34. M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul, "An introduction to variational methods for graphical models," Mach. Learning, vol. 37, no. 2, pp. 183-233, 1999.
35. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer-Verlag, 2006.
36. G. E. Hinton, "Learning multiple layers of representation," Trends Cognitive Sci., vol. 11, no. 10, pp. 428-434, 2007.
37. C. P. Chen and C.-Y. Zhang, "Data-intensive applications, challenges, techniques and technologies: A survey on big data," Inform. Sci., vol. 275, pp. 314-347, 2014.