Auto-encoder based dimensionality reduction

Neurocomputing

Volumn 184, Issue , 2016, Pages 232-242

  Wang, Yasi ^a   Yao, Hongxun ^a   Zhao, Sicheng ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Auto encoder; Dimensionality reduction; Dimensionality accuracy; Intrinsic dimensionality; Visualization

Indexed keywords

DATA REDUCTION; DATA VISUALIZATION; FLOW VISUALIZATION; NETWORK LAYERS; THREE DIMENSIONAL COMPUTER GRAPHICS; VISUALIZATION;

AUTO ENCODERS; DIMENSIONALITY REDUCTION; DIMENSIONALITY REDUCTION METHOD; DIMENSIONALITY-ACCURACY; INTRINSIC DIMENSIONALITIES; INTUITIVE UNDERSTANDING; LAYERED NEURAL NETWORK; THREE DIMENSIONAL SPACE;

LEARNING SYSTEMS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTO ENCODER; CLASSIFIER; IMAGE PROCESSING; ISOMAP; LINEAR DISCRIMINANT ANALYSIS; LOCALLY LINEAR EMBEDDING; MATHEMATICAL COMPUTING; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL;

EID: 84971483938     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.08.104     Document Type: Article

References (28)

1. Sartori M.A., Antsaklis P.J. A simple method to derive bounds on the size and to train multilayer neural networks. IEEE Trans. Neural Netw. 1991, 2(4):467-471.
2. Arbib M. Review of 'Perceptrons. an introduction to computational geometry'. IEEE Trans. Inf. Theory 1969, 15(6):738-739.
3. Huang G.B. Learning capability and storage capacity of two-hidden-layer feedforward networks. IEEE Trans. Neural Netw. 2003, 14(2):274-281.
4. Bengio Yoshua Learning deep architectures for AI. Found. Trends® Mach. Learn. 2009, 2(1):1-127.
5. Yoshua Bengio, Deep learning of representations: looking forward, in: Statistical Language and Speech Processing, 2013, pp. 1-37.
6. Yoshua Bengio, Aaron Courville, Pascal Vincent, Unsupervised feature learning and deep learning: a review and new perspectives, in: CoRR, 2012.
7. Bourlard H., Kamp Y. Auto-association by multilayer perceptrons and singular value decomposition. Biol. Cybern. 1988, 59(4-5):291-294.
8. Huang S.C., Huang Y.F. Bounds on the number of hidden neurons in multilayer perceptrons. IEEE Trans. Neural Netw. 1991, 2(1):47-55.
9. Xiang C., Ding S.Q., Lee T.H. Geometrical interpretation and architecture selection of MLP. IEEE Trans. Neural Netw. 2005, 16(1):84-96.
10. Cortes Corinna, Vapnik Vladimir Support-vector networks. Mach. Learn. 1995, 273-297.
11. Demers David, Cottrell Garrison Non-linear dimensionality reduction. Adv. Neural Inf. Process. Syst. 1993, 580-587.
12. Ali Ghodsi, Dimensionality Reduction a Short Tutorial, Department of Statistics and Actuarial Science, 2006.
13. Hinton Geoffrey A practical guide to training restricted Boltzmann machines. Neural Netw.: Tricks Trade 2012, 599-619.
14. Hinton Geoffrey, Osindero Simon A fast learning algorithm for deep belief nets. Neural Comput. 2006, 18(2006).
15. Hinton Geoffrey, Salakhutdinov R. Reducing the dimensionality of data with neural networks. Science 2006, 313(5786):504-507.
16. Hopfield J.J., Tank D.W. Neural computation of decisions in optimization problems. Biol. Cybern. 1985, 52(3):141-152.
17. Wang J., He H.B., Prokhorov D.V. A folded neural network autoencoder for dimensionality reduction. Proc. Comput. Sci. 2012, 13:120-127.
18. Kramer Mark A. Nonlinear principal component analysis using autoassociative neural networks. AIChE J. 1991, 37(2):233-243.
19. Krizhevsky Alex, Ilya Sutskever, Hinton Geoffrey Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 2012, 1097-1105.
20. Marvin Minsky, Seymour Papert, Perceptrons: An Introduction to Computational Geometry (Expanded edition), 1988.
21. Nathalie Japkowicz, Hanson S., Gluck M. Nonlinear autoassociation is not equivalent to PCA. Neural Comput. 2000, 12(3):531-545.
22. S. Tamura, Capabilities of a three layer feedforward neural network, in: IEEE International Joint Conference on Neural Networks, 1991, pp. 2757-2762.
23. Tamura S., Tateishi M. Capabilities of a four-layered feedforward neural network. four layers versus three. IEEE Trans. Neural Netw. 1997, 8(2):251-255.
24. Q.V. Le, Building high-level features using large scale unsupervised learning, in: IEEE International Conference on Acoustics, Speech and Signal Processing, 2013, pp. 8595-8598.
25. Wang Wei, Huang Yan, Wang Yizhou, Wang Liang, Generalized autoencoder: a neural network framework for dimensionality reduction, in: IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2014, pp. 496-503.
26. Matthew D. Zeiler, Rob Fergus, Visualizing and understanding convolutional networks, in: CoRR, 2013.
27. Zhaohua Hu, Yaoliang Song Dimensionality reduction and reconstruction of data based on autoencoder network. J. Electron. Inf. Technol. 2009, 31(5):1189-1192.
28. Zhenyao Zhu, Ping Luo, Xiaogang Wang, Xiaoou Tang, Deep learning identity-preserving face space, in: IEEE International Conference on Computer Vision, 2013, pp. 113-120.