Sampling hidden parameters from oracle distribution

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8681 LNCS, Issue , 2014, Pages 539-546

  Sonoda, Sho ^a   Murata, Noboru ^a  

^a WASEDA UNIVERSITY   (Japan)

Author keywords

backpropagation; Integral representation; neural networks; oracle distribution; sampling learning; weight initialization

Indexed keywords

LEARNING SYSTEMS; NEURAL NETWORKS; NORMAL DISTRIBUTION;

INTEGRAL REPRESENTATION; LEARNING METHODS; LINEAR-TIME; NUMERICAL EXPERIMENTS; ORACLE DISTRIBUTION; SAMPLING ALGORITHM; WEIGHT INITIALIZATION;

BACKPROPAGATION;

EID: 84958526124     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-11179-7_68     Document Type: Conference Paper

References (9)

1. Bengio, Y., Courville, A., Vincent, P.: Representation learning: A review and new perspectives. IEEE Trans. on PAMI 35(8), 1798-1828 (2013)
2. Denoeux, T., Lengelĺe, R.: Initializing back propagation networks with prototypes. Neural Networks 6(3), 351-363 (1993)
3. De Freitas, J. F. G., Niranjan, M., Gee, A. H., Doucet, A.: Sequential Monte Carlo methods to train neural network models. Neural Computation 12(4), 955-993 (2000)
4. Kůrková, V.: Complexity estimates based on integral transforms induced by computational units. Neural Networks 33, 160-167 (2012)
5. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proceedings of the IEEE 11, 2278-2324 (1998)
6. LeCun, Y. A., Bottou, L., Orr, G. B., Müller, K.-R.: Efficient Backprop. In: Montavon,p G., Orr, G. B., Müller, K.-R. (eds. ) NN: Tricks of the Trade, 2nd edn. LNCS, vol. 7700, pp. 9-48. Springer, Heidelberg (2012)
7. LeCun, Y., Cortes, C.: The MNIST database of handwritten digits, http://yann. lecun. com/exdb/mnist/
8. Murata, N.: An integral representation of functions using three-layered networks and their approximation bounds. Neural Networks 9(6), 947-956 (1996)
9. Sprecher, D. A.: A numerical implementation of Kolmogorov's superpositions. Neural Networks 9(5), 765-772 (1996)