A new active labeling method for deep learning

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2014, Pages 112-119

  Wang, Dan ^a   Shang, Yi ^a  

^a University of Missouri   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COST EFFECTIVENESS; LABELED DATA; LEARNING SYSTEMS;

AUTOENCODERS; BENCHMARK DATASETS; COST EFFECTIVE; DATA SELECTION; LABELING METHODS; LEARNING NETWORK; RESTRICTED BOLTZMANN MACHINE; UNLABELED DATA;

DEEP LEARNING;

EID: 84908483797     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2014.6889457     Document Type: Conference Paper

References (22)

1. Y. BENGIO, P. LAMBLIN, D. POPOVICI, AND H. LAROCHELLE, "GREEDY LAYER-WISE TRAINING OF DEEP NETWORKS", ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS, vol. 19, pp. 153-160, 2007.
2. G. E. HINTON AND R. R. SALAKHUTDINOV, "REDUCING THE DIMENSIONALITY OF DATA WITH NEURAL NETWORKS", SCIENCE, vol. 313, pp. 504-507, 2006.
3. P. SMOLENSKY, "INFORMATION PROCESSING IN DYNAMICAL SYSTEMS: FOUNDATIONS OF HARMONY THEORY", IN PARALLEL DISTRIBUTED PROCESSING: EXPLORATIONS IN THE MICROSTRUCTURE OF COGNITION, ED CAMBRIDGE, MA, USA: MIT PRESS, 1986, pp. 194-281.
4. B. SETTLES, "ACTIVE LEARNING LITERATURE SURVEY", UNIVERSITY OF WISCONSIN, MADISON 2010.
5. G. E. HINTON, S. OSINDERO, AND Y. W. TEH, "A FAST LEARNING ALGORITHM FOR DEEP BELIEF NETS", NEURAL COMPUTATION, vol. 18, pp. 1527-1554, 2006.
6. G. E. HINTON, "TRAINING PRODUCTS OF EXPERTS BY MINIMIZING CONTRASTIVE DIVERGENCE", NEURAL COMPUTATION, vol. 14, pp. 1771-1800, 2002.
7. G. HINTON, "A PRACTICAL GUIDE TO TRAINING RESTRICTED BOLTZMANN MACHINES", MOMENTUM, vol. 9, P. 1, 2010.
8. Y. LE CUN, "MODÈLES CONNEXIONNISTES DE L'APPRENTISSAGE", PHD DISSERTATION, PARIS 6, 1987.
9. H. BOURLARD AND Y. KAMP, "AUTO-ASSOCIATION BY MULTILAYER PERCEPTRONS AND SINGULAR VALUE DECOMPOSITION", BIOLOGICAL CYBERNETICS, vol. 59, pp. 291-294, 1988.
10. G. E. HINTON AND R. S. ZEMEL, "AUTOENCODERS, MINIMUM DESCRIPTION LENGTH, AND HELMHOLTZ FREE ENERGY", ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS, pp. 3-10, 1994.
11. D. F. WULSIN, J. R. GUPTA, R. MANI, J. A. BLANCO, AND B. LITT, "MODELING ELECTROENCEPHALOGRAPHY WAVEFORMS WITH SEMI-SUPERVISED DEEP BELIEF NETS: FAST CLASSIFICATION AND ANOMALY MEASUREMENT", JOURNAL OF NEURAL ENGINEERING, vol. 8, pp. 1-13, 2011.
12. S. ZHOU, Q. CHEN, AND X. WANG, "ACTIVE DEEP NETWORKS FOR SEMI-SUPERVISED SENTIMENT CLASSIFICATION", IN PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL LINGUISTICS: POSTERS, 2010, pp. 1515-1523.
13. N. ROY AND A. MCCALLUM, "TOWARD OPTIMAL ACTIVE LEARNING THROUGH MONTE CARLO ESTIMATION OF ERROR REDUCTION", ICML, WILLIAMSTOWN, pp. 441-448, 2001.
14. C. E. SHANNON AND W. WEAVER, "A MATHEMATICAL THEORY OF COMMUNICATION", THE BELL SYSTEM TECHNICAL JOURNAL, vol. 27, pp. 379-423, 623-656, JULY, OCTOBER 1948.
15. Y. LECUN, L. BOTTOU, Y. BENGIO, AND P. HAFFNER, "GRADIENT-BASED LEARNING APPLIED TO DOCUMENT RECOGNITION", PROCEEDINGS OF THE IEEE, vol. 86, pp. 2278-2324, 1998.
16. A. NG. (2013). UFLDL TUTORIAL. AVAILABLE: HTTP://UFLDL. STANFORD. EDU/WIKI/INDEX. PHP/UFLDL-TUTORI AL
17. A. L. GOLDBERGER, L. A. AMARAL, L. GLASS, J. M. HAUSDORFF, P. C. IVANOV, R. G. MARK, ET AL., "PHYSIOBANK, PHYSIOTOOLKIT, AND PHYSIONET COMPONENTS OF A NEW RESEARCH RESOURCE FOR COMPLEX PHYSIOLOGIC SIGNALS", CIRCULATION, vol. 101, pp. E215-E220, 2000.
18. M. LÄNGKVIST, L. KARLSSON, AND A. LOUTFI, "SLEEP STAGE CLASSIFICATION USING UNSUPERVISED FEATURE LEARNING", ADVANCES IN ARTIFICIAL NEURAL SYSTEMS, vol. 2012, 2012.
19. A. R. OSBORNE AND A. PROVENZALE, "FINITE CORRELATION DIMENSION FOR STOCHASTIC SYSTEMS WITH POWER-LAW SPECTRA", PHYSICA D: NONLINEAR PHENOMENA, vol. 35, pp. 357-381, 1989.
20. L. ZOUBEK, S. CHARBONNIER, S. LESECQ, A. BUGUET, AND F. CHAPOTOT, "FEATURE SELECTION FOR SLEEP/WAKE STAGES CLASSIFICATION USING DATA DRIVEN METHODS", BIOMEDICAL SIGNAL PROCESSING AND CONTROL, vol. 2, pp. 171-179, 2007.
21. E. PEREDA, A. GAMUNDI, R. RIAL, AND J. GONZALEZ, "NON-LINEAR BEHAVIOUR OF HUMAN EEG: FRACTAL EXPONENT VERSUS CORRELATION DIMENSION IN AWAKE AND SLEEP STAGES", NEUROSCIENCE LETTERS, vol. 250, pp. 91-94, 1998.
22. T. GASSER, P. BÄCHER, AND J. MÖCKS, "TRANSFORMATIONS TOWARDS THE NORMAL DISTRIBUTION OF BROAD BAND SPECTRAL PARAMETERS OF THE EEG", ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, vol. 53, pp. 119-124, 1982.