Multiscale wavelets on trees, graphs and high dimensional data: Theory and applications to semi supervised learning

ICML 2010 - Proceedings, 27th International Conference on Machine Learning

Volumn , Issue , 2010, Pages 367-374

  Gavish, Matan ^a,c   Nadler, Boaz ^a   Coifman, Ronald R ^b  

^a WEIZMANN INSTITUTE OF SCIENCE   (Israel)

^b YALE UNIVERSITY   (United States)

^c STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AS GRAPH; EUCLIDEAN; EXPONENTIAL RATES; HIERARCHICAL TREE; HIGH DIMENSIONAL DATA; HIGH-DIMENSIONAL; LEARNING TASKS; LOW DIMENSIONAL; MULTI-SCALE WAVELET; OR-NETWORKS; ORTHONORMAL BASIS; PRACTICAL ALGORITHMS; SEMI-SUPERVISED LEARNING; STATISTICAL INFERENCE; WAVELET COEFFICIENTS;

CLUSTERING ALGORITHMS; EXPONENTIAL FUNCTIONS; FOURIER SERIES; GRAPH THEORY; HARMONIC ANALYSIS; HARMONIC FUNCTIONS; SIGNAL PROCESSING; SUPERVISED LEARNING; TREES (MATHEMATICS);

LEARNING ALGORITHMS;

EID: 77956556554     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Bartal, Y. Probabilistic approximation of metric spaces and its algorithmic applications. In Proc. of the 37th Annual IEEE Symp. on Foundations of Computer Science, 1996.
2. Bartal, Y. On approximating arbitrary metrics by tree metrics. In Proc. of the 30th Annual Symp. on Theory of Computing, 1998.
3. Belkin, M. and Niyogi, P. Using manifold structure for partially labelled classification. In Advances in Neural Information Processing Systems, Vol. 13, 2003.
4. Binev, P., Cohen, A., Dahmen, W., DeVore, R. and Temlyakov, V. Universal algorithms for learning theory, part I: Piecewise constant functions. JMLR, pp. 1297-1321, 2005.
5. Breiman, L. Random forests. Machine Learning, 45: 5-32, 2001.
6. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J. Classification and regression trees. Wadsworth International, Belmont, CA, 1984.
7. Chapelle, O., Schölkopf, B. and Zien, A. Semi-Supervised Learning. MIT Press, 2006.
8. Coifman, R.R. and Donoho, D.L. Translation-invariant de-noising. In Wavelets and Statistics, pp. 125-150, NY, 1995. Springer-Verlag.
9. Coifman, R.R. and Maggioni, M. Diffusion wavelets. Appl. Comp. Harm. Anal., 21(1):53-94, 2006.
10. Coifman, R.R. and Weiss, G. Extensions of Hardy spaces and their use in analysis. Bulletin of the AMS, 83(4), 1977.
11. Deng, D. and Han, Y. Harmonic Analysis on Spaces of Homogeneous Type. Springer, Berlin, 2009.
12. Donoho, D.L. CART and best-ortho-basis: a connection. Annals of Statistics, 25:1870-1911, 1997.
13. Hardie, W., Kerkyacharian, G., Picard, D. and Tsy-bakov, A.B. Wavelets, Approximation and Statistical Applications. Springer, NY, 1998.
14. Herbster, M., Pontil, M. and Rojas-Galeano, S. Fast prediction on a tree. In Advances in Neural Information Processing Systems, Vol. 21, 2009.
15. Jansen, M., Nason, G.P. and Silverman, B.W. Multi-scale methods for data on graphs and irregular multidimensional situations. J. Royal Stat. Soc. B, 71: 97-125, 2009.
16. Kemp, C.C., Griffiths, T.L., Stromsten, S. and Tenen-baum, J.B. Semi-supervised learning with trees. In Advances in Neural Information Processing Systems, Vol. 14. MIT Press, 2004.
17. Lee, A.B., Nadler, B. and Wasserman, L. Treelets: an adaptive multi-scale basis for sparse unordered data. Annals of Applied Statistics, 2(2):437-471, 2008.
18. Lehmann, EX. and Casella, G. Theory of Point Estimation. Springer, 2nd edition, 2003.
19. Mahadevan, S. and Maggioni, M. Value function approximation with diffusion wavelets and Laplacian eigenfunctions. In Advances in Neural Information Processing Systems, Vol. 18, 2006.
20. Mallat, S. A wavelet tour of signal processing. Academic Press, 2nd edition, 1999.
21. Murtagh, F. The Haar wavelet transform of a dendrogram. J. Classification, 24:3-32, 2007.
22. Nadler, B., Srebro, N. and Zhou, X. Semi-supervised learning with the graph Laplacian: The limit of infinite unlabeled data. In Advances in Neural Information Processing Systems, Vol. 21, 2009.
23. Neal, R.M. and Zhang, J. High dimensional classification with Bayesian neural networks and Dirichlet diffusion trees. In Feature Extraction: Foundations and Applications, pp. 265-295. 2006.
24. Vapnik, V.N. Statistical Learning Theory. Wiley, NY, 1998.
25. Zhu, X. Semi-supervised learning literature review. Technical report, Computer Science Department, University of Wisconsin, 2008.
26. Zhu, X., Ghahramani, Z. and Lafferty, J. Semi-supervised learning using gaussian fields and harmonic functions. In International Conference on Machine Learning, Vol. 13, 2003.