High-dimensional density estimation via SCA: An example in the modelling of hurricane tracks

Statistical Methodology

Volumn 8, Issue 1, 2011, Pages 18-30

  Buchman, Susan M ^a   Lee, Ann B ^a   Schafer, Chad M ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Application to physical sciences; Dimension reduction; Nonparametric density estimation

Indexed keywords

EID: 78649693330     PISSN: 15723127     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.stamet.2009.07.002     Document Type: Article

References (35)

1. P. Arias, G. Randall, G. Sapiro, Connecting the out-of-sample and pre-image problems in kernel methods, in: CVPR07, 2007, pp. 1-8.
2. Bashtannyk D.M., Hyndman R.J. Bandwidth selection for kernel conditional density estimation. Computational Statistics and Data Analysis 2001, 36:279-298.
3. Belkin M., Niyogi P. Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Computation 2003, 15(6):1373-1396.
4. Belkin M., Niyogi P. Semi-supervised learning on Riemannian manifolds. Machine Learning 2004, 209-239.
5. Coifman R., Lafon S., Lee A., Maggioni M., Nadler B., Warner F., Zucker S. Geometric diffusions as a tool for harmonics analysis and structure definition of data: Diffusion maps. Proceedings of the National Academy of Sciences 2005, 102(21):7426-7431.
6. Efromovich S. Nonparametric Curve Estimation: Methods, Theory, and Applications 1999, Springer.
7. Emanuel K., Ravela S., Vivant E., Risi C. A statistical deterministic approach to hurricane risk assessment. Bulletin of the American Meteorological Society 2006, 299-312.
8. Girolami M. Orthogonal series density estimation and the kernel eigenvalue problem. Neural Computation 2002, 14(3):669-688.
9. Gooijer J.G.D., Zerom D. On conditional density estimation. Statistica Neerlandica 2003, 57(2):159-176.
10. Hall P., Heckman N.E. Estimating and depicting the structure of a distribution of random functions. Biometrika 2002, 89(1):145-158.
11. T. Hall, S. Jewson, SST and North American Tropical Cyclone Landfall: A Statistical Modeling Study, [physics.ao-ph], 2008. arxiv:0801.1013v1.
12. Hall T.M., Jewson S. Statistical modelling of North Atlantic tropical cyclone tracks. Tellus 2007, 486-498.
13. Hall P., Racine J., Li Q. Cross-validation and the estimation of conditional probability densities. Journal of the American Statistical Association 2004, 99(468):1015-1026.
14. Hall P., Tajvidi N. Permutation tests for equality of distributions in high-dimensional settings. Biometrika 2002, 89(2):359-374.
15. M.P. Holmes, A.G. Gray, C.L. Isbell Jr., Fast nonparametric conditional density estimation, in: The Learning Workshop, SNOWBIRD, 2007.
16. HURDAT Database, 2007. http://www.aoml.noaa.gov/hrd/hurdat/Data_Storm.html.
17. Hyndman R.J., Bashtannyk D.M., Grunwald G.K. Estimating and visualizing conditional densities. Journal of Computational and Graphical Statistics 1996, 5(4):315-336.
18. Justel A., Peña D., Zamar R. A multivariate Kolmogorov-Smirnov test of goodness of fit. Statistics and Probability Letters 1997, 35:251-259.
19. Kwok J.T.Y., Tsang I.W.H. The pre-image problem in kernel methods. IEEE Transactions on Neural Networks 2004, 15(6):1517-1525.
20. Lafon S., Lee A.B. Diffusion maps and coarse-graining: A unified framework for dimensionality reduction, graph partitioning, and data set parameterization. IEEE Transactions on Pattern Analysis and Machine Intelligence 2006, 28(9):1393-1403.
21. Lee A.B., Nadler B., Wasserman L. Treelets - An adaptive multi-scale basis for sparse unordered data. Annals of Applied Statistics 2008, 2(2):435-471.
22. A.B. Lee, L. Wasserman, Spectral Connectivity Analysis (submitted for publication). Preprint available at arxiv:0811.0121.
23. H. Liu, J. Lafferty, L. Wasserman, Sparse nonparametric density estimation in high dimensions using the rodeo, in: M. Meila, X. Shen (Eds.), Eleventh International Conference on Artificial Intelligence and Statistics, AISTATS, 2007.
24. Mika S., Schölkopf B., Smola A.J., Müller K.-R., Scholz M., Rätsch G. Kernel PCA and de-noising in feature spaces. Advances in Neural Information Processing Systems 11 1999, MIT Press, citeseer.ist.psu.edu/mika99kernel.html. M.S. Kearns, S.A. Solla, D.A. Cohn (Eds.).
25. Ng A.Y., Jordan M.I., Weiss Y. On Spectral Clustering: Analysis and an Algorithm. Advances in Neural Information Processing Systems 2001, vol. 14:849-856. MIT Press.
26. Richards J.W., Freeman P.E., Lee A.B., Schafer C.M. Exploiting low-dimensional structure in astronomical spectra. The Astrophysical Journal 2009, 691(1):32-42.
27. Rosenblatt M. Conditional probability density and regression estimators. Multivariate Analysis II 1969, P.R. Krishnaiah (Ed.).
28. Rumpf J., Weindl H., Höppe P., Rauch E., Schmidt V. Statistical modelling of tropical cyclone tracks. Mathematical Methods of Operations Research 2007, 66(3):475-490.
29. Scott D.W Multivariate Density Estimation: Theory, Practice, and Visualization. Wiley Series in Probability and Statistics 1992, Wiley-Interscience.
30. Silverman B.W. Density Estimation for Statistics and Data Analysis 1986, Chapman & Hall/CRC.
31. Smith T.M., Reynolds R.W., Peterson T., Lawrimore J. Improvements to NOAA's historical merged land-ocean surface temperature analysis (1880-2006). Journal of Climate 2008, 21(10):2283-2296.
32. Vecchi G., Knutson T.R. On estimates of historical North Atlantic tropical cyclone activity. Journal of Climate 2008, 21(14):3580-3600.
33. Vickery P.J., Skerlj P.F., Twisdale L.A. Simulation of hurricane risk in the US using empirical track model. Journal of Structural Engineering 2000, 1222-1237.
34. von Luxburg U. A tutorial on spectral clustering. Statistics and Computing 2007, 17(4):395-416.
35. Xie L., Yan T., Pietrafesa L.J., Morrison J.M., Karl T. Climatology and interannual variability of North Atlantic hurricane tracks. Journal of Climate 2005, 18(24):5370-5381.