Engaging uncertainty in hydrologic data sets using principal component analysis: BaNPCA algorithm

Water Resources Research

Volumn 44, Issue 10, 2008, Pages

  Tripathi, Shivam ^a   Govindaraju, Rao S ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ATMOSPHERIC PRESSURE; ATMOSPHERIC TEMPERATURE; DATA VISUALIZATION; EARTH SCIENCES; FEATURE EXTRACTION; MEASUREMENT ERRORS; NICKEL COMPOUNDS; RESTORATION; SUBMARINE GEOPHYSICS; UNCERTAINTY ANALYSIS;

AUTOMATIC RELEVANCE DETERMINATIONS; BAYESIAN; DATA POINTS; DATA RECONSTRUCTIONS; DIMENSIONALITY REDUCTIONS; EXISTING METHODS; GEOSCIENCES; HYDROLOGIC DATUMS; MISSING VALUES; PACIFIC DECADAL OSCILLATIONS; PRINCIPAL COMPONENTS; ROBUST OPTIMIZATIONS; SEA SURFACE TEMPERATURES; SOUTHERN OSCILLATIONS; SPACE AND TIMES; SST DATUMS; STANDARD FORMS; SUMMER MONSOONS; SYNTHETIC DATA SETS;

PRINCIPAL COMPONENT ANALYSIS;

ALGORITHM; BAYESIAN ANALYSIS; DATA SET; EL NINO-SOUTHERN OSCILLATION; PACIFIC DECADAL OSCILLATION; PRINCIPAL COMPONENT ANALYSIS; SEA SURFACE TEMPERATURE; UNCERTAINTY ANALYSIS;

EID: 57149086464     PISSN: 00431397     EISSN: None     Source Type: Journal    
DOI: 10.1029/2007WR006692     Document Type: Article

References (47)

1. Adida, E., and G. Perakis (2006), A robust optimization approach to dynamic pricing and inventory control with no backorders, Math. Program., 107(1), 97-129, doi:10.1007/s10107-005-0681-5.
2. Adler, R. F., et al. (2003), The version-2 Global Precipitation Climatology Project (GPCP) monthly precipitation analysis (1979 to pesent), J. Hydrometeorol., 4(6), 1147-1167.
3. Ahn, J., and J. Oh (2003), A constrained EM algorithm for principal component analysis, Neural Comput., 15(1), 57-65.
4. Allan, R., and T. Ansell (2006), A new globally complete monthly historical gridded mean sea level pressure dataset (HadSLP2): 1850-2004, J. Clim., 19(22), 5816-5842, doi:10.1175/2FJCLI3937.1.
5. Alvera-Azcarate, A., A. Barth, M. Rixen, and J. M. Beckers (2005), Reconstruction of incomplete oceanographic data sets using empirical orthogonal functions: Application to the Adriatic Sea surface temperature, Ocean Modell., 9, 325-346, doi:10.1016/j.ocemod.2004.08.001.
6. Ambroise, C., and G. J. McLachlan (2002), Selection bias in gene extraction on the basis of microarray gene-expression data, Proc. Natl. Acad. Sci. U. S. A., 99(10), 6562-6566, doi:10.1073/pnas.102102699.
7. Beckers, J. M., and M. Rixen (2003), EOF calculations and data filling from incomplete oceanographic datasets, J. Atmos. Oceanic Technol., 20(12), 1839-1856.
8. Ben-Tal, A., and A. Nemirovski (2002), Robust optimization - Methodology and applications, Math. Program., 92(3), 453-480, doi:10.1007/ s101070100286.
9. Berger, J. O. (1985), Statistical Decision Theory and Bayesian Analysis, 2nd ed., Springer, New York.
10. Bhattacharyya, C., L. R. Grate, A. Rizki, D. Radisky, F. J. Molina, M. I. Jordan, M. J. Bissell, and I. S. Mian (2003), Simultaneous classification and relevant feature identification in high-dimensional spaces: Application to molecular profiling data, Signal Processing, 83(4), 729-743, doi:10.1016/S0165-1684(02)00474-7.
11. Bhattacharyya, C., L. R. Grate, M. I. Jordan, L. Ghaoui, and I. S. Mian (2004), Robust sparse hyperplane classifiers: Application to uncertain molecular profiling data, J. Comput. Biol., 11(6), 1073-1089, doi:10.1089/cmb. 2004.11.1073.
12. Bishop, C. M. (1999), Bayesian PCA, in Advances in Neural Information Processing Systems, vol. 11, edited by M. J. Keams, S. A. Solla, and D. A. Cohn, pp. 382-388, MIT Press, Cambridge, Mass.
13. Bishop, C. M. (2006), Pattern Recognition and Machine Learning, 1st ed., Springer, New York.
14. Brohan, P., J. J. Kennedy, I. Harris, S. F. B. Tett, and P. D. Jones (2006), Uncertainty estimates in regional and global observed temperature changes: A new data set from 1850, J. Geophys. Res., 111, D12106, doi:10.1029/2005JD006548.
15. Cherkassky, V., and F. Mulier (1998), Learning From Data: Concepts, Theory, and Methods, Wiley Intersci., New York.
16. Chowdhury, S., and A. Sharma (2007), Mitigating parameter bias in hydrological modelling due to uncertainty in covariates, J. Hydrol., 340(3-4), 197-204.
17. Dempster, A. P., N. M. Laird, and D. B. Rubin (1977), Maximum likelihood from incomplete data via the EM algorithm, J. R. Stat. Soc., Ser. B, 39(1), 1-38.
18. Folland, C. K., and D. E. Parker (1995), Correction of instrumental biases in historical sea surface temperature data, Q. J. R. Meteorol. Soc., 121(522), 319-367, doi:10.1002/qj.49712152206.
19. German, A., J. B. Carlin, H. S. Stern, and D. B. Rubin (2004), Bayesian Data Analysis, 2nd ed., CRC Press, Boca Raton, Fla.
20. Golub, G. H., and C. F. van Loan (1996), Matrix Computations, 3rd ed., Johns Hopkins Univ. Press, Baltimore, Md.
21. Gunawan, S., and S. Azarm (2005), Multi-objective robust optimization using a sensitivity region concept, Struct. Multidisciplinary Optim., 29(1), 50-60, doi:10.1007/s00158-004-0450-8.
22. Huard, D., and A. Mailhot (2006), A Bayesian perspective on input uncertainly in model calibration: Application to hydrological model "abc," Water Resour. Res., 42, W07416, doi:10.1029/ 2005WR004661.
23. Jonsson, P., and C. Wohlin (2006), Benchmarking k-nearest neighbour imputation with homogeneous Likert data, Empirical Softw. Eng., 11(3), 463-489, doi:10.1007/s10664-006-9001-9.
24. Kavetski, D., G. Kuczera, and S. W. Franks (2006), Bayesian analysis of input uncertainty in hydrological modeling: 1. Theory, Water Resour. Res., 42, W03407, doi:10.1029/2005WR004368.
25. Kumar, K. K., B. Rajagopalan, M. Hoerling, G. Bates, and M. Cane (2006), Unraveling the mystery of India monsoon failure during El Niño, Science, 314(5796), 115-119, doi:10.1126/science.1131152.
26. Lau, K. M., K. M. Kim, and S. S. P. Shen (2002), Potential predictability of seasonal precipitation over the United States from canonical ensemble correlation predictions, Geophys. Res. Lett, 29(7), 1097, doi:10.1029/ 2001GL014263.
27. Little, R. J. A., and D. B. Rubin (2002), Statistical Analysis With Missing Data, 2nd ed., John Wiley, New York.
28. MacKay, D. J. C. (1992), Bayesian interpolation, Neural Comput., 4(3), 415-447.
29. MacKay, D. J. C. (2005), Information Theory, Inference and Learning Algorithms [electronic], version 7.2, Cambridge Univ. Press, New York. (Available at http://www.inference.phy.cam.ac.uk/mackay/itila/ book.html)
30. Neal, R. M. (1996), Bayesian Learning for Neural Networks, Springer, New York.
31. Pappenberger, F., and K. J. Beven (2006), Ignorance is bliss: Or seven reasons not to use uncertainty analysis, Water Resour. Res., 42, W05302, doi:10.1029/2005WR004820.
32. Parthasarathy, B., A. A. Munot, and D. R. Kothawale (1994), All-India monthly and seasonal rainfall series: 1871-1993, Theor. Appl. Climatol., 49(4), 217-224.
33. Rayner, N. A., P. Brohan, D. E. Parker, C. K. Folland, J. J. Kennedy, M. Vanicek, T. J. Ansell, and S. F. B. Tett (2006), Improved analyses of changes and uncertainties in sea surface temperature measured in situ since the mid-nineteenth century: The HadSST2 dataset, J. Clim., 19(3), 446-469, doi:10.1175/JCLI3637.1.
34. Regonda, S. K., B. Rajagopalan, M. Clark, and E. Zagona (2006), A multimodel ensemble forecast framework: Application to spring seasonal flows in the Gunnison river basin, Water Resour. Res., 42, W09404, doi:10.1029/2005WR004653.
35. Roweis, S. T. (1998), EM algorithms for PCA and SPCA, in Advances in Neural Information Processing Systems, vol. 10, edited by M. I. Jordan, M. J. Kearns, and S. A. Solla, pp. 626-632, MIT Press, Cambridge, Mass.
36. Rutherford, S., M. E. Mann, T. L. Delworth, and R. J. Stouffer (2003), Climate field reconstruction under stationary and nonstationary forcing, J. Clim., 16(3), 462-479.
37. Sanguinetti, G., M. Milo, M. Rattray, and N. D. Lawrence (2005), Accounting for probe-level noise in principal component analysis of microarray data, Bioinformatics, 21(19), 3748-3754, doi:10.1093/bioinformatics/ bti617.
38. Schneider, T. (2001), Analysis of incomplete climate data: Estimation of mean values and covariance matrices and imputation of missing values, J. Clim., 14(5), 853-871.
39. Smith, T. M., R. W. Reynolds, R. E. Livezey, and D. C. Stokes (1996), Reconstruction of historical sea surface temperatures using empirical orthogonal functions, J. Clim., 9(6), 1403-1420.
40. Sturm, J. F. (1999), Using SeDuMi 1.02, a Matlab toolbox for optimization over symmetric cones, Optim. Methods Softw., 11(1), 625-653.
41. Tipping, M. E., and C. M. Bishop (1999), Probabilistic principal component analysis, J. R. Stat. Soc., Ser. B, 61(3), 611-622.
42. Tootle, G. A., and T. C. Piechota (2006), Relationships between Pacific and Atlantic ocean sea surface temperatures and U.S. streamflow variability, Water Resour. Res., 42, W07411, doi:10.1029/2005WR004184.
43. Tripathi, S., and R. S. Govindaraju (2008), Statistical forecasting of Indian summer monsoon rainfall: An enduring challenge, in Soft Computing Applications in Industry, edited by B. Prasad, pp. 207-224, Springer, Berlin, doi:10.1007/978-3-540-77465-5_11.
44. Wessels, L. F. A., M. J. T. Reinders, A. A. M. Hart, C. J. Veenman, H. Dai, Y. D. He, and L. J. van't Veer (2005), A protocol for building and evaluating predictors of disease state based on microarray data, Bioinformatics, 21(19), 3755-3762, doi:10.1093/bioinformatics/bti429.
45. Westra, S., C. Brown, U. Lall, and A. Sharma (2007), Modeling multivariable hydrological series: Principal component analysis or independent component analysis?, Water Resour. Res., 43, W06429, doi:10.1029/ 2006WR005617.
46. Worley, S. J., S. D. Woodruff, R. W. Reynolds, S. J. Lubker, and N. Lott (2005), ICOADS release 2.1 data and products, Int. J. Climatol., 25(7), 823-842, doi:10.1002/joc.1166.
47. Wyckoff, S. (1997), Doing Science: An Introduction to Physical Science [electronic], Ariz. State Univ., Tempe. (Available at http://acept.asu.edu/ courses/phs110/ds/toc.html)