The data big bang and the expanding digital universe: High-dimensional, complex and massive data sets in an inflationary Epoch

Advances in Astronomy

Volumn 2010, Issue , 2010, Pages

  Pesenson, Meyer Z ^a   Pesenson, Isaac Z ^b   McCollum, Bruce ^a  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b Temple University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77956133596     PISSN: 16877969     EISSN: 16877977     Source Type: Journal    
DOI: 10.1155/2010/350891     Document Type: Article

References (136)

1. York D., Adelman J., Anderson J., The Sloan digital sky survey: technical summary Astronomical Journal 2000 120 1579 1587
2. Tyson J., Roat C., Bosch J., Wittman D., Lewis J., Argyle R., Bunclark P., LSST and the dark sector: image processing challenges 394 Proceedings of the 17th Annual Conference on Astronomical Data Analysis Software and Systems (ADASS 08) 2008 London, UK ASP ASP Conference Series
3. Szalay A. S., Gray J., Van den Berg J., Petabyte scale data mining: dream or reality? 4836 Survey and Other Telescope Technologies and Discoveries 2002 333 338 Proceedings of SPIE
4. Perryman M. A. C., GAIA: an astrometric and photometric survey of our galaxy Astrophysics and Space Science 2002 280 1-2 1 10
5. Hodapp K. W., Kaiser N., Aussel H., Design of the Pan-STARRS telescopes Astronomische Nachrichten 2004 325 68 636 642
6. Price P., Magnier E., Hoblitt J., Processing petabytes for Pan-STARRS, AAS Meeting 210 Bulletin of the American Astronomical Society 2007 38 183
7. Law N. M., Kulkarni S. R., Dekany R. G., The palomar transient factory: system overview, performance, and first results Publications of the Astronomical Society of the Pacific 2009 121 886 1395 1408
8. Zhao G., Chen Y. Q., Shi J.-R., Stellar abundance and Galactic chemical evolution through LAMOST spectroscopic survey Chinese Journal of Astronomy and Astrophysics 2006 6 3 265 280
9. Djorgovski S. G., Baltay C., Mahabal A. A., The Palomar-Quest digital synoptic sky survey Astronomische Nachrichten 2008 329 3 263 265
10. Barden S. C., Armandroff T., Barden S., Performance of the WIYN fiber-fed MOS system: Hydra 2476 Fiber Optics in Astronomical Applications April 1995 Orlando, Fla, USA 56 67 Proceedings of SPIE
11. Bigelow B. C., Dressler A. M., Shectman S. A., Epps H. W., DOdorico S., IMACS: the multi-object spectrograph and imager for the Magellan I telescope 3355 Optical Astronomical Instrumentation 1998 225 231 Proceedings of SPIE
12. Lewis I. J., Cannon R. D., Taylor K., The Anglo-Australian observatory 2dF facility Monthly Notices of the Royal Astronomical Society 2002 333 2 279 298
13. Sharples R. M., Bender R., Lehnert M., Moorwood A. F. M., Masanori I., KMOS: an infrared multiple object integral field spectrograph for the ESO VLT 5492 Ground-Based Instrumentation for Astronomy 2004 1179 1186 Proceedings of SPIE
14. Mark Wagner R., McLean I. S., Masanori I., An overview of instrumentation for the Large Binocular Telescope 6269 Ground-Based and Airborne Instrumentation for Astronomy 2006 Proceedings of SPIE
15. Freeman K., Bland-Hawthorne J., Kodama T., Yamada T., Aoki K., Panoramic high resolution spectroscopy 399 Proceedings of the Panoramic Views of Galaxy Formation and Evolution 2008 439 ASP Conference Series
16. Eto S., Maihara T., Ohta K., Moorwood A. F. M., Masanori I., The fiber multi-object spectrograph (FMOS) for the Subaru Telescope III 5492 Ground-Based Instrumentation for Astronomy 2004 1314 1318 Proceedings of SPIE
17. Barden S. C., Dey A., Boyle B., Glazebrook K., Moorwood A. F. M., Masanori I., KAOS: kilo-aperture optical spectrograph 5492 Ground-Based Instrumentation for Astronomy June 2004 Glasgow, UK 364 372 Proceedings of SPIE
18. Ditto T. D., Ritter J. M., Atad-Ettedgui E., Lemke D., Million object spectrograph 7018 Advanced Optical and Mechanical Technologies in Telescopes and Instrumentation 2008 70182R.1 70182R.12 Proceedings of SPIE
19. Zaldarriaga M., Seljak U., All-sky analysis of polarization in the microwave background Physical Review D 1997 55 4 1830 1840
20. Frazin R., Jacob M., Manchester W., Morgan H., Wakin M., Toward reconstruction of coronal mass ejection density from only three points of view Astrophysical Journal 2009 695 1 636 641
21. Tegmark M., Zaldarriaga M., Fast Fourier transform telescope Physical Review D 2009 79 8
22. Loredo T., Accomazzi A., Bloom J., The astronomical information sciences: a keystone for 21st-century astronomy. submitted to the The Astronomy and Astrophysics Decadal Survey
23. Borne K., Kargupta H., Han J., Yu P. S., Motwani R., Kumar V., Scientific data mining in astronomy Next Generation of Data Mining 2009 CRC Press 91 114
24. Ferguson H., Greenfield P., Axelrod T., Astronomical data reduction and analysis for the next decade. submitted to the The Astronomy and Astrophysics Decadal Survey
25. Grand M., Patterns in Java v.1 1998 New York, NY, USA Addison-Wesley
26. Booch G., Rumbaugh J., Jacobson I., The Unified Modeling Language User Guide 2005 Reading, Mass, USA Addison-Wesley
27. Fayad M., Johnson R., Schmidt D., Building Application Frameworks: Object Oriented Foundations of Framework Design 1999 New York, NY, USA John Wiley Sons
28. Pesenson M., Roby W., McCollum B., Multiscale astronomical image processing based on nonlinear partial differential equations Astrophysical Journal 2008 683 1 566 576
29. France K., McCandliss S., Lupu R., A Cometary Bow Shock and Mid-Infrared Emission Variations Revealed in Spitzer Observations of HD 34078 and IC 405 The Astrophysical Journal 2007 655 2 920 939
30. Bovik A., Handbook of Image and Video Processing 2005 Amsterdam, The Netherlands Elsevier
31. Paragios N., Chen Y., Faugeras O., Handbook of Mathematical Models in Computer Vision 2006 Berlin, Germany Springer
32. Herbig G., The spectra of Be- and Ae-TYPE stars associated with nebulosity Astrophysical Journal Supplement 1960 4 337
33. Feigelson E. D., Montmerle T., High-energy processes in young stellar objects Annual Review of Astronomy and Astrophysics 1999 37 1 363 408
34. Clark D. H., Murdin P., An unusual emission-line star/X-ray source/radio star, possibly associated with an SNR Nature 1978 276 5683 44 45
35. Feldman P., Purton C., Stiff T., Kwok S., H-alpha-Emission Object SS 433. IAU Circulars, no. 3258, 1978
36. Margon B., Ford H., Katz J., The bizarre spectrum of SS 433 Astrophysical Journal 1979 230 L41 L45
37. Whitney B. A., Sewilo M., Indebetouw R., Spitzer sage survey of the large magellanic cloud. III. Star formation and 1000 new candidate young stellar objects The Astronomical Journal 2008 136 1 18 43
38. van der Veen W., Habing H., Geballe T., Objects in transition from the AGB to the planetary Nebula stage Astronomy Astrophysics 1989 226 108 136
39. van der Veen W., Habing H., Far evolved AGB stars in the galactic bulge Astronomy Astrophysics 1990 231 2 404 418
40. Finlator K., Ivezi Z., Fan X., Optical and infrared colors of stars observed by the Two Micron All Sky Survey and the Sloan Digital Sky Survey The Astronomical Journal 2000 120 5 2615 2626
41. Egan M. P., Van Dyk S. D., Price S. D., MSX, 2Mass, and the large magellanic cloud: a combined near- and mid-infrared view The Astronomical Journal 2001 122 4 1844 1860
42. Ortiz R., Lorenz-Martins S., Maciel W. J., Rangel E. M., Evolution from AGB to planetary nebula in the MSX survey Astronomy Astrophysics 2005 431 2 565 574
43. Ramirez S. V., Arendt R. G., Sellgren K., Point sources from a Spitzer IRAC survey of the galactic center Astrophysical Journal 2008 175 1 147 164
44. Munari U., Henden A., Kiyota S., The mysterious eruption of V838 Mon Astronomy Astrophysics 2002 389 2 L51 L56
45. Bond H. E., Henden A., Levay Z. G., An energetic stellar outburst accompanied by circumstellar light echoes Nature 2003 422 6930 405 408
46. Combi J. A., Albacete-Colombo J. F., Mart J., A new search strategy for microquasar candidates using NVSS/2MASS and XMM-Newton data Astronomy Astrophysics 2008 477 1 125 132
47. Brosche P., The manifold of galaxies. Galaxies with known dynamical parameters Astronomy Astrophysics 1973 23 259 268
48. Djorgovski S., Davis M., Fundamental properties of elliptical galaxies Astrophysical Journal 1987 313 59
49. Djorgovski S., Brunner R., Mahabal A., Williams R., Granat R., Stolorz P., Feigelson E., Babu G., Challenges for cluster analysis in a virtual observatory Statistical Challenges in Astronomy 2003 Berlin, Germany Springer 127 141
50. Haykin S., Neural Networks and Learning Machines 2009 Upper Saddle River, NJ, USA Prentice Hall
51. Ball N., Brunner R., Data mining and machine learning in astronomy International Journal of Modern Physics D 2009 18 17 1 53
52. Longo G., Donalek C., Raiconi G., Artificial intelligence tools for data mining in large astronomical databases Globular Clusters-Guides to Galaxies 2004 Berlin, Germany Springer 1431
53. Bellman R., Adaptive Control Processes 1961 Princeton, NJ, USA Princeton University Press
54. Scott D., Multivariate Density Estimation: Theory, Practice and Visualization 1992 New York, NY, USA John Wiley Sons Wiley Series in Probability and Mathematical Statistics
55. Matousek J., Lectures on Discrete Geometry 2002 New York, NY, USA Springer
56. Bijaoui A., Astronomical application of information compression Astronomy Astrophysics 1974 30 199
57. Borg I., Groenen P., Modern Multidimensional Scaling: Theory and Applications 2005 New York, NY, USA Springer
58. Boroson T. A., Green R. F., The emission-line properties of low-redshift quasi-stellar objects Astrophysical Journal 1992 80 1 109 135
59. Francis P. J., Hewett P. C., Foltz C. B., Chaffee F. H., An objective classification scheme for QSO spectra Astrophysical Journal 1992 398 2 476 490
60. Francis P., Wills B., Ferland G., Baldwin J., An introduction to PCA Quasars and Cosmology 1999 162 San Francisco, Calif, USA ASP 363 ASP Conference Series
61. Connolly A. J., Csabai I., Szalay A. S., Koo D. C., Kron R. G., Munn J. A., Slicing through multicolor space: galaxy redshifts from broadband photometry The Astronomical Journal 1995 110 6 2655 2664
62. Glazebrook K., Offer A. R., Deeley K., Automatic redshift determination by use of principal component analysis. I. Fundamentals Astrophysical Journal 1998 492 1 98 109
63. Yip C. W., Connolly A. J., Vanden Berk D. E., Spectral classification of quasars in the sloan digital sky survey: eigenspectra, redshift, and luminosity effects The Astronomical Journal 2004 128 6 2603 2630
64. Wild V., Hewett P. C., Peering through the OH forest: a new technique to remove residual sky features from sloan digital sky survey spectra Monthly Notices of the Royal Astronomical Society 2005 358 3 1083 1099
65. Wild V., Kauffmann G., Heckman T., Bursty stellar populations and obscured active galactic nuclei in galaxy bulges Monthly Notices of the Royal Astronomical Society 2007 381 2 543 572
66. Kuraszkiewicz J., Wilkes B., Schmidt G., Smith P., Principal component analysis of the spectral energy distribution and emission line properties of red 2Mass active galactic nuclei Astrophysical Journal 2009 692 2 1180 1189
67. Gross J., Yellen J., Handbook of Graph Theory 2004 Boca Raton, Fla, USA CRC Press
68. Chung F., Spectral graph theory Conference Board of the Mathematical Sciences 1997 Providence, RI, USA American Mathematical Society
69. Pesenson I., Poincar-type inequalities and reconstruction of Paley-Wiener functions on manifolds Journal of Geometric Analysis 2004 14 1 101 121
70. Pesenson I., An approach to spectral problems on Riemannian manifolds Pacific Journal of Mathematics 2004 215 1 183 199
71. Pesenson I., Variational splines on Riemannian manifolds with applications to integral geometry Advances in Applied Mathematics 2004 33 3 548 572
72. Pesenson I., Band limited functions on quantum graphs Proceedings of the American Mathematical Society 2005 133 12 3647 3655
73. Pesenson I., Polynomial splines and eigenvalue approximations on quantum graphs Journal of Approximation Theory 2005 135 2 203 220
74. Pesenson I., Analysis of band-limited functions on quantum graphs Applied and Computational Harmonic Analysis 2006 21 2 230 244
75. Pesenson I., Frames for spaces of Paley-Wiener functions on Riemannian manifolds, integral geometry and tomography Contemporary Mathematics 2006 405 Providence, RI, USA American Mathematical Society 135 148
76. Pesenson I., Sampling in Paley-Wiener spaces on combinatorial graphs Transactions of the American Mathematical Society 2008 360 10 5603 5627
77. Pesenson I., Variational splines and Paley-Wiener spaces on combinatorial graphs Constructive Approximation 2009 29 1 1 21
78. Pesenson I., Paley-Wiener approximations and multiscale approximations in Sobolev and Besov spaces onmanifolds Journal of Geometric Analysis 2009 19 2 390 419
79. Pesenson I., Pesenson M., Sampling of bandlimited functions on combinatorial graphs Proceedings of the 8th International Conference on Sampling Theory and Applications 2009 Marseille, France
80. Pesenson M., Pesenson I., McCollum B., Facing the Curse of Dimensionality: image fusion and nonlinear dimensionality reduction for advanced data mining and visualization of astronomical images Proceedings of the 214th AAS Meeting 2009
81. Pesenson I., Pesenson M., Eigenmaps, minimal and bandlimited immersions of graphs into Euclidean spaces Journal of Mathematical Analysis and Applications 2010 366 1 137 152
82. Zhou D., Huang J., Scholkopf B., Beyond pairwise classification and clustering using hypergraphs 2005 143 Tubingen, Germany Max Plank Institute for Biological Cybernetics
83. Ihler E., Wagner D., Wagner F., Modeling hypergraphs by graphs with the same min cut properties Information Processing Letters 1993 45 4 171 175
84. Mabdelbrot B., Fractal Geometry of Nature 1977 New York, NY, USA W.H. Freeman
85. Schroeder M., Fractals, Chaos, Power Laws 1991 New York, NY, USA W. H. Freeman
86. Faloutsos C., Next generation data mining tools: power laws and self-similarity for graphs, streams and traditional data 2838 Proceedings of the 7th European Conference on Principles and Practice of Knowledge Discovery in Databases 2003 10 15 Lecture Notes in Artificial Intelligence
87. Elmegreen B. G., Elmegreen D. M., Fractal structure in galactic star fields The Astronomical Journal 2001 121 3 1507 1511
88. Larson R., Towards understanding the stellar initial mass function Monthly Notices of the Royal Astronomical Society 1992 256 4 641 646
89. Einasto J., Einasto M., Gramann M., Saar E., Structure and formation of superclusters. XIIIthe void probability function Monthly Notices of the Royal Astronomical Society 1991 248 593
90. Kurokawa T., Morikawa M., Mouri H., Scaling analysis of galaxy distribution in the Las Campanas Redshift Survey data Astronomy Astrophysics 2001 370 2 358 364
91. Bottorff M., Ferland G., Fractal quasar clouds Astrophysical Journal 2001 549 1 118 132
92. de Gouveia dal Pino E. M., Elisabete M., Hetem A., Evidence for a very large scale fractal structure in the universe from COBE measurements Astrophysical Journal 1995 442 2 L45 L48
93. Ghezzi C. R., de Gouveia dal Pino E. M., Horvath J. E., Asymmetric explosions of thermonuclear supernovae Monthly Notices of the Royal Astronomical Society 2004 348 2 451 457
94. Elmegreen B. G., Falgarone E., A fractal origin for the mass spectrum of interstellar clouds Astrophysical Journal 1996 471 2 816 821
95. Balasubramanian M., Schwartz E. L., The isomap algorithm and topological stability Science 2002 295 5552 7a
96. Budavri T., Wild V., Szalay A. S., Dobos L., Yip C.-W., Reliable eigenspectra for new generation surveys Monthly Notices of the Royal Astronomical Society 2009 394 3 1496 1502
97. Horn D., Gottlieb A., Algorithm for data clustering in pattern recognition problems based on quantum mechanics Physical Review Letters 2002 88 1 4
98. Pesenson M., Pesenson I., Image segmentation, unsupervised manifold learning and information visualization: a unified approach based on nonlinear dynamics. submitted
99. Kuramoto Y., Chemical Oscillations, Waves and Turbulence 1984 Berlin, Germany Springer
100. Pikovsky A., Rosenblum M., Kurths J., Synchronization 2001 Cambridge, UK Cambridge University Press
101. Ware C., Bobrow R., Supporting visual queries on medium sized node-link diagrams ACM Transactions on Applied Perception 2004 1 3 18
102. Bertin E., Arnouts S., SExtractor: software for source extraction Astronomy Astrophysics 1996 117 2 393 404
103. Goodman J., ORourke J., Handbook of Discrete and Computational Geometry 2004 Chapman Hall/CRC Discrete Mathematics and Its Applications
104. Feigelson E., Babu J., Statistical Challenges in Astronomy 2003 Berlin, Germany Springer
105. Silk J., Feigelson E. D., Babu G. J., An astronomers perspective on SCMA III Statistical Challenges in Astronomy, III 2003 New York, NY, USA Springer 387
106. Gorski M., Hivon E., Banday A. J., HEALPix: a framework for high-resolution discretization and fast analysis of data distributed on the sphere Astrophysical Journal 2005 622 2 759 771
107. Pietrobon D., Balbi A., Marinucci D., Integrated Sachs-Wolfe effect from the cross correlation of WMAP 3 year and the NRAO VLA sky survey data: New results and constraints on dark energy Physical Review D-Particles, Fields, Gravitation and Cosmology 2006 74 4
108. Baldi P., Kerkyacharian G., Marinucci D., Picard D., High frequency asymptotics for wavelet-based tests for Gaussianity and isotropy on the torus Journal of Multivariate Analysis 2008 99 4 606 636
109. Marinucci D., Pietrobon D., Balbi A., Spherical needlets for cosmic microwave background data analysis Monthly Notices of the Royal Astronomical Society 2008 383 2 539 545
110. Fa G., Guilloux F., Betoule M., Cardoso J.-F., Delabrouille J., Le Jeune M., CMB power spectrum estimation using wavelets Physical Review D 2008 78 8
111. Pietrobon D., Amblard A., Balbi A., Cabella P., Cooray A., Marinucci D., Needlet detection of features in the WMAP CMB sky and the impact on anisotropies and hemispherical asymmetries Physical Review D 2008 78 10
112. Geller D., Marinucci D., Spin wavelets on the sphere. http://arxiv.org/abs/0811.2935
113. Geller D., Hansen F. K., Marinucci D., Kerkyacharian G., Picard D., Spin needlets for cosmic microwave background polarization data analysis Physical Review D 2008 78 12
114. Geller D., Mayeli A., Continuous wavelets on compact manifolds Mathematische Zeitschrift 2009 262 4 895 927
115. Pesenson I., Lagrangian splines, spectral entire functions and Shannon-Whittaker theorem on manifolds Temple University Research Report 1995 95/87
116. Pesenson I., A sampling theorem on homogeneous manifolds Transactions of the American Mathematical Society 2000 352 9 4257 4269
117. Geller D., Pesenson I., Band-limited localized Parseval frames and Besov spaces on compact homogeneous manifolds. to appear in Journal of Geometric Analysis
118. Starck J.-L., Murtagh F., Bijaoui A., Image Processing and Data Analysis: The Multiscale Approach 1998 Cambridge, UK Cambridge University Press
119. Starck J.-L., Murtagh F., Astronomical Image and Data Analysis 2002 Berlin, Germany Springer
120. Belkin M., Niyogi P., Towards a theoretical foundation for Laplacian-based manifold methods Learning Theory 2005 3559 Berlin, Germany Springer 486 500 Lecture Notes in Computer Science
121. Coifman R. R., Lafon S., Diffusion maps Applied and Computational Harmonic Analysis 2006 21 1 5 30
122. Lafon S., Lee A. B., Diffusion maps and coarse-graining: a unified framework for dimensionality reduction, graph partitioning, and data set parameterization IEEE Transactions on Pattern Analysis and Machine Intelligence 2006 28 9 1393 1403
123. Richards J., Freeman P., Lee A., Schafer C., Exploiting low-dimensional structure in astronomical spectra Astrophysical Journal 2009 691 32 42
124. Tenenbaum J. B., de Silva V., Langford J. C., A global geometric framework for nonlinear dimensionality reduction Science 2000 290 5500 2319 2323
125. Roweis S. T., Saul L. K., Nonlinear dimensionality reduction by locally linear embedding Science 2000 290 5500 2323 2326
126. DAbrusco R., Staiano A., Longo G., Mining the SDSS archive. I. Photometric redshifts in the nearby universe Astrophysical Journal 2007 663 2 752 764
127. DAbrusco R., Longo G., Walton N. A., Quasar candidates selection in the Virtual Observatory era Monthly Notices of the Royal Astronomical Society 2009 396 1 223 262
128. Pasian F., Becciani U., Cassisi S., VObs.itthe Italian Virtual Observatory Highlights of Astronomy 2007 14 631
129. Comparato M., Becciani U., Costa A., Visualization, exploration, and data analysis of complex astrophysical data Publications of the Astronomical Society of the Pacific 2007 119 858 898 913
130. Draper P., Currie M., Jenness T., Shaw R., Hill F., Bell D., GAIA 3D; visualizing data cubes 376 Proceedings of the 16th Annual Conference on Astronomical Data Analysis Software and Systems (ADASS 07) 2007 Tucson, Ariz, USA 695 698 ASP Conference Series
131. Borkin M., Goodman A., Halle M., Shaw R., Hill F., Bell D., Application of medical imaging software to 3D visualization of astronomical data 376 Proceedings of the 16th Annual Conference on Astronomical Data Analysis Software and Systems (ADASS 07) 2007 Tucson, Ariz, USA 621 624 ASP Conference Series
132. Chan W. L., Charan K., Takhar D., Kelly K. F., Baraniuk R. G., Mittleman D. M., A single-pixel terahertz imaging system based on compressed sensing Applied Physics Letters 2008 93 12
133. Bobin J., Starck J.-L., Ottensamer R., Compressed sensing in astronomy IEEE Journal on Selected Topics in Signal Processing 2008 2 5 718 726
134. Candes E. J., Wakin M. B., An introduction to compressive sampling IEEE Signal Processing Magazine 2008 25 2 21 30
135. Romberg J., Imaging via compressive sampling IEEE Signal Processing Magazine 2008 25 2 14 20
136. Wiaux Y., Jacques L., Puy G., Scaife A. M. M., Vandergheynst P., Compressed sensing imaging techniques for radio interferometry Monthly Notices of the Royal Astronomical Society 2009 395 3 1733 1742