Computational intelligence challenges and applications on large-scale astronomical time series databases

IEEE Computational Intelligence Magazine

Volumn 9, Issue 3, 2014, Pages 27-39

  Huijse, Pablo ^a   Estevez, Pablo A ^b   Protopapas, Pavlos ^c   Principe, Jose C ^d   Zegers, Pablo ^e  

^a MILLENNIUM INSTITUTE OF ASTROPHYSICS   (Chile)

^b UNIVERSITY OF CHILE   (Chile)

^c HARVARD UNIVERSITY   (United States)

^d UNIVERSITY OF FLORIDA   (United States)

^e UNIVERSIDAD DE LOS ANDES   (Chile)

Author keywords

[No Author keywords available]

Indexed keywords

ASTROPHYSICS; BIG DATA; LEARNING SYSTEMS; SURVEYS;

ASTRONOMICAL DATA; ASTROPHYSICAL OBJECTS; DATA GENERATION; EXPONENTIAL GROWTH; INTERDISCIPLINARY COLLABORATIONS; LARGE SYNOPTIC SURVEY TELESCOPES; SOUTHERN HEMISPHERE; TIME SERIES DATABASE;

ARTIFICIAL INTELLIGENCE;

EID: 84904605380     PISSN: 1556603X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCI.2014.2326100     Document Type: Article

References (65)

1. C. Alcock, R. A. Allsman, D. R. Alves, T. S. Axelrod, A. C. Becker, D. P. Bennett, K. H. Cook, N. Dalal, A. J. Drake, K. C. Freeman, M. Geha, K. Griest, M. J. Lehner, S. L. Marshall, D. Minniti, C. A. Nelson, B. A. Peterson, P. Popowski, M. R. Pratt, P. J. Quinn, C. W. Stubbs, W. Sutherland, A. B. Tomaney, T. Vandehei, and D. Welch, "The MACHO project: Microlensing results from 5.7 years of LMC observations," Astrophys. J., vol. 542, no. 1, pp. 281-307, 2000.
2. Y. R. Rahal, C. Afonso, J.-N. Albert, J. Andersen, R. Ansari, E. Aubourg, P. Bareyre, J.-P. Beaulieu, X. Charlot, F. Couchot, C. Coutures, F. Derue, R. Ferlet, P. Fouqué, J.-F. Glicenstein, B. Goldman, A. Gould, D. Graff, M. Gros, J. Haissinski, C. Hamadache, J. de Kat, E. Lesquoy, C. Loup, L. L. Guillou, C. Magneville, B. Mansoux, J.-B. Marquette, E. Maurice, A. Maury, A. Milsztajn, M. Moniez, N. Palanque-Delabrouille, O. Perdereau, S. Rahvar, J. Rich, M. Spiro, P. Tisserand, A. Vidal-Madjar, "The EROS-2 search for microlensing events towards the spiral arms: The complete seven season results," Astron. Astrophys., vol. 500, no. 3, pp. 1027-1044, 2009.
3. A. Udalski, M. Kubiak, and M. Szymanski, "Optical gravitational lensing experiment. OGLE-II-The second phase of the OGLE project," Acta Astron., vol. 47, pp. 319-344, Oct. 1997. (Pubitemid 127777736)
4. D. G. York, J. Adelman, J. E. Anderson, Jr., S. F. Anderson, J. Annis, N. A. Bahcall, J. A. Bakken, R. Barkhouser, S. Bastian, E. Berman, W. N. Boroski, S. Bracker, C. Briegel, J. W. Briggs, J. Brinkmann, R. Brunner, S. Burles, L. Carey, M. A. Carr, F. J. Castander, B. Chen, P. L. Colestock, A. J. Connolly, J. H. Crocker, I. Csabai, P. C. Czarapata, J. E. Davis, M. Doi1, T. Dombeck, D. Eisenstein, N. Ellman, B. R. Elms, M. L. Evans, X. Fan, G. R. Federwitz, L. Fiscelli, S. Friedman, J. A. Frieman, M. Fukugita, B. Gillespie, J. E. Gunn, V. K. Gurbani, E. de Haas, M. Haldeman, F. H. Harris, J. Hayes, T. M. Heckman, G. S. Hennessy, R. B. Hindsley, S. Holm, D. J. Holmgren, C.-H. Huang, C. Hull, D. Husby, S.-I. Ichikawa, T. Ichikawa, Ž. Ivezić, S. Kent, R. S. J. Kim, E. Kinney, M. Klaene, A. N. Kleinman, S. Kleinman, G. R. Knapp, J. Korienek, R. G. Kron, P. Z. Kunszt, D. Q. Lamb, B. Lee, R. F. Leger, S. Limmongkol, C. Lindenmeyer, D. C. Long, C. Loomis, J. Loveday, R. Lucinio, R. H. Lupton, B. MacKinnon, E. J. Mannery, P. M. Mantsch, B. Margon, P. McGehee, T. A. McKay, A. Meiksin, A. Merelli, D. G. Monet, J. A. Munn, V. K. Narayanan, T. Nash, E. Neilsen, R. Neswold, H. J. Newberg, R. C. Nichol, T. Nicinski, M. Nonino, N. Okada, S. Okamura, J. P. Ostriker, R. Owen, A. G. Pauls, J. Peoples, R. L. Peterson, D. Petravick, J. R. Pier, A. Pope, R. Pordes, A. Prosapio, R. Rechenmacher, T. R. Quinn, G. T. Richards, M. W. Richmond, C. H. Rivetta, C. M. Rockosi, K. Ruthmansdorfer, D. Sandford, D. J. Schlegel, D. P. Schneider, M. Sekiguchi, G. Sergey, K. Shimasaku, W. A. Siegmund, S. Smee, J. A. Smith, S. Snedden, R. Stone, C. Stoughton, M. A. Strauss, C. Stubbs, M. SubbaRao, A. S. Szalay, I. Szapudi, G. P. Szokoly, A. R. Thakar, C. Tremonti, D. L. Tucker, A. Uomoto, D. V. Berk, M. S. Vogeley, P. Waddell, S.-I. Wang, M. Watanabe, D. H. Weinberg, B. Yanny, and N. Yasuda, "The sloan digital sky survey: Technical summary," Astron. J., vol. 120, no. 3, pp. 1579-1587, 2000.
5. N. Kaiser, H. Aussel, B. E. Burke, H. Boesgaard, K. Chambers, M. R. Chun, J. N. Heasley, K.-W. Hodapp, B. Hunt, R. Jedicke, D. Jewitt, R. Kudritzki, G. A. Luppino, M. Maberry, E. Magnier, D. G. Monet, P. M. Onaka, A. J. Pickles, Rhoads, H. H. Pui, T. Simon, A. Szalay, I. Szapudi, D. J. Tholen, J. L. Tonry, M. Waterson, and J. Wick, "Pan-STARRS: A large synoptic survey telescope array," in Proc. Society Photo-Optical Instrumentation Engineers Conf. Series, 2002, vol. 4836, pp. 154-164.
6. S. Larson, E. Beshore, R. Hill, E. Christensen, D. McLean, S. Kolar, R. McNaught, and G. Garradd, "The CSS and SSS NEO surveys," in Proc. AAS/Division for Planetary Sciences Meeting Abstracts #35, Bulletin of the American Astronomical Society, May 2003, vol. 35, p. 982.
7. J. Tyson and K. Borne, "Future sky surveys, new discovery frontiers," in Advances in Machine Learning and Data Mining for Astronomy, M. Way, J. D. Scargle, K. Ali, and A. Srivastava, Eds. Boca Raton, FL: CRC Press, 2012, ch. 9, pp. 161-181.
8. Z. Ivezic, J. A. Tyson, E. Acosta, R. Allsman, S. F. Anderson, J. Andrew, R. Angel, T. Axelrod, J. D. Barr, A. C. Becker, J. Becla, C. Beldica, R. D. Blandford, J. S. Bloom, K. Borne, W. N. Brandt, M. E. Brown, J. S. Bullock, D. L. Burke, S. Chandrasekharan, S. Chesley, C. F. Claver, A. Connolly, K. H. Cook, A. Cooray, K. R. Covey, C. Cribbs, R. Cutri, G. Daues, F. Delgado, H. Ferguson, E. Gawiser, J. C. Geary, P. Gee, M. Geha, R. R. Gibson, D. K. Gilmore, W. J. Gressler, C. Hogan, M. E. Huffer, S. H. Jacoby, B. Jain, J. G. Jernigan, R. L. Jones, M. Juric, S. M. Kahn, J. S. Kalirai, J. P. Kantor, R. Kessler, D. Kirkby, L. Knox, V. L. Krabbendam, S. Krughoff, S. Kulkarni, R. Lambert, D. Levine, M. Liang, K-T. Lim, R. H. Lupton, P. Marshall, S. Marshall, M. May, M. Miller, D. J. Mills, D. G. Monet, D. R. Neill, M. Nordby, P. O'Connor, J. Oliver, S. S. Olivier, K. Olsen, R. E. Owen, J. R. Peterson, C. E. Petry, F. Pierfederici, S. Pietrowicz, R. Pike, P. A. Pinto, R. Plante, V. Radeka, A. Rasmussen, S. T. Ridgway, W. Rosing, A. Saha, T. L. Schalk, R. H. Schindler, D. P. Schneider, G. Schumacher, J. Sebag, L. G. Seppala, I. Shipsey, N. Silvestri, J. A. Smith, R. C. Smith, M. A. Strauss, C. W. Stubbs, D. Sweeney, A. Szalay, J. J. Thaler, D. V. Berk, L. Walkowicz, M. Warner, B. Willman, D. Wittman, S. C. Wolff, W. M. Wood-Vasey, P. Yoachim, and H. Zhan. (June 2011). LSST: From science drivers to reference design and anticipated data products. ArXiv e-prints. [Online]. Available: http://www.lsst.org/lsst/overview/
9. LSST Science Collaborations and LSST Project 2009. (2013). LSST science book. Version 2.0, arXiv:0912.0201. [Online]. Available: http://www.lst.org/ lsst/scibook
10. K. Borne, "Virtual observatories, data mining and astroinformatics," in Planets, Stars and Stellar Systems. Astronomical Techniques, Software, and Data, vol. 2, T. Oswalt and H. Bond, Eds. New York: Wiley, 2013, pp. 404-443.
11. K. Borne. (2012). Learning from big data in astronomy-An overview. [Online]. Available: http://www.samsi.info/sites/default/files/Borne- september2012.pdf
12. E. Feigelson and G. Babu, "Big data in astronomy," Significance, vol. 9, no. 4, pp. 22-25, 2012.
13. K. Borne, "Astroinformatics: Data-oriented astronomy research and education," J. Earth Sci. Inform., vol. 3, nos. 1-2, pp. 5-17, 2010.
14. M. Petit, Variable Stars. Reading, MA: New York: Wiley, 1987.
15. J. Percy, Understanding Variable Stars. Cambridge, U.K.: Cambridge Univ. Press, 2007.
16. L. Eyer and N. Mowlavi, "Variable stars across the observational HR diagram," J. Phys.: Conf. Ser., vol. 118, no. 1, p. 012010, 2008.
17. N. Samus, O. V. Durlevich, E. V. Kazarovets, N. N. Kireeva, E. N. Pastukhova, and A. V. Zharova, "General catalogue of variable stars," (Samus+ 2007-2012), VizieR On-line Data Catalog: B/gcvs, 2012.
18. A. Walker, "Distances to local group galaxies," in Stellar Candles for the Extragalactic Distance Scale (Lecture Notes in Physics, vol. 635), D. Alloin and W. Gieren, Eds. Berlin Heidelberg, Germany: Springer-Verlag, 2003, pp. 265-279.
19. F. E. Olivares and M. Hamuy, Core-Collapse Supernovae As Standard Candles. Germany: Lambert Academic Publishing, 2011.
20. D. Popper, "Stellar masses," Annu. Rev. Astron. Astrophys., vol. 18, no. 1, pp. 115-164, 1980.
21. P. Huijse, P. A. Estevez, P. Protopapas, P. Zegers, and J. C. Principe, "An information theoretic algorithm for finding periodicities in stellar light curves," IEEE Trans. Signal Process., vol. 60, no. 10, pp. 5135-5145, 2012.
22. J. Principe, Information Theoretic Learning: Renyi's Entropy and Kernel Perspectives. New York: Springer-Verlag, 2010.
23. J. Scargle, "Studies in astronomical time series analysis. II. Statistical aspects of spectral analysis of unevenly spaced data," Astrophys. J., vol. 263, pp. 835-853, Dec. 1982.
24. P. Protopapas, P. Huijse, P. A. Estévez, J. Principe, and P. Zegers, "A novel, fully automated pipeline for period estimation in the EROS-2 data set," Astrophys. J., 2014, to be published.
25. M. J. Graham, A. J. Drake, S. G. Djorgovski, A. A. Mahabal, and C. Donalek, "Using conditional entropy to identify periodicity," Mon. Not. Roy. Astron. Soc., vol. 434, pp. 2629-2635, Sept. 2013.
26. R. Tagliaferri, A. Ciaramella, L. Milano, F. Barone, and G. Longo, "Spectral analysis of stellar light curves by means of neural networks," Astron. Astrophys. Suppl. Ser., vol. 137, no. 2, pp. 391-405, 1999.
27. M. J. Graham, A. J. Drake, S. G. Djorgovski, A. A. Mahabal, C. Donalek, V. Duan, and A. Maher, "A comparison of period finding algorithms," Mon. Not. Roy. Astron. Soc., vol. 434, pp. 3423-3444, Oct. 2013.
28. J. Debosscher, L. M. Sarro, C. Aerts, J. Cuypers, B. Vandenbussche, R. Garrido, and E. Solano, "Automated supervised classification of variable stars. I. Methodology," Astron. Astrophys., vol. 475, no. 3, pp. 1159-1183, 2007. (Pubitemid 350190715)
29. J. Blomme, L. M. Sarro, F. T. O'Donovan, J. Debosscher, T. Brown, M. Lopez, P. Dubath, L. Rimoldini, D. Charbonneau, E. Dunham, G. Mandushev, D. R. Ciardi, J. de Ridder, and C. Aerts, "Improved methodology for the automated classification of periodic variable stars," Mon. Not. Roy. Astron. Soc., vol. 418, no. 1, pp. 96-106, 2011.
30. G. Wachman, R. Khardon, P. Protopapas, and C. Alcock, "Kernels for periodic time series arising in astronomy," in Proc. European Conf. Machine Learning Knowledge Discovery Databases: Part II, (Bled, Slovenia), 2009, pp. 489-505.
31. P. Dubath, L. Rimoldini, M. Suveges, J. Blomme, M. Lopez, L. M. Sarro, J. de Ridder, J. Cuypers, L. Guy, I. Lecoeur, K. Nienartowicz, A. Jan, M. Beck, N. Mowlavi, P. de Cat, T. Lebzelter, and L. Eyer, "Random forest automated supervised classification of hipparcos periodic variable stars," Mon. Not. Roy. Astron. Soc., vol. 414, no. 3, pp. 2602-2617, 2011.
32. J. Long, J. Bloom, N. Karoui, J. Rice, and J. Richards, "Classification of poorly time sampled light curves of periodic variable stars," in Astrostatistics and Data Mining (Springer Series in Astrostatistics, vol. 2), L. M. Sarro, L. Eyer, W. O'Mullane, and J. de Ridder, Eds. New York: Springer-Verlag, 2012, pp. 163-171.
33. D.-W. Kim, P. Protopapas, Y.-I. Byun, C. Alcock, R. Khardon, and M. Trichas, "Quasi-stellar object selection algorithm using time variability and machine learning: Selection of 1620 quasi-stellar object candidates from MACHO large magellanic cloud database," Astrophys. J., vol. 735, p. 68, July 2011.
34. J. W. Richards, D. L. Starr, N. R. Butler, J. S. Bloom, J. M. Brewer, A. Crellin-Quick, J. Higgins, R. Kennedy, and M. Rischard, "On machine-learned classification of variable stars with sparse and noisy time-series data," Astrophys. J., vol. 733, no. 1, p. 10, 2011.
35. K. Pichara and P. Protopapas, "Automatic classification of variable stars in catalogs with missing data," Astrophys. J., vol. 777, no. 2, p. 83, 2013.
36. M. Hernandez-Pajares and J. Floris, "Classification of the HIPPARCOS input catalogue using the Kohonen network," Mon. Not. Roy. Astron. Soc., vol. 268, p. 444, May 1994.
37. D. R. Brett, R. G. West, and P. J. Wheatley, "The automated classification of astronomical light curves using Kohonen self-organizing maps," Mon. Not. Roy. Astron. Soc., vol. 353, pp. 369-376, Sept. 2004. (Pubitemid 39234252)
38. L. M. Sarro, J. Debosscher, C. Aerts, and M. López, "Comparative clustering analysis of variable stars in the Hipparcos, OGLE Large Magellanic Cloud, and CoRoT exoplanet databases," Astron. Astrophys., vol. 506, pp. 535-568, Oct. 2009.
39. A. Torralba, R. Fergus, and W. Freeman, "80 million tiny images: A large data set for nonparametric object and scene recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, pp. 1958-1970, Nov. 2008.
40. C. Varón, C. Alzate, J. A. K. Suykens, and J. Debosscher, "Kernel spectral clustering of time series in the CoRoT exoplanet database," Astron. Astrophys., vol. 531, p. A156, July 2011.
41. A. C. Fabian, "Serendipity in astronomy," ArXiv e-prints, Aug. 2009.
42. P. Protopapas, J. M. Giammarco, L. Faccioli, M. F. Struble, R. Dave, and C. Alcock, "Finding outlier light curves in catalogues of periodic variable stars," Mon. Not. Roy. Astron. Soc., vol. 369, no. 2, pp. 677-696, 2006. (Pubitemid 43856627)
43. D. Yankov, E. Keogh, and U. Rebbapragada, "Disk aware discord discovery: Finding unusual time series in terabyte sized datasets," Knowl. Inform. Syst., vol. 17, no. 2, pp. 241-262, 2008.
44. U. Rebbapragada, P. Protopapas, C. E. Brodley, and C. Alcock, "Finding anomalous periodic time series: An application to catalogs of periodic variable stars," Mach. Learn., vol. 74, pp. 281-313, May 2009.
45. J. W. Richards, D. Homrighausen, P. E. Freeman, C. M. Schafer, and D. Poznanski, "Semi-supervised learning for photometric supernova classification," Mon. Not. Roy. Astron. Soc., vol. 419, pp. 1121-1135, Jan. 2012.
46. J. W. Richards, D. L. Starr, H. Brink, A. A. Miller, J. S. Bloom, N. R. Butler, J. B. James, J. P. Long, and J. Rice, "Active learning to overcome sample selection bias: Application to photometric variable star classification," Astrophys. J., vol. 744, p. 192, Jan. 2012.
47. C. Donalek, S. G. Djorgovski, A. A. Mahabal, M. J. Graham, A. J. Drake, T. J. Fuchs, M. J. Turmon, A. A. Kumar, N. S. Philip, M.T.-C. Yang, and G. Longo, "Feature selection strategies for classifying high dimensional astronomical data sets," in Proc. IEEE Int. Conf. Big Data, Oct. 2013, pp. 35-41.
48. J. Vergara and P. A. Estévez, "A review of feature selection methods based on mutual information," Neural Comput. Applicat., vol. 24, no. 1, pp. 175-186, 2014.
49. S. G. Djorgovski, C. Donalek, A. Mahabal, R. Williams, A. Drake, M. Graham, and E. Glikman, "Some pattern recognition challenges in data-intensive astronomy," in Proc. 18th Int. Conf. Pattern Recognition, 2006, p. 865.
50. M. J. Graham, S. G. Djorgovski, A. Mahabal, C. Donalek, A. Drake, G. Longo, "Data challenges of time domain astronomy," Distrib. Parallel Databases, vol. 30, no. 5, pp. 371-384, 2012.
51. S. G. Djorgovski, C. Donalek, A. Mahabal, B. Moghaddam, M. Turmon, M. J. Graham, A. J. Drake, N. Sharma, and Y. Chen, "Towards an automated classification of transient events in synoptic sky surveys," in Proc. CIDU, NASA Ames, 2011, pp. 174-188.
52. W. B. March, A. Ozakin, D. Lee, R. Riegel, and A. G. Gray, "Multitree algorithms for large-scale astrostatistics," in Advances in Machine Learning and Data Mining for Astronomy, M. J. Way, J. D. Scargle, K. M. Ali, and A. N. Srivastava, Eds. Boca Raton, FL: CRC Press, 2012, pp. 463-483.
53. G. V. Kulkarni, R. C. Nichol, R. K. Sheth, H.-J. Seo, D. J. Eisenstein, and A. Gray, "The three-point correlation function of luminous red galaxies in the sloan digital sky survey," Mon. Not. Roy. Astron. Soc., vol. 378, pp. 1196-1206, July 2007.
54. Y. Bengio and Y. LeCun, "Scaling learning algorithms towards AI," in Large Scale Kernel Machines, L. Bottou, O. Chapelle, D. DeCoste, and J. Weston, Eds. Cambridge, MA: MIT Press, 2007.
55. G. E. Hinton and S. Osindero, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006. (Pubitemid 44024729)
56. J. Fan, F. Han, and H. Liu, "Challenges of big data analysis," ArXiv e-prints, Aug. 2013.
57. K. Das and K. Bhaduri, "Parallel and distributed data mining for astronomy applications," in Advances in Machine Learning and Data Mining for Astronomy, M. J. Way, J. D. Scargle, K. M. Ali, and A. N. Srivastava, Eds. Boca Raton, FL: CRC Press, 2012, pp. 595-615.
58. V. Kindratenko and P. Trancoso, "Trends in high-performance computing," Comput. Sci. Eng., vol. 13, no. 3, pp. 92-95, 2011.
59. D. Sart, A. Mueen, W. Najjar, E. Keogh, and V. Niennattrakul, "Accelerating dynamic time warping subsequence search with GPUs and FPGAs," in Proc. IEEE Int. Conf. Data Mining, Dec. 2010, pp. 1001-1006.
60. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in Proc. 6th Conf. Symp. Opearting Systems Design Implementation, USENIX Association, Berkeley, CA, 2004, vol. 6, pp. 10-10.
61. C. T. Chu, S. K. Kim, Y. A. Lin, Y. Yu, G. R. Bradski, A. Y. Ng, and K. Olukotun, "Map-reduce for machine learning on multicore," in Neural Information Processing Systems, B. Schölkopf, J. C. Platt, and T. Hoffman, Eds. Cambridge, MA: MIT Press, 2006, pp. 281-288.
62. G. B. Berriman, E. Deelman, G. Juve, M. Regelson, and P. Plavchan, "The application of cloud computing to astronomy: A study of cost and performance," ArXiv e-prints, Oct. 2010.
63. K. Wiley, A. Connolly, J. Gardner, S. Krughoff, M. Balazinska, B. Howe, Y. Kwon, and Y. Bu, "Astronomy in the cloud: Using MapReduce for image co-addition," Publications Astron. Soc. Pacific, vol. 123, pp. 366-380, Mar. 2011.
64. W. Pedrycz, A. Skowron, and V. Kreinovich, Handbook of Granular Computing. New York: Wiley, 2008.
65. G. Greene, T. Budavari, N. Li, M. Nieto-Santisteban, A. Szalay, and A. Thakar, "Chapter 13: Web-based tools-Open SkyQuery: Distributed database queries and crossmatching," in Astronomical Society of the Pacific Conference Series, vol. 382, M. J. Graham, M. J. Fitzpatrick, and T. A. McGlynn, Eds. San Francisco, CA: Astron. Soc. Pacific, 2007, p. 111.