Stable and efficient gaussian process calculations

Journal of Machine Learning Research

Volumn 10, Issue , 2009, Pages 857-882

  Foster, Leslie ^a   Waagen, Alex ^a   Aijaz, Nabeela ^a   Hurley, Michael ^a   Luis, Apolonio ^a   Rinsky, Joel ^a   Satyavolu, Chandrika ^a   Way, Michael J ^b   Gazis, Paul ^c   Srivastava, Ashok ^c  

^a SAN JOSE STATE UNIVERSITY   (United States)

^b NASA GODDARD INSTITUTE FOR SPACE STUDIES   (United States)

^c NASA AMES RESEARCH CENTER   (United States)

Author keywords

Gaussian processes; Low rank approximations; Numerical stability; Photometric red shift; Subset of regressors method

Indexed keywords

GAUSSIAN PROCESSES; LOW RANK APPROXIMATIONS; NUMERICAL STABILITY; PHOTOMETRIC RED-SHIFT; SUBSET OF REGRESSORS METHOD;

EDUCATION; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); PHOTOMETRY; SYSTEM STABILITY;

CONVERGENCE OF NUMERICAL METHODS;

EID: 66549124160     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (30)

1. Ed Anderson, Zhaojun Bai, Christian H. Bischof, Susan Blackford, James W. Demmel, Jack J. Dongarra, Jeremy J. Du Croz, Anne Greenbaum, Sven J. Hammarling, Alan McKenney, and Danny C. Sorensen. LAPACK Users' Guide. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, third edition, 1999. ISBN 0-89871-447-8.
2. Åke Björck. Numerical Methods for Least Squares Problems. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 1996. ISBN 0-89871-360-9.
3. Bem Cayco, Wasin So, Miranda Braselton, Kelley Cartwright, Michael Hurley, Maheen Khan, Miguel Rodriguez, David Shao, Jason Smith, Jimmy Ying, and Genti Zaimi. Camcos project -Fall 2006: Improved linear algebra methods for redshift computation from limited spectrum data. At www.math.sjsu.edu/ ∼foster/camcos07/redshift.html, 2006.
4. Lehel Csato and Manfred Opper. Sparse on-line gaussian processes. Neural Computation, 14: 641-668,2002.
5. Jack J. Dongarra, James R. Bunch, Cleve B. Moler, and G. W. Stewart. LINPACK Users' Guide. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 1979. ISBN 0-89871-172-X.
6. Bradley Efron and Robert J. Tibshirani. An Introduction to the Bootsrap. Chapman and Hall, New York, 1993.
7. Shai Fine and Katya Scheinberg. Efficient svm training using low-rank kernel representations. J. of Machine Learning Research, 2:243-264, 2001.
8. George E. Forsythe and Cleve B. Moler. Computer Solution of Linear Algebraic Systems. Prentice-Hall, Englewood Cliffs, NJ, USA, 1967.
9. Leslie Foster, Alex Waagen, Nabeela Aijaz, Michael Hurley, Apolo Luis, Joel Rinsky, Chandrika Satyavolu, Ashok Srivastava, Paul Gazis, and Michael Way. Improved linear algebra methods for redshift computation from limited spectrum data - II. NASA Technical Report NASA/TM-2008-214571, NASA Ames Research Center, Moffett Field, CA, 2008. Available at ntrs.nasa.gov and at www.math.sjsu.edu/ ∼foster/camcos07/redshift.html.
10. Gene H. Golub and Charles F. Van Loan. Matrix Computations. Johns Hopkins University Press, Baltimore, MD, USA, third edition, 1996. ISBN 0-8018-5413-X, 0-8018-5414-8.
11. Ming Gu and Stanley C. Eisenstat. Efficient algorithm for computing a strong rank-revealing qr factorization. SIAMJ. Sci. Comput., 17(4):848-869, 1996.
12. Ming Gu and Luiza Miranian. Strong rank-revealing Cholesky factorization. Electronic Transactions on Numerical Analysis, 17:76-92, 2004.
13. Per Christian Hansen. Rank-Deficient and Discrete Ill-Posed Problems. SIAM, Philadelphia, PA, USA, 1998.
14. Nicholas J. Higham. Analysis of the Cholesky decomposition of a semi-definite matrix. In M. G. Cox and S. J. Hammarling, editors, Reliable Numerical Computation, pages 161-185. Oxford University Press, 1990.
15. Nicholas J. Higham. Accuracy and Stability of Numerical Algorithms. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, second edition, 2002. ISBN 0-89871-521-0.
16. Craig Lucas. LAPACK-style codes for level 2 and 3 pivoted cholesky factorizations. Numerical Analysis Report No. 442, Manchester Centre for Computational Mathematics, Manchester, England, 2004. LAPACK Working Note 161.
17. Douglas C. Montgomery, Elizabeth A. Peck, and G. Geoffrey Vining. Introduction to Linear Regression Analysis. John Wiley and Sons, Hoboken, NJ, USA, fourth edition, 2006.
18. Gwen Peters and James H. Wilkinson. The least squares problem and pseudo-inverses. Comput. J., 13(3):309-316, 1970.
19. Tomaso Poggio and Fedirico Girosi. Networks for approximation and learning. Proceedings of IEEE, 78:1481-1497, 1990.
20. Joaquin Quinonero-Candela and Carl E. Rasmussen. A unifying view of sparse approximate Gaussian process regression. J. of Machine Learning Research, 6:1939-1959, 2005.
21. Carl E. Rasmussen and Christopher K. I. Williams. Gaussian Processes for Machine Learning. MIT Press, Cambridge, Massachusetts, 2006.
22. Matthias Seeger, Christopher Williams, and Neil D. Lawrence. Fast forward selection to speed up sparse gaussian process regression. In C. M. Bishop and B. J. Frey, editors, Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics, San Francisco, 2003.Morgan Kaufmann.
23. Alex J. Smola and Peter Bartlett. Sparse greedy gaussian process regression. In T. Leen, T. Diettrich, and V. Tresp, editors, Advances in Neural Information Processing Systems 13, pages 619-625. MIT Press, 2001.
24. Edward Snelson and Zoubin Ghahramani. Sparse gaussian process using pseudo-inputs. In Y. Weiss, B. Scholkpf, and J. Platt, editors, Advances in Neural Information Processing Systems 18, pages 1257-1264. MIT Press, 2006.
25. G.W. Stewart. The efficient generation of random orthogonal matrices with an application to condition estimators. SIAMJ. Numer. Anal., 17(3):403-409, 1980.
26. Lloyd N. Trefethen and David Bau III. Numerical Linear Algebra. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 1997. ISBN 0-89871-361-7.
27. Sethu Vijayakumar, Aaron DSouza, Tomohiro Shibata, Jorg Conradt, and Stefan Schaal. Statistical learning for humanoid robots. Autonomous Robot, 12:55-69, 2002.
28. Grace Wahba. Spline Models for Observation Data. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, 1990.
29. Michael J. Way and Ashok Srivastava. Novel methods for predicting photometric redshifts from broadband data using virtual sensors. The Astrophysical Journal, 647:102-115, 2006.
30. Donald G. York, J. Adelman, and John E. Anderson et. al. The sloan digital sky survey: Technical summary. The Astronomical Journal, 120:1579-1587, 2000.