Tight coupling of r and distributed linear algebra for high-level programming with big data

Proceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012

Volumn , Issue , 2012, Pages 811-815

  Schmidt, Drew ^a   Ostrouchov, George ^a,b   Chen, Wei Chen ^b   Patel, Pragneshkumar ^a  

^a UNIVERSITY OF TENNESSEE   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Big data; Distributed computing; Large scale analytics; MPI; R; ScaLAPACK

Indexed keywords

BIG DATUM; LARGE-SCALE ANALYTICS; MPI; R; SCALAPACK;

DISTRIBUTED COMPUTER SYSTEMS; LINEAR ALGEBRA;

DIGITAL STORAGE;

EID: 84876541042     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.Companion.2012.113     Document Type: Conference Paper

References (18)

1. R Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2012, ISBN 3-900051-07-0. [Online]. Available: http://www.r-project.org/
2. R. Muenchen, "The popularity of data analysis software," 2012. [Online]. Available: http://r4stats.com/articles/popularity/
3. J. Chambers, Software for Data Analysis: Programming with R, ser. Statistics and Computing. Springer, 2008.
4. G. Ostrouchov, W.-C. Chen, D. Schmidt, and P. Patel, "Programming with big data in R," 2012. [Online]. Available: http://r-pbd.org/
5. L. S. Blackford, J. Choi, A. Cleary, E. D'Azevedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, and R. C. Whaley, ScaLAPACK Users' Guide. Philadelphia, PA: Society for Industrial and Applied Mathematics, 1997. [Online]. Available: http: //netlib.org/scalapack/ slug/scalapack slug.html/
6. J. Dongarra and R. C. Whaley, "A user's guide to the blacs," University of Tennessee, Tech. Rep., mar 1995, uT-CS-95-281.
7. W.-C. Chen, G. Ostrouchov, D. Schmidt, P. Patel, and H. Yu, "pbdMPI: Programming with big data-interface to MPI," 2012, R Package. [Online]. Available: http://cran.r-project.org/package=pbdMPI
8. W.-C. Chen, D. Schmidt, G. Ostrouchov, and P. Patel, "pbdSLAP: Programming with big data-scalable linear algebra packages," 2012, R Package. [Online]. Available: http://r-pbd.org/
9. D. Schmidt, W.-C. Chen, G. Ostrouchov, and P. Patel, "pbdBASE: Programming with big data-BASE," 2012, R Package. [Online]. Available: http://r-pbd.org/
10. -, "pbdDMAT: Programming with big data-distributed matrix algebra computation," 2012, R Package. [Online]. Available: http://r-pbd.org/
11. E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra, J. M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R. H. Castain, D. J. Daniel, R. L. Graham, and T. S. Woodall, "Open MPI: Goals, concept, and design of a next generation MPI implementation," in Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 2004, pp. 97-104.
12. W. Gropp, "Mpich2: A new start for mpi implementations," in Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. London, UK, UK: Springer-Verlag, 2002, pp. 7-. [Online]. Available: http://dl.acm.org/citation. cfm?id=648139.749473
13. Intel Corporation, "Intel Math Kernel Library (Intel MKL)," 2010. [Online]. Available: http://software.intel.com/en-us/intel-mkl
14. Cray, "Cray xt-libsci," 2011. [Online]. Available: http://www.nersc.gov/users/software/programming-libraries/math-libraries/libsci/
15. H. Yu, "Rmpi: Interface (wrapper) to mpi (message-passing interface))," 2010, R Package (v:0.5-9). [Online]. Available: http://cran.r-project.org/package=Rmpi
16. A. Rencher, Methods of Multivariate Analysis, ser. Wiley series in probability and mathematical statistics. Probability and mathematical statistics. John Wiley & Sons, 2002. [Online]. Available: http://books.google.bg/books?id=SpvBd7IUCxkC
17. D. Bates, J. Chambers, D. Cook, P. Dalgaard, R. Gentleman, K. Hornik, R. Ihaka, F. Leisch, T. Lumley, M. Mächler, G. Masarotto, P. Murrell, B. Narasimhan, B. Ripley, G. Sawitzki, D. Lang, L. Tierney, and B. Venables. The omega project for statistical computing. [Online]. Available: http://www.omegahat. org/
18. H. Childs, E. Brugger, K. Bonnell, J. Meredith, M. Miller, B. Whitlock, and N. Max, "A contract based system for large data visualization," in Visualization, 2005. VIS 05. IEEE, oct. 2005, pp. 191-198.