Simple parallel statistical computing in R

Journal of Computational and Graphical Statistics

Volumn 16, Issue 2, 2007, Pages 399-420

  Rossini, A J ^a   Tierney, Luke ^b   Li, Na ^c  

^a NOVARTIS PHARMA AG   (Switzerland)

^b UNIVERSITY OF IOWA   (United States)

^c UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Bootstrap; Cross validation; Grid computing; Kriging; LAM MPI; Message passing; MPI; Profile likelihood; PVM

Indexed keywords

EID: 34250722705     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186007X178979     Document Type: Article

References (47)

1. Bar, M. (2006), OpenMosix WWW page. Available online at http://openmosix.sourceforge.net/.
2. Barak, A., and La'adan, O. (1998), "The MOSIX Multicomputer Operating System for High Performance Cluster Computing," Journal of Future Generation Computer Systems, 13, 361-372.
3. Basney, J., and Livny, M. (1999), "Deploying a High Throughput Computing Cluster," in High Performance Cluster Computing: Architectures and Systems (vol. 1), ed. Rajkumar Buyya, Englewood Cliffs, NJ: Prentice Hall.
4. Bisseling, Rob H. (2004), Parallel Scientific Computation: A Structured Approach using BSP and MPI, Cambridge, MA: Oxford.
5. Cardelli, L. (1995), "A Language With Distributed Scope," in Proceedings of the 22nd Annual ACM Symposium on Principles of Programming Languages, pp. 286-297.
6. Carriero, N., and Warnes, G. R. (2006), nws. Available online at http://cran.r-project.org/.
7. Cygwin (2005), Cygwin home page. Available online at http://www. cygwin.com/.
8. Davison, A.C., and Hinkley, D. V. (1997), Bootstrap Methods and Their Application, New York: Cambridge University Press.
9. Dwarkadas, S., Schäffer, A. A., Cottingham Jr., R. W., Cox, A. L., Keleher, P., and Zwaenepoel, W. (1994), "Parallelization of General-Linkage Analysis Problems," Human Heredity, 44, 127-141.
10. Eddelbuettel, D. (2006), Quantian homepage. Available online at http://www.quantian.org/.
11. Foster, I., and Kesselman, C. (eds.) (2003), The Grid 2: Blueprint for a New Computing Infrastructure (2nd ed.), San Francisco, CA: Morgan Kaufmann.
12. Gebhardt, A. (2003), "Pvm Kriging with R," in Proceedings of the 3nd International Workshop on Distributed Statistical Computing DSC-2003. Available online at http://www.ci.tuwien.ac.at/Conferences/DSC- 2003/ Proceedings/.
13. Geist, A., Beguelin, A., Dongarra, J., Jiang, W., Manchek, R., and Sunderam, V. (eds.) (1994), PVM: Parallel Virtual Machine. A User's Guide and Tutorial for Networked Parallel Computing, Cambridge, MA: MIT Press.
14. Gentleman, R., and Ihaka, R. (2000), "Lexical Scope and Statistical Computing," Journal of Computational and Graphical Statistics, 9, 491-508.
15. Geyer, C. J., and Thompson, E. A. (1995), "Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference," Journal of the American Statistical Association, 90, 909-920.
16. Globus Project (2006), The Globus Project. Available online at http://www.globus.org/.
17. Gupta, S. K., Schäffer, A. A., Cox, A. L., Dwarkadas, S., and Zwaenepoel, W. (1995), "Integrating Parallelization Strategies for Linkage Analysis," Computers and Biomedical Research, 28, 116-139.
18. Hains, G., and Loulergue, F. (2002), "Functional Bulk Synchronous Parallel Programming using the BSMLlib Library," in Constructive Methods for Parallel Programming, Advances in Computation: Theory and Practice, eds. S. Gorlatch and C. Lengauer, Nova Science Publishers, pp. 165-178.
19. Hendriks, E. A. (2002), BProc: Beowulf Distributed Process Space. Available online at http://bproc.sourceforge.net/.
20. Hinsen, K. (2002), "High-Level Scientific Programming in Python," in Computational Science - ICCS 2002, eds. P.M.A. Sloot, C.J. K. Tan, J. J. Dongarra, and A. G. Hoekstra, number 2331 in Lecture Notes in Computer Science, New York: Springer-Verlag.
21. Hough, P. D., Kolda, T. G., and Torczon, V. J. (2001), "Asynchronous Parallel Pattern Search for Nonlinear Optimization," SIAM Journal of Scientific Computing, 23, 134-156.
22. Ihaka, R., and Gentleman, R. (1996), "R: A Language for Data Analysis and Graphics," Journal of Computational and Graphical Statistics, 5, 299-314.
23. L'Ecuyer, P., and Leydold, J. (2005), "rstream: Streams of Random Numbers for Stochastic Simulation," R News, 5(2), 16-20, November 2005. Available online at http://CRAN.R-project.org/doc/Rnews/.
24. L'Ecuyer, P., Simard, R., Chen, E. J., and Kelton. W. D. (2002), "An Object-Oriented Random-Number Package With Many Long Streams and Substreams," OR, 50, 1073-1075.
25. Leydold, J. (2006), rstream. Available online at http://cran.r- project.org/.
26. Li, N. (2004), reprng. Available online at http://cran.r-project.org/.
27. Li, N., and Rossini, A. J. (2001), "RPVM: Cluster Statistical Computing in R," R News, 1(3), 4-7, September 2001. Available online at http://CRAN.R-project.org/doc/Rnews/.
28. _ (2005), rpvm. Available online at http://cran.r-project.org/.
29. Liaw, A. (2006), randomForest. Available online at http://cran.r- project.org/.
30. Martin, A. (2006), "Parallel Computing in R for MacOS X." Available online at http://adm.wustl.edu/rcluster.php.
31. Mascagni, M., and Srinivasan, A. (2001), SPRNG. Available online at http://sprng.cs.fsu.edu.
32. Meng, X.-L., and Wong, W. H. (1996), "Simulating Ratios of Normalizing Constants via a Simple Identity: A Theoretical Exploration," Statistica Sinica, 6, 831-860.
33. Merlin, A., Hains, G., and Loulergue, F. (2001), "A SPMD Environment Machine for Functional BSP Programs," in Proceedings of the Third Scottish Functional Programming Workshop.
34. Message Passing Interface Forum (1995), MPI: A Message-Passing Interface Standard (version 1.1). Avaialbe online att http://www.mpi- forum.org; technical report, http://www.mpi-forum.org.
35. _ (1997), MP1-2: Extensions to the Message Passing Interface. Available online at http://www.mpi-forum.org; technical report, http://www.mpi-forum.org.
36. Miller, P. L., Nadkarni, P., Gelernter, J. E., Carriero, N., Pakstis, A. J., and Kidd, K. K. (1991), "Parallelizing Genetic Linkage Analysis: A Case Study for Applying Parallel Computation in Molecular Biology," Computing in Biomedical Research, 24, 234-248.
37. R Development Core Team (2005), R 2.2.1. http://cran.r-project.org/.
38. Samatova, N. F., Bauer, D., Yoginath, S., and Kora, G. (2004), Parallel-R. Available online at http://www.aspect-sdm.org/Parallel-R/.
39. Schervish, M. J. (1988), "Applications of Parallel Computation to Statistical Inference," Journal of the American Statistical Association, 83, 976-983.
40. SciPy (2006), Scientific Python. Available online at http://www.scipy. org/.
41. Ševčíková, H., and Rossini, A. J. (2004), rleouyer. Available online at http://cran.r-project.org/.
42. Sun Microsystems Inc. (2002), Sun Cluster Grid Architecture. See http://www.sun.com/software/gridware/.
43. Venables, W. N., and Ripley, B. D. (2002), Modern Applied Statistics with S (4th ed.), New York: Springer.
44. Wilkinson, D. J. (2005), "Parallel Bayesian Computation, in Handbook of Parallel Computing and Statistics, eds. E. J. Kontoghiorghes, New York: Marcel Dekker/CRC Press.
45. Wolfram Research (2003), gridMathematica. Available online at http://www.wolfram.com/products/gridmathematica/.
46. Yu, H. (2002), "Rmpi: Parallel Statistical Computing in R," R News, 2(2), 10-14. Available online at http://CRAN.R-project.org/ doc/Rnews/.
47. _ (2006), Rmpi. Available online at http://cran.r-project.org/.