Distribution of random streams for simulation practitioners

Concurrency and Computation: Practice and Experience

Volumn 25, Issue 10, 2013, Pages 1427-1442

  Hill, David R C ^a,b,c   Mazel, Claude ^a,b,c   Passerat Palmbach, Jonathan ^a,b,c   Traore, Mamadou K ^a,b,c  

^a UNIVERSITÉ CLERMONT AUVERGNE   (France)

^b CNRS   (France)

^c ISIMA   (France)

Author keywords

high performance computing; parallel random numbers; parallel random streams; random number generation; stochastic simulation

Indexed keywords

COMPUTER ARCHITECTURE; GRAPHICS PROCESSING UNIT; NUMBER THEORY; PARALLEL PROCESSING SYSTEMS; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

GRAPHICAL PROCESSING UNIT (GPUS); HIGH PERFORMANCE COMPUTING; PARALLEL RANDOM STREAMS; PARALLELIZATION TECHNIQUES; PSEUDO RANDOM NUMBER GENERATIONS; RANDOM NUMBER GENERATORS; RANDOM NUMBERS; STOCHASTIC SIMULATIONS;

RANDOM NUMBER GENERATION;

EID: 84879412568     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.2942     Document Type: Article

References (86)

1. Gentle JE,. Random Number Generation and Monte Carlo Methods, 2nd Edition. Springer Verlag: New York, 2003.
2. James F,. A review of pseudorandom number generators. Computer Physics Communications 1990; 60: 329-344.
3. Knuth DE,. The Art of Computer Programming, Vol. 2, 2nd edition. Seminumerical Algorithms. Addison-Wesley: Reading, MA, 1981.
4. Lagarias JC,. Pseudorandom numbers. Statistical Science 1993; 8: 31-39.
5. Mascagni M,. Random number generation. CRC Standard Mathematical Tables and Formulae, 31st Edition, Zwillinger D, (ed.). Chapman and Hall/CRC: Boca Raton, 2003; 644-649.
6. L'Ecuyer P,. Pseudorandom number generators. In Encyclopedia of Quantitative Finance, Rama Cont, Ed., in volume Simulation Methods in Financial Engineering, Platen E, Jaeckel P, (eds.). Wiley: Chichester, UK, 2010.
7. El Bitar Z, Lazaro D, Breton V, Hill DRC, Buvat I,. Fully 3D Monte Carlo image reconstruction in SPECT using functional regions. Nuclear Instruments and Methods in Physics Research 2006; 569: 399-403. (Pubitemid 44820461)
8. Lazaro D, El Bitar Z, Breton V, Hill DRC, Buvat I,. Fully 3D Monte Carlo reconstruction in SPECT: a feasibility study. Physics in Medicine and Biology 2005; 50: 3739-3754. (Pubitemid 41129149)
9. Maigne L, Hill DRC, Calvat P, Breton V, Reuillon R, Lazaro D, Legré Y, Donnarieix D,. Parallelization of Monte Carlo simulations and submission to a grid environment. Parallel Processing Letter 2004; 14: 177-196.
10. Reuillon R, Hill DRC, El Bitar Z, Breton V,. Rigorous distribution of stochastic simulations using the DistMe toolkit. IEEE Transactions on Nuclear Science 2008; 55 (1): 595-603. (Pubitemid 351239517)
11. Niederreiter H,. Random Number Generation and Quasi Monte Carlo Methods. SIAM: Philadelphia, 1992.
12. Stevanovic R, Topic G, Skala K, Stipcevic M, Rogina BM,. Quantum Random Bit Generator Service for Monte Carlo and Other Stochastic Simulations, Lirkov I, Margenov S, Wasniewski J, (eds.). Lecture Notes in Computer Science. Springer-Verlag: Berlin Heidelberg, 2008; 4818: 508-515.
13. Hill DRC,. URNG: a portable optimization technique for software application requiring pseudorandom numbers. Simulation Modelling Practice and Theory 2002; 11: 643-654.
14. Kleijnen JPC,. Statistical Tools for Simulation Practitioners. Dekker: New-York, 1987.
15. De Matteis A, Pagnutti S,. Controlling correlations in parallel Monte Carlo. Parallel Computing 1995; 73-84.
16. Hellekalek P,. Don't trust parallel Monte Carlo. Proceedings of the twelfth workshop on Parallel and distributed simulation, Alberta, Canada, 1998; 82-89.
17. Pawlikowski K,. Do not trust all simulation studies of telecommunication networks. Proceeding of International Conference on Information Networking, ICOIN'03, Jeju Island, Korea, 2003; 899-908.
18. Pawlikowski K,. Towards credible and fast quantitative stochastic simulation. Proceedings of International SCS Conference on Design, Analysis and Simulation of Distributed Systems, DASD'03, 2003.
19. Fujimoto RM,. Parallel and Distributed Simulation Systems. Wiley Interscience: New-York, January, 2000.
20. Coddington PD,. Random Number Generators for Parallel Computers. NHSE Review, 2nd Issue, 1996.
21. Hellekalek P,. Good random number generators are (not so) easy to find. Mathematics and Computers in Simulation 1998; 485-505. (Pubitemid 128450414)
22. L'Ecuyer P,. Software for uniform random number generation: distinguishing the good and the bad. Proceedings of the 2001 Winter Simulation Conference. IEEE Press: Pistacaway NJ, 2001; 95-105. (Pubitemid 34091283)
23. Matsumoto M, Nishimura T,. Mersenne Twister: a 623-dimensionally equidistributed uniform pseudorandom number generator. ACM Transactions on Modeling and Computer Simulation 1998; 8: 3-30.
24. Saito M, Matsumoto M,. SIMD-oriented Fast Mersenne Twister: a 128-bit pseudorandom number generator. Proceedings of Monte Carlo and Quasi-Monte Carlo Methods 2006. Springer, 2008; 607-622.
25. Panneton F, L'Ecuyer P, Matsumoto M,. Improved long-period generators based on linear recurrences modulo 2. ACM Transactions on Mathematical Software 2006; 32 (1): 1-16. (Pubitemid 43924954)
26. L'Ecuyer P, Simard R, Chen EJ, Kelton WD,. An object-oriented random-number package with many long streams and substreams. Operations Research 2002; 50: 1073-1075.
27. De Matteis A, Pagnutti S,. Parallelization of random number generators and long-range correlations. Numerische Mathematik 1988; 53: 595-608.
28. De Matteis A, Pagnutti S,. A class of parallel random number generators. Parallel Computing 1990; 13 (2): 193-198. (Pubitemid 20674062)
29. Durst MJ,. Using linear congruential generators for parallel random number generation. Proceedings of the Winter Simulation Conference, MacNair EA, Musselman KJ, Heidelberger P, (eds.). ACM: New-York, 1989; 462-466.
30. Eddy WF,. Random number generators for parallel processors. Journal of Computational and Applied Mathematics 1990; 31: 63-71.
31. Entacher K, Uhl A, Wegenkittl S,. Linear congruential generators for parallel Monte Carlo: the leap-frog case. Monte-Carlo Methods and Applications 1998; 4 (1): 1-16.
32. Percus OE, Kalos MH,. Random number generators for MIMD parallel processors. Journal of Parallel and Distributed Computing 1999; 6: 477-497.
33. Srinivasan A,. Introduction to parallel RNG, 1998. http://sprng.cs.fsu. edu/Version1.0/paper/index.html [2012].
34. Hechenleitner B, Entacher K,. On shortcomings of the NS-2 random number generator. In Communication Networks and Distributed Systems Modeling and Simulation (CNDS), Znati T, McDonald B, (eds.). SCS, 2002; 71-77.
35. Pawlikowski K, Jeong HDJ, Lee JSR,. On credibility of simulation studies of telecommunication networks. IEEE Communications Magazine 2002; 40 (1): 132-139. (Pubitemid 34110003)
36. Entacher K, Hechenleitner B,. Pitfalls when using parallel streams in OMNET++ simulations. Proceedings of Inter-domain Performance and Simulation (IPS) Workshop, Salzburg, Austria, 2003; 11-20.
37. Traore M, Hill DRC,. The use of random number generation for stochastic distributed simulation: application to ecological modeling. Proceedings of the 13th European Simulation Symposium, 1991; 555-559.
38. Bauke H, Mertens S,. Random numbers for large scale distributed Monte Carlo simulations. Physical Review E 2007; 75 (6): 701-714.
39. Mascagni M, Srinivasan A,. Parameterizing parallel multiplicative lagged-Fibonacci generators. Parallel Computing 2004; 30: 899-916.
40. Hechenleitner B,. Defects in random number routines of well-known network simulators and appropriate improvements. PhD Thesis, School of Scientific Computing of the University of Salzburg, 2004.
41. De Matteis A, Pagnutti S,. Long-range correlations in linear and non-linear random number generators. Parallel Computing 1990; 14 (2): 207-210. (Pubitemid 20708265)
42. Srinivasan A, Mascagni M, Ceperley DM,. Testing parallel random number generators. Parallel Computing 2003; 29 (1): 69-94.
43. Wu P, Huang K,. Parallel use of multiplicative congruential random number generators. Computer Physics Communications 2006; 175 (1): 25-29. (Pubitemid 43949084)
44. L'Ecuyer P, Simard R,. TestU01: a C library for empirical testing of random number generator. ACM Transactions on Mathematical Software 2007; 33 (4): 1-40.
45. Aluru S,. Lagged Fibonacci random number generators for distributed memory parallel computers. Journal of Parallel and Distributed Computing 1997; 45 (1): 1-12. (Pubitemid 127343489)
46. Janowczyk A, Chandran S, Aluru S,. Fast, processor-cardinality agnostic PRNG with a tracking application. Computer Vision, Graphics & Image Processing, 2008. ICVGIP '08, December 16-19; 2008; 171-178.
47. Matsumoto M, Nishimura T,. Dynamic creation of pseudorandom number generators. Monte Carlo and Quasi-Monte Carlo Methods conference 1998. Springer, 2000; 56-69.
48. Mascagni M, Chi H,. Parallel linear congruential generators with Sophie-Germain moduli. Parallel Computing 2004; 30 (11): 1217-1231.
49. Frederickson P, Hiromoto R, Jordan TL, Smith B, Warnock T,. Pseudo-random trees in Monte Carlo. Parallel Computing 1984; 1 (2): 175-180.
50. Sipper M,. Generating parallel random number generators by cellular programming. International Journal of Modern Physics C 1996; 7 (2): 181-190.
51. Tomassini M, Sipper M, Zolla M, Perrenoud M,. Generating high-quality random numbers in parallel by cellular automata. Future Generation Computer Systems 1999; 16 (2-3): 291-305. (Pubitemid 30522987)
52. Tomassini M,. Parallel and distributed evolutionary algorithms: a review. Evolutionary Algorithms in Engineering and Computer Science-Recent Advances in Genetic Algorithms, Evolution Strategies, Evolutionary Programming, Genetic Programming and Industrial Applications, Miettinen K, Mäkelä MM, Neittaanmäki P, Périaux J, (eds). John Wiley & Sons, 1999; 113-133.
53. Ackermann J,. Parallel random number generator for inexpensive configurable hardware cells. Computer Physics Communications 2001; 140 (3): 293-302. (Pubitemid 32998126)
54. Haramoto H, Matsumoto M, Nishimura T, Panneton F, L'Ecuyer P,. Efficient jump ahead for F-2-linear random number generators. INFORMS Journal on Computing 2008; 20 (3): 385-390.
55. Salmon JK, Moraes MA, Dror RO, Shaw DE,. Parallel random numbers: as easy as 1, 2, 3. Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SuperComputing 2011-SC11). ACM: New York, NY, 2011; 1-12.
56. Reuillon R, Traore MK, Passerat-Palmbach J, Hill DRC,. Parallel stochastic simulations with rigorous distribution of pseudo-random numbers with DistMe: application to life science simulations. Concurrency and Computation: Practice and Experience 2011, accepted 31 August 2011, published online in Wiley Online Library (wileyonlinelibrary.com). DOI: 10.1002/cpe.1883, in press, 2011.
57. Reuillon R, Chuffart F, Leclaire M, Faure T, Dumoulin N, Hill DRC,. Declarative task delegation in OpenMOLE. Proceedings of the 2010 International Conference on High Performance Computing and Simulation, Smari WW, (ed.). 2010; 55-62.
58. Reuillon R,. Testing 65536 parallel pseudo-random number streams. EGEE Grid User Forum 2008, Poster session, Clermont-Ferrand, February 11-14th, Abstract 1 p., 2008.
59. Mascagni M,. Some methods of parallel pseudorandom number generation. Algorithms for Parallel Processing, Schreiber R, Heath M, Ranade A, (eds). Springer Verlag: New York, Berlin, 1997; 277-288.
60. L'Ecuyer P, Buist E,. Simulation in Java with SSJ. Proceedings of the 2005 Winter Simulation Conference, 2005; 611-620. (Pubitemid 46187756)
61. Pawlikowski K, McNickle D,. Speeding up stochastic discrete-event simulation. Proceedings of European Simulation Symposium, ESS'01, Marseille, France, Oct. 18-20, 2001; 132-138.
62. Pawlikowski K, Yau V,. On automatic partitioning, run-time control and output analysis methodology for massively parallel simulations. Proceedings of the European Simulation Symposium, ESS'92, 1992; 135-139.
63. Hill DRC,. Object-oriented pattern for distributed simulation of large scale ecosystems. Proceedings of the SCS Summer Computer Simulation Conference, 1997; 945-950.
64. Li Y, Mascagni M,. Improving performance via computational replication on a large computational grid. In 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003; 442-448.
65. Mascagni M, Ceperley D, Srinivasan A,. SPRNG: a scalable library for pseudorandom number generation. ACM Transactions on Mathematical Software 2000; 26: 618-619.
66. Ewing G, Pawlikowski K, McNickle D,. Akaroa-2: exploiting network computing by distributed stochastic simulation. 13th European Simulation Multiconference, Warsaw, Poland, SCSC, June 1999; 175-181.
67. Mascagni M,. High-performance Monte Carlo tools. IEEE Computational Science and Engineering 1998; 5 (2): 97-98.
68. L'Ecuyer P, Leydold J,. Rstream: streams of random numbers for stochastic simulation. The newsletter of the R project 2005; 5: 16-19.
69. Coddington PD, Newell AJ,. JAPARA-a Java parallel random number library for high-performance computing. Proceedings of the 18th International Parallel and Distributed Processing Symposium (IPDPS'04)-Workshop 5, 2004; 156-166.
70. Bradley T, du Toit J, Tong R, Giles M, Woodhams P,. Parallelization techniques for random numbers generators, Chapter 16. GPU Computing Gems, Corporation N, Hwu WW, (eds.), Emerald Edition. Elsevier, 2011; 231-246.
71. Passerat-Palmbach J, Mazel C, Mahul A, Hill DRC,. Reliable initialization of GPU-enabled parallel stochastic simulations using Mersenne Twister for graphics processors. ESM 2010, European Simulation, October 25-27, Hasselt University, Belgium, 2010; 187-195.
72. Marsaglia G,. Xorshift RNGs. Journal of Statistical Software 2003; 8 (14): 1-6. (Pubitemid 39217796)
73. Panneton F,. Construction d'ensembles de points basée sur des récurrences linéaires dans un corps fini de caractéristique 2 pour la simulation Monte Carlo et l'intégration quasi-Monte Carlo. Thèse de l'Université de Montréal, Département d'Informatique et de Recherche Opérationnelle, 2004.
74. Marsaglia G, Zaman A,. A new class of random number generators. The Annals of Applied Probability 1991; 3 (3): 462-480.
75. Marsaglia G, Narasimhan B, Zaman A,. A random number generator for PC's. Computer Physics Communications 1990; 60 (3): 345-349.
76. L'Ecuyer P,. Maximally equidistributed combined Tausworthe generators. Mathematics of Computation 1996; 65 (213): 203-213. (Pubitemid 126344530)
77. Saito M,. A variant of Mersenne Twister suitable for graphics processors. Available online, submitted 2010. http://arxiv.org/abs/1005.4973 [September 2012].
78. Marsaglia G,. DIEHARD: a battery of tests of randomness, 1996. http://www.stat.fsu.edu/pub/diehard/ [September 2012].
79. Rütti M,. A random number generator test suite for the C++ standard. Diploma Thesis, 2004.
80. Rütti M, Troyer M, Petersen WP,. A generic random number generator test suite, 2004. http://arxiv.org/abs/math/0410385 [September 2012].
81. Brown RG, Eddelbuettel D, Bauer D,. Dieharder: a random number test suite. Version 3.29.5b. Available at: http://www.phy.duke.edu/~rgb/General/ dieharder.php [September 2012].
82. Coddington PD, Ko SH,. Techniques for empirical testing of parallel random number generators. Proceedings of the 12th international Conference on Supercomputing, ICS '98, Melbourne, Australia. ACM Press: New York, 1998; 282-288.
83. De Matteis A, Eichenauer-Herrmann J, Grothe H,. Computation of critical distances within multiplicative congruential pseudorandom number sequences. Journal of Computational and Applied Mathematics 1992; 39 (1): 49-55.
84. Eichenauer-Herrmann J, Grothe H,. A remark on long-range correlations in multiplicative congruential pseudo random number generators. Numerische Mathematik 1989; 56 (6): 609-611.
85. Entacher K, Uhl A, Wegenkittl S,. Parallel Random Number Generation: Long-Range Correlations Among Multiple Processors. Lecture Notes in Computer Science 1999; 107-116.
86. Reuillon R,. Simulations stochastiques en environnements distribués, application aux grilles de calcul. Ph.D. Thesis, Blaise Pascal University, 2008.