Noise can speed convergence in Markov chains

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 84, Issue 4, 2011, Pages

  Franzke, Brandon ^a   Kosko, Bart ^a  

^a University of Southern California   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSORBING STATE; BIRTH-DEATH PROCESS; BLIND ALGORITHMS; CHEMICAL REACTION NETWORKS; CONVERGENCE RATES; CONVERGENCE TO EQUILIBRIUM; DIFFUSION MODEL; EHRENFEST; FASTER CONVERGENCE; FINITE-STATE; MARKOV CHAIN; MARKOV MODEL; POPULATION GENETICS; STATE DENSITIES; STATE INFORMATION; STATE SPACE; STEADY STATE; SYSTEM STATE; TIME CYCLES; WRIGHT-FISHER MODELS; ZEOLITE CRYSTALLIZATION;

ALGORITHMS; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; THEOREM PROVING;

MARKOV PROCESSES;

EID: 80054851884     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.84.041112     Document Type: Article

References (101)

1. C. Bishop, Neural Networks for Pattern Recognition (Oxford University Press, New York, 1996).
2. W. J. Freeman, H. J. Chang, B. C. Burke, P. A. Rose, and J. Badler, IEEE Trans. Circuits Syst. I ITCAEX 1057-7122 10.1109/81.633888 44, 989 (1997).
3. B. Kosko, Noise (Viking, New York, 2006).
4. P. Hänggi, Chem. Phys. Chem. CPCHFT 1439-4235 10.1002/1439- 7641(20020315)3:3<285::AID-CPHC285>3.0.CO;2-A 3, 285 (2002).
5. M. D. McDonnell, N. G. Stocks, C. E. M. Pearce, and D. Abbott, Stochastic Resonance: From Suprathreshold Stochastic Resonance to Stochastic Signal Quantization (Cambridge University Press, Cambridge, England, 2008).
6. M. M. Wilde and B. Kosko, J. Phys. A: Math. Theor. CPCHFT 1751-8113 10.1088/1751-8113/42/46/465309 42, 465309 (2009).
7. I. Lee, X. Liu, C. Zhou, and B. Kosko, IEEE Trans. Nanotechnol. CPCHFT 1536-125X 10.1109/TNANO.2006.883476 5, 613 (2006). (Pubitemid 44837042)
8. A. Patel and B. Kosko, Neural Netw. NNETEB 0893-6080 10.1016/j.neunet. 2009.06.044 22, 697 (2009).
9. B. Kosko and S. Mitaim, Phys. Rev. E PLEEE8 1539-3755 10.1103/PhysRevE.70.031911 70, 031911 (2004).
10. A. Patel and B. Kosko, IEEE Trans. Signal Process. ITPRED 1053-587X 10.1109/TSP.2009.2012893 57, 1655 (2009).
11. A. Patel and B. Kosko, IEEE Trans. Neural Netw. ITNNEP 1045-9227 10.1109/TNN.2008.2005610 19, 1993 (2008).
12. D. Applebaum, IEEE Trans. Neural Netw. ITNNEP 1045-9227 10.1109/TNN.2009.2033183 20, 1993 (2009).
13. A. R. Bulsara and A. Zador, Phys. Rev. E PLEEE8 1539-3755 10.1103/PhysRevE.54.R2185 54, R2185 (1996).
14. M. Guerriero, P. Willett, S. Maranò, and V. Matta, in ICASSP (IEEE, New York, 2008), pp. 3901-3904.
15. D. Rousseau and F. Chapeau-Blondeau, Signal Process. SPRODR 0165-1684 10.1016/j.sigpro.2004.11.002 85, 571 (2005). (Pubitemid 40206001)
16. A. Patel and B. Kosko, IEEE Signal Process. Lett. IESPEJ 1070-9908 10.1109/LSP.2010.2059376 17, 1005 (2010).
17. S. Mitaim and B. Kosko, in Proceedings of the IEEE: Special Issue on Intelligent Signal Processing (IEEE, New York, 1998), pp. 2152-2183.
18. A. A. Saha and G. V. Anand, Signal Process. SPRODR 0165-1684 10.1016/S0165-1684(03)00039-2 83, 1193 (2003).
19. M. Guerriero, S. Marano, V. Matta, and P. Willett, Trans. Sig. Proc. ITPRED 1053-587X 10.1109/TSP.2008.2005087 57, 2 (2009).
20. M. D. McDonnell, N. G. Stocks, C. E. Pearce, and D. Abbott, Phys. Lett. A PYLAAG 0375-9601 10.1016/j.physleta.2005.11.068 352, 183 (2006). (Pubitemid 43336154)
21. S. Mitaim and B. Kosko, IEEE Trans. Neural Netw. ITNNEP 1045-9227 10.1109/TNN.2004.826218 15, 1526 (2004).
22. A. Patel and B. Kosko, Neural Netw. NNETEB 0893-6080 10.1016/j.neunet. 2005.06.031 18, 467 (2005). (Pubitemid 43186565)
23. P. Parmananda, G. J. Escalera Santos, M. Rivera, and K. Showalter, Phys. Rev. E PLEEE8 1539-3755 10.1103/PhysRevE.71.031110 71, 031110 (2005). (Pubitemid 40619722)
24. H. Chen, P. Varshney, S. Kay, and J. Michels, IEEE Trans. Signal Process. ITPRED 1053-587X 10.1109/TSP.2007.893757 55, 3172 (2007). (Pubitemid 47022854)
25. S. Kay, IEEE Signal Process. Lett. IESPEJ 1070-9908 10.1109/97.809511 7, 8 (2000). (Pubitemid 30547939)
26. C. R. Robert and G. Casella, Monte Carlo Statistical Methods, 2nd ed. (Springer, New York, 2004).
27. M. Mitzenmacher and E. Upfal, Probability and Computing: Randomized Algorithms and Probabilistic Analysis (Cambridge University Press, Cambridge, England, 2005).
28. L. Tierney, The Annals of Statistics ASTSC7 0090-5364 10.1214/aos/1176325750 22, 1701 (1994).
29. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, J. Chem. Phys. JCPSA6 0021-9606 10.1063/1.1699114 21, 1087 (1954).
30. W. K. Hastings, Biometrika BIOKAX 0006-3444 10.1093/biomet/57.1.97 57, 97 (1970).
31. S. Geman and D. Geman, IEEE Trans. Pattern Anal. Mach. Intell. ITPIDJ 0162-8828 10.1109/TPAMI.1984.4767596 PAMI- 6, 721 (1984).
32. A. E. Gelfand and A. F. M. Smith, J. Am. Stat. Assoc. JSTNAL 0162-1459 10.2307/2289776 85, 398 (1990).
33. Y. J. Sung and C. J. Geyer, The Annals of Statistics ASTSC7 0090-5364 10.1214/009053606000001389 35, 990 (2007).
34. W. R. Gilks, W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Markov Chain Monte Carlo in Practice (CRC Press, London, 1996).
35. M. K. Cowles and B. P. Carlin, J. Am. Stat. Assoc. JSTNAL 0162-1459 10.2307/2291683 91, 883 (1996).
36. G. Grimmett and D. Stirzaker, Probability and Random Processes, 3rd ed. (Oxford University Press, New York, 2001).
37. S. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability, 2nd ed. (Cambridge University Press, Cambridge, England, 2009).
38. R. W. Shonkwiler and F. Mendivil, Explorations in Monte Carlo Methods (Springer, New York, 2009).
39. F. P. Kelly, Reversibility and Stochastic Networks (John Wiley & Sons, New York, 1979).
40. R. Durrett, Probability: Theory and Examples, 3rd ed. (Thompson Brooks/Cole, Florence, KY, 2005).
41. M. J. Klein, Physica PHYSAG 0031-8914 10.1016/S0031-8914(56)90001-5 22, 569 (1956).
42. A. S. Novozhilov, G. P. Karev, and E. V. Koonin, Briefings in Bioinformatics PHYSAG 1467-5463 10.1093/bib/bbk006 7, 70 (2006). (Pubitemid 44404325)
43. S. C. Kou and S. G. Kou, Adv. Appl. Probab. AAPBBD 0001-8678 10.1239/aap/1059486822 35, 641 (2003).
44. H. Berthiaux and V. Mizonov, The Canadian J. Chem. Eng. CJCEA7 0008-4034 10.1002/cjce.5450820602 82, 1143 (2004).
45. D. Diermeier and J. A. V. Mieghem, Math. Comput. Modell. MCMOEG 0895-7177 10.1016/j.mcm.2008.05.043 48, 1497 (2008).
46. K. Schulten, Z. Schulten, and A. Szabo, Physica A: Stat. Theor. Phys. PHYADX 0378-4371 10.1016/0378-4371(80)90170-3 100, 599 (1980).
47. S. Balaji, H. M. Mahmoud, and O. Watanabe, Statistics & Probability Letters PHYADX 0167-7152 10.1016/j.spl.2005.09.013 76, 666 (2006). (Pubitemid 43329365)
48. S. Prestipino, Physica A: Stat. Mech. Appl. PHYADX 0378-4371 10.1016/j.physa.2004.04.029 340, 373 (2004).
49. K. Lindgren, Phys. Rev. A PLRAAN 1050-2947 10.1103/PhysRevA.38.4794 38, 4794 (1988).
50. J. Palacios and P. Tetali, Statistics & Probability Letters PLRAAN 0167-7152 10.1016/0167-7152(95)00209-X 30, 119 (1996). (Pubitemid 126167193)
51. S. Karlin and J. McGregor, J. Appl. Probab. JPRBAM 0021-9002 10.2307/3212199 2, 352 (1965).
52. O. Krafft and M. Schaefer, J. Appl. Probab. JPRBAM 0021-9002 10.2307/3214525 30, 964 (1993).
53. H. Dette, J. Appl. Probab. JPRBAM 0021-9002 10.2307/3215318 31, 930 (1994).
54. R. A. Fisher, The Genetical Theory of Natural Selection, 2nd ed. (Dover, New York, 1958).
55. S. Wright, Genetics 16, 97 (1931).
56. W. Feller, in Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability, edited by, J. Neyman, (University of California Press, Berkeley, CA, 1951), pp. 227-246.
57. G. Baxter, R. Blythe, and A. McKane, Math. Biosci. MABIAR 0025-5564 10.1016/j.mbs.2007.01.001 209, 124 (2007). (Pubitemid 47238112)
58. D. Waxman, J. Theor. Biol. JTBIAP 0022-5193 10.1016/j.jtbi.2008.11.025 257, 245 (2009).
59. T. Lenormand, D. Roze, and F. Rousset, Trends in Ecology & Evolution TREEEQ 0169-5347 10.1016/j.tree.2008.09.014 24, 157 (2009).
60. D. Waxman, J. Theor. Biol. JTBIAP 0022-5193 10.1016/j.jtbi.2010.10.014 269, 79 (2011).
61. P. Billingsley, Probability and Measure, 3rd ed. (Wiley Interscience, New York, 1995).
62. D. B. Hawkins, Clays and Clay Minerals CLCMAB 0009-8604 10.1346/CCMN.1989.0370506 37, 433 (1989).
63. R. J. Donahoe and J. Liou, Geochim. Cosmochim. Acta GCACAK 0016-7037 10.1016/0016-7037(85)90235-2 49, 2349 (1985).
64. C. S. Cundy and P. A. Cox, Microporous Mesoporous Mater. MIMMFJ 1387-1811 10.1016/j.micromeso.2005.02.016 82, 1 (2005). (Pubitemid 40777912)
65. Q. Dai, X. Qing Liu, and T. Ming Wang, J. Mol. Struct. 803, 115 (2007).
66. J. Yang, W. J. Bruno, W. S. Hlavacek, and J. E. Pearson, Biophys. J. BIOJAU 0006-3495 10.1529/biophysj.105.071852 91, 1136 (2006). (Pubitemid 44161945)
67. M. Lindén and M. Wallin, Biophys. J. BIOJAU 0006-3495 10.1529/biophysj.106.103044 92, 3804 (2007). (Pubitemid 46910568)
68. J. M. Conroy, T. G. Kolda, D. P. O'Leary, and T. J. O'Leary, Laboratory Investigation LAINAW 0023-6837 10.1038/labinvest.3780173 80, 1629 (2000).
69. Z. Song, X. Geng, A. Kusiak, and C. Xu, Expert Systems with Applications ESAPEH 0957-4174 10.1016/j.eswa.2011.02.063 38, 10229 (2011).
70. E. Renshaw, Computational Statistics & Data Analysis CSDADW 0167-9473 10.1016/S0167-9473(03)00118-X 45, 765 (2004). (Pubitemid 38498426)
71. G. Pulford, R. A. Kennedy, and S.-H. Chung, Signal Processing SPRODR 0165-1684 10.1016/0165-1684(94)00154-R 43, 207 (1995).
72. Y.-T. Hu, R. Kiesel, and W. Perraudin, Journal of Banking & Finance SPRODR 0378-4266 10.1016/S0378-4266(02)00268-6 26, 1383 (2002).
73. C. Colella, in Zeolites and Ordered Mesoporous Materials: Progress and Prospects, edited by, J. Cejka, and, H. van Bekkum, Vol. 157 of Studies in Surface Science and Catalysis (Elsevier, New York, 2005), pp. 13-40.
74. Y. Yukselen-Aksoy, Applied Clay Science ACLSER 0169-1317 10.1016/j.clay.2010.07.015 50, 130 (2010).
75. C. Baerlocher, L. B. McCusker, and D. H. Olson, Atlas of Zeolite Framework Types, 6th ed. (Elsevier, New York, 2007).
76. R. V. Gaines, H. C. Skinner, E. E. Foord, B. Mason, and A. Rosenzweig, DANA's New Mineralogy, 8th ed. (John Wiley & Sons, New York, 1997).
77. C. Covarrubias, R. García, R. Arriagada, J. Yánez, H. Ramanan, Z. Lai, and M. Tsapatsis, J. Membr. Sci. JMESDO 0376-7388 10.1016/j.memsci.2007.12.052 312, 163 (2008).
78. S. Wang and Y. Peng, Chem. Eng. J. CMEJAJ 1385-8947 10.1016/j.cej.2009. 10.029 156, 11 (2010).
79. E. Álvarez Ayuso, A. García-Sánchez, and X. Querol, Water Res. WATRAG 0043-1354 10.1016/j.watres.2003.08.009 37, 4855 (2003). (Pubitemid 37353021)
80. C. J. Adams, A. Araya, S. W. Carr, A. P. Chapple, K. R. Franklin, P. Graham, A. R. Minihan, T. J. Osinga, and J. A. Stuart, in Progress in Zeolite and Microporous Materials, Preceedings of the 11th International Zeolite Conference, edited by, S.-K. I. Hakze Chon, and, Y. S. Uh, Vol. 105 (Elsevier, New York, 1997), pp. 1667-1674.
81. I. Yamane and T. Nakazawa, in New Developments in Zeolite Science and Technology, Proceedings of the 7th International Zeolite Conference, edited by, A. I. Y. Murakami, and, J. Ward, Vol. 28 of Studies in Surface Science and Catalysis (Elsevier, New York, 1986), pp. 991-1000.
82. J. Weitkamp, Solid State Ionics SSIOD3 0167-2738 10.1016/S0167-2738(00) 00632-9 131, 175 (2000).
83. M. Stöcker, Microporous Mesoporous Mater. MIMMFJ 1387-1811 10.1016/j.micromeso.2005.01.039 82, 257 (2005).
84. J. A. Rabo and M. W. Schoonover, Appl. Catal., A ACAGE4 0926-860X 10.1016/S0926-860X(01)00840-7 222, 261 (2001). (Pubitemid 34086253)
85. A. Bielanski and A. Malecka, Zeolites ZEOLD3 0144-2449 10.1016/0144-2449(86)90076-X 6, 249 (1986).
86. A. Dyer and D. Keir, Zeolites ZEOLD3 0144-2449 10.1016/0144-2449(84) 90026-5 4, 215 (1984).
87. A. Dyer and H. Faghihian, Microporous Mesoporous Mater. MIMMFJ 1387-1811 10.1016/S1387-1811(97)00035-8 21, 27 (1998).
88. M. Flytzani-Stephanopoulos, I.-S. Nam, and X. Verykios, edited by, Applied Catalysis B: Environmental 5, N34 (1995).
89. H. Ghobarkar, O. Schäf, B. Paz, and P. Knauth, J. Solid State Chem. JSSCBI 0022-4596 10.1016/S0022-4596(03)00073-2 173, 27 (2003).
90. Z. A. Lethbridge, J. J. Williams, R. I. Walton, K. E. Evans, and C. W. Smith, Microporous Mesoporous Mater. MIMMFJ 1387-1811 10.1016/j.micromeso.2004. 12.022 79, 339 (2005). (Pubitemid 40335616)
91. H. Ghobarkar and O. Schäf, Mater. Res. Bull. MRBUAC 0025-5408 10.1016/S0025-5408(99)00052-5 34, 517 (1999).
92. H. Ghobarkar and O. Schäf, Microporous Mesoporous Mater. MIMMFJ 1387-1811 10.1016/S1387-1811(98)00045-6 23, 55 (1998).
93. M. D. Hollingsworth, Science 295, 2410 (2002).
94. M. Falcioni and M. W. Deem, J. Chem. Phys. JCPSA6 0021-9606 10.1063/1.477812 110, 1754 (1999).
95. M. G. Wu, M. W. Deem, S. A. Elomari, R. C. Medrud, S. I. Zones, T. Maesen, C. Kibby, C.-Y. Chen, and I. Y. Chan, J. Phys. Chem. B JPCBFK 1520-6106 10.1021/jp012407b 106, 264 (2002). (Pubitemid 35281715)
96. L. Page, U.S. Patent no. 6285999: Method for node ranking in a linked database (Sep. 4, 2001).
97. Google, Inc. annual report (Form 10-K) (2010).
98. Google, Inc. annual report (Form 10-K) (2009).
99. S. Brin and L. Page, Proceedings of the Seventh International World-Wide Web Conference (WWW 1998) (International World-Wide Web Conference Committee IW3C2, Brisbane, Australia, 1998).
100. Y. Lin, X. Shi, and Y. Wei, J. Comput. Appl. Math. JCAMDI 0377-0427 10.1016/j.cam.2008.06.003 224, 702 (2009).
101. S. Kamvar, T. Haveliwala, C. Manning, and G. Golub, Proceedings of the Twelfth International World-Wide Web Conference (WWW 2003) (International World-Wide Web Conference Committee IW3C2, Budapest, Hungary, 2003).