An Information Theory Approach to Nonlinear, Nonequilibrium Thermodynamics

Journal of Statistical Physics

Volumn 145, Issue 2, 2011, Pages 385-409

  Rogers, David M ^a   Beck, Thomas L ^b   Rempe, Susan B ^a  

^a SANDIA NATIONAL LABORATORIES   (United States)

^b UNIVERSITY OF CINCINNATI   (United States)

Author keywords

Information entropy; Likelihood; Maximum entropy; Predictive statistical mechanics; Probability

Indexed keywords

EID: 81155148264     PISSN: 00224715     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10955-011-0358-9     Document Type: Article

References (64)

1. Hille, B.: Ion Channels of Excitable Membranes, 3rd edn. Sinauer, Sunderland (2001).
2. Hamill, O. P., Marty, A., Neher, E., Sakmann, B., Sigworth, F. J.: Improved patch-clamp techniques for high-resolution current recording from cells and cell-free membrane patches. Pflügers Arch. Eur. J. Physiol. 391(2), 85-100 (1981).
3. Wonderlin, W. F., Finkel, A., French, R. J.: Optimizing planar lipid bilayer single-channel recordings for high resolution with rapid voltage steps. Biophys. J. 58(2), 289-297 (1990).
4. Jaynes, E. T.: Predictive statistical mechanics. In: Moore, G. T., Scully, M. O. (eds.) Frontiers of Nonequilibrium Statistical Physics, p. 33. Plenum Press, New York (1986).
5. Gibbs, J. W.: Elementary Principles in Statistical Mechanics. Scribner's, New York (1902).
6. Ehrenfest, P., Ehrenfest, T.: The Conceptual Foundations of the Statistical Approach in Mechanics. Cornell University Press, Ithaca (1959). English translation of Encykl. Math. Wiss. 1912, by M. J. Moravcsik.
7. van Kampen, N. G.: Stochastic Processes in Physics and Chemistry, 3rd edn. Elsevier, Amsterdam (2007).
8. Zwanzig, R.: Ensemble method in the theory of irreversibility. J. Chem. Phys. 33(5), 1338-1341 (1960).
9. Mackey, M. C.: The dynamic origin of increasing entropy. Rev. Mod. Phys. 61(4), 981 (1989).
10. Schrödinger, E.: Statistical Thermodynamics. Cambridge University Press, Cambridge (1967).
11. Jaynes, E. T.: Information theory and statistical mechanics. Phys. Rev. 106(4), 620-630 (1957).
12. Jaynes, E. T., Rosenkrantz, R. D.: Papers on Probability, Statistics and Statistical Physics. Kluwer, Boston (1989).
13. Jaynes, E. T.: Probability Theory: The Logic of Science. Cambridge University Press, Cambridge (2003).
14. Grandy, W. T.: Foundations of Statistical Mechanics. Kluwer, Boston (1987).
15. Jaynes, E. T.: The Gibbs paradox. In: Smith, C. R., Erickson, G. J., Neudorfer, P. O. (eds.) Maximum Entropy and Bayesian Methods, pp. 1-22. Kluwer, Dordrecht (1992).
16. Zubarev, D. N.: Modern methods of the statistical theory of nonequilibrium processes. J. Math. Sci. 16, 1509-1571 (1981).
17. Robin, W. A.: Non-equilibrium thermodynamics. J. Phys. A, Math. Gen. 23, 2065-2085 (1990).
18. Rogers, D. M., Rempe, S. B.: A first and second law for nonequilibrium thermodynamics: maximum entropy derivation of the fluctuation-dissipation theorem and entropy production functionals. Phys. Rev. E (2011, submitted).
19. Jensen, F. V., Olesen, K. G., Andersen, S. K.: An algebra of Bayesian belief universes for knowledge-based systems. Networks 20(5), 637-659 (1990).
20. Pólya, G.: Mathematics and Plausible Reasoning. Princeton University Press, Princeton (1954), 2 vols.
21. Cox, R. T.: The Algebra of Probable Inference. Johns Hopkins University Press, Baltimore (1961).
22. Aczél, J.: A Short Course on Functional Equations and Their Applications. Reidel, Dordrecht (1987).
23. Torrie, G. M., Valleau, J. P.: Nonphysical sampling distributions in Monte Carlo free-energy estimation: umbrella sampling. J. Comput. Phys. 23(2), 187-199 (1977).
24. Lu, N., Kofke, D. A.: Accuracy of free-energy perturbation calculations in molecular simulation. I. Modeling. J. Chem. Phys. 114(17), 7303-7311 (2001).
25. Pearl, J.: Fusion propagation, and structuring in belief networks. Artif. Intell. 29(3), 241-288 (1986).
26. Shenoy, P. P., Shafer, G.: Axioms for probability and belief-function propagation. In: Shachter, R. D., Levitt, T. S., Lemmer, J. F., Kanal, L. N. (eds.) Machine Intelligence and Pattern Recognition. Uncertainty in Artificial Intelligence, vol. 4, pp. 169-198. North-Holland, Amsterdam (1990).
27. Rogers, D. M., Beck, T. L.: Modeling molecular and ionic absolute solvation free energies with quasichemical theory bounds. J. Chem. Phys. 129(13), 134505 (2008).
28. Rogers, D. M., Rempe, S. B.: Probing the thermodynamics of competitive ion binding using minimum energy structures. J. Phys. Chem. B 115(29), 9116-9129 (2011).
29. Åqvist, J., Luzhkov, V.: Ion permeation mechanism of the potassium channel. Nature 404(6780), 881-884 (2000).
30. Hestenes, D.: Entropy indistinguishability. Am. J. Phys. 38(7), 840-845 (1970).
31. Saunders, S.: On the explanation for quantum statistics. Stud. Hist. Philos. Sci. Part B, Stud. Hist. Philos. Mod. Phys. 37(1), 192-211 (2006).
32. Chipot, C., Pohorille, A. (eds.): Free Energy Calculations. Springer, Berlin (2007).
33. + channel Fab complex at 2. 0 Å resolution. Nature 414, 43-48 (2001).
34. Callen, H. B.: Thermodynamics and an Introduction to Thermostatistics, 2nd edn. Wiley, New York (1985).
35. Beck, T. L., Paulaitis, M. E., Pratt, L. R.: The Potential Distribution Theorem and Models of Molecular Solutions. Cambridge University Press, New York (2006).
36. Friedman, H. L., Krishnan, C. V.: Thermodynamics of ion hydration. In: Franks, F. (ed.) Water: A Comprehensive Treatise. Plenum Press, New York (1973).
37. + channels. Nature 466(7303), 203-208 (2010).
38. Bergmann, P. G., Lebowitz, J. L.: New approach to nonequilibrium processes. Phys. Rev. 99(2), 578-587 (1955).
39. Lebowitz, J. L.: Stationary nonequilibrium Gibbsian ensembles. Phys. Rev. 114(5), 1192-1202 (1959).
40. Filyukov, A. A., Karpov, V. Ya.: Method of the most probable path of evolution in the theory of stationary irreversible processes. J. Eng. Phys. Thermophys. 13, 416-419 (1967).
41. Akaike, H.: Information theory and an extension of the maximum likelihood principle. In: International Symposium on Information Theory, 2nd edn., pp. 267-281 (1973).
42. Kawai, R., Parrondo, J. M. R., Van den Broeck, C.: Dissipation: the phase-space perspective. Phys. Rev. Lett. 98(8), 080602 (2007).
43. Crooks, G. E.: Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. Phys. Rev. E 60(3), 2721-2726 (1999).
44. Jarzynski, C.: Rare events and the convergence of exponentially averaged work values. Phys. Rev. E 73, 046105 (2006).
45. Jaynes, E. T.: Information theory and statistical mechanics. II. Phys. Rev. 108(2), 171-190 (1957).
46. von Neumann, J.: Mathematical Foundations of Quantum Mechanics. Princeton University Press, Princeton (1996). Translated by Robert T. Bayer.
47. Jaynes, E. T.: The evolution of Carnot's principle. In: EMBO Workshop on Maximum-Entropy Methods, vol. 1, pp. 267-282 (1984). Reprinted by Ericksen & Smith in 1988.
48. Chua, L. O.: Memristor-the missing circuit element. IEEE Trans. Circuit Theory CT-18(5), 507-519 (1971).
49. Liebovitch, L. S., Fischbarg, J., Koniarek, J. P.: Ion channel kinetics: a model based on fractal scaling rather than multistate Markov processes. Math. Biosci. 84(1), 37-68 (1987).
50. Zuckerman, D. M., Woolf, T. B.: Dynamic reaction paths and rates through importance-sampled stochastic dynamics. J. Chem. Phys. 111(21), 9475-9484 (1999).
51. Baiesi, M., Maes, C., Neton, K.: Computation of current cumulants for small nonequilibrium systems. J. Stat. Phys. 135(1), 57-75 (2009).
52. Onsager, L.: Reciprocal relations in irreversible processes. I. Phys. Rev. 37(4), 405-426 (1931).
53. Neyton, J., Miller, C.: Potassium blocks barium permeation through a calcium-activated potassium channel. J. Gen. Physiol. 92(5), 549-567 (1988).
54. + channel. J. Gen. Physiol. 92(5), 569-586 (1988).
55. Niven, R. K.: Steady state of a dissipative flow-controlled system and the maximum entropy production principle. Phys. Rev. E 80(2), 021113 (2009).
56. Jou, D., Casas-Vázquez, J., Lebon, G.: Extended irreversible thermodynamics. Rep. Prog. Phys. 51, 1105-1179 (1988).
57. Jou, D., Casas-Vázquez, J., Lebon, G.: Extended irreversible thermodynamics revisited. Rep. Prog. Phys. 62, 1035-1142 (1999).
58. Kjelstrup, S., Bedeaux, D.: Non-equilibrium Thermodynamics of Heterogeneous Systems. Series on Advances in Statistical Mechanics. World Scientific, Singapore (2008).
59. Crooks, G. E.: Path-ensemble averages in systems driven far from equilibrium. Phys. Rev. E 61(3), 2361-2366 (2000).
60. Trepagnier, E. H., Jarzynski, C., Ritort, F., Crooks, G. E., Bustamante, C. J., Liphardt, J.: Experimental test of Hatano and Sasa's nonequilibrium steady-state equality. Proc. Natl. Acad. Sci. USA 101(42), 15038-15041 (2004).
61. Luzzi, R., Vasconcellos, Á. R., Galvão Ramos, J.: Predictive Statistical Mechanics: A Nonequilibrium Ensemble Formalism. Kluwer, Dordrecht (2002).
62. Shirts, M. R., Chodera, J. D.: Statistically optimal analysis of samples from multiple equilibrium states. J. Chem. Phys. 129(12), 124105 (2008).
63. Ytreberg, F. M., Zuckerman, D. M.: Single-ensemble nonequilibrium path-sampling estimates of free energy differences. J. Chem. Phys. 120, 10876 (2004). Note: J. Chem. Phys. 121, 5022 (2004) corrects the Metropolis criterion in the text above Eq. (9).
64. Minh, D. D. L., Chodera, J. D.: Optimal estimators and asymptotic variances for nonequilibrium path-ensemble averages. J. Chem. Phys. 131(13), 134110 (2009).