The meanings of entropy

Entropy

Volumn 7, Issue 1, 2005, Pages 68-96

  Brissaud, Jean Bernard ^a  

^a FACULTÉ DES SCIENCES   (Morocco)

Author keywords

Disorder; Entropy; Freedom; Information

Indexed keywords

INFORMATION ANALYSIS; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; QUANTUM THEORY; STATISTICAL METHODS;

BOLTZMANN ENTROPY; DISORDERS; FREEDOM; SHANNON'S DEMONSTRATIONS;

ENTROPY;

EID: 17444377229     PISSN: 10994300     EISSN: 10994300     Source Type: Journal    
DOI: 10.3390/e7010068     Document Type: Article

References (36)

1. Shannon: "My greatest concern was what to call it. I thought of calling it 'information', but the word was overly used, so I decided to call it 'uncertainty'. When I discussed it with John Von Neumann, he had a better idea. Von Neumann told me, 'you should call it entropy, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that name, so it already has a name. In the second place, and more important, nobody knows what entropy really is, so in a debate you will always have the advantage." as quoted in M. Tribus, E.G. McIrvine, Energy and information, Scientific American, 224 (September 1971), 178-184.
2. Ludwig Boltzmann. http://www.entropylaw.com/entropydisorder.html
3. Claude Shannon's "A mathematical theory of communication" Bell System Technical Journal, vol. 27, pp. 379-423 and 623-656, July and October, 1948.
4. Léon Brillouin (1889-1969). Science and Information Theory. Editions Academic Press. 1956
5. Gary L. Bertrand. Mass, Energy and Freedom: The coins of thermodynamics. http://web.umr.edu/~gbert/basic/entropy.htm
6. P. E. Williams. Energy and Entropy as the Fundamentals of Theoretical Physics. Entropy 2002, 4. http://www.mdpi.net/entropy/htm/e4040128.htm
7. T. L. Duncan. The Deep Physics Behind the Second Law: Information and Energy as Independent Forms of Bookkeeping. Entropy 2004, 6. http://www.mdpi.net/entropy/htm/e6010021.htm
8. P. Garbaczewski. INFORMATION -Is There Anything Where Nobody Looks? http://sympozjum-lfppi.if.pwr.wroc.pl/proceedings/KarpaczPG.pdf
9. M.V. Mesquita, A.R. Vasconcellos, R. Luzzi, S. Mascarenhas. Systems Biology: an information-theoretic-based statistical approach. Brazilian Journal of Physics, vol. 34, n° 2A, June 2004. http://pcsbf1.sbfisica.org.br/bjp/ Vol34/Num2a/v34_459.pdf
10. R. Landauer. Irreversibility and heat generation in the computing process. IBM J. Res. Dev. 5, 183-191, 1961. http://www.research.ibm.com/journal/ rd/053/ibmrd0503C.pdf
11. C. H. Bennett. Demons, engines and the second law. Scientific American. 1987.
12. Brillouin [1951a] p. 335: "Shannon, however compares information with positive entropy, a procedure which seems difficult to justify since information is lost during the process of transmission, while entropy is increased." http://www.mpiwg-berlin.mpg.de/staff/segal/thesis/thesehtm/ chap5/ch5b.htm
13. Ole E. Barndor -Nielsen, Richard D. Gill. Quantum Statistics. 1996. http://www.math.uu.nl/people/gill/Preprints/chapter2.pdf
14. Von Neumann Entropy, http://arxiv.org/pdf/math-ph/0102013
15. Properties of the Von Neumann Entropy, http://red.csie.ntu.edu.tw/QC/ peng/slides5.pdf
16. Entropy of the Spin System, http://www.realtime.net/~drwolf/papers/ dissertation/node88.html
17. OJE Maroney. Information and Entropy in Quantum Theory. Ph.D. Thesis Birkbeck College University of London. http://www.bbk.ac.uk/tpru/OwenMaroney/ thesis/thesis.pdf
18. N. J. Cerf, C. Adami. Accessible information in quantum measurement. http://xxx.lanl.gov/pdf/quant-ph/9611032
19. http://encyclopedia.thefreedictionary.com/EPR%20paradox
20. Einstein, A.; Podolsky, B.; and Rosen, N. "Can Quantum-Mechanical Description of Physical Reality Be Considered Complete?" Phys. Rev. 47, 777-780, 1935.
21. http://www.eleves.ens.fr:8080/home/madore/misc/best_of_GroTeXdieck/EPR. Mars 1999. In french.
22. http://www.entropysite.com. A site dedicated to the teaching of entropy, based on the idea that entropy is not disorder, but a measure of the dispersal of energy.
23. D.C. Brody, B. K. Meister. Discrete uncertainty relations. J. Phys. A:Math Gen 32. 1999. http://www.iop.org/EJ/S/UNREG/t7JlkvTukzd,50UZvzQ,aQ/ article/0305-4470/32/26/310/a92610.pdf
24. E.T. Jaynes. Probability Theory, The logic of science. Cambridge University Press. 2003. p. 207-210
25. D. Domert. 2001. The holographic principle. www.teorfys.uu.se/courses/ exjobb/HOLOGRAPHIC.pdf
26. J. Machta. Entropy, information and computation. University of Massachussets, Amherst 1999.
27. E.T. Jaynes. Probability Theory, The logic of science. Cambridge University Press. 2003. p.440-450
28. E.T. Jaynes. Probability Theory, The logic of science. Cambridge University Press. 2003. p.358-365
29. A Nonequilibrium Statistical Ensemble Formalism. Maxent-Nesom: Concepts, Construction, Application, Open Questions and Criticisms. Sept 1999. http://arxiv.org/PS.cache/cond-mat/pdf/9909/9909160.pdf.
30. S. Galam. Petite présentation des systèmes désordonnés. In french. http://www.cenecc.ens.fr/EcoCog/ Porquerolles2001/bases-galam.html
31. http://www.psigate.ac.uk/newsite/reference/plambeck/chem2/p02042.htm
32. T. Valone, Understanding Zero Point Energy. Integrity Research Institute, 1220 L Street NW, Suite 100, Washington. http://users.erols.com/iri/ZPEpaper. html
33. The Energetic Vacuum: Implications For Energy Research. H.E. Puthoff, PhD. Institute for Advanced Studies, Austin, http://www.ldolphin.org/energetic. html
34. R. L. Goren, Empirical Evidence for a Law of Information Growth. Entropy 2001, 3. http://www.mdpi.net/entropy/htm/e3040259.htm
35. P. H. Eberhard, (1977) Nuovo Cimento, 38B, 75 et 46B, 392.
36. P. H. Eberhard, (1977) Nuovo Cimento, 38B, 75 et 46B, 392.