Algorithmic independence of initial condition and dynamical law in thermodynamics and causal inference

New Journal of Physics

Volumn 18, Issue 9, 2016, Pages

  Janzing, Dominik ^a   Chaves, Rafael ^b,c,d   Schölkopf, Bernhard ^a  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b UNIVERSITY OF FREIBURG   (Germany)

^c UNIVERSITY OF COLOGNE   (Germany)

^d FEDERAL UNIVERSITY OF RIO GRANDE DO NORTE   (Brazil)

Author keywords

algorithmic randomness; arrow of time; causal inference; Kolmogorov complexity; physical entropy

Indexed keywords

PARALLEL PROCESSING SYSTEMS; THERMODYNAMICS;

ALGORITHMIC RANDOMNESS; ARROW OF TIME; CAUSAL INFERENCES; CAUSE AND EFFECTS; CONDITIONAL DISTRIBUTION; INITIAL CONDITIONS; KOLMOGOROV COMPLEXITY; PHYSICAL SYSTEMS;

PROBABILITY DISTRIBUTIONS;

EID: 84990890497     PISSN: 13672630     EISSN: None     Source Type: Journal    
DOI: 10.1088/1367-2630/18/9/093052     Document Type: Article

References (58)

1. Spirtes P, Glymour C and Scheines R 1993 Causation, Prediction, and Search (Lecture Notes in Statistics) (New York: Springer)
2. Pearl J 2000 Causality (Cambridge: Cambridge University Press)
3. Pearl J 2014 Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference (San Mateo, CA: Morgan Kaufmann)
4. Friedman N 2004 Inferring cellular networks using probabilistic graphical models Science 303 799-805
5. Jackson A and Scheines R 2005 Single mothers' self-efficacy, parenting in the home environment, and children's development in a two-wave study Soc. Work Res. 29 7-20
6. Moneta A, Entner D, Hoyer P and Coad A 2013 Causal inference by independent component analysis: theory and applications∗ Oxford Bull. Econ. Stat. 75 705-30
7. Fritz T 2012 Beyond Bell's theorem: correlation scenarios New J. Phys. 14 103001
8. Leifer M and Spekkens R 2013 Towards a formulation of quantum theory as a causally neutral theory of Bayesian inference Phys Rev. A 88 052130
9. Wood C and Spekkens R 2015 The lesson of causal discovery algorithms for quantum correlations: causal explanations of Bell-inequality violations require fine-tuning New J. Phys. 17 033002
10. Chaves R, Majenz C and Gross D 2015 Information-theoretic implications of quantum causal structures Nat. Commun. 6 5766
11. Chaves R, Kueng R, Brask J B and Gross D 2015 Unifying framework for relaxations of the causal assumptions in Bell's theorem Phys. Rev. Lett. 114 140403
12. Henson J, Lal R and Pusey M 2014 Theory-independent limits on correlations from generalized Bayesian networks New J. Phys. 16 113043
13. Ried K, Agnew M, Vermeyden L, Janzing D, Spekkens R and Resch K 2015 A quantum advantage for inferring causal structure Nat. Phys. 11 414-20
14. Mooij J M, Peters J, Janzing D, Zscheischler J and Schölkopf B 2016 Distinguishing cause from effect using observational data: methods and benchmarks J. Mach. Learn. Res. 17 1-102
15. Janzing D and Schölkopf B 2010 Causal inference using the algorithmic Markov condition IEEE Trans. Inf. Theory 56 5168-94
16. Lemeire J and Janzing D 2012 Replacing causal faithfulness with algorithmic independence of conditionals Minds Mach. 23 227-49
17. Zurek W 1989 Algorithmic randomness and physical entropy Phys. Rev. A 40 4731-51
18. Vapnik V 1998 Statistical Learning Theory (New York: Wiley)
19. Chapelle O, Schölkopf B and Zien A 2010 Semi-Supervised Learning (Cambridge, MA: MIT Press)
20. Schölkopf B, Janzing D, Peters J, Sgouritsa E, Zhang K and Mooij J 2012 On causal and anticausal learning ed J Langford and J Pineau (New York: ACM) pp 1255-62
21. Schölkopf B, Janzing D, Peters J, Sgouritsa E, Zhang K and Mooij J 2013 Semi-supervised learning in causal and anticausal settings Empirical inference, Festschrift in honor of Vladimir Vapnik ed B Schölkopf, Z Luo and V Vovk (Berlin: Springer) pp 129-41
22. Peters J, Janzing D, Gretton A and Schölkopf B 2009 Detecting the direction of causal time series International Conference Proceeding Series (New york: ACM) pp 801-8
23. Pickup L C, Pan Z, Wei D, Shih Y, Zhang C, Zisserman A, Schölkopf B and Freeman W T 2014 Seeing the arrow of time 2014 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) pp 2043-50
24. Janzing D 2010 On the entropy production of time series with unidirectional linearity J. Stat. Phys. 138 767-79
25. Kolmogorov A 1965 Three approaches to the quantitative definition of information Problems Inform. Transm. 1 1-7
26. Chaitin G 1975 A theory of program size formally identical to information theory J. Assoc. Comput. Mach. 22 329-40
27. Li M and Vitányi P 1997 An Introduction to Kolmogorov Complexity and Its Applications 3rd edn (New York: Springer) 2008
28. Barron A and Cover T 1991 Minimum complexity density estimation IEEE Trans. Inf. Theory 37 1034-54
29. Bennett C 1982 The thermodynamics of computation - a review Int. J. Theor. Phys. 21 905-40
30. Cover T and Thomas J 1991 Elements of Information Theory (Wileys Series in Telecommunications) (Hoboken, NK: Wiley)
31. Nielsen M and Chuang I 2000 Quantum Computation and Quantum Information (Cambridge: Cambridge University Press)
32. Jaynes E T 1965 Gibbs vs. Boltzmann entropies Am. J. Phys. 33 391-8
33. Caves C M 1993 Information and entropy Phys. Rev. E 47 4010-7
34. Caves C 1994 Information, entropy and chaos Physical Origins of Time Asymmetry ed J Halliwell et al (Cambridge: Cambridge University Press) pp 47-89
35. Balian R 1992 From Microphysics to Macrophysics (Berlin: Springer)
36. Zeh H D 2001 The Physical Basis of the Direction of Time (Berlin: Springer)
37. Deutsch D 1997 The Fabric of Reality (London: Penguin Books)
38. Janzing D and Beth T 2001 Complexity measure for continuous time quantum algorithms Phys. Rev. A 64 022301
39. Wocjan P, Rötteler M, Janzing D and Beth T 2002 Simulating Hamiltonians in quantum networks: efficient schemes and complexity bounds Phys. Rev. A 65 042309
40. Janzing D 2007 Spin-1/2 particles moving on a 2D lattice with nearest-neighbor interactions can realize an autonomous quantum computer Phys. Rev. A 75 012307
41. Gemmer J, Michel M and Mahler G 2005 Quantum Thermodynamics: Emergence of Thermodynamic Behavior Within Composite Quantum Systems (Berlin: Springer)
42. Mora C, Kraus B and Briegel H 2007 Quantum Kolmogorov complexity and its applications Int. J. Quantum Inform. 5 729-50
43. Reichenbach H 1956 The Direction of Time (Berkeley, CA: University of California Press)
44. Solomonoff R 1960 A preliminary report on a general theory of inductive inference Technical report V-131 ZTB-138
45. Levin L 1974 Laws of information conservation (non-growth) and aspects of the foundation of probability theory Problems Inf. Trans. 10 206-10
46. Allahverdyan A and Janzing D 2008 Relating the thermodynamic arrow of time to the causal arrow J. Stat. Mech. 4 P04001
47. Kano Y and Shimizu S 2003 Causal inference using nonnormality pp 261-70
48. Janzing D and Steudel B 2010 Justifying additive-noise-based causal discovery via algorithmic information theory Open Syst. Inf. Dyn. 17 189-212
49. Daniusis P, Janzing D, Mooij J M, Zscheischler J, Steudel B, Zhang K and Schölkopf B 2010 Inferring deterministic causal relations pp 143-50
50. Janzing D, Mooij J, Zhang K, Lemeire J, Zscheischler J, Daniušis P, Steudel B and Schölkopf B 2012 Information-geometric approach to inferring causal directions Artif. Intell. 182-183 1-31
51. Frisch U, d'Humiéres D and Hasslacher B 1987 Lattice gas hydrodynamics in two- and three-dimensions Complex Syst. 1 649-707
52. Shajarisales N, Janzing D, Schölkopf B and Besserve M 2015 Telling cause from effect in deterministic linear dynamical systems Proc. 32th Int. Conf. on Machine Learning (ICML) pp 285-94
53. Steudel B, Janzing D and Schölkopf B 2010 Causal Markov condition for submodular information measures Proc. 23rd Annual Conf. on Learning Theory (COLT) pp 464-76
54. Lindblad G 1976 On the generators of quantum dynamical semigroups Commun. Math. Phys. 48 119-30
55. Pechukas P 1994 Reduced dynamics need not be completely positive Phys. Rev. Lett. 73 1060-2
56. Brunner N, Cavalcanti D, Pironio S, Scarani V and Wehner S 2014 Bell nonlocality Rev. Mod. Phys. 86 419-78
57. Poh H, Markiewicz M, Kurzyński P, Cerè A, Kaszlikowski D and Kurtsiefer C Probing quantum-classical boundary with compression software New J. Phys. 18 035011
58. Bendersky A, de la Torre G, Senno G, Figueira A and Acin S 2016 Algorithmic pseudorandomness in quantum setups Phys. Rev. Lett. 116 230402