Bayesian networks and information theory for audio-visual perception modeling

Biological Cybernetics

Volumn 103, Issue 3, 2010, Pages 213-226

  Besson, Patricia ^a   Richiardi, Jonas ^b,c   Bourdin, Christophe ^a   Bringoux, Lionel ^a   Mestre, Daniel R ^a   Vercher, Jean Louis ^a  

^a CNRS   (France)

^b EPFL   (Switzerland)

^c UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

Causal Bayesian networks; Decision process; Graphical model; Information theory; Model elicitation; Mutual information

Indexed keywords

AUDIO-VISUAL; CAUSAL BAYESIAN NETWORK; CAUSAL MODEL; COGNITIVE MECHANISMS; CONDITIONAL INDEPENDENCES; CROSS-MODAL INTERACTION; DATA-DRIVEN; DECISION PROCESS; GRAPHICAL MODEL; HUMAN OBSERVERS; HUMAN SUBJECTS; MULTISENSORY; MUTUAL INFORMATIONS; ONE-FACTOR; PREDICTIVE ABILITIES; PROBABILISTIC REASONING;

DECISION THEORY; DISTRIBUTED PARAMETER NETWORKS; GRAPHIC METHODS; INFERENCE ENGINES; INFORMATION THEORY; INFORMATION USE; INTELLIGENT NETWORKS; KNOWLEDGE BASED SYSTEMS; RANDOM VARIABLES; SPEECH RECOGNITION;

BAYESIAN NETWORKS;

ANIMAL; ARTICLE; BAYES THEOREM; BIOLOGICAL MODEL; BRAIN; COMPUTER SIMULATION; HEARING; HUMAN; INFORMATION SCIENCE; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; PSYCHOMOTOR PERFORMANCE; STANDARD; STATISTICAL MODEL; TASK PERFORMANCE; VISION;

ANIMALS; AUDITORY PERCEPTION; BAYES THEOREM; BRAIN; COMPUTER SIMULATION; HUMANS; INFORMATION THEORY; MODELS, NEUROLOGICAL; MODELS, STATISTICAL; NEUROPSYCHOLOGICAL TESTS; PSYCHOMOTOR PERFORMANCE; TASK PERFORMANCE AND ANALYSIS; VISUAL PERCEPTION;

EID: 77955549915     PISSN: 03401200     EISSN: 14320770     Source Type: Journal    
DOI: 10.1007/s00422-010-0392-8     Document Type: Article

References (43)

1. H Akaike 1974 A new look at the statistical model identification IEEE Trans Autom Control 19 6 716 723 10.1109/TAC.1974.1100705
2. D Alais D Burr 2004 The ventriloquist effect results from near-optimal bimodal integration Curr Biol 14 3 257 262 1:CAS:528:DC%2BD2cXhtFCht70%3D 14761661
3. TJ Anastasio PE Patton 2003 A two-stage unsupervised learning algorithm reproduces multisensory enhancement in a neural network model of the corticotectal system J Neurosci 23 17 6713 6727 1:CAS:528:DC%2BD3sXmtFensbc%3D 12890764
4. TS Andersen K Tiippana M Sams 2004 Factors influencing audiovisual fission and fusion illusions Cogn Brain Res 21 301 308 10.1016/j.cogbrainres. 2004.06.004 (Pubitemid 39423632)
5. TS Andersen K Tiippana S Mikko 2005 Maximum likelihood integration of rapid flashes and beeps Neurosci Lett 380 155 160 10.1016/j.neulet.2005.01.030 1:CAS:528:DC%2BD2MXjs1Ghtr4%3D 15854769 (Pubitemid 40602347)
6. SA Andersson D Madigan MD Perlman 1997 A characterization of Markov equivalence classes for acyclic digraphs Ann Stat 25 2 505 541 10.1214/aos/1031833662
7. PW Battaglia RA Jacobs RN Aslin 2003 Bayesian integration of visual and auditory signals for spatial localization J Opt Soc Am A 20 7 1391 1397 10.1364/JOSAA.20.001391
8. Burnham KP, Anderson DR (2002a) Model selection and multimodel inference: a practical information-theoretic approach, Chap 2.4, 2nd edn. Springer, New York, pp 66-67
9. Burnham KP, Anderson DR (2002b) Model selection and multimodel inference: a practical information-theoretic approach, Chap 2.6, 2nd edn. Springer, New York, pp 70-72
10. Cover TM, Thomas JA (1991) Elements of information theory. Wiley, New York, USA
11. S Deneve A Pouget 2004 Bayesian multisensory integration and cross-modal spatial links J Physiol Paris 98 1-3 249 258 10.1016/j.jphysparis.2004.03.011 15477036 (Pubitemid 39345375)
12. Druzdzel MJ, Glymour C (1995) What do college ranking data tell us about student retention: causal discovery in action. In: Proceedings of 4th workshop on intelligent information systems. IPI PAN Press, Augustow, Poland, pp 1-10
13. Ernst MO (2006) A Bayesian view on multimodal cue integration. In: Human body perception from the inside out, Chap 6. Oxford University Press, New York, pp 105-131
14. MO Ernst MS Banks 2002 Humans integrate visual and haptic information in a statistically optimal fashion Nature 415 6870 429 433 10.1038/415429a 1:CAS:528:DC%2BD38XhtVCntrY%3D 11807554 (Pubitemid 34100953)
15. MO Ernst HH Bülthoff 2004 Merging the senses into a robust percept TRENDS Cogn Sci 8 4 162 169 10.1016/j.tics.2004.02.002 15050512 (Pubitemid 38429926)
16. K He G Meeden 1997 Selecting the number of bins in a histogram: a decision theoretic approach J Stat Plan Inference 61 1 49 59 10.1016/S0378-3758(96)00142-5
17. J Heron D Whitake PV McGraw 2004 Sensory uncertainty governs the extent of audio-visual interaction Vis Res 44 2875 2884 10.1016/j.visres.2004.07.001 1:STN:280:DC%2BD2cvntFektg%3D%3D 15380993 (Pubitemid 39223308)
18. TM Hospedales S Vijayakumar 2008 Structure inference for bayesian multisensory scene understanding IEEE Trans Pattern Anal Mach Intell (PAMI) 30 12 2140 2157 10.1109/TPAMI.2008.25
19. Knill, DC, Richards, W (eds) (1996) Perception as Bayesian inference. Cambridge University Press, New York
20. Kontkanen P, Myllymäki P, Silander T, Tirri H, Grünwald P (1998) Bayesian and information-theoretic priors for bayesian network parameters. In: Proceedings on 10th European conference on machine learning, vol 1398. Springer-Verlag, Chemnitz, Germany, pp 89-94
21. KP Körding U Beierholm WJ Ma S Quartz JB Tenenbaum L Shams 2007 Causal inference in multisensory perception PLoS ONE 2 9 e943 10.1371/journal.pone.0000943 17895984 (Pubitemid 351460816)
22. Lauritzen SL (1996) Graphical models. Oxford University Press, New York,USA
23. J Lewald R Guski 2003 Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli Cogn Brain Res 16 468 478 10.1016/S0926-6410(03)00074-0 (Pubitemid 36426932)
24. MacKay DJ (2003) Information theory, inference, and learning algorithms. Cambridge University Press, New York, USA
25. Margaritis D (2003) Learning bayesian network model structure from data. Phd thesis, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA
26. Murphy KP (2002) Dynamic bayesian networks: representation, inference and learning. Phd thesis, University of California, Berkeley, USA
27. Neapolitan RE (2004) Learning Bayesian networks. Prentice Hall, Upper Saddle River, NJ
28. Pearl J (1988) Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan kaufmann, San Francisco, CA
29. Richiardi J (2007) Probabilistic models for multi-classifier biometric authentication using quality measures. These no. 3954, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
30. Roach NW, Heron J, McGraw PV (2006) Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration. In: Proceedings of the Royal Society B: biological sciences, vol 273. Royal Society of London, London, UK, pp 2159-2168
31. Robins JM, Wasserman L (1999) On the impossibility of inferring causation from association without background knowledge. In: Computation, causation, and discovery. MIT Press, Cambridge, MA, USA, pp 305-321
32. Y Sato T Toyoizumi 2007 Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli Neural Comput 19 3335 3355 10.1162/neco.2007.19.12.3335 17970656
33. Scott DW, Sain SR (2005) Multi-dimensional density estimation. In: Data mining and computational statistics, Handbook of statistics, Chap 9, vol 23. Elsevier, Amsterdam, pp 229-262
34. L Shams WJ Ma U Beierholm 2005 Sound-induced flash illusion as an optimal percept NeuroReport 16 17 1923 1927 10.1097/01.wnr.0000187634.68504.bb 16272880 (Pubitemid 41653515)
35. Sheskin DJ (2004) Handbook of parametric and nonparametric statistical procedures, 3rd edn. CRC press, New York, NY, USA
36. C Spence 2007 Audiovisual multisensory integration Acoust Sci Technol 28 2 61 70 10.1250/ast.28.61 (Pubitemid 46457224)
37. Spirtes P, Glymour C, Scheines R (2001) Causation, prediction, and search. MIT Press, Cambridge, MA, USA
38. A Strehl J Ghosh 2002 Cluster ensembles-a knowledge reuse framework for combining multiple partitions J Mach Learn Res 3 583 617 10.1162/ 153244303321897735
39. Theodoridis S, Koutroumbas K (2006) Pattern recognition. Academic Press, Orlando, FL, USA
40. Verma T, Pearl J (1992) An algorithm for deciding if a set of observed independencies has a causal explanation. In: Proceedings of 8th annual conference on uncertainty in artificial intelligence (UAI-92). Morgan Kaufmann, San Mateo, CA, pp 323-333
41. DH Warren 1979 Spatial localization under conflict conditions: is there a single explanation? Perception 8 3 323 337 10.1068/p080323 1:STN:280: DyaL3c7gtVOquw%3D%3D 534159
42. RB Welch DH Warren 1980 Immediate perceptual response to intersensory discrepancy Psychol Bull 88 3 638 667 10.1037/0033-2909.88.3.638 1:STN:280:DyaL3M%2FnslOlsQ%3D%3D 7003641
43. DR Wozny UR Beierholm L Shams 2008 Human trimodal perception follows optimal statistical inference J Vis 8 3 1 11 10.1167/8.3.24 18484830