Learning audio-visual associations using mutual information

Proceedings - Integration of Speech and Image Understanding, ISIU 1999

Volumn , Issue , 1999, Pages 147-163

  Roy, D ^a   Schiele, B ^a,b   Pentland, A ^a  

^a MIT MEDIA LAB   (United States)

^b ETH ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85028689952     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIU.1999.824909     Document Type: Conference Paper

References (35)

1. M. Basseville. Information: entropies, divergences et moyennes. Technical Report 1020, IRISA, Mai 1996. in French.
2. H. Bourlard and N. Morgan. Connectionist Speech Recognition-A Hybrid Approach. Kluwer Academic Publishers, 1994.
3. C. Bregler, H. Hild S. Manke, and A. Waibel. Improving connected letter recognition by lipreading. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, 1993.
4. B. P. Clarkson and A. Pentland. Unsupervised clustering of ambulatory audio and video. In Proceedings of the International Conference of Acoustics, Speech and Signal Processing, 1999.
5. T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley-Interscience, 1991.
6. I. J. Cox and J. J. Leonard. Probabilistic data association for dynamic world modelling: A multi-hypothesis approach. In Proc. International Conference on Advanced Robotics, Pisa, 1991.
7. Carl deMarcken. Unsupervised Language Acquisition. PhD thesis, MIT Artificial Intelligence Laboratory, 1996.
8. H. F. Durrant-Whyte. Sensor models and multisensor integration. International Journal on Robotics Research, 7 (6): 97-113, 1988.
9. H. F. Durrant-Whyte and J. Manyika. Data fusion and sensor management: A decentralized information theoretic approach. Prentice Hall, 1994.
10. J. Feldman, G. Lakoff, D. Bailey, S. Narayanan, T. Regier, and A. Stolcke. Lzero: The first five years. Artificial Intelligence Review, 10: 103-129, 1996.
11. A. L. Gorin. On automated language acquisition. Journal of the Acoustic Society of America, 97 (6): 3441-3461, 1995.
12. A. L. Gorin, S. E. Levinson, A. N. Gertner, and E. Goldman. Adaptive acquisition of language. Computer Speech and Language, 5: 101-132, 1991.
13. H. Hermansky and N. Morgan. Rasta processing of speech. IEEE Transactions on Speech and Audio Processing, October 1994.
14. J. Huttenlocher and P. Smiley. Early word meanings: the case of object names. In Paul Bloom, editor, Language acquisition: core readings, pages 222-247. MIT Press, Cambridge, MA, 1994.
15. J. B. Kruskal and D. Sankoff. An anthology of algorithms and concepts for sequence comparison. In D. Sankoff and J. B. Kruskal, editors, Time Warps, String Edits, and Macromolecules. Addison-Wesley, 1983.
16. H. Moravec. Sensor fusion in certainty grids for mobile robots. AI Mag, 9 (2): 61-74, 1988.
17. H. Murase and S. K. Nayar. Visual learning and recognition of 3d objects from appearance. International Journal of Computer Vision, 14: 5-24, 1995.
18. L. R. Rabiner and B. H. Juang. Fundamentals of Speech Recognition. Prentice Hall, 1993.
19. R. P. N. Rao and D. H. Ballard. Object indexing using an iconic sparse distributed memory. In International Conference of Computer Vision, pages 24-31, 1995.
20. T. Robinson. An application of recurrent nets to phone probability estimation. IEEE Trans. Neural Networks, 5 (3), 1994.
21. R. Rose. Word spotting from continuous speech utterances. In Chin-Hui Lee, Frank K. Soong, and Kuldip K. Paliwal, editors, Automatic Speech and Speaker Recognition, chapter 13, pages 303-329. Kluwer Academic, 1996.
22. D. K. Roy. Learning words from sights and sounds: A computational model. PhD thesis, MIT Media Laboratory, 1999.
23. A. Sankar and A. Gorin. Adaptive language acquisition in a multi-sensory device, pages 324-356. Chapman and Hall, London, 1993.
24. B. Schiele. Object Recognition using Multidimensional Receptive Field Histograms. PhD thesis, I. N. P. Grenoble, July 1997. English translation.
25. B. Schiele and J. L. Crowley. Probabilistic object recognition using multidimensional receptive field histograms. In ICPR'96 Proceedings of the 13th International Conference on Pattern Recognition, Volume B, pages 50-54, August 1996.
26. B. Schiele and J. L. Crowley. Recognition without correspondence using multidimensional receptive field histograms. International Journal of Computer Vision, 2000. To appear, available as Technical Report 453, Vision and Modeling, MIT Media Laboratory.
27. B. Schiele, N. Oliver, T. Jebara, and A. Pentland. An interactive computer vision system, dypers: Dynamic personal enhanced remembrance system. In International Conference on Vision Systems, pages 51-65, Jan 1999.
28. B. Schiele and A. Pentland. Attentional objects for visual context understanding. Technical Report 500, Vision and Modeling, MIT Media Laboratory, 1999.
29. S. Seneff and V. Zue. Transcription and alignment of the timit database. In Proceedings of the Second Symposium on Advanced Man-Machine Interface through Spoken Language, Oahu, Hawaii, November 1988.
30. J. Siskind. Naive Physics, Event Perception, Lexical Semantics, and Language Acquisition. PhD thesis, Massachusetts Institute of Technology, 1992.
31. Catherine E. Snow. Mother's speech to children learning language. Child Development, 43: 549-565, 1972. speech is redundant in motherese.
32. D. G. Stork, G. Wolff, and E. Levine. Neural network lipreading system for improved speech recognition. In Proceedings of the 1992 International Joint Conference on Neural Networks, 1992.
33. M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3 (1), 1991.
34. S. Wachsmuth, H. Brandt-Pook, G. Socher, F. Kummert, and G. Sagerer. Multilevel integration of vision and speech understanding using bayesian networks. In International Conference on Vision Systems, pages 231-254, 1999.
35. J. H. Wright, M. J. Carey, and E. S. Parris. Statistical models for topic identification using phoneme substrings. In Proceedings of ICASSP, pages 307-310, 1996.