Speaker-dependent bimodal integration of Chinese phonemes and letters using multimodal self-organizing networks

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2007, Pages 248-253

  Chou, Sharon M ^a   Papliński, Andrew P ^a   Gustafsson, Lennart ^b  

^a MONASH UNIVERSITY   (Australia)

^b LULEÅ UNIVERSITY OF TECHNOLOGY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER NETWORKS;

CORTICAL AREAS; JOINT CONFERENCE; MULTI-MODAL;

NEURAL NETWORKS;

EID: 51749108658     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2007.4370963     Document Type: Conference Paper

References (20)

1. A. P. Papliński and L. Gustafsson, "Feedback in multimodal self-organizing networks enhances perception of corrupted stimuli," in Lect. Notes in Artif. Intell., vol. 4304. Springer, 2006, pp. 19-28.
2. M. S. Beauchamp, "See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex," Current Opinion in Neurobiology, vol. 15, pp. 145-153, 2005.
3. N. van Atteveldt, E. Formisano, R. Goebel, and L. Blomert, "Integration of letters and speech sounds in the human brain," Neuron, vol. 43, pp. 271-282, July 2004.
4. A. P. Papliński and L. Gustafsson, "Multimodal feedforward self-organizing maps," in Lect. Notes in Comp. Sci., vol. 3801. Springer, 2005, pp. 81-88.
5. L. Gustafsson and A. P. Papliński, "Bimodal integration of phonemes and letters: an application of multimodal self-organizing networks," in Proc. Int. Joint Conf. Neural Networks, Vancouver, Canada, July 2006, pp. 704-710.
6. W. Teder-Sälejärvi, F. Di Russo, J. McDonald, and S. Hillyard, "Effects of spatial congruity on audio-visual multimodal integration," Journal of Cognitive Neuroscience, vol. 17:9, pp. 1396-1409, 2005.
7. E. G. Calvert, C. Spence, and B. E. Stein, The handbook of multisensory processes, 1st ed. Cambridge, MA: MIT Press, 2004.
8. G. A. Calvert and R. Campbell, "Reading speech from still and moving faces: The neural substrates of visual speech," Cognitive Neuroscience, vol. 15, pp. 57-70, 2003.
9. S. Bookheimer, "How the brain reads Chinese characters," Neuroreport, vol. 12, no. 1, Jan. 2001.
10. C. K. Leong, P. W. Cheng, and H. T. Li, "The role of sensitivity to rhymes, phonemes and tones in reading English and Chinese pseudowords," Reading and Writing, vol. 18, pp. 1-26, 2005.
11. L. Johnson, "Reading acquisition in Mandarin Chinese," 2005, http://convention.asha.org/2005/handouts/293_Johnson_Laura_071593_121405034828. pdf .
12. W. Siok and P. Fletcher, "The role of phonological awareness and visual orthographic skills in Chinese reading acquisition," Developmental Psychology, vol. 37:6, pp. 886-889, 2001.
13. K.-Y. Ho, "Mandarin," http://www.glue.umd.edu/~kwyho/ phonetics_mandarin.htm .
14. "East Asian scripts," The Unicode Consortium, 2006, http://www.unicode.org/versions/Unicode4.0.0/ch11.pdf.
15. "Transliteration/Romanization Systems," 2003, http://www.eslisland.com/life/TransliterationRomanization-Zhuyin-Pinyin.htm .
16. T. Xie, "A brief introduction to Romanized spelling system of Chinese - Pinyin," Dept. Asian and Asian American Studies, California State University, Long Beach, 2004, www.csulb.edu/~txie/pcr/soundsys/introtopinyin. htm.
17. T. Kohonen, Self-Organising Maps, 3rd ed. Berlin: Springer-Verlag, 2001.
18. P. Xu, C.-H. Chang, and A. Papliński, "Self-organizing topological tree for on-line vector quantization and data clustering," IEEE Tran. System, Man and Cybernetics, Part B: Cybernetics, vol. 35, no. 3, pp. 515-526, June 2005.
19. D. Alahakoon, S. K. Halgamuge, and B. Srinivasan, "Dynamic self-organizing maps with controlled growth for knowledge discovery," IEEE Trans. Neural Networks, vol. 11, no. 3, pp. 601-614, May 2000.
20. B. Gold and N. Morgan, Speech and audio signal processing. New York: John Wiley & Sons, Inc., 2000.