A fundamental frequency estimator for the real-time processing of musical sounds for cochlear implants

Speech Communication

Volumn 49, Issue 2, 2007, Pages 113-122

  Zakis, Justin A ^a,b   McDermott, Hugh J ^c   Vandali, Andrew E ^a,b  

^a University of Melbourne   (Australia)

^b BIONIC EAR INSTITUTE   (Australia)

^c UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Cochlear implant; Fundamental frequency; Pitch; Sung vowels

Indexed keywords

COCHLEAR IMPLANTS; FUNDAMENTAL FREQUENCY; SOUND PROCESSORS; SUNG VOWELS;

ERROR ANALYSIS; FREQUENCY DOMAIN ANALYSIS; MUSICAL INSTRUMENTS; REAL TIME SYSTEMS; SPEECH PROCESSING; WHITE NOISE;

COMPUTER MUSIC;

EID: 33846908704     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2006.12.001     Document Type: Article

References (36)

1. Barry J.G., Blamey P.J., Martin L.F.A., Lee K.Y.S., Tang T., Ming Y.Y., and van Hasselt C.A. Tone discrimination in Cantonese-speaking children using a cochlear implant. Clin. Linguist. Phon. 16 2 (2002) 79-99
2. Bosman A.J., and Smoorenburg G.F. Evaluation of three pitch tracking algorithms at several signal-to-noise ratios. Acustica 83 (1997) 567-571
3. Brown J.C. Calculation of a constant Q spectral transform. J. Acoust. Soc. Amer. 89 1 (1991) 425-434
4. Brown J.C. Musical fundamental frequency tracking using a pattern recognition method. J. Acoust. Soc. Amer. 92 (1992) 1394-1402
5. Brown J.C., and Puckette M.S. A high resolution fundamental frequency determination based on phase changes of the Fourier transform. J. Acoust. Soc. Amer. 94 2 (1993) 662-667
6. Ciocca V., Francis A.L., Aisha R., and Wong L. The perception of Cantonese lexical tones by early-deafened cochlear implantees. J. Acoust. Soc. Amer. 111 (2002) 2250-2256
7. Crochiere R.E., and Rabiner L.R. Multirate Digital Signal Processing (1983), Prentice-Hall
8. de Cheveigné A., and Kawahara H. YIN, a fundamental frequency estimator for speech and music. J. Acoust. Soc. Amer. 111 (2002) 1917-1930
9. Duifhuis H., Willems L.F., and Sluyter R.J. Measurement of pitch in speech: an implementation of Goldstein's theory of pitch perception. J. Acoust. Soc. Amer. 71 6 (1982) 1568-1580
10. Geurts L., and Wouters J. Coding of the fundamental frequency in continuous interleaved sampling processors for cochlear implants. J. Acoust. Soc. Amer. 109 2 (2001) 713-726
11. Gfeller K., and Lansing P.J. Melodic, rhythmic, and timbral perception of adult cochlear implant users. J. Speech Hear. Res. 34 4 (1991) 916-920
12. Gfeller K., Knutson J.F., Woodworth G., Witt S., and DeBus B. Timbral recognition and appraisal by adult cochlear implant users and normal-hearing adults. J. Amer. Acad. Audiol. 9 (1998) 1-19
13. Gfeller K., Christ A., Knutson J.F., Witt S., Murray K.T., and Tyler R.S. Musical backgrounds, listening habits, and aesthetic enjoyment of adult cochlear implant recipients. J. Amer. Acad. Audiol. 11 7 (2000) 390-406
14. Gfeller K., Turner C., Mehr M., Woodworth G., Fearn R., Knutson J., Witt S., and Stordahl J. Recognition of familiar melodies by adult cochlear implant recipients and normal-hearing adults. Cochlear Implants Internat. 3 1 (2002) 29-53
15. Gfeller K., Witt S., Woodworth G., Mehr M.A., and Knutson J. Effects of frequency, instrumental family, and cochlear implant type on timbre recognition and appraisal. Ann. Otol. Rhinol. Laryngol. 111 4 (2002) 349-356
16. Goldstein J.L. An optimum processor theory for the central formation of the pitch of complex tones. J. Acoust. Soc. Amer. 54 6 (1973) 1496-1516
17. Green T., Faulkner A., and Rosen S. Enhancing temporal cues to voice pitch in continuous interleaved sampling cochlear implants. J. Acoust. Soc. Amer. 116 4 (2004) 2298-2310
18. Gruenz O.O., and Schott L.O. Extraction and portrayal of pitch of speech sounds. J. Acoust. Soc. Amer. 21 5 (1949) 487-495
19. Hermes D.J. Measurement of pitch by subharmonic summation. J. Acoust. Soc. Amer. 83 1 (1988) 257-264
20. Hess W. Pitch Determination of Speech Signals (1983), Springer-Verlag, Berlin
21. Hess W. Pitch and voicing determination. In: Furui S., and Sohndi M.M. (Eds). Advances in Speech Signal Processing (1992), Marcel Dekker, New York 3-48
22. Kong Y.Y., Cruz R., Jones J.A., and Zeng F.G. Music perception with temporal cues in acoustic and electric hearing. Ear Hear. 25 2 (2004) 173-185
23. Leal M.C., Shin Y.J., Laborde M.L., Calmels M.N., Verges S., Laugardon S., Andrieu S., Deguine O., and Fraysse B. Music perception in adult cochlear implant recipients. Acta Otolaryngol. 123 7 (2003) 826-835
24. Lee K.Y.S., van Hasselt C.A., Chiu S.N., and Cheung D.M.C. Cantonese tone perception ability of cochlear implant children in comparison with normal-hearing children. Int. J. Ped. Otolaryngol. 63 (2002) 137-147
25. Liu D.J., and Lin C.T. Fundamental frequency estimation based on the joint time-frequency analysis of harmonic spectral structure. IEEE Trans. Speech Audio Process. 9 6 (2001) 609-621
26. McDermott H.J. Music perception with cochlear implants: a review. Trends Amplificat. 8 2 (2004) 49-82
27. McDermott H.J., and McKay C.M. Musical pitch perception with electrical stimulation of the cochlea. J. Acoust. Soc. Amer. 101 (1997) 1622-1631
28. Moore F.R. Elements of Computer Music (1990), Prentice-Hall, New Jersey. 0-13-252552-6 pp. 246-247
29. Moore B.C.J., and Carlyon R.P. Perception of pitch by people with cochlear hearing loss and by cochlear implant users. In: Plack C.J., Oxenham A.J., Fay R.R., and Popper A.N. (Eds). Springer Handbook of Auditory Research: Pitch, Neural Coding and Perception (2005), Springer-Verlag, New York
30. Nakatani T., and Irino T. Robust and accurate fundamental frequency estimation based on dominant harmonic components. J. Acoust. Soc. Amer. 116 6 (2004) 3690-3700
31. Patrick J.F., Seligman P.M., Money D.K., et al. (1990), Churchill Livingstone, Edinburgh 99-124
32. Pijl S., and Schwarz D.W.F. Melody recognition and musical interval perception by deaf subjects stimulated with electrical pulse trains through single cochlear implant electrodes. J. Acoust. Soc. Amer. 98 (1995) 886-895
33. Scheffers M.T.M. Simulation of auditory analysis of pitch: An elaboration on the DWS pitch meter. J. Acoust. Soc. Amer. 74 6 (1983) 1716-1725
34. Skinner M.W., Holden L.K., Holden T.A., Dowell R.C., Seligman P.M., Brimacombe J.A., and Beiter A.L. Performance of postlinguistically deaf adults with the Wearable Speech Processor (WSP III) and the Mini Speech Processor (MSP) of the Nucleus multi-electrode cochlear implant. Ear Hear. 12 (1991) 3-22
35. Vandali A.E., Sucher C., Tsang D.J., McKay C.M., Chew J.W.D., and McDermott H.J. Pitch ranking ability of cochlear implant recipients: a comparison of sound-processing strategies. J. Acoust. Soc. Amer. 117 5 (2005) 3126-3138
36. Zakis J.A., McDermott H.J., and Fisher M. An advanced sound processing system for hearing aid research. Iranian Audiol. 3 1 (2004) 75-78