Characterizing fundamental frequency in Mandarin: A functional principal component approach utilizing mixed effect models

Journal of the Acoustical Society of America

Volumn 131, Issue 6, 2012, Pages 4651-4664

  Hadjipantelis, Pantelis Z ^a   Aston, John A D ^a   Evans, Jonathan P ^b  

^a UNIVERSITY OF WARWICK   (United Kingdom)

^b INSTITUTE OF LINGUISTICS   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

EIGENVALUES AND EIGENFUNCTIONS; NATURAL FREQUENCIES;

ANALYSIS FRAMEWORKS; FUNDAMENTAL FREQUENCIES; MANDARIN CHINESE; MIXED-EFFECT MODELS; PRINCIPAL COMPONENTS; RELATIVE PITCH; TIBETANS; WEIGHTED LEAST SQUARES;

PRINCIPAL COMPONENT ANALYSIS;

EID: 84919429649     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4714345     Document Type: Article

References (63)

1. M. Schroeder, T. D. Rossing, F. Dunn, W. M. Hartmann, D. M. Campbell, and N. H. Fletcher, Springer Handbook of Acoustics, 1st ed. (Springer, Berlin, 2007), Chaps. 13 and 16.
2. F. Nolan, " Acoustic phonetics-International encyclopedia of linguistics, William J. Frawley," (2003), URL http://www.oxford-linguistics.com/entry?entry=t202.e0008 (e-reference edition, date last viewed 2/2/11).
3. S.-A. Jun, Prosodic Typology: The Phonology of Intonation and Phrasing (Oxford University Press, Oxford, UK, 2006), Chap. 2.
4. A. W. Black and A. Hunt, " Generating f0 contours from tobi labels using linear regression," in ICSLP (1996).
5. Y. Xu, " Effects of tone and focus on the formation and alignment of f0 contours," J. Phonetics 27, 55-105 (1999). 10.1006/jpho.1999.0086
6. C. E. Rasmussen, Gaussian Processes for Machine Learning (MIT Press, Cambridge, 2006), Chaps. 1 and 2.
7. M. Seeger, " Gaussian processes for machine learning," Int. J. Neural Syst. 14, 2004 (2004). 10.1142/S0129065704001899
8. J. Ramsay and B. Silverman, Applied Functional Data Analysis: Methods and Case Studies (Springer Verlag, New York, 2002), Chap. 1.
9. E. Grabe, G. Kochanski, and J. Coleman, " Connecting intonation labels to mathematical descriptions of fundamental frequency," Lang. Speech 50, 281-310 (2007). 10.1177/00238309070500030101
10. D. Hirst and R. Espesser, " Automatic modelling of fundamental frequency using a quadratic sline function," Trav. Inst. Phonét. Aix 15, 71-85 (1993).
11. J. Ramsay and B. Silverman, Functional Data Analysis (Springer Verlag, New York, 1997), Chap. 6.
12. S. Rangachari and P. Loizou, " A noise-estimation algorithm for highly non-stationary environments," Speech Commun. 48, 220-231 (2006). 10.1016/j.specom.2005.08.005
13. M. Grimm, K. Kroschel, E. Mower, and S. Narayanan, " Primitives-based evaluation and estimation of emotions in speech," Speech Commun. 49, 787-800 (2007). 10.1016/j.specom.2007.01.010
14. R. Baayen, D. Davidson, and D. Bates, " Mixed-effects modeling with crossed random effects for subjects and items," J. Memory Lang. 59, 390-412 (2008). 10.1016/j.jml.2007.12.005
15. J. Aston, J. Chiou, and J. Evans, " Linguistic pitch analysis using functional principal component mixed effect models," J. R. Stat. Soc., Ser. C, Appl. Stat. 59, 297-317 (2010). 10.1111/j.1467-9876.2009.00689.x
16. See supplementary material at http://dx.doi.org/10.1121/1.4714345 E-JASMAN-131-045206 for additional information concerning the analysis in this paper.
17. H. Fujisaki, " Information, prosody, and modeling-with emphasis on tonal features of speech," in Speech Prosody 2004, International Conference (ISCA) (2004).
18. H. Mixdorff, H. Fujisaki, G. P. Chen, and Y. Hu, " Towards the automatic extraction of Fujisaki model parameters for Mandarin," in Eighth European Conference on Speech Communication and Technology (ISCA) (2003).
19. H. Mixdorff, " A novel approach to the fully automatic extraction of Fujisaki model parameters," in Acoustics, Speech, and Signal Processing, 2000. ICASSP'00. Proceedings. 2000 IEEE International Conference (2000), Vol. 3, pp. 1281-1284.
20. J. Louw and E. Barnard, " Automatic intonation modeling with INTSINT," Proceedings of the Pattern Recognition Association of South Africa (2004), pp. 107-111.
21. D. Hirst, " A Praat plugin for Momel and INTSINT with improved algorithms for modelling and coding intonation," in Proceedings of the XVIth International Conference of Phonetic Sciences (2007), pp. 1233-1236.
22. P. Taylor, " Analysis and synthesis of intonation using the tilt model," J. Acoust. Soc. Am. 107, 1697-1714 (2000). 10.1121/1.428453
23. S. Prom-on, Y. Xu, and B. Thipakorn, " Quantitative target approximation model: Simulating underlying mechanisms of tones and intonations," in Acoustics, Speech and Signal Processing, 2006, ICASSP 2006 Proceedings, 2006 IEEE International Conference (2006), Vol. 1.
24. J. Evans, M. Chu, J. Aston, and C. Su, " Linguistic and human effects on F0 in a tonal dialect of Qiang," Phonetica 67, 82-99 (2010). 10.1159/000319380
25. J. Faraway, Extending the Linear Model with R: Generalized Linear, Mixed Effects and Nonparametric Regression Models (CRC Press, Boca Raton, FL, 2006), Chaps. 1, 8, 10.
26. J. O. Ramsay, K. G. Munhall, V. L. Gracco, and D. J. Ostry, " Functional data analyses of lip motion," J. Acoust. Soc. Am. 6, 3718-3727 (1996). 10.1121/1.414986
27. J. Lucero and A. Löfqvist, " Measures of articulatory variability in VCV sequences," Acoust. Res. Lett. Online 6, 80 (2005). 10.1121/1.1850952
28. S. Lee, D. Byrd, and J. Krivokapic, " Functional data analysis of prosodic effects on articulatory timing," J. Acoust. Soc. Am. 119, 1666-1671 (2006). 10.1121/1.2161436
29. D. Byrd, S. Lee, and R. Campos-Astorkiza, " Phrase boundary effects on the temporal kinematics of sequential tongue tip consonants," J. Acoust. Soc. Am. 123, 4456-4465 (2008). 10.1121/1.2912444
30. L. L. Koening, J. C. Lucero, and E. Perlman, " Speech production variability in fricatives of children and adults: results of functional data analysis," J. Acoust. Soc. Am. 5, 3158-3170 (2008). 10.1121/1.2981639
31. M. T. Jackson and R. S. McGowan, " Predicting midsagittal pharyngeal dimensions from measures of anterior tongue position in swedish vowels: Statistical considerations," J. Acoust. Soc. Am. 123, 336-346 (2008). 10.1121/1.2816579
32. K. Reilly and C. Moore, " Respiratory movement patterns during vocalizations at 7 and 11 months of age," J. Speech Lang. Hear. Res. 52, 223-239 (2009). 10.1044/1092-4388(2008/06-0215)
33. J. Ni, R. Wang, and D. Xia, " A functional model for generation of local components of F0 contours in Chinese," in Spoken Language, 1996. ICSLP 96. Proceedings, Fourth International Conference (IEEE) (2002), Vol. 3, 1644-1647.
34. C. Tseng, Y. Cheng, and C. Chang, " Sinica COSPRO and toolkit: Corpora and platform of Mandarin Chinese fluent speech," in Proceedings of Oriental COCOSDA (2005), pp. 6-8.
35. C. Tseng, S. Pin, Y. Lee, H. Wang, and Y. Chen, " Fluent speech prosody: Framework and modeling," Speech Commun. 46, 284-309 (2005). 10.1016/j.specom.2005.03.015
36. X. He and L. Deng, " Speech recognition, machine translation, and speech translation; a unified discriminative learning paradigm [lecture notes]," Sign. Process. Mag., IEEE 28, 126-133 (2011). 10.1109/MSP.2011.941852
37. C. Tseng, Y. Cheng, and C. Chang, " Sinica COSPRO and toolkit-Corpora and platform of Mandarin Chinese fluent speech," in Oriental COCOSDA 2005, Jakarata, Indonesia (2005).
38. F. Ferraty and P. Vieu, Nonparametric Functional Data Analysis: Theory and Practice (Springer Verlag, New York, 2006), Chaps. 1 and 4.
39. J. Chiou, H. Müller, and J. Wang, " Functional quasi-likelihood regression models with smooth random effects," J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 65, 405-423 (2003). 10.1111/1467-9868.00393
40. J. Mercer, " Functions of positive and negative type, and their connection with the theory of integral equations," Philos. Trans. R. Soc. London, Ser. A 209, 415-446 (1909). 10.1098/rsta.1909.0016
41. F. Yao, H. Müller, and J. Wang, " Functional data analysis for sparse longitudinal data," J. Am. Stat. Assoc. 100, 577-590 (2005). 10.1198/016214504000001745
42. P. Castro, W. Lawton, and E. Sylvestre, " Principal modes of variation for processes with continuous sample curves," Technometrics 28, 329-337 (1986). 10.2307/1268982
43. P. Hall, H. Müller, and J. Wang, " Properties of principal component methods for functional and longitudinal data analysis," Ann. Stat. 34, 1493-1517 (2006). 10.1214/009053606000000272
44. J. Rice and B. Silverman, " Estimating the mean and covariance structure nonparametrically when the data are curves," J. R. Stat. Soc., Ser. B (Methodol.) 53, 233-243 (1991).
45. P. Buser and M. Imbert, Audition, 1st ed. (MIT Press, Cambridge, 1992), Chap. 2.
46. S. Sudhoff, Methods in Empirical Prosody Research (Walter De Gruyter, Berlin, 2006), Chap. 4.
47. J. Pinheiro and D. Bates, Mixed-Effects Models in S and S-PLUS (Springer Verlag, New York, 2009), Chap. 2.
48. B. West, K. Welch, and A. Galecki, Linear Mixed Models: A Practical Guide using Statistical Software (CRC Press, Boca Raton, FL, 2007), Chaps. 2 and 6.
49. A. Davison, Statistical Models (Cambridge University Press, Cambridge, 2003), Chap. 4.
50. G. Fitzmaurice, N. Laird, and J. Ware, Applied Longitudinal Analysis (Wiley-Interscience, New York, 2004), Chap. 7.
51. M. Galassi, J. Theiler, J. Davies, and B. Gough, GNU Scientific Library Reference Manual, 3rd ed. (Network Theory Limited, Bristol, UK, 2009).
52. MATLAB, version 7.10.0 (R2010a) (MathWorks, Natick, MA, 2010).
53. R Development Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria (2011), http://www. R-project.org (date last viewed 2/11/11).
54. D. Bates and M. Maechler, LME4: Linear mixed-effects models using S4 classes (2011), http://CRAN.R-project.org/package=lme4, r package version 0.999375-41 (date last viewed 2/11/11).
55. R. H. Baayen, Language R: Data sets and functions with "Analyzing Linguistic Data: A practical introduction to statistics " (2011), http://CRAN.R-project.org/ package=languageR, R package version 1.2 (date last viewed 2/11/11).
56. R. Baayen, Analyzing Linguistic Data: A Practical Introduction to Statistics using R (Cambridge University Press, Cambridge, UK, 2008), Chap. 4.
57. C. yu Tseng and F. Chiang Chou, " Machine readable phonetic transcription system for Chinese dialects spoken in Taiwan," J. Acoust. Soc. Jpn. 20, 215-223 (1999). 10.1250/ast.20.215
58. R. C. Torgerson, " A comparison of Beijing and Taiwan Mandarin tone register: An acoustic analysis of three native speech styles," Master's thesis, Brigham Young University, 2005.
59. Y.-H. Lin, The Sounds of Chinese (Cambridge University Press, Cambridge, 2007).
60. M. L. Borroff, " A landmark underspecification account of the patterning of glottal stop," Ph.D. thesis, Department of Linguistics, Stony Brook University, New York, 2007.
61. Y. R. Chao, A Grammar of Spoken Chinese (University of California Press, Berkeley, 1968).
62. C. Shih and G. Kochanski, " Chinese tone modeling with stem-ml," in ICSLP (2000), pp. 67-70.
63. The Functional Phylogenetic Group, J. A. D. Aston, D. Buck, J. Coleman, C. J. Cotter, N. S. Jones, V. Macaulay, N. MacLeod, J. M. Moriarty, and A. Nevins, " Phylogenetic inference for function-valued traits: Speech sound evolution," Trends Ecol. Evol. 27, 160-166 (2012). 10.1016/j.tree.2011.10.001