Validity of rating scale measures of voice quality

Journal of the Acoustical Society of America

Volumn 104, Issue 3 I, 1998, Pages 1598-1608

  Kreiman, Jody ^a   Gerratt, Bruce R ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; DATA ANALYSIS; HOARSENESS; LARYNX DISORDER; PRIORITY JOURNAL; RATING SCALE; RELIABILITY; VOICE;

HUMANS; REPRODUCIBILITY OF RESULTS; SPEECH PERCEPTION; VOICE; VOICE QUALITY;

EID: 0031718672     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.424372     Document Type: Article

References (46)

1. Allen, M. J., and Yen, W. M. (1979). Introduction to Measurement Theory (Brooks/Cole, Monterey, CA).
2. ANSI (1960). ANSI S1.1-1960, "Acoustical Terminology" (American National Standards Institute, New York).
3. Berk, R. (1979). "Generalizability of behavioral observations: A clarification of interobserver agreement and interobserver reliability," Am. J. Mental Deficiency 83, 460-472.
4. Carmines, E. G., and Zeller, R. A. (1979). Reliability and Validity Assessment, Sage University Paper series on Quantitative Applications in the Social Sciences, 07-017 (Sage, Newbury Park, CA).
5. Chhetri, D. K. (1997). "Treatment of voice disorders related to unilateral paralysis of the vocal cord," unpublished senior medical student thesis, University of California, Los Angeles.
6. Colton, R. H., and Estill, J. A. (1981). "Elements of voice quality: Perceptual, acoustic, and physiologic aspects," in Speech and Language: Advances in Basic Research and Practice, edited by N. J. Lass (Academic, New York), Vol. 5, pp. 311-403.
7. Cone, J. D. (1977). "The relevance of reliability and validity for behavioral assessment," Behav. Therapy 8, 411-426.
8. Crocker, L., and Algina, J. (1986). Introduction to Classical and Modern Test Theory (Holt, Rinehart and Winston, New York).
9. Cronbach, L. J. (1951). "Coefficient alpha and the internal structure of tests," Psychometrika 16, 297-334.
10. de Bodt, M. S., Wuyts, F. L., Van de Heyning, P. H., and Croux, C. (1997). "Test-retest study of the GRBAS scale: Influence of experience and professional background on perceptual rating of voice quality," J. Voice 11, 74-80.
11. de Krom, G. (1995). "Some spectral correlates of pathological breathy and rough voice quality for different types of vowel fragments," J. Speech Hear. Res. 38, 794-811.
12. Ebel, R. (1951). "Estimation of the reliability of ratings," Psychometrika 16, 407-424.
13. Fleiss, J. L. (1981). Statistical Methods for Rates and Proportions (Wiley, New York).
14. Fritzell, B., Hammarberg, B., Gauffin, J., Karlsson, I., and Sundberg, J. (1986). "Breathiness and insufficient vocal fold closure," J. Phon. 14, 549-553.
15. Gerratt, B. R., and Kreiman, J. (1995). "The utility of acoustic voice measures," in Proceedings of the Workshop on Standardization in Acoustic Voice Analysis, edited by D. Wong (National Center for Voice and Speech, Denver), pp. GER1-GER7.
16. Gerratt, B. R., Kreiman, J., Antonanzas-Barroso, N., and Berke, G. S. (1993). "Comparing internal and external standards in voice quality judgments," J. Speech Hear. Res. 36, 14-20.
17. Gerratt, B. R., Till, J., Rosenbek, J. C., Wertz, R. T., and Boysen, A. E. (1991). "Use and perceived value of perceptual and instrumental measures in dysarthria management," in Dysarthria and Apraxia of Speech, edited by C. A. Moore, K. M. Yorkston, and D. R. Beukelman (Brookes, Baltimore), pp. 77-93.
18. Gregson, R. A. (1975). Psychometrics of Similarity (Academic, New York).
19. Hammarberg, B., and Gauffin, J. (1995). "Perceptual and acoustic characteristics of quality differences in pathological voices as related to physiological aspects," in Vocal Fold Physiology: Voice Quality Control, edited by O. Fujimura and M. Hirano (Singular, San Diego), pp. 283-303.
20. Helmholtz, H. (1885; reprinted 1954). On the Sensations of Tone (Dover, New York).
21. Hillenbrand, J., Cleveland, R. A., and Erickson, R. L. (1994). "Acoustic correlates of breathy vocal quality," J. Speech Hear. Res. 37, 769-778.
22. Jensen, P. J. (1965). "Adequacy of terminology for clinical judgment of voice quality deviation," The Eye, Ear, Nose and Throat Monthly 44, 77-82.
23. Kazdin, A. (1977). "Artifact, bias, and complexity of assessment: The ABCs of reliability," J. Appl. Behav. Anal. 10, 141-150.
24. Kearns, K., and Simmons, N. (1988). "Interobserver reliability and perceptual ratings: More than meets the ear," J. Speech Hear. Res. 31, 131-136.
25. Kempster, G. B., Kistler, D., and Hillenbrand, J. (1991). "Multidimensional scaling analysis of dysphonia in two speaker groups," J. Speech Hear. Res. 34, 534-543.
26. Kerlinger, F. N. (1973). Foundations of Behavioral Research (Holt, Rinehart, and Winston, New York), 2nd ed.
27. Kreiman, J. (1997). "Listening to voices: Theory and practice in voice perception research," in Talker Variability in Speech Processing, edited by K. Johnson and J. W. Mullennix (Academic, San Diego), pp. 85-108.
28. Kreiman, J., and Gerratt, B. R. (1996). "The perceptual structure of pathologic voice quality," J. Acoust. Soc. Am. 100, 1787-1795.
29. Kreiman, J., and Gerratt, B. R. (1998a). "Measuring vocal quality," to appear in Handbook of Voice Quality Measurement, edited by R. Kent and M. J. Ball (Singular, San Diego).
30. Kreiman, J., and Gerratt, B. R. (1998b). "Sources of listener disagreement in voice quality assessment" (in preparation).
31. Kreiman, J., Gerratt, B. R., and Berke, G. S. (1994). "The multidimensional nature of pathologic vocal quality," J. Acoust. Soc. Am. 96, 1291-1302.
32. Kreiman, J., Gerratt, B. R., Kempster, G. B., Erman, A., and Berke, G. S. (1993). "Perceptual evaluation of voice quality: Review, tutorial, and a framework for future research," J. Speech Hear. Res. 36, 21-40.
33. Kreiman, J., Gerratt, B. R., and Precoda, K. (1990). "Listener experience and perception of voice quality," J. Speech Hear. Res. 33, 103-115.
34. Kreiman, J., Gerratt, B. R., Precoda, K., and Berke, G. S. (1992). "Individual differences in voice quality perception," J. Speech Hear. Res. 35, 512-520.
35. Mackey, L. S., Finn, P., and Ingham, R. J. (1997). "Effect of speech dialect on speech naturalness ratings: A systematic replication of Martin, Haroldson, and Triden (1984)," J. Speech Lang. Hear. Res. 40, 349-360.
36. Martin, D., Fitch, J., and Wolfe, V. (1995). "Pathologic voice type and the acoustic prediction of severity," J. Speech Hear. Res. 38, 765-771.
37. Murry, T., Singh, S., and Sargent, M. (1977). "Multidimensional classification of abnormal voice qualities," J. Acoust. Soc. Am. 61, 1630-1635.
38. Perkins, W. (1971). "Vocal function: A behavioral analysis," in Handbook of Speech Pathology and Audiology, edited by L. Travis (Appleton Century Croft, New York), pp. 481-504.
39. Rabinov, C. R., Kreiman, J., Gerratt, B. R., and Bielamowicz, S. (1995). "Comparing reliability of perceptual ratings of roughness and acoustic measures of jitter," J. Speech Hear. Res. 38, 26-32.
40. Shrout, P., and Fleiss, J. (1979). "Intraclass correlations: Uses in assessing rater reliability," Psychol. Bull. 86, 420-428.
41. Silverman, F. H. (1977). Research Design in Speech Pathology and Audiology (Prentice-Hall, Englewood Cliffs, NJ).
42. Sodersten, M., Hertegard, S., and Hammarberg, B. (1995). "Glottal closure, transglottal airflow, and voice quality in healthy middle-aged women," J. Voice 9, 182-204.
43. Suen, H. K., and Ary, D. (1989). Analyzing Quantitative Behavioral Observation Data (Erlbaum, Hillsdale, NJ).
44. Ventry, I. M., and Schiavetti, N. (1980). Evaluating Research in Speech Pathology and Audiology (Addison-Wesley, Reading, MA).
45. Young, M. A. (1993). "Supplementing tests of statistical significance: Variation accounted for," J. Speech Hear. Res. 36, 644-656.
46. Young, M. A., and Downs, T. D. (1968). "Testing the significance of the agreement among observers," J. Speech Hear. Res. 11, 5-17.