Agreement and reliability assessments for performance of sensory descriptive panel

Journal of Sensory Studies

Volumn 18, Issue 1, 2003, Pages 61-76

  Bi, Jian ^a,b  

^a Sensometrics Research and Service   (United States)

^b NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

QUALITY CONTROL; RATING; RELIABILITY;

RELIABILITY COEFFICIENTS;

SENSORY PERCEPTION;

EID: 0038640529     PISSN: 08878250     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1745-459X.2003.tb00373.x     Document Type: Article

References (22)

1. AMERINE, M.A., PANGBORN, R.M. and ROESSLER, E.B. 1965. Principles of Sensory Evaluation of Food. Academic Press, New York.
2. BARTKO, J. 1966. The intraclass correlation coefficient as a measure of reliability. Psychological Repts. 19, 3-11.
3. BRADLEY, R.A. and TERRY, M.E. 1952. The rank analysis of incomplete block designs. I. The method of paired comparisons. Biometrika 39, 324-345.
4. nd Ed. Oxford University Press, New York.
5. EBEL, R.L. 1951. Estimation of the reliability of ratings. Psychometrika 16, 407-424.
6. FINN, R.H. 1970. A note on estimating the reliability of categorical data. Educ. Psychological Meas. 30, 71-76.
7. FISHER, R.A. 1946. Statistical Methods for Research Workers. Hafner, New York.
8. GONZALEZ, R., BENEDITO, J., CARCEL J.A. and MULET, A. 2001. Cheese hardness assessment by expert and untrained judges. J. Sensory Studies 16, 277-285.
9. HAGGARD, E.A. 1958. Interclass Correlation and the Analysis of Variance. Dryden, New York.
10. JAMES, L.R., DEMAREE, R.G. and WOLF, G. 1984. Estimating within-group interrater reliability with and without response bias. J. Appl. Psych. 69, 85-98.
11. wg: An assessment of within-group interater agreement. J. Appl. Psych. 78, 306-309.
12. KOZLOWSKI, S.W.J. and HATTRUP, K. 1992. A disagreement about within-group agreement: Disentangling issues of consistency versus consensus. J. Appl. Psych. 77(2), 161-167.
13. LEA, P., RODBOTTEN, N. and NAS, T. 1995. Measuring validity in sensory analysis. Food Qual. Pref. 4, 321-326.
14. MANGAN, P.A.P. 1992. Performance assessment of sensory panelists. J. Sensory Studies 7, 229-252.
15. McEWAN, J.A., HUNTER, E.A., GEMERT, L.J. and LEA, P. 2002. Proficiency testing for sensory profile panels: measuring panel performance. Food Qual. Pref. 13, 181-190.
16. nd Ed. CRC Press, Boca Raton, FL.
17. SHROUT, P.E. and FLEISS, J.L. 1979. Intraclass correlation: Uses in assessing rating reliability. Psych. Bull. 86, 420-428.
18. STONE, H. and SIDEL, J.L. 1993. Sensory Evaluation Practices, Academic Press, San Diego, CA.
19. TINSLEY, H.E.A. and WEISS, D.J. 1975. Interater reliability and agreement of subjective judgments. J. Counseling Psych. 22, 358-376.
20. THURSTONE, L.L. 1927. A law of comparative judgment. Psychol. Rev. 34, 273-286.
21. THURSTONE, L.L. 1959. The Measurement of Values. University of Chicago Press, Chicago.
22. nd Ed.) McGraw-Hill, New York.