The signal detection theory roc curve: Some applications in food sensory science

Journal of Sensory Studies

Volumn 23, Issue 2, 2008, Pages 186-204

  O'Mahony, M ^a   Hautus, M J ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF AUCKLAND   (New Zealand)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 41649103082     PISSN: 08878250     EISSN: 1745459X     Source Type: Journal    
DOI: 10.1111/j.1745-459X.2007.00149.x     Document Type: Article

References (66)

1. BROWN, J. 1974. Recognition assessed by rating and ranking. Br. J. Psychol. 65, 13 22.
2. DAI, H., VERSFELD, N.J. GREEN, D.M. 1996. The optimum decision rules in the same-different paradigm. Percept. Psychophys. 58, 1 9.
3. DELWICHE, J. O'MAHONY, M. 1996. Flavor discrimination - an extension of Thurstonian paradoxes to the tetrad method. Food Qual. Prefer. 7, 1 5.
4. ELLIOTT, P.B. 1964. Tables of d′. In Signal Detection and Recognition by Human Obervers: Contemporary Readings (J.A. Swets, ed.) pp. 651 684, John Wiley and Sons Inc., New York, NY.
5. ENNIS, D.M. 1988a. Confusable and discriminable stimuli: Comment on Nosofsky (1986) and Shepard (1986). J. Exp. Psychol. Gen. 117, 408 411.
6. ENNIS, D.M. 1988b. Multivariate sensory analysis. Food Technol. 42, 118 122.
7. ENNIS, D.M. 1990. Relative power of difference testing methods in sensory evaluation. Food Technol. 44, 114 118.
8. ENNIS, D.M. 1992. Modeling similarity and identification when there are momentary fluctuations in psychological magnitudes. In Multidimensional Models of Perception and Cognition (F.G. Ashby, ed.) pp. 279 298, Lawrence Erlbaum Associates, Hillsdale, NJ.
9. ENNIS, D.M. 1993. The power of sensory discrimination methods. J. Sens. Stud. 8, 353 370.
10. ENNIS, D.M. MULLEN, K. 1985. The effect of dimensionality on results from the triangular method. Chem. Senses 10, 605 608.
11. ENNIS, D.M. MULLEN, K. 1986a. A multivariate model for discrimination methods. J. Math. Psychol. 30, 206 219.
12. ENNIS, D.M. MULLEN, K. 1986b. Theoretical aspects of sensory discrimination. Chem. Senses 11, 513 522.
13. ENNIS, D.M. MULLEN, K. 1992a. A general probabilistic model for triad discrimination, preferential choice and two-alternative identification. In Multidimensional Models of Perception and Cognition (F.G. Ashby, ed.) pp. 115 122, Lawrence Erlbaum Associates, Hillsdale, NJ.
14. ENNIS, D.M. MULLEN, K. 1992b. Probabilistic psychophysics with noisy stimuli. Math. Soc. Sci. 23, 221 234.
15. ENNIS, D.M. O'MAHONY, M. 1995. Probabilistic models for sequential taste effects in triadic choice. J. Exp. Psychol. Hum. Percept. Perform. 5, 1088 1097.
16. ENNIS, D.M., MULLEN, K. FRIJTERS, J.E.R. 1988a. Variants of the method of triads: Unidimensional Thurstonian models. Br. J. Math. Stat. Psychol. 41, 25 36.
17. ENNIS, D.M., PALEN, J.J. MULLEN, K. 1988b. A multidimensional stochastic theory of similarity. J. Math. Psychol. 32, 449 465.
18. ENNIS, J.M., ENNIS, D.M., YIP, D. O'MAHONY, M. 1998. Thurstonian models for variants of the method of tetrads. Br. J. Math. Stat. Psychol 51, 205 215.
19. FRANCIS, M.A. IRWIN, R.J. 1995. Decision strategies and visual-field symmetries in same-different judgments of word meaning. Mem. Cogn. 23, 301 312.
20. FRIJTERS, J.E.R. 1979a. The paradox of discriminatory nondiscriminators resolved. Chem. Senses Flavor 4, 355 358.
21. FRIJTERS, J.E.R. 1979b. Variations of the triangular method and the relationship of its unidimensional probabilistic models to three-alternative forced-choice signal detection theory models. Br. J. Math. Stat. Psychol. 32, 229 241.
22. FRIJTERS, J.E.R. 1980. Three-stimulus procedures in olfactory psychophysics: An experimental comparison of Thurstone-Ura and three-alternative forced-choice signal detection theory. Percept. Psychophys. 28, 390 397.
23. FRIJTERS, J.E.R. 1981a. The excitatory state in the triangular constant method. Psychometrika 46, 219 222.
24. FRIJTERS, J.E.R. 1981b. An olfactory investigation of the compatibility of oddity instructions with the design of a 3-AFC Signal Detection task. Acta Psychol. 49, 1 16.
25. FRIJTERS, J.E.R. 1982. Expanded tables for conversion of a proportion of correct responses (Pc) to the measure of sensory difference (d′) for the trianguar method and the 3-alternative forced choice procedure. J. Food Sci. 47, 139 143.
26. FRIJTERS, J.E.R., KOOISTRA, A. VEREIJKEN, P.F.G. 1980. Tables of d′ for the triangular method and the 3-AFC signal detection procedure. Percept. Psychophys. 27, 176 178.
27. GREEN, D.M. SWETS, J.A. 1966. Signal Detecting Theory and Psychophysics. John Wiley and Sons, New York, NY.
28. LEE, H-S., VAN HOUT, D., HAUTUS, M.J. O'MAHONY, M. 2007. Can the same-different test use a beta criterion as well as a tau criterion? Food. Qual. Prefer. 18, 605 613.
29. HACKER, M.J. RATCLIFF, R. 1979. A revised table of d′ for M-alternative forced choice. Percept. Psychophys. 26, 168 170.
30. HAUTUS, M.J. IRWIN, R.J. 1995. Two models for estimating the discriminability of foods and beverages. J. Sens. Stud. 10, 203 215.
31. HAUTUS, M.J., IRWIN, R.J. SUTHERLAND, S. 1994. Relativity of judgments about sound amplitude and the asymmetry of the same-different ROC. Q. J. Exp. Psychol. 47A, 1035 1045.
32. IRWIN, R.J. FRANCIS, M.A. 1995. Perception of simple and complex visual stimuli: Decision strategies and hemispheric differences in same-different judgments. Perception 24, 787 809.
33. IRWIN, R.J. HAUTUS, M.J. 1997. Likelihood ratio decision strategy for independent observations in the same-different task: An approximation to the detection-theoretic model. Percept. Psychophys. 59, 313 316.
34. IRWIN, R.J., HAUTUS, M.J. STILLMAN, J.A. 1992. Use of the receiver operating characteristic in the study of taste perception. J. Sens. Stud. 7, 291 314.
35. IRWIN, R.J., STILLMAN, J.A., HAUTUS, M.J. HUDDLESTON, L.M. 1993. The measurement of taste discrimination with the same-different task. J. Sens. Stud. 8, 229 239.
36. KAPENGA, J.A., DE DONCKER, E., MULLEN, K. ENNIS, D.M. 1987. The integration of the multivariate normal density function for the triangular method. In Numerical Integration (G. Fairweather, ed.) pp. 321 328, D. Reidl Publ. Co., Dordrecht.
37. KAPLAN, H.L., MACMILLAN, N.A. CREELMAN, C.D. 1978. Tables of d′ for variable standard discrimination designs. Behav. Res. Methods Instrum. 10, 796 813.
38. KIM, H-J., JEON, S.Y., KIM, K-O. O'MAHONY, M. 2006. Thurstonian models and variance I: Experimental confirmation of cognitive strategies for difference tests and effects of perceptual variance. J. Sens. Stud. 21, 465 484.
39. LEE, H-S. O'MAHONY, M. 2004. Sensory difference testing: Thurstonian models. Food Sci. Biotechnol. 13, 841 847.
40. LEE, H-S. O'MAHONY, M. 2007. The evolution of a model: A review of Thurstonian and conditional stimulus effects on difference testing. Food Qual. Prefer. 18, 17 33.
41. MACMILLAN, N.A. CREELMAN, C.D. 2005. Detection Theory: A User's Guide, 2nd Ed., Cambridge University Press, New York, NY.
42. MACMILLAN, N.A., KAPLAN, H.L. CREELMAN, C.D. 1977. The psychophysics of categorical perception. Psychol. Rev. 84, 452 471.
43. MASUOKA, S., HATJOPOULOS, D. O'MAHONY, M. 1995. Beer bitterness detection: Testing Thurstonian and Sequential Sensitivity Analysis models for triad and tetrad methods. J. Sens. Stud. 10, 295 306.
44. MOSTELLER, F. 1951a. Remarks on the method of paired comparisons: I. The least squares solution assuming equal standard deviations and equal correlations. Psychometrika 16, 3 9.
45. MOSTELLER, F. 1951b. Remarks on the method of paired comparisons: II. The effect of an aberrant standard deviation when equal standard deviations and equal correlations are assumed. Psychometrika 16, 203 206.
46. MOSTELLER, F. 1951c. Remarks on the method of paired comparisons: III. A test of significance for paired comparisons when equal standard deviations and equal correlations are assumed. Psychometrika 16, 207 218.
47. MULLEN, K. ENNIS, D.M. 1987. Mathematical formulation of multivariate Euclidean models for discrimination methods. Psychometrika 52, 235 249.
48. MULLEN, K. ENNIS, D.M. 1991. A simple multivariate probabilistic model for preferential and triadic choices. Psychometrica 56, 69 75.
49. MULLEN, K., ENNIS, D.M., DE DONCKER, E. KAPENGA, J.A. 1988. Models for the duo-trio and triangular methods. Biometrics 44, 1169 1175.
50. NOREEN, D.L. 1981. Optimal decision rules for some common psychophysical paradigms. In Mathematical Psychology and Psychophysiology, Vol 13: Proceedings of the Symposium in Applied Mathematics of the American Mathematical Society and the Society for Industrial Applied Mathematics (S. Grossberg, ed.) pp. 237 279, American Mathematical Society, Providence, RI.
51. O'MAHONY, M. 1992. Understanding discrimination tests: A user-friendly treatment of response bias, rating and ranking R-index tests and their relationship to signal detection. J. Sens. Stud. 7, 1 47.
52. O'MAHONY, M. 1995. Who told you the triangle test was simple? Food Qual. Prefer. 6, 227 238.
53. O'MAHONY, M. ROUSSEAU, B. 2002. Discrimination testing: A few ideas, old and new. Food Qual. Prefer. 14, 157 164.
54. O'MAHONY, M., MASUOKA, S. ISHII, R. 1994. A theoretical note on difference tests: Models, paradoxes and cognitive strategies. J. Sens. Stud. 9, 247 272.
55. ROUSSEAU, B. 2001. The β-strategy: An alternative and powerful cognitive strategy when performing sensory discrimination tests. J. Sens. Stud. 16, 301 318.
56. ROUSSEAU, B. O'MAHONY, M. 1997. Sensory difference tests: Thurstonian and SSA predictions for vanilla-flavored yogurts. J. Sens. Stud. 12, 127 146.
57. ROUSSEAU, B., MEYER, A. O'MAHONY, M. 1998. Power and sensitivity of the same-different test: Comparison with triangle and duo-trio methods. J. Sens. Stud. 13, 149 173.
58. SORKIN, R.D. 1962. Extensions to the theory of signal detectability to matching procedures in psychoacoustics. J. Acoust. Soc. Am. 34, 1745 1751.
59. STILLMAN, J.A. 1993. Response selection, sensitivity and taste-test performance. Percept. Psychophys. 54, 190 194.
60. STILLMAN, J.A. IRWIN, R.J. 1995. Advantages of the same-different method over the triangular method for the measurement of taste discrimination. J. Sens. Stud. 10, 261 272.
61. TEDJA, S., NONAKA, R., ENNIS, D.M. O'MAHONY, M. 1994. Triadic discrimination testing-refinement of Thurstonian and Sequential Sensitivity Analysis approaches. Chem. Senses 19, 279 301.
62. THURSTONE, L.L. 1927a. A law of comparative judgment. Psychol. Rev. 34, 273 286.
63. THURSTONE, L.L. 1927b. Psychophysical analysis. Am. J. Psychol. 38, 368 389.
64. URA, S. 1960. Pair, triangle and duo-trio test. Rep. Stat. Appl. Res. 7, 107 119.
65. VESSEREAU, A. 1965. Les méthodes statistiques appliquées au test des caractères organoleptiques. Ann. Nutr. 19, 103 140.
66. WONG, D.A. 1997. Cognitive strategies of the triangle difference test. MS Thesis, pp. 1 18, University of California, Davis, CA.