Investigation Of Test Performance Over Repeated Sessions Using Signal Detection Theory: Comparison Of Three Nonattribute-Specified Difference Tests 2-Afcr, A-Not A And 2-Afc

Journal of Sensory Studies

Volumn 26, Issue 5, 2011, Pages 311-321

  Van Hout, Danielle ^a,b   Hautus, Michael J ^c   Lee, Hye Seong ^d  

^a UNILEVER RESEARCH VLAARDINGEN   (Netherlands)

^b ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^c UNIVERSITY OF AUCKLAND   (New Zealand)

^d Ewha Womans University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

BUSINESS DECISIONS; BUSINESS SITUATIONS; COGNITIVE STRATEGY; FOOD COMPANIES; LEARNING EFFECTS; PERFORMANCE LEVEL; SIGNAL DETECTION THEORY; TEST EFFECTIVENESS; TEST METHOD; TEST PERFORMANCE; TEST PRODUCTS; TRAINING TIME;

TESTING;

SIGNAL DETECTION;

EID: 80053564088     PISSN: 08878250     EISSN: 1745459X     Source Type: Journal    
DOI: 10.1111/j.1745-459X.2011.00346.x     Document Type: Article

References (52)

1. ANGULO, O., LEE, H.-S. and O'MAHONY, M. 2007. Sensory difference tests: Overdispersion and warm-up. Food Qual. Prefer. 18, 190-195.
2. BI, J. 2011. Similarity tests using forced-choice methods in terms of Thurstonian discriminal distance, d'. J. Sensory Studies 26, 151-157.
3. BI, J. and ENNIS, D.M. 2001a. Statistical models for the A-Not a method. J. Sensory Studies 16, 215-237.
4. BI, J. and ENNIS, D.M. 2001b. The power of the A-Not A method. J. Sensory Studies 16, 343-359.
5. BI, J., ENNIS, D.M. and O'MAHONY, M. 1997. How to estimate and use the variance of d' from difference tests. J. Sensory Studies 12, 87-104.
6. BI, J., LEE, H.-S. and O'MAHONY, M. 2010. d' and variance of d' for four-alternative forced choice (4-AFC). J. Sensory Studies 25, 740-750.
7. CHAE, J.-E., LEE, Y.-M. and LEE, H.-S. 2010. Affective same-different discrimination tests for assessing consumer discriminability between milks with subtle differences. Food Qual. Prefer. 21, 427-438.
8. DESSIRIER, J.-M. and O'MAHONY, M. 1999. Comparison of d' values for the 2-AFC (paired comparison) and 3-AFC discrimination methods: Thurstonian models, sequential sensitivity analysis and power. Food Qual. Prefer. 10, 51-58.
9. DORFMAN, D.D. and ALF, E.A. 1969. Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals - rating-method data. J. Math. Psychol. 6, 487-496.
10. ENNIS, D.M. 1990. Relative power of difference testing methods in sensory evaluation. Food Technol. 44, 114-118.
11. GARCÍA-PÉREZ, M.A. and ALCALÁ-QUINTANA, R. 2010. The difference model with guessing explains interval bias in two-alternative forced-choice detection procedures. J. Sensory Studies. 25, 876-898.
12. GREEN, D.M. and SWETS, J.A. 1966. Signal Detection Theory and Psychophysics, John Wiley and Sons, New York, NY.
13. HAUTUS, M.J. 1994. Amplitude resolution by human and ideal observers for Rayleigh noise and other Gaussian processes. PhD Thesis, University of Auckland. (accessed February 2010).
14. HAUTUS, M.J. 1997. Calculating estimates of sensitivity from group data: Pooled versus averaged estimators. Behav. Res. Methods Instrum. Comput. 29, 556-562.
15. HAUTUS, M.J. and COLLINS, S. 2003. An assessment of response bias for the same-different task: Implications for the single-interval task. Percept. Psychophys. 65, 844-860.
16. HAUTUS, M.J. and MENG, X. 2002. Decision strategies in the ABX (matching-to-sample) psychophysical task. Percept. Psychophys. 64, 89-106.
17. HAUTUS, M.J., IRWIN, R.J. and SUTHERLAND, S. 1994. Relativity of judgements about sound amplitude and the asymmetry of the same-different ROC. Q. J. Exp. Psychol. 47A, 1035-1045.
18. HAUTUS, M.J., O'MAHONY, M. and LEE, H.-S. 2008. Decision strategies determined from the shape of the same-different ROC curve: What are the effects of incorrect assumptions? J. Sensory Studies 23, 743-764.
19. HAUTUS, M.J., VAN HOUT, D. and LEE, H.-S. 2009. Variants of a Not-A and 2AFC tests: Signal detection theory models. Food Qual. Prefer. 20, 222-229.
20. HAUTUS, M.J., STOCKS, M.A. and SHEPHERD, D. 2010. The single interval adjustment matrix (SIAM) yes-no task applied to the measurement of sucrose thresholds. J. Sensory Studies 25, 940-955.
21. HAUTUS, M.J., SHEPHERD, D. and PENG, M. 2011a. Decision strategies for the A Not-A, 2AFC and 2AFC-reminder tasks: Empirical tests. Food Qual. Prefer. 22, 433-442.
22. HAUTUS, M.J., SHEPHERD, D. and PENG, M. 2011b. Decision strategies for the two-alternative forced choice reminder paradigm. Atten. Percept. Psychophys. 73, 729-737.
23. JESTEADT, W. and BILGER, R.C. 1974. Intensity and frequency discrimination in one- and two-interval paradigms. J. Acoust. Soc. Am. 55, 1266-1276.
24. KIM, M.-A., LEE, M. and LEE, H.-S. 2010. Comparison of d' estimates produced by three versions of a duo-trio test for discriminating tomato juices with varying salt concentrations: The effects of the number and position of the reference stimulus. Food Qual. Prefer. 21, 504-511.
25. KIM, M.-A., CHAE, J.-E., VAN HOUT, D. and LEE, H.-S. 2011. Discriminations of the A-Not A difference test improved when "A" was familiarized using a brand image. Food Qual. Prefer. doi:10.1016/j.foodqual.2011.06.007.
26. LEE, Y.-M., CHAE, J.-E. and LEE, H.-S. 2009. Effects of order of tasting in sensory difference tests using apple juice stimuli: Development of a new model. J. Food Sci. 74, S268-S275.
27. LEE, H.-S. and O'MAHONY, M. 2004. Sensory difference testing: Thurstonian models. Food Sci. Biotechnol. 13, 841-847.
28. LEE, H.-S. and O'MAHONY, M. 2006. Sensory difference testing: The problem of overdispersion and the use of beta binomial statistical analysis. Food Sci. Biotechnol. 15, 494-498.
29. LEE, H.-S. and O'MAHONY, M. 2007. The evolution of a model: A review of Thurstonian and conditional stimulus effects on difference testing. Food Qual. Prefer. 18, 369-383.
30. LEE, H.-S., VAN HOUT, D. and HAUTUS, M. 2007a. Comparison of performance in the A-Not A, 2-AFC, and same-different tests for the flavor discrimination of margarines: The effect of cognitive decision strategies. Food Qual. Prefer. 18, 920-928.
31. LEE, H.-S., VAN HOUT, D. and O'MAHONY, M. 2007b. Sensory difference tests for margarine: A comparison of R-Indices derived from ranking and A-Not A methods considering response bias and cognitive strategies. Food Qual. Prefer. 18, 675-680.
32. LEE, H.-S., VAN HOUT, D., HAUTUS, M. and O'MAHONY, M. 2007c. Can the same-different test use a beta criterion as well as a tau criterion? Food Qual. Prefer. 18, 605-613.
33. MACMILLAN, N.A. and CREELMAN, C.D. 2005. Detection Theory: A User's Guide, 2nd Ed., Lawrence Erlbaum, Mahwah, NJ.
34. MATA-GARCIA, M., ANGULO, O. and O'MAHONY, M. 2006. On Warm-up. J. Sensory Studies 22, 187-193.
35. MEILGAARD, M., CIVILLE, G.V. and CARR, B.T. 1999. Sensory Evaluation Techniques, 3rd Ed., pp. 77-81, pp. 133-150, CRC Press, Boca Raton, FL.
36. MOSKOWITZ, H.R., BECKLEY, J.H. and RESURRECCION, A.V.A. 2006. Sensory and Consumer Research in Food Product Design and Development, Blackwell Publishing, Ames, IA.
37. O'MAHONY, M. 1992. Understanding discrimination tests: A user friendly treatment of response bias, rating and ranking R-index tests and their relationship to signal detection. J. Sensory Studies 7, 1-47.
38. O'MAHONY, M. 1995a. Sensory measurement in food science: Fitting methods to goals. Food Technol. 29, 72-82.
39. O'MAHONY, M. 1995b. Who told you the triangle test was simple? Food Qual. Prefer. 6, 227-238.
40. O'MAHONY, M. Personal communication, 2011.
41. O'MAHONY, M. and HAUTUS, M.J. 2008. The signal detection theory ROC curve: Some applications in food sensory science. J. Sensory Studies 23, 186-204.
42. O'MAHONY, M. and ROUSSEAU, B. 2002. Discrimination testing: A few ideas, old and new. Food Qual. Prefer. 14, 157-164.
43. O'MAHONY, M., THIEME, U. and GOLDSTEIN, L.R. 1988. The warm-up effect as a measure of increasing the discriminability of sensory difference tests. J. Sensory Studies 53, 1848-1850.
44. O'MAHONY, M., MASUOKA, S. and ISHII, R. 1994. A theoretical note on difference tests: Models, paradoxes and cognitive strategies. J. Sensory Studies 9, 247-272.
45. PERYAM, D.R. 1958. Sensory difference tests. Food Technol. 12, 231-236.
46. PFAFFMANN, C., SCHLOSBERG, H. and CORNSWEET, J. 1954. Variables affecting difference tests. In Food Acceptance Testing Methodology (D.R. Peryam, F.J. Pilgrim and M.S. Peterson, eds.) pp. 4-20, Quartermaster Food and Container Institute, Chicago, IL.
47. PRESS, W.H., TEUKOLSKY, S.A., VETTERLING, W.T. and FLANNERY, B.P. 2007. Numerical Recipes. The Art of Scientific Computing, 3rd Ed., Cambridge University Press, London, U.K.
48. RECKMEYER, N.M., VICKERS, Z.M. and CSALLANY, A.S. 2010. Effect of free fatty acids on sweet, salty, sour and umami tastes. J. Sensory Studies 25, 751-760.
49. ROUSSEAU, B. and O'MAHONY, M. 2000. Investigation of the effect of within-trial retasting and comparison of the dual-pair, same-different and triangle paradigms. Food Qual. Prefer. 11, 457-464.
50. ROUSSEAU, B., MEYER, A. and O'MAHONY, M. 1998. Power and sensitivity of the same-different test: Comparison with triangle and duo-trio methods. J. Sensory Studies 13, 149-173.
51. THIEME, U. and O'MAHONY, M. 1990. Modifications to sensory difference test protocols: The warmed up paired comparison, the single standard duo-trio and the A-not A test modified for response bias. J. Sensory Studies 5, 159-176.
52. WANG, M., IRWIN, R.J. and HAUTUS, M.J. 2005. Detection-theoretic analysis of same-different judgments for the amplitude discrimination of acoustic sinusoids. J. Acoust. Soc. Am. 117, 1305-1313.