Equivalence tests - A review

Food Quality and Preference

Volumn 26, Issue 2, 2012, Pages 231-245

  Meyners, Michael ^a  

^a PROCTER AND GAMBLE COMPANY   (United States)

Author keywords

Equivalence testing; Non inferiority; Open symmetric intervals; Parity; Rejection region; Similarity; TOST

Indexed keywords

EID: 84862126929     PISSN: 09503293     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.foodqual.2012.05.003     Document Type: Review

References (70)

1. Alderson P. Absence of evidence is not evidence of absence - we need to report uncertain results and do it clearly. British Medical Journal 2004, 328:476-477.
2. Altman D.G., Bland J.M. Statistics notes: absence of evidence is not evidence of absence. British Medical Journal 1995, 311:485.
3. Altman D.G., Bland J.M. Confidence intervals illuminate absence of evidence. British Medical Journal 2004, 328:1016-1017.
4. ASTM E 1958-07 (2006). Standard Guide for Sensory Claim Substantiation, ASTM International.
5. Anderson S., Hauck W.W. A new procedure for testing equivalence in comparative bioavailability and other clinical trials. Communications in Statistics A 1983, 12:2663-2692.
6. Berger R.L. Multiparameter hypothesis testing and acceptance sampling. Technometrics 1982, 24:295-300.
7. Berger R.L. Uniformly more powerful tests for hypotheses concerning linear inequalities and normal means. Journal of the American Statistical Association 1989, 84:192-199.
8. Berger R.L. Likelihood ratio tests and intersection-union tests. Advances in Statistical Decision Theory and Applications 1997, 225-237. Birkhäuser, Boston. S. Panchapakesan, N. Balakrishnan (Eds.).
9. Berger R.L., Hsu J.C. Bioequivalence trials, intersection-union tests and equivalence confidence sets (with discussion). Statistical Science 1996, 11:283-319.
10. Bi J. Similarity testing in sensory and consumer research. Food Quality and Preference 2005, 16:139-149.
11. Bi J. Statistical analyses for R-index. Journal of Sensory Studies 2006, 21:584-600.
12. Bi J. Similarity testing using paired comparison method. Food Quality and Preference 2007, 18:500-507.
13. Bi J. Replicated similarity testing using paired comparison method. Journal of Sensory Studies 2007, 22:176-186.
14. Bi J. Response to Ennis. Food Quality and Preference 2008, 19:344-346.
15. Bi J. Comments on D.M. Ennis' presentation on equivalence testing. Food Quality and Preference 2010, 21:259-260.
16. Bi J. Using the benchmark dose (BMD) methodology to determine an appropriate reduction of certain ingredients in food products. Journal of Food Science 2010, 75:R9-16.
17. Bi J. Similarity tests using forced-choice methods in terms of Thurstonian discriminal distance, d'. Journal of Sensory Studies 2011, 26:151-157.
18. Bi J. Bayesian approach to sensory preference, difference, and equivalence tests. Journal of Sensory Studies 2011, 26:383-399.
19. Brockhoff P.B. The statistical power of replications in difference tests. Food Quality and Preference 2003, 14:405-417.
20. Bross I. Why proof of safety is much more difficult than proof of hazard. Biometrics 1985, 41:758-793.
21. Brown, L.D., Hwang, J.T.G., Munk A. (1995). An unbiased test for the bioequivalence problem, Technical Report, Cornell University.
22. Brown L.D., Hwang J.T.G., Munk A. An unbiased test for the bioequivalence problem. The Annals of Statistics 1997, 25:2345-2367.
23. Buehler, G.J. (2010). History of Bioequivalence for Critical Dose Drugs. April 13, 2010. Available at: <>, Transcript available at <>, pp. 34-49. Accessed February 27, 20. http://www.fda.gov/downloads/AdvisoryCommittees/CommitteesMeetingMaterials/Drugs/AdvisoryCommitteeforPharmaceuticalScienceandClinicalPharmacology/UCM212010.pdf.
24. Castura J.C. Equivalence testing: a brief review. Food Quality and Preference 2010, 21:257-258.
25. Carr, B.T. (1995). Confidence intervals in the analysis of sensory discrimination tests - The integration of similarity and difference testing. Proceedings of the 4th AgroStat Meeting 1995, Dijon, France, 22-31.
26. Christensen R.H.B., Brockhoff P.B. Estimation and inference in the same-different test. Food Quality and Preference 2009, 20:514-524.
27. Dunnett C.W., Gent M. Significance testing to establish equivalence between treatments, with special reference to data in the form of 2×2 tables. Biometrics 1977, 33:593-602.
28. Ennis, D.M. (2008a). Response to: Bi, J. (2007). Similarity testing using paired comparison method. Food Quality and Preference, 19, 344.
29. Ennis D.M. Rejoinder to Bi and Meyners. Food Quality and Preference 2008, 19:347-348.
30. Ennis D.M. Tables for parity testing. Journal of Sensory Studies 2008, 23:80-91.
31. Ennis D.M., Ennis J.M. Hypothesis testing for equivalence defined on symmetric open intervals. Communications in Statistics - Theory and Methods 2009, 38:1792-1803.
32. Ennis D.M., Ennis J.M. Equivalence hypothesis testing. Food Quality and Preference 2010, 21:253-256.
33. Ennis D.M., Ennis J.M. Equivalence hypothesis testing: reply to Bi. Food Quality and Preference 2010, 21:261.
34. Ennis D.M., Ennis J.M., Palen J., Lampe R.E. Confidence bounds for positive ratios of normal random variables. Communications in Statistics - Theory and Methods 2008, 37:307-317.
35. Fisher, R.A. (1951). Letter to W.E. Hick of October 1951.
36. Hartung J., Cottrell J.E., Giffin J.P. Absence of evidence is not evidence of absence. Anesthesiology 1983, 58:298-300.
37. Hauck W.W., Anderson S. A new statistical procedure for testing equivalence in two-group comparative bioavailability trials. Journal of Pharmacokinetics and Biopharmaceutics 1984, 12:83-91.
38. Hauck W.W., Anderson S. Comment. Statistical Science 1996, 11:303.
39. Hauschke D., Steinijans V., Pigeot I. Bioequivalence Studies in Drug Development: Methods and Applications 2007, Wiley, New York.
40. Henderson J.D., Esham R.H. Generic substitution: issues for problematic drugs. Southern Medical Journal 2001, 94:16-21.
41. Hsu J.C., Hwang J.T.G., Lui H.K., Ruberg S.J. Confidence intervals associated with tests for bioequivalence. Biometrika 1994, 81:103-114.
42. Kirkwood T.B.L. Bioequivalency testing - a need to rethink. Biometrics 1981, 37:589-591.
43. Kunert J., Meyners M. On the triangle test with replications. Food Quality and Preference 1999, 10:477-482.
44. Lee H.S., van Hout D. Quantification of sensory and food quality: the R-index analysis. Journal of Food Science 2009, 74:R57-64.
45. Lehmann E.L. The Fisher, Neyman-Pearson theories of testing hypotheses: one theory or two?. JASA 1993, 88:1242-1249.
46. Liu H., Berger R.L. Uniformly more powerful, one-sided tests for hypotheses about linear inequalities. The Annals of Statistics 1995, 23:55-72.
47. MacRae A.W. Confidence intervals for the triangle test can give reassurance that products are similar. Food Quality and Preference 1995, 6:61-67.
48. Martin Andrés A. On testing for bioequivalence. Biometrical Journal 1990, 32:125-126.
49. McDermott M.P., Wang Y. Construction of uniformly more powerful tests for hypotheses about linear inequalities. Journal of Statistical Planning and Inference 2002, 107:207-217.
50. Meredith M.P., Heise M.A. Comment. Statistical Science 1996, 11:304-306.
51. Meyners M. Least equivalent allowable difference in equivalence testing. Food Quality and Preference 2007, 18:541-547.
52. Meyners M. Proper and improper use and interpretation of Beta-binomial models in the analysis of replicated difference and preference tests. Food Quality and Preference 2007, 18:741-750.
53. Meyners M. Comments on the letters by D.M. Ennis and J. Bi. Food Quality and Preference 2008, 19:346.
54. Meyners, M. (2008b). On the definition of equivalence in Beta-binomial models. Proceedings of the 10th AgroStat Meeting 2008, Louvain-la-Neuve, Belgium, 245-251.
55. Millard S.P. Proof of safety vs. proof of hazard. Biometrics 1987, 43:719-725.
56. Munk A. On a problem in pharmaceutical statistics and the iteration of a peculiar nonlinear operator in the upper complex halfplane. Nonlinear Analysis 2001, 47:1513-1523.
57. Patel H.I., Gupta G.D. A problem of equivalence in clinical trials. Biometrical Journal 1984, 36:471-474.
58. Perlman M.D., Wu L. The Emperor's new tests (with discussion). Statistical Science 1999, 14:355-381.
59. Rocke D.M. On testing for bioequivalence. Biometrics 1984, 40:225-230.
60. Schuirmann D.J. On hypothesis testing to determine if the mean of a normal distribution is contained in a known interval. Biometrics 1981, 37:617.
61. Schuirmann D.J. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. Journal of Pharmacokinetics and Biopharmaceutics 1987, 15:657-680.
62. Schuirmann, D.J. (1987b). A compromise test for equivalence of average bioavailability. ASA Proceedings of the Biopharmaceutical Section, 137-142.
63. Schuirmann D.J. Comment. Statistical Science 1996, 11:312-313.
64. Senn S. Statistical issues in bioequivalence. Statistics in Medicine 2001, 20:2785-2799.
65. U.S. Environmental Protection Agency (1995). The use of the benchmark dose approach in health risk assessment. Risk Assessment Forum, U.S. Environmental Protection Agency, Washington DC 20460, February 1995.
66. U.S. Food and Drug Administration (2001). Guidance for Industry: Statistical approaches to establishing bioequivalence. U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, Rockville MD 20857, January 2001.
67. Wellek S. Testing Statistical Hypotheses of Equivalence and Noninferiority 2010, CRC Press, Boca Raton. 2nd ed.
68. Westlake W.J. Use of confidence intervals in analysis of comparative bioavailability trials. Journal of Pharmaceutical Science 1972, 61:1340-1341.
69. Westlake W.J. Symmetrical confidence intervals for bioequivalence trials. Biometrics 1976, 32:741-744.
70. Westlake W.J. Response to TBL Kirkwood: bioequivalency testing - a need to rethink. Biometrics 1981, 37:591-594.