Statistics of interlaboratory in vitro toxicological studies

Alternatives to Laboratory Animals

Volumn 31, Issue SUPPL. 1, 2003, Pages 43-63

  Hothorn, Ludwig A ^a  

^a LEIBNIZ UNIVERSITY HANNOVER   (Germany)

Author keywords

Alternatives; In vitro assays; Interaction contrasts; Interlaboratory study; Meta analysis; Parallel line assay; Statistics; Trend tests

Indexed keywords

ANALYSIS OF VARIANCE; ASSAY; DOSE RESPONSE; IMMUNOTOXICITY; IN VITRO STUDY; LABORATORY; MANDEL PLOT; META ANALYSIS; PARAMETRIC TEST; PRIORITY JOURNAL; REVIEW; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS; TOXICITY TESTING;

EID: 0042196050     PISSN: 02611929     EISSN: None     Source Type: Journal    
DOI: 10.1177/026119290303101s03     Document Type: Review

References (91)

1. Kirkland, D.J., Hayashi, M., MacGregor, J.T., Müller, L., Schechtmann, L. & Sofuni,T. (2000). Summary of major conclusions from the international workshop on genotoxicity test procedure. Environmental and Molecular Mutagenesis 35, 162-166.
2. Association of Analytical Communities (1999). International Methods Committee Guidelines for Validation of Qualitative and Quantitative Microbiological Official Methods of Analysis. Web site http:// aoac.org/umeth/MicrobiologyGuidelines112700.htm (Accessed May 2003).
3. Juhel-Gaugain M., Sanders, P., Laurentie, M., Anger, B., Roudaut, B. & Maris, P. (1998). Results of a European interlaboratory study for the determination of oxytetracycline in pig muscle by HPLC. Analyst 123, 2767-2771.
4. Maestroni, B.M., Skerritt, J.H., Ferris, I.G. & Ambrus, A. (2001). Analysis of DDT residues in soil by ELISA: an international interlaboratory study. Journal AOAC International (Association of Analytical Communities) 84, 134-142.
5. Bantle, J.A., Finch, R.A., Fort, D.J., Stover, E.L., Hull, M., Kumsher-King, M. & Gaudet-Hull, A.M. (1999). Phase III interlaboratory study of FETAX. Part 3. FETAX validation using 12 compounds with and without an exogenous metabolic activation system. Journal of Applied Toxicology 19, 447-472.
6. Anon. (1995). Validations of Analytical Procedures, ICH Q2A Guideline as CPMP/ICH/381/95. Federal Register, 1.3.95, 60 FR 11260.
7. Van der Hude, W., Kalweit, S., Engelhardt, G., McKiernan, S., Kasper, P., Slacik-Erben, R., Miltenburger, H.G., Honarvar, N., Fahrig, R., Gorlitz, B., Albertini, S., Kirchner, S., Utesch, D., Potter-Locher, F., Stopper, H. & Madle, S. (2000). In vitro micronucleus assay with Chinese hamster V79 cells: results of a collaborative study with in situ exposure to 26 chemical substances. Mutation Research 468, 137-163.
8. Watanabe, K., Sasaki, T. & Kawakami, K. (1998). Comparisons of chemically-induced mutation among four bacterial strains, Salmonella typhimurium TA102 and TA2638, and Escherichia coli WP2/pKM101 and WP2 uvrA/pKM101: collaborative study III and evaluation of the usefulness of these strains. Mutation Research 416, 169-181.
9. Gee P., Sommers, C.H., Melick, A.S., Gidrol, X.M., Todd, M.D., Burris, R.B., Nelson, M.E., Klemm, R.C. & Zeiger, E. (1998). Comparison of responses of base-specific Salmonella tester strains with the traditional strains for identifying mutagens: the results of a validation study. Mutation Research 412, 115-130.
10. Morita, T., Asano, N., Awogi, T., Sasaki, Y.F., Sato, S., Shimada, H., Sutou, S., Suzuki, T., Wakata, A., Sofuni, T. & Hayashi, M. (1997). Evaluation of the rodent micronucleus assay in the screening of IARC carcinogens (groups 1, 2A and 2B). The summary report of the 6th collaborative study by CSGMT/JEMS MMS. Collaborative Study of the Micronucleus Group Test. Mammalian Mutagenicity Study Group. Mutation Research 389, 3-122.
11. NIEHS (1999). The murine local lymph node assay. NIH Publication No. 99-4494. Web site http://iccvam.niehs.nih.gov/methods/llna.htm (Accessed May 2003).
12. Neuhäuser, M. & Hothorn, L. A. (1995). Auswertung der Dosis-Wirkungs-Abhängigkeit des Ames Mutagenitätsassay bei direkter Kontrolle des Konsumentenrisiko. In Medizinische Informatik, Biometrie und Epidemiologie, Volume 80 (ed. H.J. Trampisch & S. Lange), pp. 113-116, Munich, Germany: MMV Medizin Verlag.
13. Scholz G. & Genschow E. (1999). Prevalidation of the embryonic stem cell test (EST): a new in vitro embryotoxicity test. Toxicology in Vitro 13, 675-618.
14. Lischer, P. (1996). Robust statistical methods in interlaboratory analytical studies. In Robust Statistics, Data Analysis, and Computer Intensive Methods (ed. H. Reider), pp. 251-265. Berlin, Germany: Springer Verlag.
15. Wernimont, G.T. (1987). Use of Statistics to Develop and Evaluate Analytical Methods, 183pp. Gaithersburg, MD, USA: AOAC.
16. Heyes, G.B. (1993). Review of ASTM E691-87 Standard Practice for Conducting An Interlaboratory Study to Determine the Precision of a Test Method. Journal of Quality Technology 25, 313-314.
17. Minkkinen, P. (1995). Estimation of variance components from the results of interlaboratory comparisons. Chemometrics and Intelligent Laboratory Systems 29, 263-270.
18. Rocke, D.M. (1983), Robust statistical analysis of interlaboratory studies. Biometrika 70, 421-431.
19. Kristiansen, S. (1991). A statistical procedure for the estimation of accuracy parameters in interlaboratory studies. Statistics in Medicine 10, 843-854.
20. Vangel, M.G. & Rukhin, A.L. (1999). Maximum likelihood analysis for heteroscedastic one-way random effects ANOVA in interlaboratory studies. Biometrics 55, 129-136.
21. Anon. (1994). ISO 5725-2:1994(E). Geneva, Switzerland: International Organization for Standardization.
22. NIEHS (1997). Validation and regulatory acceptance of toxicological test methods. NIH Publication No. 97-3981. Web site http://iccvam.niehs.nih.gov/ parts/iccvam.htm (Accessed May 2003).
23. Dean, A. & Voss, D. (1999). Design and Analysis of Experiments, 768pp. New York, NY, USA: Springer.
24. Dunnett, C.W. (1955). A multiple comparison procedure for comparing several treatments with a control. Journal of the American Statistical Association 50, 1096-1121.
25. Hothorn, L.A., Neuhäuser, M. & Koch, H-F. (1997). Analysis of randomized dose-finding studies: closure test modifications based on multiple contrast tests. Biometrical Journal 39, 467-479.
26. Hochberg, Y. & Tamhane, A.C. (1987). Probability and Mathematical Statistics: Multiple Comparison Procedures. New York, NY, USA: Wiley & Sons.
27. Bradu, D. & Gabriel, K.R. (1974). Simultaneous statistical inference on interaction in 2-way analysis of variance. Journal of the American Statistical Association 69, 428-436.
28. Westfall, P.H., Tobias, R.D. & Rom, D. (1999). Multiple Comparisons and Multiple Tests, 396pp. Cary, NC, USA: SAS.
29. Bretz, F. & Westfall, P.H. (2002). The Multivariate T-Distribution for Interaction Contrasts in the Two-Way Layout. Web site: www.bioinf.uni-hannover/ -bretz (Accessed May 2003).
30. Westfall, P.H., Tobias, R.D., Rom, D., Wolfinger, R.D. & Hochberg, Y. (1999). Multiple Comparisons and Multiple Tests Using the SAS System, 397pp. Cary, NC, USA: SAS Institute.
31. Schuirmann, D.J. (1987). A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. Journal of Pharmacokinetics Biopharmaceutics 15, 657-680.
32. Schulte, A., Althoff, J., Ewe, S., Richter-Reichhelm, H-B. & the BGVV Group Investigators (2002). Two immunotoxicity ring studies according to OECD TG 407: comparison of data on cyclosporin A and hexachlorobenzene. Regulatory Toxicology and Pharmacology 36, 12-21.
33. Luster, M.I., Portier, C., Pait, D.G., White, K.L., Gennings, C., Munson, A.E., Rosenthal, G. J. & Dean, J.H. (1992). Risk assessment in immunotoxicology. I. Sensitivity and predictability of immune tests. Fundamental and Applied Toxicology 18, 200-210.
34. Freni, S.C., Razzaghi, M. & Moore, G.E. (1994). Reproducibility of the dose-response curve of steroid-induced cleft palate in mice. Risk Analysis 14, 1073-1077.
35. Piegorsch, W.W. & Zeiger, E. (1991). Measuring intra-assay agreement for the Ames salmonella assay. In Statistical Methods in Toxicology (ed. L. Hothorn), pp. 35-41. Heidelberg, Germany: Springer.
36. Ohno, T., Itagaki, H. & Tanaka, N. (1995). Validation study on five different cytotoxicity assays in Japan. Toxicology in Vitro 9, 571-576.
37. Frenzilli, G., Bosco, E. & Barale, R. (2000). Validation of single cell gel assay in human leukocytes with 18 reference compounds. Mutation Research 468, 93-108.
38. Myers, L.E., Adams, N.H., Hughes, T.J., Williams, L.R. & Claxton, L.D. (1987). An interlaboratory study of an EPA/Ames/Salmonella test protocol. Mutation Research 182, 121-133.
39. Margolin, B.H. & Risko, K.J. (1987). The statistical analysis of in vivo genotoxicity data-case studies of the rat hepatocyte UDS and mouse bone marrow micronucleus assays. Environmental Health Perspectives 75, 126.
40. Irr, J.D. & Snee, R.D. (1982). A statistical method for analysis of mouse lymphoma L5178Y cell TK locus forward mutation assay: comparison of results among three laboratories. Mutation Research 97, 371-392.
41. Finney, D.J. (1978). Statistical Methods in Biological Assay, 508pp. London, UK: Griffin.
42. Bartholomew, D.J. (1961). Ordered test in the analysis of variance. Biometrika 48, 325-332.
43. Mukerjee, H., Robertson, T., Wright, F.T. (1986). Multiple contrast tests for testing against a simple tree ordering. In Advances in Order Restricted Statistical Inference (ed. R. Dykstra), pp. 203-230. Berlin, Germany: Springer.
44. Anraku, K. (1999). An information criterion for parameters under a simple order restriction. Biometrika 86, 141-152.
45. Bretz, F. (1999). Powerful Modifications of William's Test on Trend. PhD thesis. University of Hannover.
46. Hirotsu, C. (1997). Isotonic inference with particular interest in application to clinical trial. In Industrial Statistics (ed. C.P. Kitsos & L. Edler), pp. 233-241. Heidelberg, Germany: Physica Verlag.
47. Westfall, P.H. & Young, S.S. (1993). Resampling-based Multiple Testing: Examples and Methods for P-Value Adjustment, 397pp. New York, NY, USA: Wiley.
48. Hedges, L.V. & Olkin, I. (1985). Statistical Methods for Meta-analysis, 369pp. Orlando, FL, USA: Academic Press.
49. Boose, D.D. & Brownie, C. (1992). A rank-based mixed model approach to multistage clinical trials. Biometrics 48, 61-72.
50. Wellek, S. (1997). Testing for absence of qualitative interactions between risk factors and treatment effects. Biometrical Journal 39, 809-821.
51. Bartlett, M.S. (1937). Properties of sufficiency and statistical tests. Proceedings of the Royal Society A160, 268-282.
52. Snee, R.D. & Irr, J.D. (1984). A procedure for the statistical evaluation of Ames Salmonella assay results: comparison of results among four laboratories. Mutation Research 128, 115-125.
53. Anderson, D., Green, M.H., Mattern, I.E. & Godley, M.J. (1984). An international collaborative study of "genetic drift" in Salmonella typhimurium strains used in the Ames test. Mutation Research 130, 1-10.
54. Margolin, B.H., Risko, K.J., Shelby, M.D. & Zeiger, E. (1984). Sources of variability in Ames Salmonella typhimurium tester strains: analysis of the International Collaborative Study on "genetic drift". Mutation Research 130, 11-25.
55. Agnese, G., Risso, D. & De Flora, S. (1984). Statistical evaluation of inter- and intra-laboratory variations of the Ames test, as related to the genetic stability of Salmonella tester strains. Mutation Research 130, 27-44.
56. Zeiger, E., Anderson, B., Haworth, S., Lawlor, T. & Mortelmans, K. (1992). Salmonella mutagenicity tests. V. Results from the testing of 311 chemicals. Environmental and Molecular Mutagenesis 21, 2-141.
57. Mitchell, A.D., Auletta, A.E., Clive, D., Kirby, P.E., Moore, M.M. & Myhr, B.C. (1997). The L5178Y/tk+/- mouse lymphoma specific gene and chromosomal mutation assay a phase III report of the US Environmental Protection Agency Gene-Tox Program. Mutation Research 394, 177-303.
58. Caspary, W.J., Daston, D.S., Myhr, B.C., Mitchell, A.D., Rudd, C.J. & Lee, P.S. (1988). Evaluation of the L5178Y mouse lymphoma cell mutagenesis assay: interlaboratory reproducibility and assessment. Environmental and Molecular Mutagenesis S13, 195-229.
59. Balls, M., Botham, P.A., Bruner, L.H. & Spielmann, H. (1995). The EC/HO international validation study on alternatives to the Draize eye irritation test. Toxicology in Vitro 9, 871-929.
60. Sofuni, T., Honma, M., Hayashi, M., Shimada, H., Tanaka, N., Wakuri, S., Awogi, T., Yamamoto, K.I., Nishi, Y. & Nakadate, M. (1996). Detection of in vitro clastogens and spindle poisons by the mouse lymphoma assay using the microwell method: interim report of an international collaborative study. Mutagenesis 11, 349-355.
61. Piegorsch, W.W., Lockhart, A.C., Carr, G.J., Margolin, B.H., Brooks, T., Douglas, G.R., Liegibel, U.M., Suzuki, T., Thybaud, V., van Delft, J.H. & Gorelick, A. (1997). Sources of variability in data from a positive selection lacZ transgenic mouse mutation assay: an interlaboratory study. Mutation Research 388, 249-289.
62. Watanabe, K., Sakamoto, K. & Sasaki, T. (1995). Collaborative study of interlaboratory variability in Salmonella typhimurium TA102 and TA2638, and Escherichia coli WP2/pKM101 and WP2 uvrA/pKM101. Mutagenesis 10, 235-241.
63. Hamada, S., Sutou, S., Morita, T., Wakata, A., Asanami, S., Hosoya, S., Ozawa, S., Kondo, K., Nakajima, M., Shimada, H., Osawa, K., Kondo, Y., Asano, N., Sato, S., Tamura, H., Yajima, N., Marshall, R., Moore, C., Blakey, D.H., Schechtman, L.M., Weaver, J.L., Torous, D.K., Proudlock, R., Ito, S., Namiki, C. & Hayashi, M. (2001). Evaluation of the rodent micronucleus assay by a 28-day treatment protocol: Summary of the 13th Collaborative Study by the Collaborative Study Group for the Micronucleus Test (CSGMT)/ Environmental Mutagen Society of Japan (JEMS)-Mammalian Mutagenicity Study Group (MMS). Environmental and Molecular Mutagenesis 37, 93-110.
64. Wakata, A., Miyamae, Y., Sato, S., Suzuki, T., Morita, T., Asano, N., Awogi, T., Kondo, K. & Hayashi, M. (1998). Evaluation of the rat micronucleus test with bone marrow and peripheral blood. Summary of the 9th Collaborative Study by the Collaborative Study Group for the Micronucleus Test (CSGMT)/Environmental Mutagen Society of Japan (JEMS)-Mammalian Mutagenicity Study Group (MMS). Environmental and Molecular Mutagenesis 32, 84-100.
65. Roguet, R., Cohen, C. & Robles, C. (1998). An interlaboratory study of the reproducibility and relevance of Episkin, a reconstructed human epidermis, in the assessment of cosmetic irritancy. Toxicology in Vitro 12, 295-304.
66. Fentem, J.H., Briggs, D., Chesne, C., Elliott, G.R., Harbell, J.W., Heylings, J.R., Portes, P., Roguet, R., van de Sandt, J.J. & Botham, P.A. (2001). A prevalidation study on in vitro tests for acute skin irritation. Results and evaluation by the Management Team. Toxicology in Vitro 15, 57-93.
67. Matsushima, T., Hayashi, M., Matsuoka, A., Ishidate, M., Miura, K.F., Shimizu, H., Suzuki, Y., Morimoto, K., Ogura, H., Mure, K., Koshi, K. & Sofuni, T. (1999). Validation study of the in vitro micronucleus test in a Chinese hamster lung cell line (CHL/IU). Mutagenesis 14, 569-580.
68. Honma, M., Hayashi, M., Shimada, H., Tanaka, N., Wakuri, S., Awogi, T., Yamamoto, K.I., Kodani, N., Nishi, Y., Nakadate, M. & Sofuni, T. (1999). Evaluation of the mouse lymphoma tk assay (microwell method) as an alternative to the in vitro chromosomal aberration test. Mutagenesis 14, 5-22.
69. Hatao, M., Murakami, N. & Sakamoto, K. (1999). Interlaboratory validation of the in vitro eye irritation test for cosmetic ingredients. 4. Haemoglobin denaturation test. Toxicology in Vitro 13, 125-137.
70. Kurishita, A., Katoh, T. & Ohsawa, H. (1999). Interlaboratory validation of the in vitro eye irritation test for cosmetic ingredients. 5. Skin ZK1100 and tissue equivalent assay. Toxicology in Vitro 13, 139-151.
71. Uchiyama, T., Akiyama, J. & Miyai, E. (1999). Interlaboratory validation of the in vitro eye irritation test for cosmetic ingredients. 7. Evaluation of cytotoxicity test by CornePack. Toxicology in Vitro 13, 163-173.
72. Tani, N., Kinoshita, S. & Okamoto, A. (1999). Interlaboratory validation of the in vitro eye irritation test for cosmetic ingredients. 8. Evaluation of cytotoxicity test on SIRC cells. Toxicology in Vitro 13, 175-187.
73. Chiba, K., Makino, I. & Ochuchi, J. (1999). Interlaboratory validation of the eye irritation test for cosmetic ingredients. 9. Evaluation of cytotoxicity test on HeLa cells. Toxicology in Vitro 13, 189-198.
74. Okumura, H., Arashima, M. & Ohuchi, J. (1999). Interlaboratory validation of the in vitro eye irritation test for cosmetic ingredients. 10. Evaluation of cytotoxicity test on CHL cells. Toxicology in Vitro 13, 199-208.
75. Matsukawa, K., Masuda, K. & Kakishima, H. (1999). Interlaboratory validation of the in vitro eye irritation test for cosmetic ingredients. 11. EYTEX. Toxicology in Vitro 13, 209-217.
76. Ohuchi, J., Kasai, Y. & Sakamoto, K. (1999). Interlaboratory validation of the in vitro eye irritation test for cosmetic ingredients. 6. Evaluation of MATREX. Toxicology in Vitro 13, 153-162.
77. Southee, J.A., McPherson, J.P. & Osborne, R. (1999). The performance of the tissue equivalent assay using skin ZK1200 model in the COLIPA international validation study to the Draize eye irritation test. Toxicology in Vitro 13, 355-373.
78. Pape, W.J.W., Pfannenbecker, U. & Bracher, M. (1999). COLIPA validation project on in vitro eye irritation test for cosmetic ingredients and finished products: the red blood cell test for estimation of acute eye irritation potentials. Toxicology in Vitro 13, 343-354.
79. Harbell, J.W., Osborne, R. & Carr, G.J. (1999). Assessment of the cytosensor microphysiometer assay in the COLIPA in vitro eye irritation validation study. Toxicology in Vitro 13, 313-323.
80. Courtellemont, P., Henert, P. & Biesse, J.P. (1999). Relevance and reliability of the PREDIS-AFE assay in the COLIPA eye irritation validation program. Toxicology in Vitro 13, 305-312.
81. Courtellemont, P., Pannentier, M. & Biesse, J.P. (1999). Evaluation of the EYTEX system in the COLIPA eye irritation program. Toxicology in Vitro 13, 295-304.
82. Bagley, D.M., Cerven, D. & Harbell, J. (1999). Assessment of chorioallantoic membrane vascular assay (CAMVA) in the COLIPA eye irritation validation study. Toxicology in Vitro 13, 285-293.
83. Ryden, E., Ekström, C., Hellmer, L. & Bolcsfoldi, G. (2000). Comparison of the sensitivities of Salmonella typhimurium strains TA102 and TA2638A to 16 mutagens. Mutagenesis 15, 495-502.
84. Schmid, D.E., Lowe, X., Marchetti, F., Bishop, J., Haseman, J. & Wyrobek, A.J. (2001). Evaluation of inter-scorer and inter-laboratory reliability of the mouse epididymal sperm aneuploidy (m-ESA) assay. Mutagenesis 16, 189-195.
85. Benigni, R. & Giuliani, A. (1988). Computer-assisted analysis of interlaboratory Ames test variability. Journal of Toxicology and Enviromental Health 25, 135-148.
86. NIEHS (1999). Corrositex: an in vitro test method for assessing dermal corrosivity potential. NIH Publication No. 99-4495. Web site http://iccvam.niehs.nih.gov/ parts/iccvam.htm (Accessed May 2003).
87. Fentem, J.H., Archer, G.E.B. & Balls, M. (1998). The ECVAM international validation study on in vitro tests for skin corrosivity. II. Results and evaluation by the management team. Toxicology in Vitro 12, 483-524.
88. Spielmann, H., Liebsch, M. & Kalweit, S. (1996). Results of a validation study in Germany on two in vitro alternatives to the Draize eye irritation test, the HET-CAM test and the 3T3 NRU cytotoxicity test. ATLA 24, 741-858.
89. Cormier, E.M., Parker, R.D., Henson, C., Cruse, L.W., Merritt, A.K., Bruce, R.D. & Osborne R. (1996). Determination of the intra- and interlaboratory reproducibility of the low volume eye test and its statistical relationship to the Draize eye test. Regulatory Toxicology and Pharmacology 23, 156-161.
90. Myers, L.E., Adams, N.H., Hughes, T.J., Williams, L.R. & Claxton, L.D. (1987). An interlaboratory study of an EPA/Ames/Salmonella test protocol. Mutation Research 182, 121-133.
91. De Boeck, M., Touil, N., De Visscher, G., Vande, P.A. & Kirsch-Volders, M. (2000). Validation and implementation of an internal standard in comet assay analysis. Mutation Research 469, 181-197.