Integrated Testing Strategy (ITS) - Opportunities to better use existing data and guide future testing in toxicology

Altex

Volumn 27, Issue 4, 2010, Pages 231-242

  Jaworska, Joanna ^a   Hoffmann, Sebastian ^b  

^a PROCTER AND GAMBLE COMPANY   (United States)

^b Seh Consulting + Services   (Germany)

Author keywords

21st century toxicology tools; Adaptive framework; Hypothesis driven; Integrated testing strategy; Probabilistic

Indexed keywords

CONCEPTUAL FRAMEWORK; COST; DECISION MAKING; HUMAN; HYPOTHESIS; INTEGRATED TESTING STRATEGY; METHODOLOGY; NONHUMAN; PROBABILITY; PUBLICATION; REVIEW; RISK ASSESSMENT; SKIN SENSITIZATION; TOXICITY TESTING; ANIMAL; ANIMAL TESTING ALTERNATIVE; CLASSIFICATION; DANGEROUS GOODS; STANDARD; TOXICOLOGY;

ANIMAL TESTING ALTERNATIVES; ANIMALS; DECISION MAKING; HAZARDOUS SUBSTANCES; TOXICITY TESTS; TOXICOLOGY;

EID: 79955724481     PISSN: 09467785     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (82)

1. Ahlers, J., Stock, F. and Werschkun, B. (2008). Integrated testing and intelligent assessment - new challenges under REACH. Environ. Sci. Pollut. Res. 15, 565-572.
2. Alonzo, T. A. and Pepe, M. S. (1999). Using a combination of reference tests to assess the accuracy of a new diagnostic test. Stat. Med. 18, 2987-3003. (Pubitemid 29526940)
3. Alonzo, T. A. and Pepe, M. S. (1998). Assessing the accuracy of a new diagnostic test when a gold standard does not exist. UW Biostatistics Working Paper Series, working paper 156.
4. st century: bringing the vision to life. Toxicol. Sci. 107, 324-330.
5. Anon (2007). Regulation (EC) No 1907/2006 of the European Parliament and of the Council of 18 December 2006 concerning the Registration, Evaluation, Authorisation and Restriction of Chemicals (REACH), establishing a European Chemicals Agency, amending Directive 1999/45/EC and repealing Council Regulation (EEC) No 793/93 and Commission Regulation (EC) No 1488/94 as well as Council Directive 76/769/EEC and Commission Directives 91/155/EEC, 93/67/EEC, 93/105/EC and 2000/21/EC. Official Journal of the European Union L396, 1-856, 2007.
6. Anon (2005). REACH and the need for intelligent testing strategies. [EUR 21554 EN], 32pp. Ispra, Italy: Institute for Health and Consumer Protection, EC Joint Research Centre.
7. Anon (2003). Directive 2003/15/EC of the European Parliament and the Council of 27 February amending Directive 76/786/EEC on the approximation of the laws of the member States relating to cosmetic products. Official Journal of the European Communities L66, 26-35.
8. Antezana, E., Kuiper, M. and Mironov, V. (2009). Biological knowledge management: the emerging role of the Semantic Web technologies. Brief Bioinform. 10, 392-407.
9. Baughman, A. L., Bisgard, K. M., Cortese, M. M. et al. (2008). Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clin. Vaccine Immunol. 15, 106-114. (Pubitemid 351966543)
10. Benfenati, E., Gini, G., Hoffmann, S. and Luttik, R. (2010). Comparing in vivo, in vitro and in silico methods and integrated strategies for chemical assessment: problems and prospects. ATLA 38,153-166.
11. Bessems, J. G. M. (2009). Opinion on the usefulness of in vitro data for human risk assessment. Suggestions for better use of non-testing approaches. RIVM brief rapport 320016002, 25 p.
12. Blanchard, G. and Roquain, E. (2009). Adaptive FDR control under independence and dependence. J. Mach. Learn Res. 10, 2837-2871.
13. Bloemer, J. M. M., Brijs, T., Swinnen, G. and Vanhoof, K. (2003). Comparing complete and partial classification for identifying customers at risk, International Journal of Research in Marketing 20 (2), 117-131. (Pubitemid 36613892)
14. Boulesteix, A.-L. (2010). Over-optimism in bioinformatics research. Bioinformatics 26, 437-439.
15. Boulesteix, A.-L. and Hothorn, T. (2010). Testing the additional predictive value of high-dimensional molecular data. BMC Bioinformatics 11, 78.
16. Boulesteix, A.-L. and Strobl, C. (2009). Optimal classifier selection and negative bias in error rate estimation: An empirical study on high-dimensional prediction. BMC Med. Res. Methodol. 9, 85.
17. Bradbury, S., Feijtel, T. and van Leeuwen, K. (2004). Meeting the scientific needs of ecological risk assessment in a regulatory context. Environ. Sci. Technol. 38, 463a-470a. (Pubitemid 39582820)
18. Breton, R. L., Gilron, G., Thompson, R. et al. (2009). A new quality assurance system for the evaluation of ecotoxicity studies submitted under the New Substances Notification Regulations in Canada. Integr. Environ. Assess. Manag. 5, 127-137.
19. Burlinson, B., Tice, R. R., Speit, G. et al. (2007). In Vivo Comet Assay Workgroup, part of the Fourth International Workgroup on Genotoxicity Testing. Mutat. Res. 627, 31-35. (Pubitemid 46091764)
20. Caldas, J., Gehlenborg, N., Faisal, A. et al. (2009). Probabilistic retrieval and visualization of biologically relevant microarray experiments. Bioinformatics 25, i145-153.
21. Cook, D. J., Mulrow, C. D. and Haynes, R. B. (1997). Systematic reviews: synthesis of best evidence for clinical decisions. Ann. Intern. Med. 126, 376-380. (Pubitemid 27102522)
22. Egger, M. and Smith, G. D. (1997). Meta-Analysis. Potentials and promise. BMJ 315, 1371-1374. (Pubitemid 27499747)
23. Enøe, C., Georgiadis, M. P. and Johnson, W. O. (2000). Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown. Prev. Vet. Med. 45, 61-81. (Pubitemid 30308340)
24. EBI - European Bioinformatics Institute. http://www.ebi.ac.uk (accessed Oct 05, 2010).
25. Gadaleta, E., Lemoine, N. R. and Chelala, C. (2010). Online resources of cancer data: barriers, benefits and lessons. Brief Bioinform., Epub ahead of print on March 25.
26. Georgiadis, M. P., Johnson, W. O. and Gardner, I. A. (2005). Sample size determination for estimation of the accuracy of two conditionally independent tests in the absence of a gold standard. Prev. Vet. Med. 71, 1-10. (Pubitemid 41207097)
27. GO (2010). "Gene Ontology", retrievable from the Internet: http://www.geneontology.org (accessed Oct 05, 2010).
28. Gottgtroy, P., Kasabov, N., MacDonell, S. (2006). Evolving ontologies for intelligent decision support. In Sanchez E. (ed.), Fuzzy Logic and the Semantic Web. Capturing Intelligence 1, 415-439.
29. Gubbels-van Hal, W. M., Blaauboer, B. J., Barentsen, H. M. et al. (2005). An alternative approach for the safety evaluation of new and existing chemicals, an exercise in integrated testing. Regul. Toxicol. Pharmacol. 42, 284-295. (Pubitemid 41021978)
30. Han, J. (2008). Understanding biological functions through molecular networks. Cell Res. 18, 224-237.
31. Hanson, S. O. and Rudén, C. (2007). Towards a theory of tiered testing. Regul. Toxicol. Pharmacol. 48, 35-44.
32. Hardy, B., Douglas, N., Helma, C. et al (2010). Collaborative development of predictive toxicology applications. J. Cheminform., accepted 3 June 2010.
33. st century? ALTEX, current issue.
34. Hartung, T. (2009). Food for thought... on evidence-based toxicology. ALTEX 26, 75-82.
35. Hengstler, J. G., Foth, H., Kahl, R. et al. (2006). The REACH concept and its impact on toxicological sciences. Toxicology 220, 232-239. (Pubitemid 43279497)
36. Hobbs, D. A., Warne, M. S. and Markich, S. J. (2005). Evaluation of criteria used to assess the quality of aquatic toxicity data. Integr. Environ. Assess. Manag. 1, 174-180.
37. Hoffmann, S. (2009). Aspects of test assessment. Hum. Exp. Toxicol. 28, 95-96.
38. Hoffmann, S. and Hartung, T. (2006). Towards an evidence-based toxicology. Hum. Exp. Toxicol. 25, 497-513.
39. Hoffmann, S. and Hartung, T. (2005). Diagnosis: toxic! - Trying to apply approaches of clinical diagnostics and prevalence in toxicology considerations. Toxicol. Sci. 85, 422-428. (Pubitemid 40614273)
40. Hoffmann, S., Saliner, A. G., Patlewicz, G. et al. (2008). A feasibility study developing an integrated testing strategy assessing skin irritation potential of chemicals. Toxicol. Lett. 180, 9-20.
41. Hoffmann, S., Edler, L., Gardner, I. et al. (2008). Points of reference in the validation process: the report and recommendations of ECVAM Workshop 66. ATLA 36, 343-352
42. Hong, D. and Man, S. (2010). Signal propagation in smallworld biological networks with weak noise. J. Theor. Biol. 262, 370-380.
43. Horvath, A. R. and Pewsner, D. (2004). Systematic reviews in laboratory medicine: principles, processes and practical considerations. Clin. Chim. Acta 342, 23-39. (Pubitemid 38352912)
44. Hothorn, L. A. (2002). Selected biostatistical aspects of the validation of in vitro toxicological assays. ATLA 30, Suppl. 2, 93-98.
45. Hulzebos, E. and Gerner, I. (2010). Weight factors in an Integrated Testing Strategy using adjusted OECD principles for (Q)SARs and extended Klimisch codes to decide on skin irritation classification. Regul. Toxicol. Pharmacol. 58(1), 131-144
46. Jaworska, J., Gabbert, S. and Aldenberg, T. (2010a). Towards optimization of chemical testing under REACH: a Bayesian network approach to Integrated Testing Strategies. Regul. Toxicol. Pharmacol. 57, 157-167.
47. Jaworska, J., Harol, A., Kern, P. and Gerberick, F. (2010b). Bayesian adaptive testing strategy based on integrated nonanimal information - skin sensitization test case. Tox. Sci., submitted.
48. Jiang, W. and Tanner, M. A. (2008). Gibbs posterior for variable selection in high-dimensional classification and data mining. Ann. Statist. 36, 2207-2231.
49. Kavlock, R. J., Ankley, G., Blancato, J. et al. (2008). Computational toxicology - a state of the science mini review. Tox. Sci. 103, 14-27. (Pubitemid 351524473)
50. Kim, H.-G., Fillies, C., Smith, B. and Wikarski, D. (2002). Visualizing a dynamic knowledge map using semantic web technology. In Engineering and Deployment of Cooperative Information Systems (130-140). Berlin: Springer.
51. Klimisch, H.-J., Andreae, M. and Tillmann, U. (1997). A systematic approach for evaluating the quality of experimental toxicological and ecotoxicological data. Regul. Toxicol. Pharmacol. 25, 1-5. (Pubitemid 27117571)
52. Knottnerus, J. A. and Muris, J. W. (2003). Assessment of the accuracy of diagnostic tests: the cross-sectional study. J. Clin. Epidemiol. 56, 1118-1128. (Pubitemid 37386337)
53. Lander, A. (2010). The edges of understanding. BMC Biol. 8, 40-44.
54. Lin, W.-Y. and Lee, W.-C. (2010). Incorporating prior knowledge to facilitate discoveries in a genome-wide association study on age-related macular degeneration. BMC Res. Notes 3, 26.
55. Matthews, L., Gopinath, G., Gillespie M. et al. (2009). Reactome knowledgebase of human biological pathways and processes. Nucleic Acids Res. 37, D619-622.
56. McInturff, P., Johnson, W. O., Cowling, D. and Gardner, I. A. (2004). Modelling risk when binary outcomes are subject to error. Stat. Med. 23, 1095-1109. (Pubitemid 38477069)
57. Meinshausen, M. (2008). Hierarchical testing of variable importance. Biometrika 95, 265-278.
58. Myers, C. L., Barrett, D. R., Hibbs, M. A. et al. (2006). Finding function: evaluation methods for functional genomic data. BMC Genomics 7, 187.
59. OECD (2008). Workshop on integrated approaches to testing and assessment. OECD Environment Health and Safety Publications. Series on Testing and Assessment No. 88. Paris: OECD.
60. OECD (2002). OECD guideline for testing of chemicals No. 404: Acute dermal irritation/corrosion. Organisation for Economic Cooperation and Development, Paris, 1-13.
61. Pearl, J. (1988). Probabilistic reasoning in intelligent systems: networks of plausible inference. San Francisco: Morgan Kaufmann Publishers.
62. Pepe, M. (2003). The statistical evaluation of medical tests for classification and prediction. Oxford: Oxford University Press.
63. Rao, C. V., Wolf, A. and Arkin, P. (2002). Control, exploitation and tolerance of intracellular noise. Nature 420, 231-237. (Pubitemid 35340135)
64. Reitsma, J. B., Rutjes, A. W., Khan, K. S. et al. (2009). A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J. Clin. Epidemiol. 62, 797-806.
65. Rudén, C. (2001). The use and evaluation of primary data in 29 trichloroethylene carcinogen risk assessments. Regul. Toxicol. Pharmacol. 34, 3-16.
66. Rutjes, A. W., Reitsma, J. B., Coomarasamy, A. et al. (2007). Evaluation of diagnostic tests when there is no gold standard. A review of methods. Health Technol. Assess. 11, iii, ix-51.
67. Schaafsma, G., Kroese, E. D., Tielemans, E. L. et al. (2009). REACH, non-testing approaches and the urgent need for a change in mind set. Regul. Toxicol. Pharmacol. 53, 70-80.
68. Schneider, K., Schwarz, M., Burkholder, I. et al. (2009). "ToxR-Tool", a new tool to assess the reliability of toxicological data. Toxicol. Lett. 189, 138-144.
69. Schreider, J., Barrow, C., Birchfield, N. et al. (2010). Enhancing the credibility of decisions based on scientific conclusions: transparency is imperative. Toxicol. Sci. 116, 5-7.
70. Scott, L., Eskes, C., Hoffmann, S. et al. (2010). A proposed eye irritation testing strategy to reduce and replace in vivo studies using Bottom-Up and Top-Down approaches. Toxicol. In Vitro 24, 1-9.
71. Smith, G. D., Egger, M. and Phillips, A. N. (1997), Meta-analysis. Beyond the grand mean? BMJ 315, 1610-1614. (Pubitemid 27522409)
72. Spasic, I., Ananiadou, S., McNaught, J. and Kumar, A. (2005). Text mining and ontologies in biomedicine: making sense of raw text. Brief Bioinform. 6, 239-251. (Pubitemid 41614546)
73. Šuc, D., Vladusic, D. and Bratko, I. (2004). Qualitatively faithful quantitative prediction. Artif. Intell. 158, 189-214.
74. van Leeuwen, C. J., Patlewicz, G. Y. and Worth, A. P. (2007). Intelligent testing strategies. In C. J. Van Leeuwen, T. G. Vermeire (eds.), Risk assessment of chemicals. An introduction (467-509, second ed.). Dordrecht, The Netherlands: Springer Publishers.
75. Vastrik, I., D'Eustachio, P., Schmidt, E. et al. (2007). Reactome: a knowledge base of biologic pathways and processes. Genome Biol. 8, R39.
76. Weeber, M., Kors, J. A. and Mons, B. (2005). Online tools to support literature-based discovery in the life sciences. Brief Bioinform. 6, 277-286. (Pubitemid 41614549)
77. Weed, D. L. (2005). Weight of evidence: a review of concept and methods. Risk Anal. 25, 1545-1557.
78. Worth, A. P., Bassan, A., De Bruijn, J. et al. (2007). The role of the European Chemicals Bureau in promoting the regulatory use of (Q)SAR methods. SAR QSAR Environ. Res. 18, 111-125.
79. Wu, W. (2009). On false discovery control under dependence. Ann. Stat. 36, 364-380.
80. Yoav, B. and Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. Ann. Stat. 29, 1165-1188.
81. Zehetmayer, S. and Posch, M. (2010). Post hoc power estimation in large-scale multiple testing problems. Bioinformatics 26, 1050-1056.
82. Zhou, X., Obuchowski, N. and McClish, D. (eds.) (2002). Methods for correcting imperfect standard bias. In Statistical methods in diagnostic medicine (359-395). New York: John Wiley & Sons.