Use of diagnostic accuracy as a metric for evaluating laboratory proficiency with microarray assays using mixed-tissue RNA reference samples

Pharmacogenomics

Volumn 9, Issue 11, 2008, Pages 1753-1763

  Pine, P S ^a   Boedigheimer, M ^b   Rosenzweig, B A ^a   Turpaz, Y ^c   He, Y D ^d   Delenstarr, G ^e   Ganter, B ^f   Jarnagin, K ^f   Jones, W D ^g   Reid, L H ^g   Thompson, K L ^a  

^a CENTER FOR DRUG EVALUATION AND RESEARCH   (United States)

^b AMGEN INC   (United States)

^c Thermo Fisher Scientific   (United States)

^d ROSETTA INPHARMATICS   (United States)

^e AGILENT TECHNOLOGIES   (United States)

^f Entelos Inc   (United States)

^g Expression Analysis Inc   (United States)

Author keywords

microarrays; performance; proficiency testing; quality control; standards

Indexed keywords

RNA;

ANIMAL TISSUE; ARTICLE; CONTROLLED STUDY; DIAGNOSTIC ACCURACY; GENE EXPRESSION; LABORATORY TEST; MICROARRAY ANALYSIS; NONHUMAN; RAT; RECEIVER OPERATING CHARACTERISTIC; RELIABILITY; SENSITIVITY AND SPECIFICITY; ANIMAL; ANTIBODY SPECIFICITY; DIAGNOSIS, MEASUREMENT AND ANALYSIS; DNA MICROARRAY; GENE EXPRESSION PROFILING; GENETICS; METHODOLOGY; QUALITY CONTROL; REPRODUCIBILITY; STANDARD;

RATTUS;

ANIMALS; GENE EXPRESSION PROFILING; LABORATORY TECHNIQUES AND PROCEDURES; OLIGONUCLEOTIDE ARRAY SEQUENCE ANALYSIS; ORGAN SPECIFICITY; QUALITY CONTROL; RATS; REFERENCE STANDARDS; REPRODUCIBILITY OF RESULTS; RNA; SENSITIVITY AND SPECIFICITY;

EID: 61349095462     PISSN: 14622416     EISSN: 17448042     Source Type: Journal    
DOI: 10.2217/14622416.9.11.1753     Document Type: Article

References (31)

1. Goodsaid F, Frueh FW: Implementing the US FDA guidance on pharmacogenomic data submissions. Environ. Mol. Mutagen. 48, 354-358 (2007). (Pubitemid 47011763)
2. Dix DJ, Gallagher K, Benson WH, et al. A framework for the use of genomics at the EPA. Nat. Biotechnol. 24, 1108-1111 (2006).
3. MAQC Consortium: The MicroArray Quality Control (MAQC) project shows inter-and intraplatform reproducibility of gene expression measurements. Nat. Biotechnol. 24, 1151-1161 (2006).
4. Fare TL Coffey EM, Dai H, et al. Effects of atmospheric ozone on microarray data quality. Anal. Chem. 75, 4672-4675 (2003). (Pubitemid 37082262)
5. Branham WS, Melvin CD, Han T, et al. Elimination of laboratory ozone leads to a dramatic improvement in the reproducibility of microarray gene expression measurements. BMC Biotechnol. 12, 8 (2007). (Pubitemid 46306405)
6. Shi L, Tong W, Su Z, et al. Microarray scanner calibration curves: characteristics and implications. BMC Bioinformatics 6, S11 (2005). (Pubitemid 41574316)
7. External RNA Controls Consortium: The External RNA Controls Consortium: a progress report. Nat. Methods 2, 731-734 (2005).
8. External RNA Controls Consortium: Proposed methods for testing and selecting the ERCC external RNA controls. BMC Genomics 6, 150 (2005).
9. Mueller MM: Implementation of reference systems in laboratory medicine. Clin. Chem. 46, 1907-1909 (2000).
10. Thompson KL, Rosenzweig BA, Pine PS, et al. Use of a mixed tissue RNA design for performance assessments on multiple microarray formats. Nucleic Acids Res. 33, E187 (2005).
11. Ganter B, Tugendreich S, Pearson CI, et al. Development of a large-scale chemogenomics database to improve drug candidate selection and to understand mechanisms of chemical toxicity and action. J. Biotechnol. 119, 219-244 (2005). (Pubitemid 41253686)
12. Sharov V, Kwong KY, Frank B, et al. The limits of log-ratios. BMC Biotechnol. 22, 1-6 (2004). (Pubitemid 38846484)
13. Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143, 29-36 (1982). (Pubitemid 12142173)
14. Swets JA: Measuring the accuracy of diagnostic systems. Science 240, 1285-1293 (1988).
15. He YD, Dai H, Schadt EE, et al. Microarray standard data set and figures of merit for comparing data processing methods and experiment designs. Bioinformatics 19, 956-965 (2003). (Pubitemid 36675816)
16. Choe SE, Boutros M, Michelson AM, Church GM, Halfon MS: Preferred analysis methods for Affymetrix GeneChips revealed by a wholly defined control dataset. Genome Biol. 6, R16 (2005).
17. Cope LM, Irizarry RA, Jaffee HA, Wu Z, Speed TP: A benchmark for Affymetrix GeneChip expression measures. Bioinformatics 20, 323-331 (2004). (Pubitemid 38262763)
18. Shippy R, Fulmer-Smentek S, Jensen RV, et al. Using RNA sample titrations to assess microarray platform performance and normalization techniques. Nat. Biotechnol. 24, 1123-1131 (2006). (Pubitemid 44359724)
19. Irizarry RA, Bolstad BM, Collin F, Cope LM, Hobbs B, Speed TP: Summaries of Affymetrix GeneChip probe level data. Nucleic Acids Res. 31, E15 (2003).
20. Irizarry RA, Hobbs B, Collin F, et al. Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics 4, 249-264 (2003).
21. Tumor Analysis Best Practices Working Group: Expression profiling -best practices for data generation and interpretation in clinical trials. Nat. Rev. Genetics 5, 229-237 (2004).
22. Han T, Melvin CD, Shi L, et al. Improvement in the reproducibility and accuracy of DNA microarray quantification by optimizing hybridization conditions. BMC Bioinformatics 7, S17 (2006). (Pubitemid 46442962)
23. Mongan MA, Higgins MA, Pine PS, Afshari CA, Hamadeh HK: Assessment of repeated microarray experiments using mixed tissue RNA reference samples. Biotechniques 45, 283-292 (2008).
24. Yauk CL, Berndt ML: Review of the literature examining the correlation among DNA microarray technologies. Environ. Mol. Mutagen. 48, 380-394 (2007).
25. Barnes M, Freudenberg J, Thompson S, Aronow B, Pavlidis P: Experimental comparison and cross-validation of the Affymetrix and Illumina gene expression analysis platforms. Nucleic Acids Res. 33, 5914-5923 (2005). (Pubitemid 41742611)
26. Thompson KL, Pine PS: Comparison of the diagnostic performance of human whole genome microarrays using mixed-tissue RNA reference samples. Toxicol. Lett. doi 10.1016/j. toxlet.2008.08.018 (2008) (Epub ahead of print)
27. Zheng X, Huang HC, Li W, Liu P, Li QZ, Liu Y: Modeling nonlinearity in dilution design microarray data. Bioinformatics 23, 1339-1347 (2007). (Pubitemid 47050515)
28. Salit M: Standards in gene expression microarray experiments. Methods Enzymol. 411, 63-78 (2006). (Pubitemid 44291421)
29. ArrayExpress at the European Bioinformatics Institute http://www.ebi.ac.uk/microarray-as/ae/
30. Critical Path Opportunities List. US Food and Drug Administration, Accessed March 2006. www.fda.gov/oc/initiatives/criticalpath/reports/opp-list. pdf
31. Report of the Secretarys Advisory Committee on Genetics, Health, and Society. US System of Oversight of Genetic Testing: A Response to the Charge of the Secretary of Health and Human Services (2008) www4.od.nih.gov/oba/sacghs/ reports/SACGHS-oversight-report.pdf