Statistical issues in quality control of proteomic analyses: Good experimental design and planning

Proteomics

Volumn 11, Issue 6, 2011, Pages 1037-1048

  Cairns, David A ^a,b  

^a ST JAMES S UNIVERSITY HOSPITAL   (United Kingdom)

^b EUROPEAN INSTITUTE OF ONCOLOGY   (Italy)

Author keywords

Bioinformatics; Components of variance; Experimental design; Quality control; Randomization; Sample size

Indexed keywords

ANALYSIS OF VARIANCE; EXPERIMENTAL DESIGN; GENE EXPRESSION; MATRIX ASSISTED LASER DESORPTION IONIZATION TIME OF FLIGHT MASS SPECTROMETRY; MULTIVARIATE ANALYSIS; NONHUMAN; PLANNING; PRIORITY JOURNAL; PROTEOMICS; QUALITY CONTROL; QUANTITATIVE ANALYSIS; REVIEW; SAMPLE SIZE; STATISTICAL SIGNIFICANCE; VARIANCE;

ANALYSIS OF VARIANCE; BIAS (EPIDEMIOLOGY); COMPUTATIONAL BIOLOGY; ELECTROPHORESIS, GEL, TWO-DIMENSIONAL; HUMANS; PROTEOMICS; QUALITY CONTROL; RANDOM ALLOCATION; RESEARCH DESIGN; SAMPLE SIZE; TWO-DIMENSIONAL DIFFERENCE GEL ELECTROPHORESIS;

EID: 79952310105     PISSN: 16159853     EISSN: 16159861     Source Type: Journal    
DOI: 10.1002/pmic.201000579     Document Type: Review

References (62)

1. Stead, D. A., Paton, N. W., Missier, P., Embury, S. M. et al., Information quality in proteomics. Brief Bioinform. 2008, 9, 174-188.
2. Aebersold, R., Mann, M., Mass spectrometry-based proteomics. Nature 2003, 422, 198-207.
3. Ong, S. E., Blagoev, B., Kratchmarova, I., Kristensen, D. B. et al., Stable isotope labeling by amino acids in cell culture, SILAC, as a simple and accurate approach to expression proteomics. Mol. Cell. Proteomics 2002, 1, 376-386.
4. Ross, P. L., Huang, Y. L. N., Marchese, J. N., Williamson, B. et al., Multiplexed protein quantitation in Saccharomyces cerevisiae using amine-reactive isobaric tagging reagents. Mol. Cell. Proteomics 2004, 3, 1154-1169.
5. Yanagisawa, K., Shyr, Y., Xu, B. J., Massion, P. P. et al., Proteomic patterns of tumour subsets in non-small-cell lung cancer. Lancet 2003, 362, 433-439.
6. Fan, Y., Wang, J., Yang, Y., Liu, Q. et al., Detection and identification of potential biomarkers of breast cancer. J. Cancer Res. Clin. Oncol. 2010, 136, 1243-1254.
7. Unlu, M., Morgan, M. E., Minden, J. S., Difference gel electrophoresis: a single gel method for detecting changes in protein extracts. Electrophoresis 1997, 18, 2071-2077.
8. Diamandis, E. P., Mass Spectrometry as a diagnostic and a cancer biomarker discovery tool - opportunities and potential limitations. Mol. Cell. Proteomics 2004, 3, 367-378.
9. Bonaldi, T., Straub, T., Cox, J., Kumar, C. et al., Combined use of RNAi and quantitative proteomics to study gene function in Drosophila. Mol. Cell 2008, 31, 762-772.
10. Mann, M., Comparative analysis to guide quality improvements in proteomics. Nat. Methods 2009, 6, 717-719.
11. Patterson, S. D., Data analysis - the Achilles heel of proteomics. Nat. Biotechnol. 2003, 21, 221-222.
12. Karp, N. A., Lilley, K. S., Design and Analysis Issues in Quantitative Proteomics Studies. Proteomics 2007, 7, 42-50.
13. Urfer, W., Grzegorczyk, M., Jung, K., Statistics for proteomics: A review of tools for analyzing experimental data. Proteomics 2006, 48-55.
14. Palagi, P. M., Hernandez, P., Walther, D., Appel, R. D., Proteome informatics I: bioinformatics tools for processing experimental data. Proteomics 2006, 6, 5435-5444.
15. Lisacek, F., Cohen-Boulakia, S., Appel, R. D., Proteome informatics II: bioinformatics for comparative proteomics. Proteomics 2006, 6, 5445-5466.
16. Cox, J., Mann, M., MaxQuant enables high peptide identification rates, individualized p.p.b.-range mass accuracies and proteome-wide protein quantification. Nat. Biotechnol. 2008, 26, 1367-1372.
17. Kumar, C., Mann, M., Bioinformatics analysis of mass spectrometry-based proteomics data sets. FEBS Lett. 2009, 583, 1703-1712.
18. Taylor, C. F., Paton, N. W., Lilley, K. S., Binz, P. A. et al., The minimum information about a proteomics experiment (MIAPE). Nat. Biotechnol. 2007, 25, 887-893.
19. Gentleman, R. C., Carey, V. J., Bates, D. M., Bolstad, B. et al., Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004, 5, R80.
20. Eckel-Passow, J. E., Oberg, A. L., Therneau, T. M., Bergen, H. R., III, An insight into high-resolution mass-spectrometry data. Biostatistics 2009, 10, 481-500.
21. Oberg, A., Vitek, O., Statistical design of quantitative mass spectrometry-based proteomic profiling experiments. J. Proteome Res. 2009, 8, 2144-2156.
22. Fisher, R. A., The Design of Experiments, Oliver & Boyd, Edinburgh 1937.
23. Prakash, A., Piening, B., Whiteaker, J., Zhang, H. et al., Assessing bias in experiment design for large scale mass spectrometry-based quantitative proteomics. Mol. Cell. Proteomics 2007, 6, 1741-1748.
24. Baggerly, K. A., Morris, J. S., Coombes, K. R., Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments. Bioinformatics 2004, 20, 777-785.
25. Hu, J., Coombes, K. R., Morris, J. S., Baggerly, K. A., The importance of experimental design in proteomic mass spectrometry experiments: some cautionary tales. Brief Funct. Genomic Proteomic 2005, 3, 322-331.
26. Karp, N. A., Spencer, M., Lindsay, H., O'Dell, K., Lilley, K. S., Impact of replicate types on proteomic expression analysis. J. Proteome Res. 2005, 4, 1867-1871.
27. Yang, Y. H., Speed, T., Design issues for cDNA microarray experiments. Nat. Rev. Genet. 2002, 3, 579-588.
28. Fisher, R. A. S., The Design of Experiments, Oliver and Boyd, Edinburgh [S.l.] 1935.
29. Atkinson, A. C., Donev, A. N., Optimum Experimental Designs, Clarendon 1992.
30. Cox, D. R., Reid, N., The Theory of the Design of Experiments, Chapman & Hall/CRC, Boca Raton, FL; London 2000.
31. Eckel-Passow, J. E., Hoering, A., Therneau, T. M., Ghobrial, I., Experimental design and analysis of antibody microarrays: applying methods from cDNA arrays. Cancer Res. 2005, 65, 2985-2989.
32. Jiang, W., Freidlin, B., Simon, R., Biomarker-adaptive threshold design: a procedure for evaluating treatment with possible biomarker-defined subset effect. J. Natl. Cancer Inst. 2007, 99, 1036-1043.
33. Wang, S. J., Utility of adaptive strategy and adaptive design for biomarker-facilitated patient selection in pharmacogenomic or pharmacogenetic clinical development program. J. Formos Med. Assoc. 2008, 107, 19-27.
34. Song, X., Bandow, J., Sherman, J., Baker, J. D. et al., iTRAQ experimental design for plasma biomarker discovery. J. Proteome Res. 2008, 7, 2952-2958.
35. Huang, J. T. J., McKenna, T., Hughes, C., Leweke, F. M. et al., CSF biomarker discovery using label-free nano-LCMS based proteomic profiling: Technical aspects. J. Sep. Sci. 2007, 30, 214-225.
36. Callesen, A. K., Vach, W., Jorgensen, P. E., Cold, S. et al., Combined experimental and statistical strategy for mass spectrometry based serum protein profiling for diagnosis of breast cancer: A case-control study. J. Proteome Res. 2008, 7, 1419-1426.
37. Garrod, A. E., Incidence of alkaptonuria: A study in chemical individulity. Lancet 1902, 2, 1616.
38. Williams, G. Z., Young, D. S., Stein, M. R., Cotlove, E., Biological and analytic components of variation in long-term studies of serum constituents in normal subjects. I. Objectives, subject selection, laboratory procedures, and estimation of analytic deviation. Clin. Chem. 1970, 16, 1016-1021.
39. Fraser, C. G., Biological Variation: From Principles to Practice, AACC Press, Washington, DC 2001.
40. Fraser, C. G., Harris, E. K., Generation and application of data on biological variation in clinical chemistry. Crit. Rev. Clin. Lab. Sci. 1989, 27, 409-437.
41. Jackson, D. H., Banks, R. E., Banking of clinical samples for proteomic biomarker studies: A consideration of logistical issues with a focus on pre-analytical variation. Proteomics Clin. Appl. 2010, 4, 250-270.
42. Yasui, Y., Pepe, M., Thompson, M. L., Adam, B. L. et al., A data-analytic strategy for protein biomarker discovery: profiling of high-dimensional proteomic data for cancer detection. Biostatistics 2003, 4, 449-463.
43. SPSS Inc, SPSS 13.0. Chicago, IL.
44. R Development Core Team, R: A language and environment for statistical computing. Vienna, Austria. ISBN 3-900051-07-0.
45. Nonlinear Dynamics Limited, Progenesis SameSpots 4.1. Newcastle, UK.
46. Bates, D., Maechler, M., lme4: Linear mixed-effects models using S4 classes. R package version 0.999375-36.
47. Cairns, D. A., Perkins, D. N., Stanley, A. J., Thompson, D. et al., Integrated multi-level quality control for proteomic profiling studies using mass spectrometry. BMC Bioinformatics 2008, 9, 519.
48. Tonge, R., Shaw, J., Middleton, B., Rowlinson, R. et al., Validation and development of fluorescence two-dimensional differential gel electrophoresis proteomics technology. Proteomics 2001, 1, 377-396.
49. Jackson, D., Herath, A., Swinton, J., Bramwell, D. et al., Considerations for powering a clinical proteomics study: Normal variability in the human plasma proteome. Proteomics Clin. Appl. 2009, 3, 397-407.
50. Rosner, B., Fundamentals of Biostatistics. Duxbury Press, Belmont, CA 2005.
51. Tworoger, S. S., Hankinson, S. E., Use of biomarkers in epidemiologic studies: minimizing the influence of measurement error in the study design and analysis. Cancer Causes Control 2006, 17, 889-899.
52. Paulovich, A. G., Billheimer, D., Ham, A. J. L., Vega-Montoto, L. et al., Interlaboratory Study Characterizing a Yeast Performance Standard for Benchmarking LC-MS Platform Performance. Mol. Cell. Proteomics 2010, 9, 242-254.
53. Anderle, M., Roy, S., Lin, H., Becker, C., Joho, K., Quantifying reproducibility for differential proteomics: noise analysis for protein liquid chromatography-mass spectrometry of human serum. Bioinformatics 2004, 20, 3575-3582.
54. Coombes, K. R., Fritsche, H. A., Jr., Clarke, C., Chen, J. N. et al., Quality control and peak finding for proteomics data collected from nipple aspirate fluid by surface-enhanced laser desorption and ionization. Clin. Chem. 2003, 49, 1615-1623.
55. de Noo, M. E., Tollenaar, R. A., Ozalp, A., Kuppen, P. J. et al., Reliability of human serum protein profiles generated with C8 magnetic beads assisted MALDI-TOF mass spectrometry. Anal. Chem. 2005, 77, 7232-7241.
56. Chow, S.-C., Shao, J., Wang, H., Sample Size Calculations in Clinical Research, Chapman & Hall/CRC, Boca Raton, FL; London 2008.
57. Dobbin, K., Simon, R., Sample size determination in microarray experiments for class comparison and prognostic classification. Biostatistics 2005, 6, 348-348.
58. Cairns, D. A., Barrett, J. H., Billingham, L. J., Stanley, A. J. et al., Sample size determination in clinical proteomic profiling experiments using mass spectrometry for class comparison. Proteomics 2009, 9, 74-86.
59. Horgan, G. W., Sample size and replication in 2D gel electrophoresis studies. J. Proteome Res. 2007, 6, 2884-2887.
60. Yang, Y. H., Dudoit, S., Luu, P., Lin, D. M. et al., Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Res. 2002, 30, e15.
61. Levin, Y., Wang, L., Ingudomnukul, E., Schwarz, E. et al., Real-time evaluation of experimental variation in large-scale LC-MS/MS-based quantitative proteomics of complex samples. J. Chromatogr. B Analyt. Technol. Biomed. Life Sci. 2009, 877, 1299-1305.
62. Dobbin, K. K., Simon, R. M., Sample size planning for developing classifiers using high-dimensional DNA microarray data. Biostatistics 2007, 8, 101-117.