Repeatability and reproducibility in proteomic identifications by liquid chromatography-tandem mass spectrometry

Journal of Proteome Research

Volumn 9, Issue 2, 2010, Pages 761-776

  Tabb, David L ^a   Vega Montoto, Lorenzo ^a,b   Rudnick, Paul A ^c   Variyath, Asokan Mulayath ^b,n   Ham, Amy Joan L ^a   Bunk, David M ^c   Kilpatrick, Lisa E ^c   Billheimer, Dean D ^d   Blackman, Ronald K ^e,o   Cardasis, Helene L ^f,p   Carr, Steven A ^e   Clauser, Karl R ^e   Jaffe, Jacob D ^e   Kowalski, Kevin A ^g   Neubert, Thomas A ^f   Regnier, Fred E ^g   Schilling, Birgit ^h   Tegeler, Tony J ⁱ   Wang, Mu ⁱ   Wang, Pei ^j   Whiteaker, Jeffrey R ^j   Zimmerman, Lisa J ^a   Fisher, Susan J ^k   Gibson, Bradford W ^h   Kinsinger, Christopher R ^l   Mesri, Mehdi ^l   Rodriguez, Henry ^l   Stein, Stephen E ^c   Tempst, Paul ^m   Paulovich, Amanda G ^j   Liebler, Daniel C ^a,q   Spiegelman, Cliff ^b   more..

^a VANDERBILT UNIVERSITY MEDICAL CENTER   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c NATIONAL INSTITUTE OF STANDARDS AND TECHNOLOGY   (United States)

^d UNIVERSITY OF ARIZONA   (United States)

^e BROAD INSTITUTE OF MIT AND HARVARD   (United States)

^f NEW YORK UNIVERSITY SCHOOL OF MEDICINE   (United States)

^g PURDUE UNIVERSITY   (United States)

^h BUCK INSTITUTE FOR RESEARCH ON AGING   (United States)

ⁱ Monarch Life Sciences   (United States)

^j Fred Hutchinson Cancer Research Center   (United States)

^k UNIVERSITY OF CALIFORNIA   (United States)

^l NATIONAL CANCER INSTITUTE   (United States)

^m MEMORIAL SLOAN KETTERING CANCER CENTER   (United States)

ⁿ MEMORIAL UNIVERSITY OF NEWFOUNDLAND   (Canada)

^o Synta Pharmaceuticals Corp   (United States)

^p MERCK RESEARCH LABORATORIES   (United States)

^q VANDERBILT UNIVERSITY   (United States)

more..

Author keywords

Biomarkers; Complexity; Repeatability; Reproducibility; Sampling

Indexed keywords

KERATIN; PEPTIDE; PROTEOME; TRYPSIN;

ANALYTIC METHOD; ARTICLE; CELL LYSATE; COMPARATIVE STUDY; HUMAN; INSTRUMENT; LIQUID CHROMATOGRAPHY; PEPTIDE ANALYSIS; PRIORITY JOURNAL; PROTEIN ANALYSIS; PROTEIN DEGRADATION; PROTEIN STABILITY; PROTEIN VARIANT; PROTEOMICS; REPRODUCIBILITY; TANDEM MASS SPECTROMETRY; YEAST;

CHROMATOGRAPHY, LIQUID; PROTEOME; REPRODUCIBILITY OF RESULTS; TANDEM MASS SPECTROMETRY;

EID: 76149142168     PISSN: 15353893     EISSN: None     Source Type: Journal    
DOI: 10.1021/pr9006365     Document Type: Article

References (33)

1. Steen, H.; Mann, M. The ABC's (and XYZ's) of peptide sequencing. Nat. Rev. Mol. Cell Biol. 2004, 5 (9), 699-711.
2. Prakash, A.; Mallick, P.; Whiteaker, J.; Zhang, H.; Paulovich, A.; Flory, M.; Lee, H.; Aebersold, R.; Schwikowski, B. Signal maps for mass spectrometry-based comparative proteomics. Mol. Cell. Proteomics 2006, 5 (3), 423-432.
3. Liu, H.; Sadygov, R. G.; Yates, J. R., III. A model for random sampling and estimation of relative protein abundance in shotgun proteomics. Anal. Chem. 2004, 76 (14), 4193-4201.
4. Tabb, D. L.; MacCoss, M. J.; Wu, C. C.; Anderson, S. D.; Yates, J. R. 3rd, Similarity among tandem mass spectra from proteomic experiments: detection, significance, and utility. Anal. Chem. 2003, 75 (10), 2470-2477.
5. de Godoy, L. M.; Olsen, J. V.; de Souza, G. A.; Li, G.; Mortensen, P.; Mann, M. Status of complete proteome analysis by mass spectrometry: SILAC labeled yeast as a model system. Genome Biol. 2006, 7 (6), R50.
6. Bammler, T.; Beyer, R. P.; Bhattacharya, S.; Boorman, G. A.; Boyles, A.; Bradford, B. U.; Bumgarner, R. E.; Bushel, P. R.; Chaturvedi, K.; Choi, D.; Cunningham, M. L.; Deng, S.; Dressman, H. K.; Fannin, R. D.; Farin, F. M.; Freedman, J. H.; Fry, R. C.; Harper, A.; Humble, M. C.; Hurban, P.; Kavanagh, T. J.; Kaufmann, W. K.; Kerr, K. F.; Jing, L.; Lapidus, J. A.; Lasarev, M. R.; Li, J.; Li, Y. J.; Lobenhofer, E. K.; Lu, X.; Malek, R. L.; Milton, S.; Nagalla, S. R.; O'Malley J, P.; Palmer, V. S.; Pattee, P.; Paules, R. S.; Perou, C. M.; Phillips, K.; Qin, L. X.; Qiu, Y.; Quigley, S. D.; Rodland, M.; Rusyn, I.; Samson, L. D.; Schwartz, D. A.; Shi, Y.; Shin, J. L.; Sieber, S. O.; Slifer, S.; Speer, M. C.; Spencer, P. S.; Sproles, D. I.; Swenberg, J. A.; Suk, W. A.; Sullivan, R. C.; Tian, R.; Tennant, R. W.; Todd, S. A.; Tucker, C. J.; Van Houten, B.; Weis, B. K.; Xuan, S.; Zarbl, H. Standardizing global gene expression analysis between laboratories and across platforms. Nat. Methods 2005, 2 (5), 351-356.
7. van Midwoud, P. M.; Rieux, L.; Bischoff, R.; Verpoorte, E.; Niederlander, H. A. Improvement of recovery and repeatability in liquid chromatography-mass spectrometry analysis of peptides. J. Proteome Res. 2007, 6 (2), 781-791.
8. Delmotte, N.; Lasaosa, M.; Tholey, A.; Heinzle, E.; van Dorsselaer, A.; Huber, C. G. Repeatability of peptide identifications in shotgun proteome analysis employing off-line two-dimensional chromatographic separations and ion-trap MS. J. Sep. Sci. 2009, 32 (8), 1156-11164.
9. Slebos, R. J.; Brock, J. W.; Winters, N. F.; Stuart, S. R.; Martinez, M. A.; Li, M.; Chambers, M. C.; Zimmerman, L. J.; Ham, A. J.; Tabb, D. L.; Liebler, D. C. Evaluation of strong cation exchange versus isoelectric focusing of peptides for multidimensional liquid chromatography-tandem mass spectrometry. J. Proteome Res. 2008, 7 (12), 5286-5294.
10. Elias, J. E.; Haas, W.; Faherty, B. K.; Gygi, S. P. Comparative evaluation of mass spectrometry platforms used in large-scale proteomics investigations. Nat. Methods 2005, 2 (9), 667-675.
11. Resing, K. A.; Meyer-Arendt, K.; Mendoza, A. M.; Aveline-Wolf, L. D.; Jonscher, K. R.; Pierce, K. G.; Old, W. M.; Cheung, H. T.; Russell, S.; Wattawa, J. L.; Goehle, G. R.; Knight, R. D.; Ahn, N. G. Improving reproducibility and sensitivity in identifying human proteins by shotgun proteomics. Anal. Chem. 2004, 76 (13), 3556-3568.
12. Kapp, E. A.; Schutz, F.; Connolly, L. M.; Chakel, J. A.; Meza, J. E.; Miller, C. A.; Fenyo, D.; Eng, J. K.; Adkins, J. N.; Omenn, G. S.; Simpson, R. J. An evaluation, comparison, and accurate benchmarking of several publicly available MS/MS search algorithms: sensitivity and specificity analysis. Proteomics 2005, 5 (13), 3475-3490.
13. Kislinger, T.; Gramolini, A. O.; MacLennan, D. H.; Emili, A. Multidimensional protein identification technology (MudPIT): technical overview of a profiling method optimized for the comprehensive proteomic investigation of normal and diseased heart tissue. J. Am. Soc. Mass Spectrom. 2005, 16 (8), 1207-1220.
14. Balgley, B. M.; Wang, W.; Song, T.; Fang, X.; Yang, L.; Lee, C. S. Evaluation of confidence and reproducibility in quantitative proteomics performed by a capillary isoelectric focusing-based proteomic platform coupled with a spectral counting approach. Electrophoresis 2008, 29 (14), 3047-3054.
15. Washburn, M. P.; Ulaszek, R. R.; Yates, J. R., III. Reproducibility of quantitative proteomic analyses of complex biological mixtures by multidimensional protein identification technology. Anal. Chem. 2003, 75 (19), 5054-5061.
16. Bell, A. W.; Deutsch, E. W.; Au, C. E.; Kearney, R. E.; Beavis, R.; Sechi, S.; Nilsson, T.; Bergeron, J. J.; Beardslee, T. A.; Chappell, T.; Meredith, G.; Sheffield, P.; Gray, P.; Hajivandi, M.; Pope, M.; Predki, P.; Kullolli, M.; Hincapie, M.; Hancock, W. S.; Jia, W.; Song, L.; Li, L.; Wei, J.; Yang, B.; Wang, J.; Ying, W.; Zhang, Y.; Cai, Y.; Qian, X.; He, F.; Meyer, H. E.; Stephan, C.; Eisenacher, M.; Marcus, K.; Langenfeld, E.; May, C.; Carr, S. A.; Ahmad, R.; Zhu, W.; Smith, J. W.; Hanash, S. M.; Struthers, J. J.; Wang, H.; Zhang, Q.; An, Y.; Goldman, R.; Carlsohn, E.; van der Post, S.; Hung, K. E.; Sarracino, D. A.; Parker, K.; Krastins, B.; Kucherlapati, R.; Bourassa, S.; Poirier, G. G.; Kapp, E.; Patsiouras, H.; Moritz, R.; Simpson, R.; Houle, B.; Laboissiere, S.; Metalnikov, P.; Nguyen, V.; Pawson, T.; Wong, C. C.; Cociorva, D.; Yates Iii, J. R.; Ellison, M. J.; Lopez-Campistrous, A.; Semchuk, P.; Wang, Y.; Ping, P.; Elia, G.; Dunn, M. J.; Wynne, K.; Walker, A. K.; Strahler, J. R.; Andrews, P. C.; Hood, B. L.; Bigbee, W. L.; Conrads, T. P.; Smith, D.; Borchers, C. H.; Lajoie, G. A.; Bendall, S. C.; Speicher, K. D.; Speicher, D. W.; Fujimoto, M.; Nakamura, K.; Paik, Y. K.; Cho, S. Y.; Kwon, M. S.; Lee, H. J.; Jeong, S. K.; Chung, A. S.; Miller, C. A.; Grimm, R.; Williams, K.; Dorschel, C.; Falkner, J. A.; Martens, L.; Vizcaino, J. A. A HUPO test sample study reveals common problems in mass spectrometry-based proteomics. Nat. Methods 2009, 6, 423-430.
17. Chamrad, D.; Meyer, H. E. Valid data from large-scale proteomics studies. Nat. Methods 2005, 2 (9), 647-648.
18. Omenn, G. S.; States, D. J.; Adamski, M.; Blackwell, T. W.; Menon, R.; Hermjakob, H.; Apweiler, R.; Haab, B. B.; Simpson, R. J.; Eddes, J. S.; Kapp, E. A.; Moritz, R. L.; Chan, D. W.; Rai, A. J.; Admon, A.; Aebersold, R.; Eng, J.; Hancock, W. S.; Hefta, S. A.; Meyer, H.; Paik, Y. K.; Yoo, J. S.; Ping, P.; Pounds, J.; Adkins, J.; Qian, X.; Wang, R.; Wasinger, V.; Wu, C. Y.; Zhao, X.; Zeng, R.; Archakov, A.; Tsugita, A.; Beer, I.; Pandey, A.; Pisano, M.; Andrews, P.; Tammen, H.; Speicher, D. W.; Hanash, S. M. Overview of the HUPO Plasma Proteome Project: results from the pilot phase with 35 collaborating laboratories and multiple analytical groups, generating a core dataset of 3020 proteins and a publicly-available database. Proteomics 2005, 5 (13), 3226-3245.
19. Bland, J. M.; Altman, D. G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1 (8476), 307-310.
20. McNaught, A. D.; Wilkinson, A. Compendium of Chemical Terminology (the "Gold Book")., 2.02 ed.; Blackwell Scientific Publications: Oxford, 1997.
21. Kessner, D.; Chambers, M.; Burke, R.; Agus, D.; Mallick, P. ProteoWizard: open source software for rapid proteomics tools development. Bioinformatics 2008, 24 (21), 2534-2536.
22. Tabb, D. L.; Fernando, C. G.; Chambers, M. C. MyriMatch: highly accurate tandem mass spectral peptide identification by multivariate hypergeometric analysis. J. Proteome Res. 2007, 6 (2), 654-661.
23. Ma, Z. Q.; Dasari, S.; Chambers, M. C.; Litton, M. D.; Sobecki, S. M.; Zimmerman, L. J.; Halvey, P. J.; Schilling, B.; Drake, P. M.; Gibson, B. W.; Tabb, D. L. IDPicker 2.0: improved protein assembly with high discrimination peptide identification filtering. J. Proteome Res. 2009, 8 (8), 3872-3881.
24. Zhang, B.; Chambers, M. C.; Tabb, D. L. Proteomic parsimony through bipartite graph analysis improves accuracy and transparency. J. Proteome Res. 2007, 6 (9), 3549-3557.
25. Craig, R.; Beavis, R. C. A method for reducing the time required to match protein sequences with tandem mass spectra. Rapid Commun. Mass Spectrom. 2003, 17 (20), 2310-2316.
26. Team, R. D. C. R: A Language and Environment for Statistical Computing, 2.9.0 ed.; R Foundation for Statistical Computing: Vienna, Austria, 2009.
27. Rudnick, P. A.; Clauser, K. R.; Kilpatrick, L. E.; Tchekhovskoi, D. V.; Neta, P.; Blounder, N.; Billheimer, D. D.; Blackman, R. K.; Bunk, D. M.; Cardasis, H. L.; Ham, A. J.; Jaffe, J. D.; Kinsinger, C. R.; Mesri, M.; Neubert, T. A.; Schilling, B.; Tabb, D. L.; Tegeler, T. J.; Vega-Montoto, L.; Variyath, A. M.; Wang, M.; Wang, P.; Whiteaker, J. R.; Zimmerman, L. J.; Carr, S. A.; Fisher, S. J.; Gibson, B. W.; Paulovich, A. G.; Regnier, F. E.; Rodriguez, H.; Spiegelman, C.; Tempst, P.; Liebler, D. C.; Stein, S. E. Performance metrics for liquid chromatography-tandem mass spectrometry systems in proteomic analyses and evaluation by the CPTAC Network Mol. Cell. Proteomics, [Published In Press], DOI: 10.1074/mcp.M900223-MCP200. Published online: Oct 16, 2009.
28. Paulovich, A. G.; Billheimer, D. D.; Ham, A. J.; Vega-Montoto, L.; Rudnick, P. A.; Tabb, D. L.; Wang, P.; Blackman, R. K.; Bunk, D. M.; Cardasis, H. L.; Clauser, K. R.; Kinsinger, C. R.; Schilling, B.; Tegeler, T. J.; Variyath, A. M.; Wang, M.; Whiteaker, J. R.; Zimmerman, L. J.; Fenyo, D.; Carr, S. A.; Fisher, S. J.; Gibson, B. W.; Mesri, M.; Neubert, T. A.; Regnier, F. E.; Rodriguez, H.; Spiegelman, C.; Stein, S. E.; Tempst, P.; Liebler, D. C. A yeast reference proteome for benchmarking LC-MS platform performance Mol. Cell. Proteomics 2009, DOI: 10.1074/mcp.M900222-MCP200.
29. Addona, T. A.; Abbatiello, S. E.; Schilling, B.; Skates, S. J.; Mani, D. R.; Bunk, D. M.; Spiegelman, C. H.; Zimmerman, L. J.; Ham, A. J.; Keshishian, H.; Hall, S. C.; Allen, S.; Blackman, R. K.; Borchers, C. H.; Buck, C.; Cardasis, H. L.; Cusack, M. P.; Dodder, N. G.; Gibson, B. W.; Held, J. M.; Hiltke, T.; Jackson, A.; Johansen, E. B.; Kinsinger, C. R.; Li, J.; Mesri, M.; Neubert, T. A.; Niles, R. K.; Pulsipher, T. C.; Ransohoff, D.; Rodriguez, H.; Rudnick, P. A.; Smith, D.; Tabb, D. L.; Tegeler, T. J.; Variyath, A. M.; Vega-Montoto, L. J.; Wahlander, A.; Waldemarson, S.; Wang, M.; Whiteaker, J. R.; Zhao, L.; Anderson, N. L.; Fisher, S. J.; Liebler, D. C.; Paulovich, A. G.; Regnier, F. E.; Tempst, P.; Carr, S. A. Multi-site assessment of the precision and reproducibility of multiple reaction monitoringbased measurements of proteins in plasma. Nat. Biotechnol. 2009, 27 (7), 633-641.
30. Keller, A.; Nesvizhskii, A. I.; Kolker, E.; Aebersold, R. Empirical statistical model to estimate the accuracy of peptide identifications made by MS/MS and database search. Anal. Chem. 2002, 74 (20), 5383-5392.
31. Rifai, N.; Gillette, M. A.; Carr, S. A. Protein biomarker discovery and validation: the long and uncertain path to clinical utility. Nat. Biotechnol. 2006, 24 (8), 971-983.
32. Rudomin, E. L.; Carr, S. A.; Jaffe, J. D. Directed sample interrogation utilizing an accurate mass exclusion-based data-dependent acquisition strategy (AMEx). J. Proteome Res. 2009, 8 (6), 3154-3160.
33. Hoopmann, M. R.; Merrihew, G. E.; von Haller, P. D.; MacCoss, M. J. Post analysis data acquisition for the iterative MS/MS sampling of proteomics mixtures. J. Proteome Res. 2009, 8 (4), 1870-1875.