Methodological deficits in diagnostic research using '-Omics' technologies: Evaluation of the QUADOMICS tool and quality of recently published studies

PLoS ONE

Volumn 5, Issue 7, 2010, Pages

  Parker, Lucy A ^a,b   Saez, Noemí Gómez ^a   Lumbreras, Blanca ^a,b   Porta, Miquel ^b,c   Hernández Aguado, Ildefonso ^a,b  

^a MIGUEL HERNÁNDEZ UNIVERSITY   (Spain)

^b CIBER EPIDEMIOLOGÍA Y SALUD PÚBLICA CIBERESP   (Spain)

^c UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGICAL MARKER;

ARTICLE; CLINICAL ASSESSMENT TOOL; CLINICAL RESEARCH; CONSENSUS DEVELOPMENT; CONTROLLED STUDY; DIAGNOSTIC PROCEDURE; INSTRUMENT VALIDATION; INTERNAL CONSISTENCY; PATIENT CARE; PROCESS DEVELOPMENT; PROFESSIONAL STANDARD; PUBLICATION; QUALITY CONTROL; RESEARCH SUBJECT; SAMPLING; SCIENTIFIC LITERATURE; SYSTEMATIC ERROR; TOTAL QUALITY MANAGEMENT; MEDICAL RESEARCH; METHODOLOGY; REPRODUCIBILITY; STANDARD;

BIOMEDICAL RESEARCH; DIAGNOSTIC TECHNIQUES AND PROCEDURES; QUALITY CONTROL; REPRODUCIBILITY OF RESULTS;

EID: 77955387187     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0011419     Document Type: Article

References (47)

1. Ghosh D, Poisson LM (2009) "Omics" data and levels of evidence for biomarker discovery. Genomics 93: 13-16.
2. Thomas DC (2006) High-volume "-omics" technologies and the future of molecular epidemiology. Epidemiol 17: 490-491.
3. Finn WG (2007) Diagnostic pathology and laboratory medicine in the age of "omics": a paper from the 2006 William Beaumont Hospital Symposium on Molecular Pathology. J Mol Diagn 9: 431-436.
4. Negm RS, Verma M, Srivastava S (2002) The promise of biomarkers in cancer screening and detection. Trends Mol Med 8: 288-293.
5. Check E (2004) Proteomics and cancer: running before we can walk? Nature 429: 496-497.
6. Diamandis EP (2007) Oncopeptidomics: A useful approach for cancer diagnostics? Clin Chem 53: 1004-1006.
7. Ioannidis JP (2007) Is molecular profiling ready for use in clinical decision making? Oncologist 12: 301-311.
8. Lumbreras B, Porta M, Marquez S, Pollán M, Parker LA, et al. (2009) Sources of error and its control in studies on the diagnostic accuracy of "-omics" technologies. Proteomics Clin Appl 3: 173-184.
9. Petricoin EF, Ardekani AM, Hitt BA, Levine PJ, Fusaro VA, et al. (2002) Use of proteomic patterns in serum to identify ovarian cancer. Lancet 359: 572-577.
10. Wagner L (2004) A test before its time? FDA stalls distribution process of proteomic test. J Natl Cancer Inst 96: 500-501.
11. Baggerly KA, Morris JS, Coombes KR (2004) Reproducibility of SELDI-TOF protein patterns in serum: comparing datasets from different experiments. Bioinformatics 20: 777-785.
12. Ransohoff DF (2005) Bias as a threat to the validity of cancer molecular-marker research. Nat Rev Cancer 5: 142-149.
13. Porta M, Pumarega J, Ferrer-Armengou O, López T, Alguacil J, et al. (2007) Timing of blood extraction in epidemiologic and proteomic studies: Results and proposals from the PANKRAS II Study. Eur J Epidemiol 22: 577-588.
14. Porta M, Pumarega J, López T, Jariod M, Marco E, et al. (2009) Influence of tumor stage, symptoms and time of blood draw on serum concentrations of organochlorine compounds in exocrine pancreatic cancer. Cancer Causes Control 20: 1893-1906.
15. Baggerly KA, Morris JS, Edmonson SR, Coombes KR (2005) Signal in noise: evaluating reported reproducibility of serum proteomic tests for ovarian cancer. J Natl Cancer Inst 97: 307-309.
16. Simon R, Radmacher MD, Dobbin K, McShane LM (2003) Pitfalls in the use of DNA microarray data for diagnostic and prognostic classification. J Natl Cancer Inst 95: 14-8.
17. Carrol S, Goodstein D (2009) Defining the scientific method. Nat Methods 6: 237.
18. Lumbreras B, Parker LA, Porta M, Pollán M, Ioannidis JPA, et al. (2009) Overinterpretation of clinical applicability in molecular diagnostic research. Clin Chem 55: 786-794.
19. Haynes RB, Sackett DL, Guyatt GH, Tugwell P (2006) Clinical epidemiology. How to do clinical practice research. 3rd. ed. Philadelphia: Lippincott, Williams & Wilkins.
20. Ransohoff DF (2007) How to improve reliability and efficiency of research about molecular markers: roles of phases, guidelines, and study design. J Clin Epidemiol 60: 1205-1219.
21. Whiting P, Rutjes AWS, Reitsma JB, Bossuyt PMM, Kleijnen J (2003) The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 3: 25-37.
22. Lumbreras B, Porta M, Márquez S, Pollán M, Parker LA, et al. (2008) QUADOMICS: An adaptation of the Quality Assessment of Diagnostic Accuracy Assessment (QUADAS) for the evaluation of the methodological quality of studies on the diagnostic accuracy of '-omics' based technology. Clin Biochem 41: 1316-1325.
23. Feinstein AR (1985) Clinical epidemiology: the architecture of clinical research, Philadelphia: WB Saunders.
24. Pepe MS, Etzioni R, Feng Z, Potter JD, Thompson ML, et al. (2001) Phases of biomarker development for early detection of cancer. J Natl Cancer 93: 1054-1061.
25. Sackett DL, Haynes RB (2002) Evidence base of clinical diagnosis: The architecture of diagnostic research. BMJ 324: 539-541.
26. Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, et al. (2004) Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med 140: 189-202.
27. Irwig L, Tosteson AN, Gatsonis C, Lau J, Colditz G, et al. (1994) Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med 120: 667-676.
28. Tatsioni A, Zarin DA, Aronson N, Samson DJ, Flamm CR, et al. (2002) Challenges in systematic reviews of diagnostic technologies. Ann Intern Med 142: 1048-1055.
29. Whiting PF, Weswood ME, Rutjes AW, Reitsma JB, Bossuyt PN, et al. (2006) Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Med Res Methodol 6: 9-16.
30. Lantz CA, Nebenzahl E (1996) Behavior and interpretation of the k statistic: Resolution of the two paradoxes. J Clin Epidemiol 49: 431-434.
31. Armitage P, Berry G, Matthews JNS (2002) Statistical methods in medical research. 4th edition. Oxford: Blackwell.
32. Kleinbaum DG, Kupper LL, Muller KE (1998) Applied regression analysis and other multivariable methods. 3rd edition. Pacific Grove, CA: Duxbury.
33. Porta M, ed (2008) A dictionary of epidemiology. 5th edition. New York: Oxford University Press 69,226.
34. Lijmer JG, Mol BW, Heistekamp S, Bonsel GJ, Prins MH, et al. (1999) Emprirical evidence of design-related bias in studies of diagnostic tests. JAMA 282: 1061-1066.
35. Rutjes AWS, Reitsma JB, DiNisio M, Smidt N, van Rijn JC, et al. Evidence of bias and variation in diagnostic accuracy studies. CMAJ 176: 469-476.
36. Pasinetti GM, Unger LH, Lange DJ, Yemul S, Deng H, et al. (2006) Identification of potential CSF biomarkers in ALS. Neurology 66: 1218-1222.
37. Belluco C, Petricoin EF, Mammano E, Facchiano F, Ross-Rucker S, et al. (2007) Serum proteomic analysis identifies a highly sensitive and specific discriminatory pattern in stage 1 breast cancer. Ann Surg Oncol 14: 2470-2476.
38. Whiting P, Harbord R, Kleijnen J (2005) No role for quality scores in systematic reviews of diagnostic accuracy studies. BMC Med Res Methodol 5: 19.
39. Petri AL, Simonsen AH, Yip TT, Hogdall E, Fung ET, et al. (2009) Three new potential ovarian cancer biomarkers detected in human urine with equalizer bead technology. Acta Obstet Gynecol Scand 88: 18-26.
40. Monzon FA, Lyons-Weiler M, Buturovic LJ, Rigl CT, Henner WD, et al. (2009) Multicenter validation of a 1,550-gene expression profile for identification of tumor tissue of origin. J Clin Oncol 27: 2503-2508.
41. Steyerberg EW, Bleeker SE, Moll HA, Grobbee DE, Moons KGM (2003) Internal and external validation of predictive models: A simulation study of bias and precision in small samples. J Clin Epidemiol 56: 441-447.
42. Taylor JM, Ankerst DP, Andridge RR (2008) Validation of biomarker-based risk prediction models. Clin Cancer Res 14: 5977-5983.
43. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, et al. (2003) Standards for Reporting of Diagnostic Accuracy. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem 49: 7-18.
44. Fontela PS, Pant Pai N, Schiller I, Dendukuri N, Ramsay A, et al. (2009) Quality and reporting of diagnostic accuracy studies in TB, HIV and malaria: evaluation using QUADAS and STARD standards. PLoS One 4: e7753.
45. Smidt N, Rutjes AW, van der Windt DA, Ostelo RW, Bossuyt PM, et al. (2006) The quality of diagnostic accuracy studies since the STARD statement: has it improved? Neurology 67: 740-741.
46. Porta M, Ferrer-Armengou O, Pumarega J, López T, Crous-Bou M, et al. (2008) Exocrine pancreatic cancer clinical factors were related to timing of blood extraction and influenced serum concentrations of lipids. J Clin Epidemiol 61: 695-704.
47. Hoppin JA, Tolbert PE, Taylor JA, Schroeder JC, Holly EA (2002) Potential for selection bias with tumor tissue retrieval in molecular epidemiology studies. Ann Epidemiol 12: 1-6.