A practical guide to epidemiological practice and standards in the identification and validation of diagnostic markers using a bladder cancer example

Biochimica et Biophysica Acta - Proteins and Proteomics

Volumn 1844, Issue 1 PART A, 2014, Pages 145-155

  Behrens, T ^a   Bonberg, N ^a   Casjens, S ^a   Pesch, B ^a   Bruning T ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

Bias; Biomarker; Confounder; Epidemiology; Methodology; PRoBE

Indexed keywords

BIOLOGICAL MARKER; CREATININE; DNA; HEPARIN; PROTEIN; RETINOIC ACID RECEPTOR BETA; SURVIVIN; TUMOR MARKER;

AREA UNDER THE CURVE; BLADDER CANCER; CANCER DIAGNOSIS; CANCER EPIDEMIOLOGY; CYSTOSCOPY; DISEASE MARKER; HUMAN; PRIORITY JOURNAL; RECEIVER OPERATING CHARACTERISTIC; REVIEW; SAMPLE SIZE; SENSITIVITY AND SPECIFICITY;

BIAS; BIOMARKER; CONFOUNDER; EPIDEMIOLOGY; METHODOLOGY; PROBE;

HUMANS; TUMOR MARKERS, BIOLOGICAL; URINARY BLADDER NEOPLASMS;

EID: 84890429644     PISSN: 15709639     EISSN: 18781454     Source Type: Journal    
DOI: 10.1016/j.bbapap.2013.07.018     Document Type: Review

References (91)

1. J.A. Indulski, and W. Lutz Molecular epidemiology: cancer risk assessment using biomarkers for detecting early health effects in individuals exposed to occupational and environmental carcinogens Rev. Environ. Health 12 1997 179 190
2. W. Hoffmann, U. Latza, W. Ahrens, K.H. Greiser, A. Kroke, A. Nieters, M.B. Schulze, M. Steiner, C. Terschüren, and M. Wjst Biologische Marker in der Epidemiologie: Begriffe, Anwendungen, Perspektiven (Teil I) [Biological markers in epidemiology: concepts, applications, perspectives (part I)] Gesundheitswesen 64 2002 99 107
3. V. Gallo, M. Egger, V. McCormack, P.B. Farmer, J.P.A. Ioannidis, M. Kirsch-Volders, G. Matullo, D.H. Phillips, B. Schoket, U. Stromberg, R. Vermeulen, C. Wild, M. Porta, and P. Vineis STrengthening the Reporting of OBservational studies in Epidemiology-Molecular Epidemiology (STROBE-ME): an extension of the STROBE statement Eur. J. Epidemiol. 26 2011 797 810
4. J.E. Anderson, L.L. Hansen, F.C. Mooren, M. Post, H. Hug, A. Zuse, and M. Los Methods and biomarkers for the diagnosis and prognosis of cancer and other diseases: towards personalized medicine Drug Resist. Updat. 9 2006 198 210
5. D.E. Brenner, and D.P. Normolle Biomarkers for cancer risk, early detection, and prognosis: the validation conundrum Cancer Epidemiol. Biomarkers Prev. 16 2007 1918 1920
6. P.A. Hall, and J.J. Going Predicting the future: a critical appraisal of cancer prognosis studies Histopathology 35 1999 489 494
7. L.M. McShane, D.G. Altman, W. Sauerbrei, S.E. Taube, M. Gion, and G.M. Clark REporting recommendations for tumor MARKer prognostic studies (REMARK) J. Natl. Cancer Inst. 97 2005 1180 1184
8. M.S. Pepe, Z. Feng, H. Janes, P.M. Bossuyt, and J.D. Potter Pivotal evaluation of the accuracy of a biomarker used for classification or prediction: standards for study design J. Natl. Cancer Inst. 100 2008 1432 1438
9. A.E. Fung, R. Palanki, S.J. Bakri, E. Depperschmidt, and A. Gibson Applying the CONSORT and STROBE statements to evaluate the reporting quality of neovascular age-related macular degeneration studies Ophthalmology 116 2009 286 296
10. M.S. Pepe, R. Etzioni, Z. Feng, J.D. Potter, M.L. Thompson, M. Thornquist, M. Winget, and Y. Yasui Phases of biomarker development for early detection of cancer J. Natl. Cancer Inst. 93 2001 1054 1061
11. S. Larré, J.W.F. Catto, M.S. Cookson, E.M. Messing, S.F. Shariat, M.S. Soloway, R.S. Svatek, Y. Lotan, A.R. Zlotta, and H.B. Grossman Screening for bladder cancer: rationale, limitations, whom to target, and perspectives Eur. Urol. 63 2013 1049 1058
12. S. Huber, C. Schwentner, D. Taeger, B. Pesch, M. Nasterlack, G. Leng, T. Mayer, K. Gawrych, N. Bonberg, M. Pelster, G. Johnen, H. Bontrup, H. Wellhäußer, H.-G. Bierfreund, C. Wiens, C. Bayer, F. Eberle, B. Scheuermann, M. Kluckert, G. Feil, T. Brüning, and A. Stenzl Nuclear matrix protein-22: a prospective evaluation in a population at risk for bladder cancer. Results from the UroScreen study BJU Int. 110 2012 699 708
13. G. Johnen, K. Gawrych, H. Bontrup, B. Pesch, D. Taeger, S. Banek, M. Kluckert, H. Wellhäußer, F. Eberle, M. Nasterlack, G. Leng, A. Stenzl, and T. Brüning Performance of survivin mRNA as a biomarker for bladder cancer in the prospective study UroScreen PLoS One 7 2012 e35363
14. B. Pesch, M. Nasterlack, F. Eberle, N. Bonberg, D. Taeger, G. Leng, G. Feil, G. Johnen, K. Ickstadt, M. Kluckert, H. Wellhäusser, A. Stenzl, and T. Brüning The role of haematuria in bladder cancer screening among men with former occupational exposure to aromatic amines BJU Int. 108 2011 546 552
15. M. Horstmann, H. Bontrup, J. Hennenlotter, D. Taeger, A. Weber, B. Pesch, G. Feil, O. Patschan, G. Johnen, A. Stenzl, and T. Brüning Clinical experience with survivin as a biomarker for urothelial bladder cancer World J. Urol. 28 2010 399 404
16. N. Bonberg, D. Taeger, K. Gawrych, G. Johnen, S. Banek, C. Schwentner, K.D. Sievert, H. Wellhäußer, M. Kluckert, G. Leng, M. Nasterlack, A. Stenzl, T. Behrens, T. Brüning, and B. Pesch Chromosomal instability and bladder cancer - The UroVysion™ test in the UroScreen study. BJU Int. 112 2013 E372 E382 10.1111/j.1464-410X.2012.11666.x
17. E.W. Steyerberg, F.E. Harrell, G.J. Borsboom, M.J. Eijkemans, Y. Vergouwe, and J.D. Habbema Internal validation of predictive models: efficiency of some procedures for logistic regression analysis J. Clin. Epidemiol. 54 2001 774 781
18. D.F. Ransohoff How to improve reliability and efficiency of research about molecular markers: roles of phases, guidelines, and study design J. Clin. Epidemiol. 60 2007 1205 1219
19. J.P.A. Ioannidis Biomarker failures Clin. Chem. 59 2013 202 204
20. R.D. Riley, W. Sauerbrei, and D.G. Altman Prognostic markers in cancer: the evolution of evidence from single studies to meta-analysis, and beyond Br. J. Cancer 100 2009 1219 1229
21. D.F. Ransohoff, and M.L. Gourlay Sources of bias in specimens for research about molecular markers for cancer J. Clin. Oncol. 28 2010 698 704
22. J. Deeks, J. Glanville, and T. Sheldon CRD Guidelines for Those Carrying Out or Commissioning Reviews 1996 York Publishing Services Ltd York
23. Z. Feng, R. Prentice, and S. Srivastava Research issues and strategies for genomic and proteomic biomarker discovery and validation: a statistical perspective Pharmacogenomics 5 2004 709 719
24. G. Mowatt, S. Zhu, M. Kilonzo, C. Boachie, C. Fraser, T.R.L. Griffiths, J. N'Dow, G. Nabi, J. Cook, and L. Vale Systematic review of the clinical effectiveness and cost-effectiveness of photodynamic diagnosis and urine biomarkers (FISH, ImmunoCyt, NMP22) and cytology for the detection and follow-up of bladder cancer Health Technol. Assess. 14 2010 1 331
25. C. Mian, M. Lodde, E. Comploj, G. Negri, E. Egarter-Vigl, L. Lusuardi, S. Palermo, M. Marberger, and A. Pycha Liquid-based cytology as a tool for the performance of uCyt+™ and UroVysion Multicolour-FISH in the detection of urothelial carcinoma Cytopathology 14 2003 338 342
26. H.B. Grossman, E. Messing, M. Soloway, K. Tomera, G. Katz, Y. Berger, and Y. Shen Detection of bladder cancer using a point-of-care proteomic assay J. Am. Med. Assoc. 293 2005 810 816
27. H.B. Grossman, M. Soloway, E. Messing, G. Katz, B. Stein, V. Kassabian, and Y. Shen Surveillance for recurrent bladder cancer using a point-of-care proteomic assay J. Am. Med. Assoc. 295 2006 299 305
28. M.S. Pepe, and H.E. Janes Gauging the performance of SNPs, biomarkers, and clinical factors for predicting risk of breast cancer J. Natl. Cancer Inst. 100 2008 978 979
29. M. Babjuk, W. Oosterlinck, R. Sylvester, E. Kaasinen, A. Böhle, J. Palou-Redorta, and M. Rouprêt EAU guidelines on non-muscle-invasive urothelial carcinoma of the bladder, the 2011 update Eur. Urol. 59 2011 997 1008
30. X.-H. Zhou, D.K. McClish, and N.A. Obuchowski Statistical Methods in Diagnostic Medicine 2002 Wiley Interscience New York
31. W. Krzanowski, and D. Hand ROC Curves for Continuous Data 2009 Chapman & Hall/CRC Press Boca Raton, London, New York
32. K. Kas On the technicalities of discovering and applying protein biomarkers for cancer prevention Eur. J. Cancer Prev. 13 2004 437 446
33. A.J. Schetter, N.H.H. Heegaard, and C.C. Harris Inflammation and cancer: interweaving microRNA, free radical, cytokine and p53 pathways Carcinogenesis 31 2010 37 49
34. L.A. Liotta, and E. Petricoin Cancer biomarkers: closer to delivering on their promise Cancer Cell 20 2011 279 280
35. M. Hassanein, J.C. Callison, C. Callaway-Lane, M.C. Aldrich, E.L. Grogan, and P.P. Massion The state of molecular biomarkers for the early detection of lung cancer Cancer Prev. Res. (Phila.) 5 2012 992 1006
36. J.B. Vaught, E. Caboux, and P. Hainaut International efforts to develop biospecimen best practices Cancer Epidemiol. Biomarkers Prev. 19 2010 912 915
37. J. Vaught, and N.C. Lockhart The evolution of biobanking best practices Clin. Chim. Acta 413 2012 1569 1575
38. D.H. Jackson, and R.E. Banks Banking of clinical samples for proteomic biomarker studies: a consideration of logistical issues with a focus on pre-analytical variation Proteomics Clin. Appl. 4 2010 250 270
39. S.S. Tworoger, and S.E. Hankinson Use of biomarkers in epidemiologic studies: minimizing the influence of measurement error in the study design and analysis Cancer Causes Control 17 2006 889 899
40. C. Sturgeon, R. Hill, G.L. Hortin, and D. Thompson Taking a new biomarker into routine use - a perspective from the routine clinical biochemistry laboratory Proteomics Clin. Appl. 4 2010 892 903
41. N. Rifai, M.A. Gillette, and S.A. Carr Protein biomarker discovery and validation: the long and uncertain path to clinical utility Nat. Biotechnol. 24 2006 971 983
42. H.K. Meier-Ewert, P.M. Ridker, N. Rifai, N. Price, D.F. Dinges, and J.M. Mullington Absence of diurnal variation of C-reactive protein concentrations in healthy human subjects Clin. Chem. 47 2001 426 430
43. N.L. Anderson, M. Polanski, R. Pieper, T. Gatlin, R.S. Tirumalai, T.P. Conrads, T.D. Veenstra, J.N. Adkins, J.G. Pounds, R. Fagan, and A. Lobley The human plasma proteome: a nonredundant list developed by combination of four separate sources Mol. Cell. Proteomics 3 2004 311 326
44. J.B. Vaught Blood collection, shipment, processing, and storage Cancer Epidemiol. Biomarkers Prev. 15 2006 1582 1584
45. Y. Jin, and T. Manabe Differences in protein distribution between human plasma preparations, EDTA-plasma and heparin-plasma, analyzed by non-denaturing micro-2-DE and MALDI-MS PMF Electrophoresis 30 2009 931 938
46. E. Caboux, C. Lallemand, G. Ferro, B. Hémon, M. Mendy, C. Biessy, M. Sims, N. Wareham, A. Britten, A. Boland, A. Hutchinson, A. Siddiq, P. Vineis, E. Riboli, I. Romieu, S. Rinaldi, M.J. Gunter, P.H.M. Peeters, Y.T. van der Schouw, R. Travis, H.B. Bueno-de-Mesquita, F. Canzian, M.-J. Sánchez, G. Skeie, K.S. Olsen, E. Lund, R. Bilbao, N. Sala, A. Barricarte, D. Palli, C. Navarro, S. Panico, M.L. Redondo, S. Polidoro, L. Dossus, M.C. Boutron-Ruault, F. Clavel-Chapelon, A. Trichopoulou, D. Trichopoulos, P. Lagiou, H. Boeing, E. Fisher, R. Tumino, C. Agnoli, and P. Hainaut Sources of pre-analytical variations in yield of DNA extracted from blood samples: analysis of 50,000 DNA samples in EPIC PLoS One 7 2012 e39821
47. E. Biganzoli, P. Boracchi, and E. Marubini Biostatistics and tumor marker studies in breast cancer: design, analysis and interpretation issues Int. J. Biol. Markers 18 2003 40 48
48. Office of Biorepositories and Biospecimen Research NCI Best Practices for Biospecimen Resources 2013 National Cancer Institute Bethesda, MD
49. D.A. Lawlor, and T. Stone Public health and data protection: an inevitable collision or potential for a meeting of minds? Int. J. Epidemiol. 30 2001 1221 1225
50. D. Adam Data protection law threatens to derail UK epidemiology studies Nature 411 2001 509
51. L. Doyal, J.S. Tobias, M. Warnock, L. Power, and H. Goodare Informed consent in medical research BMJ 316 1998 1000 1005
52. N. Becker Follow-up Studien in Deutschland: Erfahrungsbericht unter dem Gesichtspunkt der datenschutzrechtlichen Rahmenbedingungen Follow-up studies in Germany: report on experiences with view to privacy legislation Inform. Biometr. Epidemiol. Med. Biol. 33 2002 36 44
53. S.J. Klug, H. Zeeb, and M. Blettner Neue Möglichkeit der Recherche von Todesursachen in Deutschland über Statistische Landesämter am Beispiel einer retrospektiven Kohortenstudie New research avenues in exploring causes of death in Germany via Regional Statistical Offices as exemplified by a retrospective cohort study Gesundheitswesen 65 2003 243 249
54. Council for International Organizations of Medical Sciences (CIOMS) International Ethical Guidelines for Epidemiological Studies 2009 World Health Organization (WHO) Geneva
55. C.R. Weinberg Less is more, except when less is less: studying joint effects Genomics 93 2009 10 12
56. L. Bubendorf Multiprobe fluorescence in situ hybridization (UroVysion) for the detection of urothelial carcinoma - FISHing for the right catch Acta Cytol. 55 2011 113 119
57. K. Chrouser, B. Leibovich, E. Bergstralh, H. Zincke, and M. Blute Bladder cancer risk following primary and adjuvant external beam radiation for prostate cancer J. Urol. 174 2005 107 110
58. S. Eissa, S.F. Zohny, H.H. Shehata, M.G.A. Hegazy, A.M. Salem, and M. Esmat Urinary retinoic acid receptor-β2 gene promoter methylation and hyaluronidase activity as noninvasive tests for diagnosis of bladder cancer Clin. Biochem. 45 2012 402 407
59. M.W.Y. Chan, L.W. Chan, N.L.S. Tang, J.H.M. Tong, K.W. Lo, T.L. Lee, H.Y. Cheung, W.S. Wong, P.S.F. Chan, F.M.M. Lai, and K.F. To Hypermethylation of multiple genes in tumor tissues and voided urine in urinary bladder cancer patients Clin. Cancer Res. 8 2002 464 470
60. J.W.F. Catto, A.-R. Azzouzi, I. Rehman, K.M. Feeley, S.S. Cross, N. Amira, G. Fromont, M. Sibony, O. Cussenot, M. Meuth, and F.C. Hamdy Promoter hypermethylation is associated with tumor location, stage, and subsequent progression in transitional cell carcinoma J. Clin. Oncol. 23 2005 2903 2910
61. D. Dhawan, F.C. Hamdy, I. Rehman, J. Patterson, S.S. Cross, K.M. Feeley, Y. Stephenson, M. Meuth, and J.W.F. Catto Evidence for the early onset of aberrant promoter methylation in urothelial carcinoma J. Pathol. 209 2006 336 343
62. A.R. Florl, and W.A. Schulz Chromosomal instability in bladder cancer Arch. Toxicol. 82 2008 173 182
63. J.A. Hoppin, P.E. Tolbert, J.A. Taylor, J.C. Schroeder, and E.A. Holly Potential for selection bias with tumor tissue retrieval in molecular epidemiology studies Ann. Epidemiol. 12 2002 1 6
64. S.G. Baker, B.S. Kramer, and S. Srivastava Markers for early detection of cancer: statistical guidelines for nested case-control studies BMC Med. Res. Methodol. 2 2002 4
65. J.T. Leek, R.B. Scharpf, H.C. Bravo, D. Simcha, B. Langmead, W.E. Johnson, D. Geman, K. Baggerly, and R.A. Irizarry Tackling the widespread and critical impact of batch effects in high-throughput data Nat. Rev. Genet. 11 2010 733 739
66. K.N. Harper, B. Peters, and M.V. Gamble Batch effects and pathway analysis: two potential perils in cancer studies involving DNA methylation array analysis Cancer Epidemiol. Biomarkers Prev. 22 2013 1052 1060
67. A.G. Rundle, P. Vineis, and H. Ahsan Design options for molecular epidemiology research within cohort studies Cancer Epidemiol. Biomarkers Prev. 14 2005 1899 1907
68. T.L. Fare, E.M. Coffey, H. Dai, Y.D. He, D.A. Kessler, K.A. Kilian, J.E. Koch, E. LeProust, M.J. Marton, M.R. Meyer, R.B. Stoughton, G.Y. Tokiwa, and Y. Wang Effects of atmospheric ozone on microarray data quality Anal. Chem. 75 2003 4672 4675
69. L. Dyrskjøt, M. Kruhøffer, T. Thykjaer, N. Marcussen, J.L. Jensen, K. Møller, and T.F.Rntoft Gene expression in the urinary bladder: a common carcinoma in situ gene expression signature exists disregarding histopathological classification Cancer Res. 64 2004 4040 4048
70. C. Chen, K. Grennan, J. Badner, D. Zhang, E. Gershon, L. Jin, and C. Liu Removing batch effects in analysis of expression microarray data: an evaluation of six batch adjustment methods PLoS One 6 2011 e17238
71. Z. Sun, H.S. Chai, Y. Wu, W.M. White, K.V. Donkena, C.J. Klein, V.D. Garovic, T.M. Therneau, and J.-P.A. Kocher Batch effect correction for genome-wide methylation data with Illumina Infinium platform BMC Med. Genomics 4 2011 84
72. W.E. Johnson, C. Li, and A. Rabinovic Adjusting batch effects in microarray expression data using empirical Bayes methods Biostatistics 8 2007 118 127
73. M. Benito, J. Parker, Q. Du, J. Wu, D. Xiang, C.M. Perou, and J.S. Marron Adjustment of systematic microarray data biases Bioinformatics 20 2004 105 114
74. J.T. Leek, W.E. Johnson, H.S. Parker, A.E. Jaffe, and J.D. Storey The SVA package for removing batch effects and other unwanted variation in high-throughput experiments Bioinformatics 28 2012 882 883
75. J.S. Koopmeiners, Z. Feng, and M.S. Pepe Conditional estimation after a two-stage diagnostic biomarker study that allows early termination for futility Stat. Med. 31 2012 420 435
76. R. Simon, and D.G. Altman Statistical aspects of prognostic factor studies in oncology Br. J. Cancer 69 1994 979 985
77. S. Landau, and D. Stahl Sample size and power calculations for medical studies by simulation when closed form expressions are not available Stat. Methods Med. Res. 2012 10.1177/0962280212439578 (online ahead of print)
78. A. Burton, D.G. Altman, P. Royston, and R.L. Holder The design of simulation studies in medical statistics Stat. Med. 25 2006 4279 4292
79. G. Schwarzer, W. Vach, and M. Schumacher On the misuses of artificial neural networks for prognostic and diagnostic classification in oncology Stat. Med. 19 2000 541 561
80. J.P.A. Ioannidis Microarrays and molecular research: noise discovery? Lancet 365 2005 454 455
81. L.I. Budman, W. Kassouf, and J.R. Steinberg Biomarkers for detection and surveillance of bladder cancer Can. Urol. Assoc. J. 2 2008 212 221
82. W.J. Youden Index for rating diagnostic tests Cancer 3 1950 32 35
83. D.G. Altman, B. Lausen, W. Sauerbrei, and M. Schumacher Dangers of using "optimal" cutpoints in the evaluation of prognostic factors J. Natl. Cancer Inst. 86 1994 829 835
84. M. Desai, J. Kubo, D. Esserman, and M.B. Terry The handling of missing data in molecular epidemiology studies Cancer Epidemiol. Biomarkers Prev. 20 2011 1571 1579
85. P. Zhang Multiple imputation: theory and method Int. Stat. Rev. 71 2003 581 592
86. J.H. Lubin, J.S. Colt, D. Camann, S. Davis, J.R. Cerhan, R.K. Severson, L. Bernstein, and P. Hartge Epidemiologic evaluation of measurement data in the presence of detection limits Environ. Health Perspect. 112 2004 1691 1696
87. L.A. Liotta, and E.F. Petricoin Omics and cancer biomarkers: link to the biological truth or bear the consequences Cancer Epidemiol. Biomarkers Prev. 2012 1229 1235
88. L.M. McShane, D.G. Altman, and W. Sauerbrei Identification of clinically useful cancer prognostic factors: what are we missing? J. Natl. Cancer Inst. 97 2005 1023 1025
89. F. Andre, L.M. McShane, S. Michiels, D.F. Ransohoff, D.G. Altman, J.S. Reis-Filho, D.F. Hayes, and L. Pusztai Biomarker studies: a call for a comprehensive biomarker study registry Nat. Rev. Clin. Oncol. 8 2011 171 176
90. Y. Lotan, U. Capitanio, S.F. Shariat, G.C. Hutterer, and P.I. Karakiewicz Impact of clinical factors, including a point-of-care nuclear matrix protein-22 assay and cytology, on bladder cancer detection BJU Int. 103 2009 1368 1374
91. I. Meiers, H. Singh, D. Hossain, K. Lang, L. Liu, J. Qian, A.P. Verhest, and D.G. Bostwick Improved filter method for urine sediment detection of urothelial carcinoma by fluorescence in situ hybridization Arch. Pathol. Lab. Med. 131 2007 1574 1577