Perspective: Fundamental limitations of the randomized controlled trial method in nutritional research: The example of probiotics

Advances in Nutrition

Volumn 9, Issue 5, 2018, Pages 561-571

  Zeilstra, Dennis ^a   Younes, Jessica A ^b   Brummer, Robert J ^c   Kleerebezem, Michiel ^d  

^a Nutriz   (Netherlands)

^b WINCLOVE PROBIOTICS   (Netherlands)

^c Örebro University   (Sweden)

^d WAGENINGEN UNIVERSITY   (Netherlands)

Author keywords

Nutrition; Probiotics; RCT limitations; Study design

Indexed keywords

PROBIOTIC AGENT;

HUMAN; KNOWLEDGE; METHODOLOGY; NUTRITIONAL SCIENCE; PROCEDURES; RANDOMIZED CONTROLLED TRIAL (TOPIC);

HUMANS; KNOWLEDGE; NUTRITIONAL SCIENCES; PROBIOTICS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 85057653417     PISSN: 21618313     EISSN: 21565376     Source Type: Journal    
DOI: 10.1093/ADVANCES/NMY046     Document Type: Article

References (62)

1. Young SS, Karr A. Deming, data and observational studies. Significance [Internet] 2011;8:116-20.
2. Ioannidis JPA. Implausible results in human nutrition research. BMJ [Internet] 2013;347:f6698.
3. Maki KC, Slavin JL, Rains TM, Kris-Etherton PM. Limitations of observational evidence: implications for evidence-based dietary recommendations. Adv Nutr [Internet] 2014;5:7-15.
4. Blumberg J, Heaney RP, Huncharek M, Scholl T, Stampfer M, Vieth R, Weaver CM, Zeisel SH. Evidence-based criteria in the nutritional context. Nutr Rev [Internet] 2010;68:478-84.
5. Pan A, Lin X, Hemler E, Hu FB. Diet and cardiovascular disease: advances and challenges in population-based studies. Cell Metab [Internet] 2018;27:489-96.
6. Burns PB, Rohrich RJ, Chung KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg [Internet] 2011;128:305-10.
7. Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, Guyatt GH, Harbour RT, Haugh MC, Henry D et al. Grading quality of evidence and strength of recommendations. BMJ [Internet] 2004;328:1490.
8. Schwingshackl L, Knüppel S, Schwedhelm C, Hoffmann G,Missbach B, Stelmach-Mardas M, Dietrich S, Eichelmann F, Kontopanteils E, Iqbal K et al. Perspective: NutriGrade: a scoring system to assess and judge the meta-evidence of randomized controlled trials and cohort studies in nutrition research. Adv Nutr [Internet] 2016;7:994-1004.
9. Hardy A, Benford D, Halldorsson T, Jeger Michael J, Knutsen Helle K, More S, Naegeli H, Noteborn H, Ockleford C, Ricci A et al. Guidance on the use of the weight of evidence approach in scientific assessments. EFSA J [Internet] 2017;15:e04971.
10. San Mauro-Martin I, Ruiz-León AM, Camina-Martín MA, Garicano- Vilar E, Collado-Yurrita L,Mateo-Silleras B de, Redondo Del RíoMDP. Chromium supplementation in patients with type 2 diabetes and high risk of type 2 diabetes: a meta-analysis of randomized controlled trials. Nutr Hosp 2016;33:27.
11. Singer GM, Geohas J. The effect of chromium picolinate and biotin supplementation on glycemic control in poorly controlled patients with type 2 diabetes mellitus: a placebo-controlled, doubleblinded, randomized trial. Diabetes Technol Ther [Internet] 2006;8: 636-43.
12. Albarracin CA, Fuqua BC, Evans JL, Goldfine ID. Chromium picolinate and biotin combination improves glucose metabolism in treated, uncontrolled overweight to obese patients with type 2 diabetes. Diabetes Metab Res Rev [Internet] 2008;24:41-51.
13. Heaney RP. Nutrients, endpoints, and the problem of proof. J Nutr [Internet] 2008;138:1591-5.
14. Satija A, Yu E, Willett WC, Hu FB. Understanding nutritional epidemiology and its role in policy. Adv Nutr [Internet] 2015;6:5-18.
15. Hébert JR, Frongillo EA, Adams SA, Turner-McGrievy GM, Hurley TG, Miller DR, Ockene IS. Perspective: randomized controlled trials are not a panacea for diet-related research. Adv Nutr [Internet] 2016;7: 423-32.
16. Your microbes, your health. Science [Internet] 2013;342:1440-1.
17. FORTUNE Editors. 29 predictions for 2015: Fortune's crystal ball [Internet]. Fortune [cited 2017 Jan 10]. Available from: http:// fortune.com/2014/12/04/predictions-2015-future-business/.
18. Podolsky SH. Metchnikoff and the microbiome. The Lancet [Internet] 2012;380:1810-11.
19. David LA,Maurice CF, Carmody RN,GootenbergDB, Button JE,Wolfe BE, Ling AV, Devlin AS, Varma Y, Fischbach MA et al. Diet rapidly and reproducibly alters the human gut microbiome. Nature [Internet] 2013;505(7484):559-63.
20. Hill C, Guarner F, Reid G, Gibson GR, Merenstein DJ, Pot B, Morelli L, Canani RB, Flint HJ, Salminen S et al. Expert consensus document: the International Scientific Association for Probiotics and Prebiotics consensus statement on the scope and appropriate use of the term probiotic. Nat Rev Gastroenterol Hepatol [Internet] 2014;11: 506-14.
21. Kalliomäki M, Salminen S, Arvilommi H, Kero P, Koskinen P, Isolauri E. Probiotics in primary prevention of atopic disease: a randomised placebo-controlled trial. The Lancet [Internet] 2001;357:1076-9.
22. Kalliomäki M, Salminen S, Poussa T, Arvilommi H, Isolauri E. Probiotics and prevention of atopic disease: 4-year follow-up of a randomised placebo-controlled trial. The Lancet [Internet] 2003;361:1869-71.
23. Kopp MV, Hennemuth I, Heinzmann A, Urbanek R. Randomized, double-blind, placebo-controlled trial of probiotics for primary prevention: no clinical effects of Lactobacillus GG supplementation. Pediatrics [Internet] 2008;121:e850-6.
24. Zeevi D, Korem T, Zmora N, Israeli D, Rothschild D, Weinberger A, Ben-Yacov O, Lador D, Avnit-Sagi T, Lotan-Pompan M et al. Personalized nutrition by prediction of glycemic responses. Cell [Internet] 2015;163:1079-94.
25. Jüni P, AltmanDG, Egger M. Assessing the quality of controlled clinical trials. BMJ [Internet] 2001;323:42-6.
26. Sanson-Fisher RW, Bonevski B, Green LW, D'Este C. Limitations of the randomized controlled trial in evaluating population-based health interventions. Am J Prev Med [Internet] 2007;33:155-61.
27. BlackN.Whywe need observational studies to evaluate the effectiveness of health care. BMJ [Internet] 1996;312:1215-18.
28. Gauch HG. Scientific method in practice. New York: Cambridge University Press; 2003.
29. Rutherford FJ, Ahlgren A. Science for all Americans. New York: Oxford University Press; 1990.
30. Hernán MA, Robins JM. Causal inference [Internet]. Boca Raton, FL: Chapman & Hall/CRC; forthcoming [cited 2018 Apr 25]. Available from: https://www.hsph.harvard.edu/miguel-hernan/causal-inferencebook/.
31. Rothwell PM. External validity of randomised controlled trials: "to whom do the results of this trial apply?" The Lancet [Internet] 2005;365:82-93.
32. Toh S, Hernán MA. Causal inference from longitudinal studies with baseline randomization. Int J Biostat [Internet] 2008;4(1):22.
33. Kane GC, Lipsky JJ. Drug-grapefruit juice interactions.Mayo Clin Proc [Internet] 2000;75:933-42.
34. Dekkers OM, von Elm E, Algra A, Romijn JA, Vandenbroucke JP. How to assess the external validity of therapeutic trials: a conceptual approach. Int J Epidemiol [Internet] 2010;39:89-94.
35. Corraini P, Olsen M, Pedersen L, Dekkers OM, Vandenbroucke JP. Effect modification, interaction and mediation: an overview of theoretical insights for clinical investigators. Clin Epidemiol [Internet] 2017;9:331-8.
36. Kim EM, Kim M-S, Han S-J, Moon BK, Choi EM, Kim EH, Lee J-R. Magnesium as an adjuvant for caudal analgesia in children. Paediatr Anaesth 2014;24:1231-8.
37. Sharma RA, Steward WP, Gescher AJ. Pharmacokinetics and pharmacodynamics of curcumin. In: BB Aggarwal, Y-J Surh, S Shishodia, editors. The molecular targets and therapeutic uses of curcumin in health and disease. Boston, MA: Springer; 2007. p. 453-70.
38. Khoo GM, Clausen MR, Pedersen HL, Larsen E. Bioactivity and chemical composition of blackcurrant (Ribes nigrum) cultivars with and without pesticide treatment. Food Chem 2012;132:1214-20.
39. O'Shea EF, Cotter PD, Stanton C, Ross RP, Hill C. Production of bioactive substances by intestinal bacteria as a basis for explaining probiotic mechanisms: bacteriocins and conjugated linoleic acid. Int J Food Microbiol 2012;152:189-205.
40. Arpaia N, Campbell C, Fan X, Dikiy S, van der Veeken J, deRoos P, Liu H, Cross JR, Pfeffer K, Coffer PJ et al. Metabolites produced by commensal bacteria promote peripheral regulatory T cell generation. Nature [Internet] 2013;504:451-5.
41. Consortium THMP. Structure, function and diversity of the healthy human microbiome. Nature [Internet] 2012;486:207-14.
42. van Baarlen P, Troost F, van der Meer C, Hooiveld G, Boekschoten M, Brummer RJM, Kleerebezem M. Human mucosal in vivo transcriptome responses to three lactobacilli indicate how probiotics may modulate human cellular pathways. Proc Natl Acad Sci USA [Internet] 2011;108:4562-9.
43. Bron PA, van Baarlen P, Kleerebezem M. Emerging molecular insights into the interaction between probiotics and the host intestinal mucosa. Nat Rev Microbiol [Internet] 2012;10:66-78.
44. Shulzhenko N, Morgun A, Hsiao W, Battle M, Yao M, Gavrilova O, Orandle M, Mayer L, Macpherson AJ, McCoy KD et al. Crosstalk between B lymphocytes, microbiota and the intestinal epithelium governs immunity versus metabolism in the gut. Nat Med [Internet] 2011;17:1585-93.
45. Hooper LV, Littman DR, Macpherson AJ. Interactions between the microbiota and the immune system. Science [Internet] 2012;336:1268- 73.
46. Sanders ME, Merenstein DJ, Ouwehand AC, Reid G, Salminen S, Cabana MD, Paraskevakos G, Leyer G. Probiotic use in at-risk populations. J Am Pharm Assoc [Internet] 2016;56:680-6.
47. International Probiotics Association. 2017 best practices guidelines [Internet]. [cited 2017 Mar 5]. Available from: http:// internationalprobiotics.org/resources/guidelines/2017-best-practicesguidelines/.
48. Hanekamp JC, Bast A, Calabrese EJ. Nutrition and health - transforming research traditions. Crit Rev Food Sci Nutr [Internet] 2015;55:1074-80.
49. Reid G, Gaudier E, Guarner F, Huffnagle GB, Macklaim JM, Munoz AM, Martini M, Ringel-Kulka T, Sartor BR, Unal RR et al. Responders and non-responders to probiotic interventions.GutMicrobes [Internet] 2010;1:200-4.
50. Ghiglietti A, Scarale MG, Miceli R, Ieva F, Mariani L, Gavazzi C, Paganoni AM, Edefonti V. Urn models for response-adaptive randomized designs: a simulation study based on a non-adaptive randomized trial. J Biopharm Stat 2018;1-13.
51. Schork NJ. Personalized medicine: time for one-person trials. Nature [Internet] 2015;520:609-11.
52. Kravitz R, Duan N, editors. Design and implementation of nof-1 trials: a user's guide. Rockville, MD: Agency for Healthcare Research and Quality, US Department for Health and Human Services; 2014. Available from: https://effectivehealthcare.ahrq.gov/topics/n-1- trials/research-2014-5/.
53. Tsapas A, Matthews DR. N of 1 trials in diabetes: making individual therapeutic decisions. Diabetologia [Internet] 2008;51:921-5.
54. Lillie EO, Patay B, Diamant J, Issell B, Topol EJ, Schork NJ. The n-of-1 clinical trial: the ultimate strategy for individualizing medicine? Pers Med [Internet] 2011;8:161-73.
55. Murdoch TB,Detsky AS. The inevitable application of big data to health care. JAMA [Internet] 2013;309:1351-2.
56. Marx V. Biology: the big challenges of big data. Nature [Internet] 2013;498:255-60.
57. RaghupathiW, Raghupathi V. Big data analytics in healthcare: promise and potential. Health Inf Sci Syst [Internet] 2014;2:3.
58. Szajewska H, Kolodziej M. Systematic review with meta-analysis: Saccharomyces boulardii in the prevention of antibiotic-associated diarrhoea. Aliment Pharmacol Ther [Internet] 2015;42:793-801.
59. Simon R, Roychowdhury S. Implementing personalized cancer genomics in clinical trials.Nat RevDrugDiscov [Internet] 2013;12:358- 69.
60. Kruse M, Parthan A, Coombs J, Sasane M, Taylor D. Comparison of different adjuvant therapies for 9 resectable cancer types. PostgradMed [Internet] 2013;125:83-91.
61. Gropper SAS. Advanced nutrition and human metabolism. 5th ed. Belmont, CA:Wadsworth/Cengage Learning; 2009.
62. Flood-Obbagy JE, Rolls BJ. The effect of fruit in different forms on energy intake and satiety at a meal. Appetite [Internet] 2009;52: 416-22.