Lessons learned from methodological validation research in e-epidemiology

JMIR Public Health and Surveillance

Volumn 2, Issue 2, 2016, Pages

  Kesse Guyot, Emmanuelle ^a   Assmann, Karen ^a   Andreeva, Valentina ^a   Castetbon, Katia ^b,c   Méjean, Caroline ^a   Touvier, Mathilde ^a   Salanave, Benoît ^c   Deschamps, Valérie ^c   Péneau, Sandrine ^a   Fezeu, Léopold ^a   Julia, Chantal ^a,d   Allès, Benjamin ^a   Galan, Pilar ^a   Hercberg, Serge ^a,d  

^a Université Paris 13 ^*  (France)

^b UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^c UNIVERSITÉ PARIS 13   (France)

^d AVICENNE HOSPITAL   (France)

Author keywords

Bias; Cohort studies; Epidemiology

Indexed keywords

EID: 85046023654     PISSN: None     EISSN: 23692960     Source Type: Journal    
DOI: 10.2196/publichealth.5880     Document Type: Review

References (47)

1. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol 2007 Sep;17(9):643-653. [doi: 10.1016/j.annepidem.2007.03.013] [Medline: 17553702]
2. Nohr EA, Frydenberg M, Henriksen TB, Olsen J. Does low participation in cohort studies induce bias? Epidemiology 2006 Jul;17(4):413-418. [doi: 10.1097/01.ede.0000220549.14177.60] [Medline: 16755269]
3. Schatzkin A, Subar AF, Moore S, Park Y, Potischman N, Thompson FE, et al. Observational epidemiologic studies of nutrition and cancer: the next generation (with better observation). Cancer Epidemiol Biomarkers Prev 2009 Apr;18(4):1026-1032 [FREE Full text] [doi: 10.1158/1055-9965.EPI-08-1129] [Medline: 19336550]
4. Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol 2006;21(2):103-111. [doi: 10.1007/s10654-005-6030-4] [Medline: 16518678]
5. Ekman A, Klint A, Dickman PW, Adami HO, Litton JE. Optimizing the design of web-based questionnaires-experience from a population-based study among 50,000 women. Eur J Epidemiol 2007;22(5):293-300. [doi: 10.1007/s10654-006-9091-0] [Medline: 17206467]
6. van Gelder MM, Bretveld RW, Roeleveld N. Web-based questionnaires: the future in epidemiology? Am J Epidemiol 2010 Dec 1;172(11):1292-1298 [FREE Full text] [doi: 10.1093/aje/kwq291] [Medline: 20880962]
7. Ekman A, Litton JE. New times, new needs; e-epidemiology. Eur J Epidemiol 2007;22(5):285-292. [doi: 10.1007/s10654-007-9119-0] [Medline: 17505896]
8. Bigot R, Croutte P. La diffusion des technologies de l'information et de la communication dans la société française. 317. CREDOC. Collection des rapports 2014.
9. Russell CW, Boggs DA, Palmer JR, Rosenberg L. Use of a web-based questionnaire in the Black Women's Health Study. Am J Epidemiol 2010 Dec 1;172(11):1286-1291 [FREE Full text] [doi: 10.1093/aje/kwq310] [Medline: 20937635]
10. Smith B, Smith TC, Gray GC, Ryan MA, Millennium Cohort Study Team. When epidemiology meets the Internet: Web-based surveys in the Millennium Cohort Study. Am J Epidemiol 2007 Dec 1;166(11):1345-1354 [FREE Full text] [doi: 10.1093/aje/kwm212] [Medline: 17728269]
11. West R, Gilsenan A, Coste F, Zhou X, Brouard R, Nonnemaker J, et al. The ATTEMPT cohort: a multi-national longitudinal study of predictors, patterns and consequences of smoking cessation; introduction and evaluation of internet recruitment and data collection methods. Addiction 2006 Sep;101(9):1352-1361. [doi: 10.1111/j.1360-0443.2006.01534.x] [Medline: 16911736]
12. Turner C, Bain C, Schluter PJ, Yorkston E, Bogossian F, McClure R, Nurses and Midwives e-cohort Group. Cohort Profile: The Nurses and Midwives e-Cohort Study-a novel electronic longitudinal study. Int J Epidemiol 2009 Feb;38(1):53-60 [FREE Full text] [doi: 10.1093/ije/dym294] [Medline: 18202083]
13. Richiardi L, Baussano I, Vizzini L, Douwes J, Pearce N, Merletti F. Feasibility of recruiting a birth cohort through the Internet: the experience of the NINFEA cohort. Eur J Epidemiol 2007;22(12):831-837. [doi: 10.1007/s10654-007-9194-2] [Medline: 17955333]
14. Mikkelsen EM, Hatch EE, Wise LA, Rothman KJ, Riis A, Sørensen HT. Cohort profile: the Danish Web-based Pregnancy Planning Study-'Snart-Gravid'. Int J Epidemiol 2009 Aug;38(4):938-943 [FREE Full text] [doi: 10.1093/ije/dyn191] [Medline: 18782897]
15. Pizzi C, De Stavola BL, Pearce N, Lazzarato F, Ghiotti P, Merletti F, et al. Selection bias and patterns of confounding in cohort studies: the case of the NINFEA web-based birth cohort. J Epidemiol Community Health 2012 Nov;66(11):976-981. [doi: 10.1136/jech-2011-200065] [Medline: 22147750]
16. Nilsen RM, Suren P, Gunnes N, Alsaker ER, Bresnahan M, Hirtz D, et al. Analysis of self-selection bias in a population-based cohort study of autism spectrum disorders. Paediatr Perinat Epidemiol 2013;27(6):553-563. [Medline: 23919580]
17. Pugh CA, Summers KM, Bronsvoort BM, Handel IG, Clements DN. Validity of Internet-based longitudinal study data: the elephant in the virtual room. J Med Internet Res 2015;17(4):e96 [FREE Full text] [doi: 10.2196/jmir.3530] [Medline: 25887101]
18. Hercberg S, Castetbon K, Czernichow S, Malon A, Mejean C, Kesse E, et al. The Nutrinet-Santé Study: a web-based prospective study on the relationship between nutrition and health and determinants of dietary patterns and nutritional status. BMC Public Health 2010;10:242 [FREE Full text] [doi: 10.1186/1471-2458-10-242] [Medline: 20459807]
19. Etude-nutrinet-sante. Welcome to Study the Nutrient Health [in French] URL:http://www.etude-nutrinet-sante.fr/ [accessed 2016-10-12] [WebCite Cache ID 6lCRhHEm5]
20. Le MN, Deheeger M, Preziosi P, Montero P, Valeix P, Rolland-Cachera M, et al. Validation du manuel photos utilisé pour l'enquête alimentaire de l'étude. SU.VI.MAX. Cahier de Nutrition et de Diététique 1996;31(1):158-164.
21. NutriNet-Santé C. Table de composition des aliments - Etude NutriNet-Santé. In: Economica. Paris: Inserm; 2013.
22. Kesse-Guyot E, Castetbon K, Touvier M, Hercberg S, Galan P. Relative validity and reproducibility of a food frequency questionnaire designed for French adults. Ann Nutr Metab 2010;57(3):153-162. [Medline: 21079389]
23. Lassale C, Castetbon K, Laporte F, Camilleri GM, Deschamps V, Vernay M, et al. Validation of a Web-based, self-administered, non-consecutive-day dietary record tool against urinary biomarkers. Br J Nutr 2015;113(6):953-962. [Medline: 25772032]
24. Lassale C, Castetbon K, Laporte F, Deschamps V, Vernay M, Camilleri GM, et al. Correlations between Fruit, Vegetables, Fish, Vitamins, and Fatty Acids Estimated by Web-Based Nonconsecutive Dietary Records and Respective Biomarkers of Nutritional Status. J Acad Nutr Diet 2016 Mar;116(3):427-438. [doi: 10.1016/j.jand.2015.09.017] [Medline: 26522988]
25. Touvier M, Kesse-Guyot E, Méjean C, Pollet C, Malon A, Castetbon K, et al. Comparison between an interactive web-based self-administered 24 h dietary record and an interview by a dietitian for large-scale epidemiological studies. Br J Nutr 2011 Apr;105(7):1055-1064. [doi: 10.1017/S0007114510004617] [Medline: 21080983]
26. Lassale C, Péneau S, Touvier M, Julia C, Galan P, Hercberg S, et al. Validity of web-based self-reported weight and height: results of the Nutrinet-Santé study. J Med Internet Res 2013;15(8):e152 [FREE Full text] [doi: 10.2196/jmir.2575] [Medline: 23928492]
27. Touvier M, Mejean C, Kesse-Guyot E, Pollet C, Malon A, Castetbon K, et al. Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol; 2010;25(5):287-296.
28. Andreeva V, Salanave B, Castetbon K, Deschamps V, Vernay M, Kesse-Guyot E, et al. Comparison of the sociodemographic characteristics of the large NutriNet-Santé e-cohort with French Census data: the issue of volunteer bias revisited. J Epidemiol Community Health 2015 Sep;69(9):893-898. [doi: 10.1136/jech-2014-205263] [Medline: 25832451]
29. Insee. La macro SAS CALMAR [In French] URL:http://www.insee.fr/fr/methodes/default.asp?page=outils/calmar/ accueil_calmar.htm [accessed 2016-07-26] [WebCite Cache ID 6jI9N91mT]
30. Castetbon K, Vernay M, Malon A, Salanave B, Deschamps V, Roudier C, et al. Dietary intake, physical activity and nutritional status in adults: the French nutrition and health survey (ENNS, 2006-2007). Br J Nutr 2009 Sep;102(5):733-743. [doi: 10.1017/S0007114509274745] [Medline: 19250574]
31. Andreeva V, Deschamps V, Salanave B, Castetbon K, Verdot C, Kesse-Guyot E, et al. Dietary intake comparison between a large online cohort (Etude NutriNet-Santé) and a nationally-representative cross-sectional study in France (ENNS): addressing the issue of generalizability in e-epidemiology. Am J Epidemiol 2016 (forthcoming)(forthcoming).
32. Kesse-Guyot E, Andreeva V, Castetbon K, Vernay M, Touvier M, Mejean C, et al. Participant profiles according to recruitment source in a large Web-based prospective studyxperience from the Nutrinet-Sante study. J Med Internet Res 2013;15(9):e205. [Medline: 24036068]
33. Méjean C, Szabo de Edelenyi F, Touvier M, Kesse-Guyot E, Julia C, Andreeva VA, et al. Motives for participating in a web-based nutrition cohort according to sociodemographic, lifestyle, and health characteristics: the NutriNet-Santé cohort study. J Med Internet Res 2014;16(8):e189 [FREE Full text] [doi: 10.2196/jmir.3161] [Medline: 25135800]
34. Pouchieu C, Mejean C, Andreeva VA, Kesse-Guyot E, Fassier P, Galan P, et al. How computer literacy and socioeconomic status affect attitudes toward a Web-based cohort: results from the NutriNet-Sante study. J Med Internet Res 2015;17(2):e34. [Medline: 25648178]
35. Andreeva VA, Galan P, Julia C, Castetbon K, Kesse-Guyot E, Hercberg S. Assessment of response consistency and respective participant profiles in the Internet-based NutriNet-Sante Cohort. Am J Epidemiol 2014;179(7):910-916. [Medline: 24521560]
36. Vergnaud AC, Touvier M, Mejean C, Kesse-Guyot E, Pollet C, Malon A, et al. Agreement between web-based and paper versions of a socio-demographic questionnaire in the NutriNet-Sante study. Int J Public Health 2011;56(4):407-417. [Medline: 21538094]
37. Touvier M, Kesse-Guyot E, Mejean C, Pollet C, Malon A, Castetbon K, et al. Comparison between an interactive web-based self-administered 24 h dietary record and an interview by a dietitian for large-scale epidemiological studies. Br J Nutr 2011;105(7):1055-1064. [Medline: 21080983]
38. Freedman LS, Commins JM, Moler JE, Willett W, Tinker LF, Subar AF, et al. Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for potassium and sodium intake. Am J Epidemiol 2015;181(7):473-487. [Medline: 25787264]
39. Freedman LS, Commins JM, Moler JE, Arab L, Baer DJ, Kipnis V, et al. Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for energy and protein intake. Am J Epidemiol 2014;180(2):172-188. [Medline: 24918187]
40. Crispim SP, Geelen A, Souverein OW, Hulshof PJ, Ruprich J, Dofkova M, EFCOVAL Consortium. Biomarker-based evaluation of two 24-h recalls for comparing usual fish, fruit and vegetable intakes across European centers in the EFCOVAL Study. Eur J Clin Nutr 2011 Jul;65 Suppl 1:S38-S47. [doi: 10.1038/ejcn.2011.86] [Medline: 21731004]
41. Øverby NC, Serra-Majem L, Andersen LF. Dietary assessment methods on n-3 fatty acid intake: a systematic review. Br J Nutr 2009 Dec;102 Suppl 1:S56-S63. [doi: 10.1017/S000711450999314X] [Medline: 20100368]
42. Dunn KM, Jordan K, Lacey RJ, Shapley M, Jinks C. Patterns of consent in epidemiologic research: evidence from over 25,000 responders. Am J Epidemiol 2004;159(11):1087-1094. [Medline: 15155293]
43. Eagan TM, Eide G, Gulsvik A, Bakke P. Nonresponse in a community cohort study: predictors and consequences for exposure-disease associations. J Clin Epidemiol 2002 Aug;55(8):775-781. [Medline: 12384191]
44. Seybert H. Internet use in households and by individuals in 2012. Bruxelles european Union Eurostat 2012.
45. Huybrechts K, Mikkelsen E, Christensen T, Riis A, Hatch E, Wise L, et al. A successful implementation of e-epidemiology: the Danish pregnancy planning study 'Snart-Gravid'. Eur J Epidemiol 2010 May;25(5):297-304 [FREE Full text] [doi: 10.1007/s10654-010-9431-y] [Medline: 20148289]
46. Sautron V, Péneau S, Camilleri GM, Muller L, Ruffieux B, Hercberg S, et al. Validity of a questionnaire measuring motives for choosing foods including sustainable concerns. Appetite 2015 Apr;87:90-97. [doi: 10.1016/j.appet.2014.12.205] [Medline: 25529817]
47. Camilleri GM, Méjean C, Bellisle F, Andreeva VA, Sautron V, Hercberg S, et al. Cross-cultural validity of the Intuitive Eating Scale-2. Psychometric evaluation in a sample of the general French population. Appetite 2015 Jan;84:34-42. [doi: 10.1016/j.appet.2014.09.009] [Medline: 25239401]