Sample selection, recruitment and participation rates in health examination surveys in Europe - experience from seven national surveys

BMC Medical Research Methodology

Volumn 15, Issue 1, 2015, Pages

  Mindell, Jennifer S ^a   Giampaoli, Simona ^b   Goesswald, Antje ^c   Kamtsiuris, Panagiotis ^c   Mann, Charlotte ^a   Männistö, Satu ^d   Morgan, Karen ^e,f   Shelton, Nicola J ^a   Verschuren, WM Monique ^g   Tolonen, Hanna ^d  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b ISTITUTO SUPERIORE DI SANITÀ   (Italy)

^c ROBERT KOCH INSTITUTE   (Germany)

^d NATIONAL PUBLIC HEALTH INSTITUTE   (Finland)

^e ROYAL COLLEGE OF SURGEONS IN IRELAND   (Ireland)

^f PERDANA UNIVERSITY   (Malaysia)

^g NATIONAL INSTITUTE FOR PUBLIC HEALTH AND THE ENVIRONMENT   (Netherlands)

Author keywords

Eligibility; Europe; Health examination survey; Incentives; Participation rates; Recruitment; Response; Sample size; Sampling frame

Indexed keywords

ADULT; AGE; EUROPE; FEMALE; HEALTH SURVEY; HUMAN; MALE; MIDDLE AGED; NUTRITION; PATIENT COMPLIANCE; PATIENT SELECTION; SAMPLE SIZE; STATISTICS AND NUMERICAL DATA; YOUNG ADULT;

ADULT; AGE FACTORS; EUROPE; FEMALE; HEALTH SURVEYS; HUMANS; MALE; MIDDLE AGED; NUTRITION SURVEYS; PATIENT COMPLIANCE; PATIENT SELECTION; SAMPLE SIZE; YOUNG ADULT;

EID: 84946489356     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/s12874-015-0072-4     Document Type: Article

References (70)

1. Grotvedt L, Kuulasmaa K, Tolonen H, Heldal J, Graff-Iversen S. 7. Sampling and recruitment. In: Tolonen H, Koponen P, Aromaa A, Conti S, Graff-Iversen S, Grotvedt L, Kanieff M, Mindell J, Natunen S, Primatesta P, et al., editors. Review of Health Examination Surveys in Europe. Helsinki: Publications of the National Public Health Institute B18/2008; 2008. Available at https://www.julkari.fi/bitstream/handle/10024/103057/2008b18.pdf?sequence=1 (Accessed 07/09/2015).
2. STEPwise approach to surveillance (STEPS) http://www.who.int/chp/steps/en/ (Accessed 07/09/2015)
3. Borodulin K, Vartiainen E, Peltonen M, et al. Fourty-year trends in cardiovascular risk factors in Finland. Eur J Public Health. 2014.
4. Oyebode O, Mindell J. Use of data from the Health Survey for England in obesity policy making and monitoring. Obesity Reviews. 2013;14(6):463-76.
5. Tolonen H, Koponen P, Mindell JS, Mannisto S, Giampaoli S, Dias CM, et al. Under-estimation of obesity, hypertension and high cholesterol by self-reported data: Comparison of self-reported information and objective measures from health examination surveys. Eur J Public Health. 2014, doi: 10.1093/eurpub/cku074.
6. Tolonen H, Koponen P, Mindell J, Mannisto S, Kuulasmaa K. European Health Examination Survey - towards a sustainable monitoring system. Eur J Public Health. 2014;24(2):338-44.
7. Biemer PP. Measurement errors in surveys. Hoboken, N.J.: Wiley-Interscience; 2004.
8. Blackman S, Goldstein KM. Some aspects of a theory of community mental health. Community Ment Health J. 1968;4(1):85-90.
9. Boshuizen HC, Viet AL, Picavet HS, Botterweck A, van Loon AJ. Non-response in a survey of cardiovascular risk factors in the Dutch population: determinants and resulting biases. Public Health. 2006;120(4):297-308.
10. Drivsholm T, Eplov LF, Davidsen M, Jorgensen T, Ibsen H, Hollnagel H, et al. Representativeness in population-based studies: a detailed description of non-response in a Danish cohort study. Scand J Public Health. 2006;34(6):623-31.
11. Harald K, Salomaa V, Jousilahti P, Koskinen S, Vartiainen E. Non-participation and mortality in different socioeconomic groups: the FINRISK population surveys in 1972-92. J Epidemiol Community Health. 2007;61(5):449-54.
12. Sogaard AJ, Selmer R, Bjertness E, Thelle D. The Oslo Health Study: The impact of self-selection in a large, population-based survey. Int J Equity Health. 2004;3(1):3.
13. Tolonen H, Dobson A, Kulathinal S. Effect on trend estimates of the difference between survey respondents and non-respondents: results from 27 populations in the WHO MONICA Project. Eur J Epidemiol. 2005;20(11):887-98.
14. Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J. Survey non-response in the Netherlands: effects on prevalence estimates and associations. Ann Epidemiol. 2003;13(2):105-10.
15. Hara M, Sasaki S, Sobue T, Yamamoto S, Tsugane S. Comparison of cause-specific mortality between respondents and nonrespondents in a population-based prospective study: ten-year follow-up of JPHC Study Cohort I. Japan Public Health Center. J Clin Epidemiol. 2002;55(2):150-6.
16. Jousilahti P, Salomaa V, Kuulasmaa K, Niemela M, Vartiainen E. Total and cause specific mortality among participants and non-participants of population based health surveys: a comprehensive follow up of 54 372 Finnish men and women. J Epidemiol Community Health. 2005;59(4):310-5.
17. Une H, Miyazaki M, Momose Y. Comparison of mortality between respondents and non-respondents in a mail survey. J Epidemiol. 2000;10(3):136-9.
18. Boniface DRE, Tefft ME. Dietary fats and 16-year coronary heart disease mortality in a cohort of men and women in Great Britain. Eur J Clin Nutr. 2002;56:786-92.
19. Atrostic BK, Bates N, Burt G, Silberstein A. Nonresponse in U.S. government household surveys: consistent measures, recent trends, and new insights. J Off Stat. 2001;17(2):209-26.
20. De Heer W. International reponse trends. Results of an international survey. J Off Stat. 1999;15(2):129-42.
21. de Leeuw E, de Heer W. Trends in Household Survey Nonresponse: A Longitudinal and International Comparison. In: Groves R, Dillman D, Eltinge J, Little RJ, editors. Survey Nonresponse. New York: Wiley; 2002. p. 41-54.
22. Aromaa A, Koponen P, Tafforeau J, Vermneire C, Primatesta P, Marmot M. Health surveys: evaluation and recommendations. Subproject reports of Phase 2 of the project Health surveys in the EU: HIS and HIS/HES Evaluations and Models. Helsinki: National Public Health Institute; 2003.
23. Tolonen H, Helakorpi S, Talala K, Helasoja V, Martelin T, Prattala R. 25-year trends and socio-demographic differences in response rates: Finnish adult health behaviour survey. Eur J Epidemiol. 2006;21(6):409-15.
24. Williams B, Entwistle V, Haddow G, Wells M. Promoting research participation: Why not advertise altruism? Soc Sci Med. 2008;66(7):1451-6.
25. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;3, MR000008.
26. Church AH. Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opin Quartely. 1993;57:62-79.
27. Antonsen S. Motivasjon for deltakelse i helseundersokelser. Norsk Epidemiologi. 2005;15(1):99-109.
28. Holle R, Hochadel M, Reitmeir P, Meisinger C, Wichmann HE. Prolonged recruitment efforts in health surveys: effects on response, costs, and potential bias. Epidemiology. 2006;17(6):639-43.
29. Mindell J, Aresu M, Becares L, Tolonen H. Representativeness of participants in a cross-sectional health survey by time of day and day of week of data collection. Eur J Public Health. 2012;22(3):364-9.
30. Galea S, Tracy M. Participation rates in epidemiologic studies. Ann Epidemiol. 2007;17(9):643-53.
31. Tunstall-Pedoe H, Kuulasmaa K, Tolonen H, Davidson M, Mendis S, for The WHOMP, et al. MONICA Monograph and Multimedia Sourcebook. Geneva: WHO; 2003.
32. Gosswald A, Lange M, Dolle R, Holling H. The first wave of the German Health Interview and Examination Survey for Adults (DEGS1): participant recruitment, fieldwork, and quality management. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2013;56(5-6):611-9.
33. Kamtsiuris P, Lange M, Hoffmann R, Schaffrath Rosario A, Dahm S, Kuhnert R, et al. The first wave of the German Health Interview and Examination Survey for Adults (DEGS1): sample design, response, weighting and representativeness. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2013;56(5-6):620-30.
34. Giampaoli S, Vanuzzo D, Survey edGdRdPOECHE. La salute cardiovascolare degli italiani. G Ital Cardiol. 2014;15(1):55.
35. Nederland de Maat Genomen http://www.rivm.nl/Onderwerpen/Onderwerpen/N/Nederland-de-Maat-Genomen (Accessed 07/09/2015)
36. Blokstra A, Vissink P, Venmans LAMJ, Holleman P, van der Schouw YT, Smit HA, et al. Nederland de Maat Genomen, 2009-2010. Monitorin van risicofactoren in de algemene bevolking. In: RIVM Rapport 260152001/2011. 2011.
37. Craig R, Mindell J, editors. Health Survey for England 2011. Volume 2. Methods and documentation. London: The Health and Social Care Information Centre; 2012.
38. Mindell J, Biddulph JP, Hirani V, Stamatakis E, Craig R, Nunn S, et al. Cohort Profile: The Health Survey for England. Int J Epidemiol. 2012;41(6):1585-93.
39. Gray L, Batty GD, Craig P, Stewart C, Whyte B, Finlayson A, et al. Cohort Profile: The Scottish Health Surveys Cohort: linkage of study participants to routinely collected records for mortality, hospital discharge, cancer and offspring birth characteristics in three nationwide studies. Int J Epidemiol. 2010;39(2):345-50.
40. Rutherford L, Sharp C, Bromley C, editors. The Scottish Health Survey 2011. Volume 3: Technical Report. Edinburgh: The Scottish Government; 2012.
41. Morgan K, McGee H, Watson D, Perry I, Barry M, Shelley E, et al. SLÁN 2007: Survey of Lifestyle, Attitudes & Nutrition in Ireland. Main Report. Dublin: Department of Health and Children; 2008.
42. Jefferson M. The law of the primate city. Geogr Rev. 1939;29:226-32.
43. Ahmad OB, Boschi-Pinto C, Lopez AD, Murray CJL, Lozano R, Inoue M. Age standardization of rates: a new WHO standard. In: Organization WH, editor. GPE Discussion Paper Series: No 31 EIPH/GPE/EBD. 2001. Availalbe at http://www.who.int/healthinfo/paper31.pdf (Accessed 07/09/2015).
44. Wiseman F, Billington M. Comment on a Standard Definition of Response Rates. J Mark Res. 1984;21:336-8.
45. Lynn P, Beerten R, Laiho J, Martin J. Recommended Standard Final Outcome Categories and Standard Definitions of Response Rate for Social Surveys. In: Working Papers of the Institute for Social and Economic Research. Colchester: ISER, University of Essex; 2001.
46. Gray L, Merlo J, Mindell J, Hallqvist J, Tafforeau J, O'Reilly D, et al. International differences in self-reported health measures in 33 major metropolitan areas in Europe. Eur J Public Health. 2012;22(1):40-7.
47. Tolonen H. Towards the high quality of population health surveys. Standardization and quality control. Kuopio, Finland: University of Finland; 2005. Available at http://urn.fi/URN:ISBN:951-740-546-4 (Accessed 07/09/2015).
48. OECD. Society at a Glance 2006. OECD Social Indicators. In.: OECD Publishing. doi: 10.1787/soc-glance-2006-en; 2007.
49. Heldal J, Jentoft S. 2. Target population and sample size. In: Helsinki TH, editors. EHES Manual Part A Planning and preparation of the survey. Volume Directions 2013-001. National Institute for Health and Welfare; 2013. Available at http://urn.fi/URN:ISBN:978-952-245-842-1. (Accessed 07/09/2015)
50. World Health Organization. STEPS Manual. Geneva: World Health Organization; 2014. Available at http://www.who.int/chp/steps/manual/en/index2.html. (Accessed 07/09/2015).
51. Tolonen H, Aistrich A, Borodulin K. Increasing health examination survey participation rates by SMS reminders and flexible examination times. Scand J Public Health. 2014;42(7):712-7.
52. World Telecommunication/ICT Indicators database 2013 (17th Edition) [ http://www.itu.int/en/ITU-D/Statistics/Pages/publications/wtid.aspx ]. (Accessed 07/09/2015).
53. Craig R, Mindell J, Hirani V, editors. Health Survey for England 2008. Volume 2. Methods and documentation. London: The Information Centre for Health and Social Care; 2009.
54. NHANES response rates [ www.cdc.gov/nchs/nhanes/response-rates-cps.htm ]. (Accessed 07/09/2015).
55. Mindell JS, Tipping S, Pickering K, Hope S, Roth MA, Erens B. The effect of survey method on survey participation: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London. BMC Med Res Methodol. 2010;10(1):83.
56. Groves RM, Couper MP. Nonresponse in household interview surveys. New York: Wiley; 1998.
57. Goodman A, Gatward R. Who are we missing? Area deprivation and survey participation. Eur J Epidemiol. 2008;23(6):379-87.
58. Ahlmark N, Algren M, Holmberg T, Norredam M, Nielsen S, Blom A, et al. Survey nonresponse among ethnic minorities in a national health survey - a mixed-method study of participation, barriers, and potentials. Ethn Health. 2015;20(6):611-32.
59. Pelzl I, Pohlabeln H, Relneke A, Ahrens W. Externe Qualitatssicherung der ersten Welte der Studie zur Gesundheit Erwachsener in Deutschland (DEGS1). [External quality assuranceof the first wave of the German Health Interview and Examination Survey for Adults (DEGS1)]. Bundesgesund Heitsbl. 2013;56:637-42.
60. Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Quartely. 2006;70(5):646-75.
61. Davern M, McAlpine D, Beebe TJ, Ziegenfuss J, Rockwood T, Call KT. Are Lower Response Rates Hazardous to Your Health Survey? An Analysis of Three State Telephone Health Surveys. Health Serv Res. 2010;45:1324-44.
62. Korkeila K, Suominen S, Ahvenainen J, Ojanlatva A, Rautava P, Helenius H, et al. Non-response and related factors in a nation-wide health survey. Eur J Epidemiol. 2001;17(11):991-9.
63. Shlomo N, Skinner C, Schouten B. Estimation of an indicator of the representativeness of survey response. J Stat Planning Infer. 2012;142:201-11.
64. Van der Heyden J, Demarest S, Van Herck K, De Bacquer D, Tafforeau J, Van Oyen H. Association between variables used in the field substitution and post-stratification adjustment in the Belgian health interview survey and non-response. Int J Public Health. 2014;59(1):197-206.
65. Forthofer RN. Investigation of nonresponse bias in NHANES II. Am J Epidemiol. 1983;117(4):507-15.
66. Hall J, Brown V, Nicolaas G, Lynn P. Extended field efforts to reduce the risk of non-response bias: Have the effects changed over time? Can weighting achieve the same effects? Bull Méthode Social. 2013;117:5-25.
67. Groves RM, Cialdini RB, Couper MP. Understanding the decision to participate in a survey. Public Opin Q. 1992;56:475-95.
68. Gibson A, Hewson P, Asthana S. Modelling the nature, scale and consequence of health-related non-response bias in Health Survey for England data. In: Health Survey Users Meeting. London: UK Data Service; 2013.
69. Gray L, McCartney G, White IR, et al. Use of record-linkage to handle non-response and improve alcohol consumption estimates in health survey data: a study protocol. BMJ Open. 2013;3:e002647.
70. Vartiainen E, Borodulin K, Sundvall J, Laatikainen T, Peltonen M, Harald K, et al. FINRISKI Tutkimus: Väestön kolesterolitaso on vuosikymmenien laskun jälkeen kääntynyt nousuun. Suomen Lääkärilehti (Finnish Medical Journal). 2012;35:2364-8.