Sample Composition Discrepancies in Different Stages of a Probability-based Online Panel

Field Methods

Volumn 25, Issue 4, 2013, Pages 339-360

  Bosnjak, Michael ^a   Haas, Iris ^b   Galesic, Mirta ^c   Kaczmirek, Lars ^b   Bandilla, Wolfgang ^b   Couper, Mick P ^d  

^a FREE UNIVERSITY OF BOLZANO   (Italy)

^b GESIS LEIBNIZ INSTITUTE FOR THE SOCIAL SCIENCES   (Germany)

^c MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

^d UNIVERSITY OF MICHIGAN   (United States)

Author keywords

attrition; nonresponse; probability based online panels; sample composition

Indexed keywords

EID: 84885941683     PISSN: 1525822X     EISSN: 15523969     Source Type: Journal    
DOI: 10.1177/1525822X12472951     Document Type: Article

References (51)

1. Baker R.,Blumberg S. J.,Brick J. M.,Couper M. P.,Courtright M.,Dennis J. M.,Dillman D. A., et al.Research synthesis: AAPOR report on online panels.Public Opinion Quarterly. 2010;74:711-81.
2. Bandilla W.,Bosnjak M.,Altdorfer P.Survey administration effects? A comparison of web-based and traditional written self-administered surveys using the ISSP environment module.Social Science Computer Review. 2003;21:235-43.
3. Barrick M. R.,Stewart G. L.,Piotrowski M.Personality on job performance: Test of the mediating effects of motivation among sales representatives.Journal of Applied Psychology. 2002;87:43-51.
4. Bethlehem J. G.Survey nonresponse. Groves R. M.Dillman D. A.Eltinge J. L.Little R. J. A., ed. New York: Wiley; 2002:275-88.
5. Bosnjak M.,Galesic M.,Tuten T.Personality determinants of online shopping: Explaining online purchase intentions using a hierarchical approach.Journal of Business Research. 2007;60:597-605.
6. Caprara G. V.,Zimbardo P. G.Personalizing politics: A congruency model of political preference.American Psychologist. 2004;59:581-94.
7. Caspi A.,Roberts B. W.,Shiner R. L.Personality development: Stability and change.Annual Review of Psychology. 2005;56:453-84.
8. Chang L.-C.,Krosnick J. A.National surveys via RDD telephone versus the Internet: Comparing sample representativeness and response quality.Public Opinion Quarterly. 2009;73:641-78.
9. Cohen J.A power primer.Psychological Bulletin. 1992;112:155-59.
10. Couper M. P.Web surveys: A review of issues and approaches.Public Opinion Quarterly. 2000;64:464-94.
11. Couper M. P.Issues of representation in eHealth research (with a focus on web surveys).American Journal of Preventive Medicine. 2007;32:S83-89.
12. Couper M. P.,Bosnjak M.Handbook of survey research. Marsden P. V.Wright J. D., ed. Bingley, UK: Emerald Group Publishing; 2010:527-50.
13. Couper M. P.,Kapteyn A.,Schonlau M.,Winter J.Noncoverage and nonresponse in an Internet survey.Social Science Research. 2007;36:131-48.
14. DeNeve K. M.,Cooper H.The happy personality: A meta-analysis of 137 personality traits and subjective well-being.Psychological Bulletin. 1998;124:197-229.
15. De Raad B.The Big Five personality factors. Toronto, Canada: Hogrefe & Huber Publishers; 2000:.
16. Diener E.,Lucas R. E.Well-being: The foundations of hedonic psychology. Kahneman D.Diener E.Schwarz N., ed. New York: Russell-Sage; 1999:213-29.
17. Dollinger S. J.,Leong F. T. L.Volunteer bias and the five-factor model.The Journal of Psychology. 1993;127:29-36.
18. Donnellan M. B.,Lucas R. E.Age differences in the Big Five across the life span: Evidence from two national samples.Psychology and Aging. 2008;23:558-66.
19. Ferguson C. J.An effect size primer: A guide for clinicians and researchers.Professional Psychology: Research and Practice. 2009;40:532-38.
20. Fricker S.,Galesic M.,Tourangeau R.,Yan T.An experimental comparison of web and telephone surveys.Public Opinion Quarterly. 2005;69:370-92.
21. Gelman A.,Carlin J. B.Survey nonrersponse. Groves R. M.Dillman D. A.Eltinge J. L.Little R. J. A., ed. New York: Wiley; 2002:289-302.
22. Goldberg L. R.An alternative "description of personality": The Big-Five factor structure.Journal of Personality and Social Personality. 1990;59:1216-29.
23. Göritz A.Advanced methods for conducting online behavioral research. Gosling S.Johnson A., ed. Washington, DC: American Psychological Association; 2010:219-33.
24. Hasselblad V.,Hedges L. V.Meta-analysis of screening and diagnostic test.Psychological Bulletin. 1995;117:167-78.
25. Hoogendoorn A. W.,Daalmans J.Nonresponse in the recruitment of an Internet panel based on probability sampling.Survey Research Methods. 2009;3:59-72.
26. HugginsV. J.EyermanJ.2001. Probability based Internet surveys: A synopsis of early methods and survey research results. Paper presented at the Research Conference of the Federal Committee on Statistical Methodology, Arlington, VA, November 14-16, 2001. http://www.fcsm.gov/01papers/Huggins.pdf(accessed October 30, 2012).
27. John O. P.,Srivastava S.Handbook of personality: Theory and research. Pervin L. A.John O. P., ed. New York: Guilford Press; 1999:102-38.
28. Kanuk L.,Berenson C.Mail surveys and response rates: A literature review.Journal of Marketing Research. 1975;12:440-53.
29. Knoef M.,de Vos K.The representativeness of the LISS panel. Tilburg, the Netherlands: CentERdata; 2009:.
30. Lee S.An evaluation of nonresponse and coverage errors in a prerecruited probability web panel survey.Social Science Computer Review. 2006;24:460-75.
31. Lönnqvist J.-E.,Paunonen S.,Verkasalo M.,Leikas S.,Tuulio-Henriksson A.,Lönnqvist J.Personality characteristics of research volunteers.European Journal of Personality. 2007;21:1017-30.
32. McCrae R. R.,Zonderman A. B.,Costa P. T.,Bond M. H.,Paunonen S. V.Evaluating replicability of factors in the revised NEO Personality Inventory: Confirmatory factor analysis versus procrustes rotation.Journal of Personality and Social Personality. 1996;70:552-66.
33. Marcus B.,Schütz A.Who are the people reluctant to participate in research? Personality correlates of four different types of nonresponse as inferred from self- and observer ratings.Journal of Personality. 2005;73:959-84.
34. Mowen J. C.The 3M model of motivation and personality: Theory and empirical applications to consumer behavior. Boston: Kluwer Academic; 2000:.
35. Digital nation: Expanding Internet usage. Washington, DC: U.S. Department of Commerce; 2011:.
36. Ostendorf F.,Angleitner A.Neo-Persönlichkeitsinventar (revidierte Form, NEO-PI-R) nach Costa und McCrae. Göttingen, Germany: Hogrefe; 2004:.
37. Parks L.,Guay R.Personality, values, and motivation.Personality and Individual Differences. 2009;47:675-84.
38. Rammstedt B.The 10-item Big Five inventory-Norms values and investigation of sociodemographic effects based on a German population representative sample.European Journal of Psychological Assessment. 2007;23:193-201.
39. Rammstedt B.,Goldberg L. R.,Borg I.The measurement equivalence of Big-Five factor markers for persons with different levels of education.Journal of Research in Personality. 2010;44:53-61.
40. Rammstedt B.,John O. P.Measuring personality in one minute or less: A 10-item short version of the Big Five inventory in English and German.Journal of Research in Personality. 2007;41:203-12.
41. Roccas S.,Sagiv L.,Schwartz S. H.,Knafo A.The Big Five personality factors and personal values.Personality and Social Psychology Bulletin. 2002;28:789-801.
42. Rogelberg S. G.,Conway J. M.,Sederburg M. E.,Spitzmueller C.,Aziz S.,Knight W. E.Profiling active and passive nonrespondents to an organizational survey.Journal of Applied Psychology. 2003;88:1104-14.
43. Saucier G.Isms and the structure of social attitudes.Journal of Personality and Social Psychology. 2000;74:366-85.
44. Scherpenzeel A. C.,Bethlehem J. G.Das M.,Ester P.,Kaczmirek L.Social and behavioral research and the Internet: Advances in applied methods and research strategies. New York: Routledge; 2011:105-32.
45. Scherpenzeel A. C.,Das M.Social research and the Internet. Das M.Ester P.Kaczmirek L., ed. New York: Taylor and Francis; 2011:77-104.
46. Smith T. W.An experimental comparison of knowledge networks and the GSS.International Journal of Public Opinion Research. 2003;15:167-79.
47. Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. 7th edition. AAPOR.AAPOR; 2011:.
48. Trull T. J.,Durrett C.Categorical and dimensional models of personality disorder.Annual Review of Clinical Psychology. 2005;1:355-80.
49. van Eimeren B.,Frees B.Drei von vier Deutschen im Netz - ein Ende des digitalen Grabens in Sicht? Ergebnisse der ARD/ZDF-Onlinestudie 2011 (Three out of four Germans are online - Is the end of the digital devide in sight? Results of the ARD/ZDF online study 2011).Media Perspektiven. 2011;7/8:334-349.
50. Vis C. M.,Marchand M.Social and behavioral research and the Internet: Advances in applied methods and research strategies. Das M.Ester P.Kaczmirek L., ed. New York: Routledge; 2011:271-90.
51. WasmerM.ScholzE.BlohmM.2010. Konzeption und Durchführung der Allgemeinen Bevölkerungsumfrage für die Sozialwissenschaften ALLBUS 2008 (Conceptualization and implemetation of the German General Social Survey ALLBUS 2008). GESIS Technical Report2010/04. http://www.gesis.org/fileadmin/upload/forschung/publikationen/gesis_reihen/gesis_methodenberichte/2010/TechnicalReport_10-4.pdf(accessed October 30, 2012).