Is the sky falling? new technology, changing media, and the future of surveys

Survey Research Methods

Volumn 7, Issue 3, 2013, Pages 145-156

  Couper, Mick P ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Big data; Mobile surveys; Non probability surveys; Organic data; Social media

Indexed keywords

EID: 84890031943     PISSN: None     EISSN: 18643361     Source Type: Journal    
DOI: None     Document Type: Article

References (63)

1. AAPOR. (2010). Report of the AAPOR task force on online panels. Deerfield, IL: American Association for Public Opinion Research.
2. AAPOR. (2013). Report of the AAPOR task force on non-probability sampling. Deerfield, IL: American Association for Public Opinion Research.
3. Anderson, C. (2008). The end of theory: The data deluge makes the scientific method obsolete. Wired Magazine 16:07. Retrieved 05/11/2013, from http://www.wired.com/science/discoveries/magazine/16-07/pb theory
4. Armoogum, J., Roux, S., and Pham, T. (2013). Total nonresponse of a GPS-based travel surveys. (Paper presented at the conference on New Techniques and Technologies for Statistics, Brussels, March)
5. Asendorpf, J., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J., Fiedler, K., Wicherts, J. (2013). Recommendations for increasing replicability in psychology. European Journal of Personality, 27(2), 108-119.
6. Baker, R., Blumberg, S., Brick, J., Couper, M., Courtright, M., Dennis, J., Zahs, D. (2010). Research synthesis: AAPOR report on online panels. Public Opinion Quarterly, 74(4), 711-781.
7. Baker, R., Brick, J., Bates, N., Battaglia, M., Couper, M., Dever, J., Tourangeau, R. (2013). Summary report of the AAPOR task force on non-probability sampling (with discussion and rejoinder). Journal of Survey Statistics and Methodology. doi: 10.1093/jssam/smt008
8. Beniger, J. (1998). Survey and market research confront their futures on the World Wide Web. Public Opinion Quarterly, 62, 442-452.
9. Berinsky, A., Huber, G., and Lenz, G. (2012). Evaluating online labor markets for experimental research: Amazon.com's Mechanical Turk. Political Analysis, 20(3), 351-368.
10. Biler, S., Šenk, P., and Winklerová, L. (2013). Willingness of individuals to participate in a travel behavior survey using GPS devices. (Paper presented at the conference on New Techniques and Technologies for Statistics, Brussels, March)
11. Boyd, D., and Ellison, M. (2008). Social network sites: Definition, history, and scholarship. Journal of Computer-Mediated Communication, 13, 210-230.
12. Butler, D. (2013, February 13). When Google got flu wrong: US outbreak foxes a leading Web-based method for tracking seasonal flu. Nature. Retrieved 05/11/2013, from http://www.nature.com/news/when-google-got-flu-wrong-1.12413
13. Choi, H., and Varian, H. (2012). Predicting the present with Google Trends. Economic Record, 88, 2-9.
14. Cook, S., Conrad, C., Fowlkes, A., and Mohebbi, M. (2011). Assessing Google flu trends performance in the United States during the 2009 influenza virus A (H1N1) pandemic. PLoS ONE, 6(8), e23610. doi: 10.1371/journal.pone.0023610
15. Couper, M. (2000). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64(4), 464-494.
16. Couper, M., and Groves, R. (1992). Interviewer reactions to alternative hardware for computer-assisted personal interviewing. Journal of Official Statistics, 8(2), 201-210.
17. Couper, M., and Wagner, J. (2011). Using paradata and responsive design to manage survey nonresponse. (Invited paper presented at the 58th Congress of the International Statistical Institute, Dublin, Ireland, August)
18. Daas, P., Roos, M., van de Ven, M., and Neroni, J. (2012). Twitter as a potential data source for statistics. (Discussion paper 201221). Den Haag/Heerlen, The Netherlands: Statistics Netherlands.
19. Deming, W. (1944). On errors in surveys. American Sociological Review, 9(4), 359-369.
20. Downes-Le Guin, T., Baker, R., Mechling, J., and Ruyle, E. (2012). Myths and realities of respondent engagement in online surveys. International Journal of Market Research, 54(4), 613-633.
21. Dugas, A., Jalalpour, M., Gel, Y., Levin, S., Torcaso, F., Igusa, T., and Rothman, R. (2013). Influenza forecasting with Google flu trends. PLoS ONE, 8(2), e56176.
22. Findlay, K., and Alberts, K. (2011). Gamification: What it is and what it's not. (Paper presented at the ESOMAR Congress, Amsterdam, September)
23. Frijters, P., Johnston, D., Lordan, G., and Shields, M. (2013). Exploring the relationship between macroeconomic conditions and problem drinking as captured by Google searches in the US. Social Science and Medicine, 84, 61-68.
24. Ghosh, D., and Guha, R. (2013). What are we 'tweeting' about obesity? mapping tweets with topic modeling and geographic information system. Cartography and Geographic Information Science, 40(2), 90-102.
25. Groves, R. (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 646-675.
26. Groves, R. (2011). Three eras of survey research. Public Opinion Quarterly, 75(5), 861-871.
27. Groves, R., and Heeringa, S. (2006). Responsive design for household surveys: Tools for actively controlling survey nonresponse and costs. Journal of the Royal Statistical Society: Series A, 169(3), 439-457.
28. Groves, R., and Peytcheva, E. (2008). The impact of nonresponse rates on nonresponse bias: A meta-analysis. Public Opinion Quarterly, 72(2), 167-189.
29. Hampton, K., Goulet, L., Rainie, L., and Purcell, K. (2011). Social networking sites and our lives: How people's trust, personal relationships, and civic and political involvement are connected to their use of social networking sites and other technologies. Washington, DC: Pew Internet and American Life Project.
30. Hirschhorn, J., Lohmueller, K., Byrne, E., and Hirschhorn, K. (2002). A comprehensive review of genetic association studies. Genetics in Medicine, 4(2), 45-61.
31. Ioannidis, J. (2005). Why most published research findings are false. PLOS Medicine, 2(8), 696-701.
32. Keeter, S., and Christian, L. (2012). A comparison of results from surveys by the Pew Research Center and Google Consumer Surveys. Washington, DC: Pew Research Center for the People and The Press.
33. Kim, A., Hansen, H., and Murphy, J. (2012). Methodological considerations in analyzing Twitter data. (Paper presented at the annual meeting of the American Association for Public Opinion Research, Orlando, FL, May)
34. Kim, A., Murphy, J., Richards, A., Hansen, H., Powell, R., and Haney, C. (in press). Can tweets replace polls? A U.S. health care reform case study. In C. Hill and E. Dean (Eds.), Social media, sociality, and survey research (p. Chapter 3). New York: Wiley.
35. Kreuter, F. (Ed.). (2013). Improving surveys with paradata: Analytic uses of process information. New York: Wiley.
36. Lansdall-Welfare, T., Lampos, V., and Cristianini, N. (2012). Now-casting the mood of the nation. Significance, 9, 26-28.
37. Leinweber, D. (2007). Stupid data miner tricks: Overfitting the SandP 500. The Journal of Investing, 16(1), 15-22.
38. Link, M. (2013). Emerging technologies: New opportunities, old challenges. (Keynote presentation at FedCASIC, Washington, DC, March.)
39. Little, R. (2012). Calibrated Bayes: An alternative inferential paradigm for official statistics (with discussion and rejoinder). Journal of Official Statistics, 28, 309-372.
40. Lusinchi, D. (2012). 'President' Landon and the 1936 Literary Digest poll: Were automobile and telephone owners to blame? Social Science History, 36(1), 23-54.
41. Lyberg, L. (1985). Plans for computer assisted data collection at Statistics Sweden. In International Statistical Institute (Ed.), Proceedings of the 45th session, book iii (p. Topic 18.2). The Hague/Leidschenveen: P. Marin.
42. McDonald, P., Mohebbi, M., and Slatkin, B. (2012). Comparing Google Consumer Surveys to existing probability and non-probability based Internet surveys. (White paper). Mountain View, CA: Google Inc.
43. Murphy, J., Dean, E., Hill, C., and Richards, A. (2011). Social media, new technologies and the future of health survey research. (Paper presented at the Conference on Health Care Research Methods, Peachtree City, GA, April)
44. Olson, K., and Wagner, J. (2013). A field experiment using GPS devices to measure interviewer travel behavior. (Paper presented at the annual conference of the American Association for Public Opinion Research, Boston, May)
45. O'Reilly, J., Hubbard, M., Lessler, J., Biemer, P., and Turner, C. (1994). Audio and video computer assisted self-interviewing: Preliminary tests of new technologies for data collection. Journal of Official Statistics, 10(2), 197-214.
46. Palmer, J., Espenshade, T., Bartumeus, F., and Chung, C. (2013). New approaches to human mobility: Using mobile phones for demographic research. Demography, 50(3), 1105-1128.
47. Paul, M., and Dredze, M. (2011). You are what you tweet: Analyzing Twitter for public health. In Fifth international aaai conference on weblogs and social media barcelona, july 17-21. (p. 265-272). Palo Alto, CA: AAAI Publications.
48. Prewitt, K. (2013). The 2012 Morris Hansen lecture: Thank you Morris, et al., for Westat, et al. Journal of Official Statistics, 29(2), 223-231.
49. Puleston, J. (2011). Improving online surveys. International Journal of Market Research, 53(4), 557-560.
50. Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638-641.
51. Sagan, C. (1995). The demon-haunted world. New York: Ballantine Books.
52. Savage, M., and Burrows, R. (2007). The coming crisis of empirical sociology. Sociology, 41(5), 885-899.
53. Schouten, B., Calinescu, M., and Luiten, A. (2011). Optimizing quality of response through adaptive survey designs. (Discussion paper 201118). The Hague/Heerlen: Statistics Netherlands.
54. Silver, N. (2012). The signal and the noise: Why most predictions fail - but some don't. New York: Penguin.
55. Singer, N. (2013, June 20). Ways to make your online tracks harder to follow. New York Times, Special Supplement on Big Data, F4.
56. Squire, P. (1988). Why the 1936 Literary Digest poll failed. Public Opinion Quarterly, 52(1), 125-133.
57. Tourangeau, R. (2010). Incentives, falling response rates, and the respondent-researcher relationship. In L. Aday and M. Cynamon (Eds.), Proceedings of the ninth conference on health survey research methods (p. 244-253). Hyattsville, MD: National Center for Health Statistics.
58. Tourangeau, R., Conrad, F., and Couper, M. (2013). The science of Web surveys. New York: Oxford University Press.
59. Tress, F., Winkler, T., and Schmidt, S. (2012). Surveytainment 2.0: Why investing 10 more minutes in constructing your questionnaire is worth considering. (Paper presented at the General Online Research conference, Mannheim, March)
60. Vonk, T., Willems, P., and van Ossenbruggen, R. (2006). Uitkomsten Nederlands Onlinepanel Vergelijkingsonderzoek (NOPVO). Amsterdam: Markt Onderzoek Associatie. Retrieved 05/11/2013, from http://www.moaweb.nl/nopvo
61. Wagner, J. (2012). A comparison of alternative indicators for the risk of nonresponse bias. Public Opinion Quarterly, 76(3), 555-575.
62. Wilson, R., Gosling, S., and Graham, L. (2012). A review of Face-book research in the social sciences. Perspectives on Psychological Science, 7(3), 203-220.
63. Yong, E. (2012). Bad copy. Nature, 485(7398), 298-300.