Big data in survey research: Aapor task force report

Public Opinion Quarterly

Volumn 79, Issue 4, 2015, Pages 839-880

  Japec, Lilli ^a   Kreuter, Frauke ^b,c,d   Berg, Marcus ^e   Biemer, Paul ^f,g   Decker, Paul ^h   Lampe, Cliff ⁱ   Lane, Julia ^j,k,l,m   O'Neil, Cathy ⁿ   Usher, Abe ^o  

^a STATISTICS SWEDEN   (Sweden)

^b UNIVERSITY OF MARYLAND   (United States)

^c UNIVERSITY OF MANNHEIM   (Germany)

^d INSTITUTE FOR EMPLOYMENT RESEARCH IAB   (Germany)

^e STOCKHOLM UNIVERSITY   (Sweden)

^f RTI INTERNATIONAL   (United States)

^g UNIVERSITY OF NORTH CAROLINA   (United States)

^h MATHEMATICA POLICY RESEARCH   (United States)

ⁱ UNIVERSITY OF MICHIGAN   (United States)

^j NEW YORK UNIVERSITY   (United States)

^k UNIVERSITY OF MELBOURNE   (Australia)

^l UNIVERSITÉ DE STRASBOURG   (France)

^m AMERICAN INSTITUTES FOR RESEARCH   (United States)

ⁿ HumanGeo Group ^*  (United States)

^o HumanGeo Group   (United States)

more..

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84958948947     PISSN: 0033362X     EISSN: 15375331     Source Type: Journal    
DOI: 10.1093/poq/nfv039     Document Type: Review

References (80)

1. Acquisti, Alessandro. 2014. "The Economics and Behavioral Economics of Privacy." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender and Helen Nissenbaum, 98-112. New York: Cambridge University Press.
2. Antenucci, Dolan, Michael Cafarella, Margaret Levenstein, Christopher Re, and Matthew D. Shapiro. 2014. "Using Social Media to Measure Labor Market Flows." National Bureau of Economic Research, Working Paper 20010. doi:10.3386/w20010.
3. Barocas, Solon, and Helen Nissenbaum. 2014. "Big Data's End Run around Anonymity and Consent." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum, 44-75. New York: Cambridge University Press.
4. Biemer, Paul P. 2010. "Total Survey Error: Design, Implementation, and Evaluation." Public Opinion Quarterly 74:817-48.
5. Biemer, Paul P. 2014. "Toward a Total Error Framework for Big Data." Paper presented at the Annual Meeting for the American Association for Public Opinion Research, Anaheim, CA, USA.
6. Biemer, Paul P., and Dennis Trewin. 1997. "A Review of Measurement Error Effects on the Analysis of Survey Data." In Survey Measurement and Process Quality, edited by Lars Lyberg, Paul P. Biemer, Martin Collins, Edith de Leeuw, Cathryn Dippo, Norbert Schwarz, and Dennis Trewin, 603-32. New York: Wiley & Sons.
7. Bostic, William G. 2013. "Big Data Projects at the Census Bureau." Paper presented at the Council of Professional Associations on Federal Statistics, Washington, DC, USA.
8. Brynjolfsson, Erik, Lorin M. Hitt, and Heekyung Hellen Kim. 2011. "Strength in Numbers: How Does Data-Driven Decision-Making Affect Firm Performance?" Proceedings from the International Conference on Information Systems. http://ssrn.com/abstract=1819486.
9. Butler, Declan. 2013. "When Google Got Flu Wrong." Nature News, February 13.
10. Cecil, Joe, and Donna Eden. 2003. "The Legal Foundations of Confidentiality." Cited by Julia Lane, Key Issues in Confidentiality Research: Results of an NSF Workshop. National Science Foundation. http://1.usa.gov/1Eq58Df.
11. Cody, Scott, and Andrew Asher. 2014. "Smarter, Better, Faster: The Potential for Predictive Analytics and Rapid-Cycle Evaluation to Improve Program Development and Outcomes." Mathematica Policy Research. Available at http://brook.gs/1AMaW5t.
12. Couper, Mick P. 2013. "Is the Sky Falling? New Technology, Changing Media, and the Future of Surveys." Survey Research Methods 7:145-56.
13. Cukier, Kenneth, and Viktor Mayer-Schoenberger. 2013. "Rise of Big Data: How It's Changing the Way We Think about the World." Foreign Affairs, May-June. Available at http://fam.ag/1bKTv6t.
14. Daas, Piet J. H., and Marco J. H. Puts. 2014. "Social Media Sentiment and Consumer Confidence." European Central Bank Statistics Paper Series, No. 5.
15. Daas, Piet J. H., Marco J. H. Puts, Bart Buelens, and Paul A. M. van den Hurk. 2013. "Big Data and Official Statistics." Paper presented at the New Techniques and Technologies for Statistics Conference, Brussels, Belgium.
16. Day, Hannah R., and Jennifer D. Parker. 2013. "Self-Report of Diabetes and Claims-Based Identification of Diabetes among Medicare Beneficiaries." National Health Statistics Reports, No. 69.
17. Donohue, John J., and Justin Wolfers. 2006. "Uses and Abuses of Empirical Evidence in the Death Penalty Debate." Stanford Law Review 58:791-846.
18. Duncan, George T., Mark Elliot, and Juan Jose Salazar-Gonzalez. 2011. Statistical Confidentiality, Principles and Practice. New York: Springer.
19. Duong, Thao, and Steven Millman. 2014. "Behavioral Data as a Complement to Mobile Survey Data in Measuring Effectiveness of Mobile Ad Campaign." Paper presented at the Council of American Survey Research Organizations Digital Research Conference, San Antonio, TX, USA. http://bit.ly/1v4fFBc.
20. Dwork, Cynthia. 2011. "A Firm Foundation for Private Data Analysis." Communications of the ACM 54(1):86-95.
21. Evans, David S. 1987. "Tests of Alternative Theories of Firm Growth." Journal of Political Economy 95:657-74.
22. Executive Office of the President. 2014. "Big Data: Seizing Opportunities, Preserving Values." Washington, DC. http://1.usa.gov/1hqgibM.
23. Fan, Jianqing, Fang Han, and Han Liu. 2014. "Challenges of Big Data Analysis." National Science Review 1:293-314.
24. Fan, Jianqing, and Yuan Liao. 2014. "Endogeneity in Ultrahigh Dimension." Annals of Statistics 42:872-917.
25. Fan, Jianqing, Richard Samworth, and Yichao Wu. 2009. "Ultrahigh Dimensional Feature Selection: Beyond the Linear Model." Journal of Machine Learning Research 10:2013-2038.
26. Gelman, Andrew, Jeffrey Fagan, and Alex Kiss. 2007. "An Analysis of the New York City Police Department's 'Stop-and-Frisk' Policy in the Context of Claims of Racial Bias." Journal of the American Statistical Association 102:813-23.
27. Gerber, Eleanor R. 2001. "The Privacy Context of Survey Response: An Ethnographic Account." In Confidentiality, Disclosure and Data Access: Theory and Practical Applications for Statistical Agencies, edited by Pat Doyle, Julia Lane, Jules Theeuwes, and Laura Zayatz, 371-95. Amsterdam: Elsevier.
28. Greenwood, Daniel, Arkadiusz Stopczynski, Brian Sweatt, Thomas Hardjono, and Alex Pentland. 2014. "The New Deal on Data: A Framework for Institutional Controls." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum, 192-200. New York: Cambridge University Press.
29. Griffin, Jane. 2008. "The Role of the Chief Data Officer." Data Management Review 18:28.
30. Groves, Robert M. 2011a. "Three Eras of Survey Research." Public Opinion Quarterly 75:861-71.
31. Groves, Robert M. 2011b. "'Designed Data' and 'Organic Data.'" Directors Blog, May 31. US Census Bureau. Available at http://1.usa.gov/15NDn8w.
32. Halevy, Alon, Peter Norvig, and Fernando Pereira. 2009. "The Unreasonable Effectiveness of Data." Intelligent Systems 24(2):8-12. doi:10.1109/MIS.2009.36.
33. Hall, Peter, and Hugh Miller. 2009. "Using Generalized Correlation to Effect Variable Selection in Very High Dimensional Problems." Journal of Computational Graphical Statistics 18:533-50.
34. Hey, Tony, Stewart Tansley, and Kristin Tolle. 2009. The Fourth Paradigm: Data Intensive Scientific Discovery. Microsoft Research.
35. Ibrahim, Joseph, and Ming-Hui Chen. 2000. "Power Prior Distributions for Regression Model." Statistical Science 15:46-60.
36. Jovanovic, Boyan. 1982. "Selection and the Evolution of Industry." Econometrica 50:649-70.
37. Kahneman, Daniel. 2011. Thinking Fast and Slow. New York: Farrar, Straus & Giroux.
38. Karr, Alan F., and Jerome P. Reiter. 2014. "Using Statistics to Protect Privacy." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum, 276-95. New York: Cambridge University Press.
39. Keller, Sallie Ann, Steven E. Koonin, and Stephanie Shipp. 2012. "Big Data and City Living: What Can It Do for Us?" Significance 9(4):4-7.
40. Kinney, Satkartar K., Alan F. Karr, and Joe Fred Gonzalez Jr. 2009. "Data Confidentiality: The Next Five Years Summary and Guide to Papers." Journal of Privacy and Confidentiality 1:125-34.
41. Koonin, Steven E., and Michael J. Holland. 2014. "The Value of Big Data for Urban Science." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum, 137-52. New York: Cambridge University Press.
42. Kreuter, Frauke, and Roger D. Peng. 2014. "Extracting Information from Big Data: Issues of Measurement, Inference and Linkage." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum, 257-75. New York: Cambridge University Press.
43. Lane, Julia, and Victoria Stodden. 2013. "What? Me Worry? What to Do about Privacy, Big Data, and Statistical Research." AMStat News, December 1. Available at http://bit.ly/15UL9OW.
44. Lane, Julia, Victoria Stodden, Stefan Bender, and Helen Nissenbaum. 2014. "Editors' Introduction." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum, xi-xix. New York: Cambridge University Press.
45. Laney, Douglas. 2001. "3-D Data Management: Controlling Data Volume, Velocity, and Variety." META Group Research Note, February 6. Available at http://gtnr.it/1bKflKH.
46. Laney, Douglas. 2012. "The Importance of 'Big Data': A Definition." Gartner Inc.
47. Lazer, David M., Ryan Kennedy, Gary King, and Alessandro Vespignani. 2014. "The Parable of Google Flu: Traps in Big Data Analysis." Science 343:1203-1205.
48. Leek, Jeff. 2014a. "Why Big Data Is in Trouble: They Forgot about Applied Statistics." Simplystats Blog, May 7. Available at http://bit.ly/1fUzZO1.
49. Leek, Jeff. 2014b. "10 Things Statistics Taught Us about Big Data Analysis." Simplystats blog, May 22. Available at http://bit.ly/S1ma4Z.
50. Levitt, Steven D., and Thomas J. Miles. 2006. "Economic Contributions to the Understanding of Crime." Annual Review of Law and Social Science 2:147-64.
51. Lohr, Steve. 2012. "The Age of Big Data." New York Times, February 11. Available at http://nyti.ms/1f7WKqh.
52. Lohr, Steve. 2014. "For Big-Data Scientists, 'Janitor Work' Is Key Hurdle to Insights." New York Times, August 17. Available at http://nyti.ms/1Aqif2X.
53. Manzi, Jim. 2012. Uncontrolled: The Surprising Payoff of Trial-and-Error for Business, Politics, and Society. New York: Basic Books.
54. McAfee, Andrew, and Erik Brynjolfsson. 2012. "Big Data: The Management Revolution." Harvard Business Review 90:61-67.
55. Murphy, Joe, Michael W. Link, Jennifer Hunter Childs, Casey Langer Tesfaye, Elizabeth Dean, Michael Stern, Josh Pasek, Jon Cohen, Mario Callegaro, and Paul Harwood. 2014. "Social Media in Public Opinion Research: Report of the AAPOR Task Force on Emerging Technologies in Public Opinion Research." AAPOR Task Force Report. Available at http://bit.ly/15V7coJ.
56. New York Times, Editorial B 2014. Better Governing Through Data, New York Times, August 19. Available at http://nyti.ms/1qehhWr.
57. Nielsen, Michael. 2012. Reinventing Discovery: The New Era of Networked Science. Princeton, NJ: Princeton University Press.
58. Nissenbaum, Helen. 2011. "A Contextual Approach to Privacy Online." Daedalus 140(4):32-48.
59. Norberg, Anders, Muhanad Sammar, and Can Tongur. 2011. "A Study on Scanner Data in the Swedish Consumer Price Index." Paper presented at the Statistics Sweden Consumer Price Index Board, Stockholm, Sweden.
60. Ohm, Paul. 2010. "Broken Promises of Privacy: Responding to the Surprising Failure of Anonymization." UCLA Law Review 57:1701-1818.
61. Pardo, Theresa A. 2014. "Making Data More Available and Usable: A Getting Started Guide for Public Officials." Paper presented at the Privacy, Big Data, and the Public Good Book Launch. http://bit.ly/1Czw7u4.
62. Porter, Scott, and Carlos G. Lazaro. 2014. "Adding Big Data Booster Packs to Survey Data." Paper presented at the Council of American Survey Research Organizations Digital Research Conference, San Antonio, TX, USA.
63. Prada, Sergio I., Claudia Gonzalez-Martinez, Joshua Borton, Johannes Fernandes- Huessy, Craig Holden, Elizabeth Hair, and Tim Mulcahy. 2011. "Avoiding Disclosure of Individually Identifiable Health Information. A Literature Review." SAGE Open. doi:10.1177/2158244011431279.
64. Schenker, Nathaniel, Marie Davidian, and Robert Rodriguez. 2013. "The ASA and Big Data." AMStat News, June 1. Available at http://bit.ly/15XAzX8.
65. Scott, Steven L., Alexander W. Blocker, Fernando V. Bonassi, Hugh A. Chipman, Edward I. George, and Robert E. McCulloch. 2013. "Bayes and Big Data: The Consensus Monte Carlo Algorithm." http://bit.ly/1wBqh4w.
66. Shelton, Taylor, Ate Poorthuis, Mark Graham, and Matthew Zook. 2014. "Mapping the Data Shadows of Hurricane Sandy: Uncovering the Sociospatial Dimensions of 'Big Data.'" Geoforum 52:167-79.
67. Squire, Peverill. 1988. "Why the 1936 Literary Digest Poll Failed." Public Opinion Quarterly 52:125-33.
68. Stanton, Mark W. 2006. "The High Concentration of US Health Care Expenditures." Research in Action 19:1-10.
69. Stock, James H., and Mark W. Watson. 2002. "Forecasting Using Principal Components from a Large Number of Predictors." Journal of the American Statistical Association 97:1167-1179.
70. Strandburg, Katherine J. 2014. "Monitoring, Datafication, and Consent: Legal Approaches to Privacy in the Big Data Context." In Privacy, Big Data, and the Public Good: Frameworks for Engagement, edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum, 5-43. New York: Cambridge University Press.
71. Tambe, Prasanna, and Lorin M. Hitt. 2012. "The Productivity of Information Technology Investments: New Evidence from IT Labor Data." Information Systems Research 23:599-617.
72. Tapia, Andrea H., Nicolas LaLone, and Hyun-Woo Kim. 2014. "Run Amok: Group Crowd Participation in Identifying the Bomb and Bomber from the Boston Marathon Bombing." Proceedings from the International Conference on Information Systems for Crisis Response and Management, 265-74.
73. Taylor, Sean J. 2013. "Real Scientists Make Their Own Data." Sean J. Taylor Blog, January 25. Available at http://bit.ly/15XAq5X.
74. ten Bosch, Olav, and Dick Windmeijer. 2014. "On the Use of Internet Robots for Official Statistics." Paper presented at the Meeting on the Management of Statistical Information Systems, Dublin, Ireland.
75. Thompson, William W., Lorraine Comanor, and David K. Shay. 2006. "Epidemiology of Seasonal Influenza: Use of Surveillance Data and Statistical Models to Estimate the Burden of Disease." Journal of Infectious Diseases 194:S82-S91.
76. Tourangeau, Roger, Lance J. Rips, and Kenneth Rasinski. 2000. The Psychology of Survey Response. New York: Cambridge University Press.
77. Varian, Hal R. 2014. "Big Data: New Tricks for Econometrics." Journal of Economic Perspectives 28(2):3-27.
78. Wallgren, Anders, and Britt Wallgren. 2007. Register-Based Statistics: Administrative Data for Statistical Purposes. New York: Wiley & Sons.
79. Wallgren, Anders, and Britt Wallgren. 2014. Register-Based Statistics: Statistical Methods for Administrative Data. New York: Wiley & Sons.
80. Winkler, William E. 2005. "Re-Identification Methods for Evaluating the Confidentiality of Analytically Valid Microdata." Research Report Series, Statistics #2005-09. US Census Bureau.