Household surveys in crisis

Journal of Economic Perspectives

Volumn 29, Issue 4, 2015, Pages 199-226

  Meyer, Bruce D ^a   Mok, Wallace K C ^b   Sullivan, James X ^c  

^a UNIVERSITY OF CHICAGO   (United States)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c UNIVERSITY OF NOTRE DAME   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84958756048     PISSN: None     EISSN: 08953309     Source Type: Journal    
DOI: 10.1257/jep.29.4.199     Document Type: Article

References (75)

1. Abowd, John, and Martha Stinson. 2013. "Estimating Measurement Error in Annual Job Earnings: A Comparison of Survey and Administrative Data." Review of Economic Statistics 95(5): 1451-67.
2. Aguiar, Mark, and Erik Hurst. 2007. "Measuring Trends in Leisure: The Allocation of Time over Five Decades." Quarterly Journal of Economics 122(3): 969-1006.
3. Alwin, Duane F. 2007. Margins of Error: A Study of Reliability in Survey Measurement. John Wiley & Sons: Hoboken, NJ.
4. Andridge, Rebecca R., and Roderick J. A. Little. 2010. "A Review of Hot Deck Imputation for Survey Non-Response." International Statistical Review 78(1): 40-64.
5. Atrostic, B. K., Nancy Bates, Geraldine Burt, and Adrian Silberstein. 2001. "Nonresponse in US Government Household Surveys: Consistent Measures, Recent Trends, and New Insights." Journal of Official Statistics 17(2): 209-226.
6. Barrow, Lisa, and Jonathan Davis. 2012. "The Upside of Down: Postsecondary Enrollment in the Great Recession." Economic Perspectives, Federal Reserve Bank of Chicago, 4Q: 117-29.
7. Battaglia, Michael P., Mina Khare, Martin R. Frankel, Mary Cay Murray, Paul Buckley, and Saralyn Peritz. 2007. "Response Rates: How Have They Changed and Where Are They Headed?" In Advances in Telephone Survey Methodology edited by James M. Lepkowski, Clyde Tucker, J. Michael Brick, Edith D. de Leeuw, Lilli Japec, Paul J. Lavrakas, Michael W. Link, and Roberta L. Sangster, 529-60. New York, NY: Wiley.
8. Bee, C. Adam, Graton Gathright, and Bruce D. Meyer. 2015. "Bias from Unit Non-Response in the Measurement of Income in Household Surveys." Unpublished paper, University of Chicago.
9. Bee, C. Adam, Bruce Meyer, and James Sullivan. 2015. "The Validity of Consumption Data: Are the Consumer Expenditure Interview and Diary Surveys Informative?" In Improving the Measurement of Consumer Expenditures, edited by Christopher Carroll, Thomas Crossley and John Sabelhaus, 204-240. University of Chicago Press.
10. Bollinger, Christopher, and Martin H. David. 2001. "Estimation with Response Error and Non response: Food-Stamp Participation in the SIPP" Journal of Business and Economic Statistics 19(2): 129-41.
11. Bollinger, Christopher R., and Barry Hirsch. 2006. "Match Bias from Earnings Imputation in the Current Population Survey: The Case of Imperfect Matching." Journal of Labor Economics 24(3): 483-519.
12. Bound, John, Charles Brown, and Nancy Mathiowetz. 2001. "Measurement Error in Survey Data." In Handbook of Econometrics, vol. 5, edited by James J. Heckman and Edward Leamer. Elsevier: Amsterdam.
13. Brick, Michael J., and Douglas Williams. 2013. "Explaining Rising Nonresponse Rates in Cross-Sectional Surveys." Annals of the American Academy of Political and Social Science 645(1): 36-59.
14. Brown, Lawrence, Constance Citro, Carol House, Krisztina Marton, and Christopher Mackie. 2014. "The Past, Present, and Future of Federal Surveys: Observations from the Committee on National Statistics." Conference proceedings from JSM (Joint Statistical Meetings) 2014-Social Statistics Section.
15. Burman, Len, Dan Feenberg, Austan Goolsbee, Charles Hulten, Bruce Meyer, John Karl Scholz, and Joel Slemrod. 2005. "Report on the State of Publicly Available Data and Statistics For the Study of Public Economics." Report for the Committee on Economic Statistics of the American Economic Association.
16. Celhay, Pablo, Bruce D. Meyer, and Nicholas Mittag. 2015. "Measurement Error in Program Participation." Unpublished paper.
17. Chetty, Raj. 2012. "Time Trends in the Use of Administrative Data for Empirical Research." NBER Summer Institute presentation. Available at the author's website.
18. Citro, Constance F. 2014. "From Multiple Modes for Surveys to Multiple Data Sources for Estimates." Survey Methodology 40(2): 137-61.
19. Council for Marketing and Opinion Research. 2003. "Respondent Cooperation and Industry Image Study." Previously available at http://www cmor.org/rc/studies.cfm.
20. Coder, John, and Lydia Scoon-Rogers. 1996. "Evaluating the Quality of Income Data Collected in the Annual Supplement to the March Current Population Survey and the Survey of Income and Program Participation." Housing and Household Economic Statistics Division, Bureau of the Census. https://www.census.gov/sipp/workpapr/wp215.pdf.
21. Curtin, Richard, Stanley Presser, and Elinor Singer. 2005. "Changes in Telephone Survey Nonresponse over the Past Quarter Century." Public Opinion Quarterly 69(1): 87-98.
22. Davern, Michael. 2013. "Nonresponse Rates Are a Problematic Indicator of Nonresponse Bias in Survey Research." Health Services Research 48(3): 905-912.
23. de Leeuw, Edith, and Wim de Heer. 2002. "Trends in Households Survey Nonresponse: A Longitudinal and International Comparison." In Survey Nonresponse, edited by Robert M. Groves, Don A Dillman, John Eltinge, and Roderick J.A Little. Wiley.
24. Duncan, Greg J., and Daniel H. Hill. 1989. "Assessing the Quality of Household Panel Data: The Case of the Panel Study of Income Dynamics." Journal of Business and Economic Statistics 7(4): 441-52.
25. Dushi, Irena, and Howard Iams. 2010. "The Impact of Response Error on Participation Rates and Contributions to Defined Contribution Pension Plans." Social Security Bulletin 70(1): 45-60.
26. Einav, Liran, and Jonathan Levin. 2014. "Economics in the Age of Big Data." Science 346 (6210).
27. Gathright, Graton, and Tyler A. Crabb. 2014. "Reporting of SSA Program Participation in SIPP." Working Paper, US Census Bureau. http://www.eventscribe.com/2014/ASA-JSM/assets/pdf/312130-92347.pdf.
28. Grogger, Jeffrey, and Lynn A. Karoly. 2005. Welfare Reform: Effects of a Decade of Change. Cambridge, MA Harvard UP.
29. Groves, Robert M. 2004. Survey Errors and Survey Costs. Hoboken, NJ: Wiley.
30. Groves, Robert M. 2006. "Nonresponse Rates and Nonresponse Bias in Household Surveys." Public Opinion Quarterly 70(5): 646-75.
31. Groves, Robert M., and Mick P. Couper. 1998. Nonresponse in Household Interview Surveys. New York, NY: Wiley.
32. Groves, Robert M., and Emilia Peytcheva. 2008. "The Impact of Nonresponse Rates on Nonresponse Bias." Public Opinion Quarterly 72(2): 167-89.
33. Hogan, Howard. 1993. "The 1990 Post-Enumeration Survey: Operations and Results." Journal of the American Statistical Associa-tion 88(423): 1047-60.
34. Huynh, Minh, Kalman Rupp, and James Sears. 2002. "The Assessment of Survey of Income and Program Participation (SIPP) Benefit Data using Longitudinal Administrative Records." Unpublished paper, Social Security Administration, http://www.oecd.org/std/36232630.pdf.
35. Johnson, Barry W., and Kevin Moore. 2008. "Differences in Income Estimates Derived from Survey and Tax Data." 2008 SOI Paper Series.
36. Kreuter, Frauke, Gerrit Müller, and Mark Trappmann. 2014. "A Note on Mechanisms Leading to Lower Data Quality of Late or Reluctant Respondents." Sociological Methods & Research 43(3): 452-64.
37. Marquis, Kent H., and Jeffrey C. Moore. 1990. "Measurement Errors in SIPP Program Reports." In Proceedings of the 1990 Annual Research Conference, 721-45. Washington, DC: US Bureau of the Census.
38. Massey, Douglas S., and Roger Tourangeau, eds. 2013. "The Nonresponse Challenge to Surveys and Statistics, " (special title of) volume 645, issue 1 of Annals of the American Academy of Political and Social Science, pages 6-236.
39. Meyer, Bruce D., Robert Goerge, and Nicholas Mittag. 2014. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation." Unpublished paper.
40. Meyer, Bruce D., and Nicholas Mittag. e: Implications for Poverty, Program Effectiveness and Holes in the Safety Net." Unpublished paper, University of Chicago.
41. Meyer, Bruce D., Wallace K C. Mok, and James X. Sullivan. 2015. "The Under-Reporting of Transfers in Household Surveys: Its Nature and Consequences." NBER Working Paper 15181. Updated version June 2015.
42. Mishra, V. B. Barrere, R. Hong, and S. Khan. 2008. "Evaluation of Bias in HIV Seroprevalence Estimates from National Household Surveys." Sexually Transmitted Infection 84(Supplement 1): i65-i70.
43. Moore, Jeffrey C, Kent H. Marquis, and Karen Bogen. 1996. "The SIPP Cognitive Research Evaluation Experiment: Basic Results and Documentation." Working Paper 212, Survey of Income and Program Participation, US Census Bureau.
44. National Research Council. 2011. The Future of Federal Household Surveys: Summary of a Workshop. K Marton and J.C. Karberg, rapporteurs. Committee on National Statistics, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.
45. National Research Council. 2013. Nonresponse in Social Science Surveys: A Research Agenda. Edited by Roger Tourangeau and Thomas J. Plewes. Panel on a Research Agenda for the Future of Social Science Data Collection, Committee on National Statistics, Division of Behavioral and Social Sciences and Education, National Research Council. Washington, DC: The National Academies Press.
46. Nicholas, Joyce, and Michael Wiseman. 2009. "Elderly Poverty and Supplemental Security Income." Social Security Bulletin 69(1): 45-73.
47. Nicholas, Joyce, and Michael Wiseman. 2010. "Elderly Poverty and Supplemental Security Income, 2002-2005." Social Security Bulletin 70(2): 1-30.
48. Office of Management and Budget. 2006. "Standards and Guidelines for Statistical Surveys." September. Executive Office of the President, Washington, DC.
49. Office of Management and Budget. 2014. "Guidance for Providing and Using Administrative Data for Statistical Purposes." Memorandum for the Heads of Executive Departments and Agencies, M-14-06, February. Executive Office of the President, Washington, DC.
50. Pennell, Steven G. 1993. "Cross-Sectional Imputation and Longitudinal Editing Procedures in the Survey of Income and Program Participation." Prepared for the US Bureau of the Census. https://www.census.gov/sipp/workpapr/wp9314.pdf.
51. Pew Research Center. 2012. "Assessing the Representativeness of Public Opinion Surveys, " May 15. Error! Hyperlink reference not valid.
52. Peytchev, Andrew. 2013. "Consequences of Survey Nonresponse." Annals of the American Academy of Political and Social Science 645(1): 88-111.
53. Presser, Stanley, and Susan McCullogh. 2011. "The Growth of Survey Research in the United States: Government-Sponsored Surveys, 1984-2004." Social Science Research 40(4): 1019-2024.
54. Reamer, Andrew D. 2010. "Surveying for Dollars: The Role of the American Community Survey in the Geographic Distribution of Federal Funds." Brookings Report, July 2010.
55. Robinson, J. Gregory, Bashir Ahmed, Prithwis Das Gupta, and Karen A. Woodrow. 1993. "Estimation of Population Coverage in the 1990 United States Census Based on Demographic Analysis." Journal of the American Statistical Association 88(423): 1061-71.
56. Roemer, Marc I. 2000. "Assessing the Quality of the March Current Population Survey and the Survey of Income and Program Participation Income Estimates, 1990-1996." Working Papers, Census Bureau.
57. Scherpf, Erik, Constance Newman, and Mark Prell. 2014. "Targeting of Supplemental Nutrition Assistance Program Benefits: Evidence from the ACS and NY SNAP Administrative Records." Agricultural and Applied Economics Association 2014 Annual Meeting, July 27-29, 2014, paper 174295.
58. Sears, James, and Kalman Rupp. 2003. "Exploring Social Security Payment History Matched with the Survey of Income and Program Participation." Unpublished paper, Social Security Administration. http://www.oecd.org/std/36232603.pdf.
59. Smith, Tom W., Peter V. Marsden, Michael Hout, Jibum Kim. 2013. General Social Surveys, 1972-2012 [Cumulative File]. Codebook. ICPSR 34802, Inter-University Consortium for Political and Social Research.
60. Steeh, Charlotte, Nicole Kirgis, Brian Cannon, and Jeff DeWitt. 2001. "Are They Really as Bad as They Seem? Nonresponse Rates at the End of the Twentieth Century." Journal of Official Statistics 17(2): 227-47.
61. Sudman, Seymour, and Norman M. Bradburn. 1974. Response Effects in Surveys: A Review and Synthesis. Chicago: NORC/Aldine Publishing Company
62. Taeuber, Cynthia, Dean M. Resnick, Susan P. Love, Jane Stavely, Parke Wilde, and Richard Larson. 2004. "Differences in Estimates of Food Stamp Program Participation Between Surveys and Administrative Records." Working paper, US Census Bureau.
63. Tourangeau, Roger, Robert M. Groves, and Cleo D. Redline. 2010. "Sensitive Topics and Reluctant Respondents: Demonstrating a Link between Nonresponse Bias and Measurement Error." Public Opinion Quarterly 74(3): 413-32.
64. US Census Bureau. 2001. "Survey of Income Program Participation Users' Guide." Third Edition. United States Department of Commerce, Bureau of the Census, Washington, DC.
65. US Census Bureau. 2003. "Meeting 21st Century Demographic Data Needs-Implementing the American Community Survey: Testing the Use of Voluntary Methods." United States Department of Commerce, Bureau of the Census, Washington, DC.
66. US Census Bureau. 2012. "Census Bureau Releases Estimates of Undercount and Overcount in the 2010 Census." United States Department of Commerce, Bureau of the Census, Washington, DC. http://www.census.gov/newsroom/releases/archives/2010-census/cb12-95.html.
67. US Census Bureau. Various years (a). "Current Population Survey: Annual Social and Economic (ASEC) Survey Codebook." United States Department of Commerce, Bureau of the Census, Washington, DC.
68. US Census Bureau. Various years (b). "Survey of Income and Program Participation Codebook." United States Department of Commerce, Bureau of the Census, Washington, DC.
69. US Department of Health and Human Services. 2014. "National Health Interview Survey-Survey Description." Centers for Disease Control and Prevention, Division of Health Interview Statistics, National Center for Health Statistics, Hyattsville, Maryland.
70. US Department of Labor (various years). "Consumer Expenditure Interview Survey Public Use Microdata Documentation." U.S. Department of Labor, Bureau of Labor Statistics, Division of Consumer Expenditure Surveys.
71. US House of Representatives. 2014. "Expanding Opportunity in America." House Budget Committee Majority Staff, July 24.
72. US Senate. 2015. "Murray, Ryan Introduce Bill to Expand Data Use in Evaluating Federal Programs, Tax Expenditures." News Release. http://www.murray.senate.gov/public/index. cfm/2015/4/evidence-based-policy-murray-ryan-introduce-bill-to-expand-data-use-in-evaluating-federal-programs-tax-expenditures.
73. US Social Security Administration. Various years. "Annual Statistical Supplement to the Social Security Bulletin." US Social Security Administration, Office of Research, Evaluation and Statistics.
74. Wheaton, Laura. 2007. "Underreporting of Means-Tested Transfer Programs in the CPS and SIPP." 2007 Proceedings of the American Statistical Association, Social Statistics Section.
75. White House. 2015. "The President's Budget Fiscal Year 2016." https://www.whitehouse.gov/sites/default/files/omb/budget/fy2016/assets/fact-sheets/building-and-using-evidence-to-improve-results.pdf.