The utility of alternative commercial data sources for survey operations and estimation: evidence from the national survey of family growth

Journal of Survey Statistics and Methodology

Volumn 3, Issue 2, 2015, Pages 240-264

  West, Brady T ^a   Wagner, James ^a   Hubbard, Frost ^a   Gu, Haoyu ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Auxiliary information; Commercial data; National survey of family growth; Survey methodology; Survey nonresponse; Survey operations

Indexed keywords

EID: 85013789055     PISSN: 23250984     EISSN: 23250992     Source Type: Journal    
DOI: 10.1093/jssam/smv004     Document Type: Article

References (46)

1. Amaya, A., F. LeClere, L. Fiorio, and N. English (2014), "Improving the Utility of the DSF Address-Based Frame through Ancillary Information," Field Methods, 26(1), 70-86.
2. Axinn, W. G., C. F. Link, and R. M. Groves (2011), "Responsive Survey Design, Demographic Data Collection, and Models of Demographic Behavior," Demography, 48, 1127-1149.
3. Biemer, P. P., and A. Peytchev (2012), "Census Geocoding for Nonresponse Bias Evaluation in Telephone Surveys: An Assessment of the Error Properties," Public Opinion Quarterly, 76(3), 432-452.
4. Biemer, P. P., and A. Peytchev (2013), "Using Geocoded Census Data for Nonresponse Bias Correction: An Assessment," Journal of Survey Statistics and Methodology, 1(1), 24-44.
5. Brick, J. M., and D. Williams (2013), "Explaining Rising Nonresponse Rates in Cross-Sectional Surveys," The ANNALS of the American Academy of Political and Social Science, 645, 36-59.
6. Buskirk, T. D., and D. Malarek (2014), "From Flagging a Sample to Framing It: An Exploration of the Utility of Information That Can Be Appended to RDD and Address-Based Samples," paper presented at the Joint Statistical Meetings, Boston, MA.
7. Buskirk, T. D., B. T. West, and A. Burks (2013), "Respondents: Who Art Thou? Comparing Internal, Temporal, and External Validity of Survey Response Propensity Models Based on Random Forests and Logistic Regression Models," paper presented at the Joint Statistical Meetings, Montreal, Canada.
8. Daily, G., L. T. Yacey, R. Xiao, A. Sreckov, M. Link, C. Bourquin, and C. Shuttles (2008), "Transitioning to Address-Based Sampling: Results from Nielsen's TV Ratings Survey Pilot," paper presented at the 63rd Annual Conference of the American Association for Public Opinion Research, New Orleans, LA.
9. Disogra, C., J. M. Dennis, and M. Fahimi (2010), "On the Quality of Ancillary Data Available for Address-Based Sampling," Proceedings of the Section on Survey Research Methods of the Joint Statistical Meetings, pp. 4174-4183.
10. English, N., I. Bilgen, and L. Fiorio (2012), "Coverage Implications of Targeted Lists for Rare Populations," Proceedings of the Section on Survey Research Methods of the Joint Statistical Meetings, pp. 4521-4528.
11. English, N., Y. Li, A. Mayfield, and A. Frasier (2014), "The Use of Targeted Lists to Enhance Sampling Efficiency in Address-Based Sample Designs: Age, Race, and Other Qualities," paper presented at the Joint Statistical Meetings, Boston, MA.
12. Groves, R. M., and S. G. Heeringa (2006), "Responsive Design for Household Surveys: Tools for Actively Controlling Survey Errors and Costs," Journal of the Royal Statistical Society, Series A, 169(3), 439-457.
13. Heinze, G., and M. Schemper (2002), "A Solution to the Problem of Separation in Logistic Regression," Statistics in Medicine, 21(16), 2409-2419.
14. Hosmer, D.W., S. Lemeshow, and R. X. Sturdivant (2013), Applied Logistic Regression, (3rd ed.), New York: John Wiley and Sons.
15. Johnson, T. P., Y. I. K. Cho, R. T. Campbell, and A. L. Holbrook (2006), "Using Community-Level Correlates to Evaluate Nonresponse Effects in a Telephone Survey," Public Opinion Quarterly, 70(5), 704-719.
16. Keeter, S., C. Kennedy, M. Dimock, J. Best, and P. Craighill (2006), "Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey," Public Opinion Quarterly, 70(5), 759-779.
17. Keeter, S., C. Miller, A. Kohut, R. M. Groves, and S. Presser (2000), "Consequences of Reducing Nonresponse in a National Telephone Survey," Public Opinion Quarterly, 64(2), 125.
18. Kish, L. (1965), Survey Sampling, New York: John Wiley and Sons.
19. Kolenikov, S., H. Hammer, C. DiSogra, R. Martonik, H. Turner, and D. Finkelhor (2014), "Adaptive Design Features for Using Address-Based Sampling in a National CATI Survey of Households with Children," paper presented at the Joint Statistical Meetings, Boston, MA.
20. Landis, J. R., and G. G. Koch (1977), "The Measurement of Observer Agreement for Categorical Data," Biometrics, 33(1), 159-174.
21. Lepkowski, J. M., W. D. Mosher, R. M. Groves, B. T. West, J. Wagner, and H. Gu (2013), "Responsive Design, Weighting, and Variance Estimation in the 2006-2010 National Survey of Family Growth. National Center for Health Statistics," Vital Health Statistics, 2(158).
22. Lessler, J., and W. Kalsbeek (1992), "Nonresponse: Dealing with the Problem," in Nonsampling Errors in Surveys, New York: Wiley-Interscience.
23. Link, M. W., and A. T. Burks (2013), "Leveraging Auxiliary Data, Differential Incentives, and Survey Mode to Target Hard-to-Reach Groups in an Address-Based Sample Design," Public Opinion Quarterly, 77(3), 696-713.
24. Link, M. W., and J. W. Lai (2011), "Cell-Phone-Only Households and Problems of Differential Nonresponse Using an Address-Based Sampling Design," Public Opinion Quarterly, 75(4), 613-635.
25. Little, R. J. A., and S. Vartivarian (2005), "Does Weighting for Nonresponse Increase the Variance of Survey Means?" Survey Methodology, 31(2), 161-168.
26. Luiten, A., and B. Schouten (2013), "Tailored Fieldwork Design to Increase Representative Household Survey Response: An Experiment in the Survey of Consumer Satisfaction," Journal of the Royal Statistical Society: Series A (Statistics in Society), 176(1), 169-189.
27. McMichael, J. P., B. Shook-Sa, R. Harter, and J. Ridenhour (2014), "Evaluation of Combining Consumer Marketing Data Used for Address-Based Sampling," paper presented at the Joint Statistical Meetings, Boston, MA.
28. Nagelkerke, N. J. D. (1991), "A Note on the General Definition of the Coefficient of Determination," Biometrika, 78(3), 691-692.
29. Pasek, J., S. M. Jang, C. L. Cobb, III, J. M. Dennis, and C. Disogra (2014), "Can Marketing Data Aid Survey Research? Examining Accuracy and Completeness in Consumer-File Data," Public Opinion Quarterly, 78(4), 889-916.
30. Peytchev, A., and T. E. Raghunathan (2013), "Evaluation and Use of Commercial Data for Nonresponse Adjustment," paper presented at the Annual Conference of the American Association for Public Opinion Research, Boston, MA.
31. Rastogi, S., and A. O'Hara (2010), "2010 Census Match Study: Final Report," U.S. Census Bureau, Center for Administrative Records Research and Applications.
32. Roth, S. B., D. Han, and J. M. Montaquila (2013), "The ABS Frame: Quality and Considerations," Survey Practice, 6(4), 1-6.
33. Shook-Sa, B. E., D. B. Currivan, J. P. McMichael, and V. G. Iannacchione (2013), "Extending the Coverage of Address-Based Sampling Frames: Beyond the USPS Computerized Delivery Sequence File," Public Opinion Quarterly, 77(4), 994-1005.
34. Sinibaldi, J., G. B. Durrant, and F. Kreuter (2013), "Evaluating the Measurement Error of Interviewer Observed Paradata," Public Opinion Quarterly, 77, 173-193.
35. Sinibaldi, J., M. Trappmann, and F. Kreuter (2014), "Which Is the Better Investment for Nonresponse Adjustment: Purchasing Commercial Auxiliary Data or Collecting Interviewer Observations?" Public Opinion Quarterly, 78(2), 440-473.
36. Smith, T. W. (2011), "The Report of the International Workshop on Using Multi-Level Data from Sample Frames, Auxiliary Databases, Paradata and Related Sources to Detect and Adjust for Nonresponse Bias in Surveys," International Journal of Public Opinion Research, 23(3), 389-402.
37. Tourangeau, R., R. M. Groves, and C. D. Redline (2010), "Sensitive Topics and Reluctant Respondents: Demonstrating a Link between Nonresponse Bias and Measurement Error," Public Opinion Quarterly, 74(3), 413-432.
38. Valliant, R., J. A. Dever, and F. Kreuter (2013), Practical Tools for Designing and Weighting Survey Samples, New York: Springer.
39. Valliant, R., F. Hubbard, S. Lee, and W. Chang (2014), "Efficient Use of Commercial Lists in U.S. Household Sampling," Journal of Survey Statistics and Methodology, 2(2), 182-209.
40. Wagner, J., B. T. West, N. Kirgis, J. M. Lepkowski, W. G. Axinn, and S. Kruger-Ndiaye (2012), "Use of Paradata in a Responsive Design Framework to Manage a Field Data Collection," Journal of Official Statistics, 28(4), 477-499.
41. West, B. T. (2013a), "An Examination of the Quality and Utility of Interviewer Observations in the National Survey of Family Growth," Journal of the Royal Statistical Society, Series A, 176(1), 211-225.
42. West, B. T. (2013b), "The Effects of Error in Paradata on Weighting Class Adjustments: A Simulation Study," in Improving Surveys with Paradata: Analytic Uses of Process Information, Chapter 15, pp. 361-387, Wiley Publishing.
43. West, B. T., F. Kreuter, and M. Trappmann (2014), "Is the Collection of Interviewer Observations Worthwhile in an Economic Panel Survey? New Evidence from the German Labor Market and Social Security (PASS) Study," Journal of Survey Statistics and Methodology, 2(2), 159-181.
44. West, B. T., and R. J. A. Little (2013), "Nonresponse Adjustment of Survey Estimates Based on Auxiliary Variables Subject to Error," Journal of the Royal Statistical Society, Series C (Applied Statistics), 62(2), 213-231.
45. Wolfinger, R. E., and S. J. Rosenstone (1980), Who Votes? New Haven: Yale University Press.
46. Yan, T., R. Datta, K. Wolter, and H. Shin (2011), "Assessing the Performance of a Multi-Mode ABS Study Using Auxiliary Data," paper presented at the Joint Statistical Meetings (Session 65), Miami, FL.