Practical tools for designing and weighting survey samples

Practical Tools for Designing and Weighting Survey Samples

Volumn , Issue , 2013, Pages 1-670

  Valliant, Richard ^a   Dever, Jill A ^b   Kreuter, Frauke ^c  

^a UNIVERSITY OF MICHIGAN   (United States)

^b RTI INTERNATIONAL   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85028710608     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-4614-6449-5     Document Type: Book

References (253)

1. AAPOR (2011). Standard definitions: Final dispositions of case codes and outcome rates for surveys, 7th edn. Tech. rep., The American Association for Public Opinion Research, Deerfield, IL, URL http://www.aapor.org/pdfs/standarddefs 4.pdf.
2. Abraham K.G., Maitland A., Bianchi S.M. (2006). Nonresponse in the American Time Use Survey: Who is missing from the data and how much does it matter? Public Opinion Quarterly 70(5):676-703.
3. Aitken A., Hörngren J., Jones N., Lewis D., Zilhão M.J. (2004). Handbook on improving quality by analysis of process variables. Tech. rep., Luxembourg, URL http://epp.eurostat.ec.europa.eu/portal/page/portal/quality/ documents/HANDBOOK%20ON%20IMPROVING%20QUALITY.pdf.
4. Armitage P., Berry G. (1987). Statistical Methods in Medical Research, 2nd edn. Blackwell, Oxford.
5. Axinn W.G., Link C.F., Groves R.M. (2011). Responsive survey design, demographic data collection, and models of demographic behavior. Demography 48(3):1127-1149.
6. Bart J., Earnst S. (2002). Double sampling to estimate density and population trends in birds. The AuK 119(1):36-45.
7. Bates D., Maechler M., Bolker B. (2012). lme4: Linear mixed-effects models using S4 classes. URL http://CRAN.R-project.org/package=lme4.
8. Bell B., Mohadjer L., Montaquila J., Rizzo L. (1999). Creating a frame of newly constructed units for household surveys. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 306-310.
9. Bethlehem J., Cobben F., Schouten B. (2011). Handbook in Nonresponse in Household Surveys. John Wiley & Sons, Inc., New Jersey.
10. Biemer P., Lyberg L. (2003). Introduction to Survey Quality. John Wiley & Sons, Inc., New Jersey.
11. Blasius J., Thiessen V. (2012). Assessing the Quality of Survey Data. SAGE Publications Ltd., London.
12. Blom A. (2008). Measuring nonresponse cross-nationally. ISER Working Paper Series URL http://ideas.repec.org/p/ese/iserwp/2008-41.html, no. 2008-41.
13. Breiman L., Friedman J., Stone C., Olshen R. (1993). Classification and Regression Trees. Chapman & Hall, London.
14. Breivik H., Cherny N., Collett B., de Conno F., Filbet M., Foubert A.J., Cohen R., Dow L. (2009). Cancer-related pain: a pan-European survey of prevalence, treatment, and patient attitudes. Annals of Oncology 20(8):1420-1433.
15. Brick J.M., Waksberg J., Kulp D., Starer A. (1995). Bias in list-assisted telephone samples. Public Opinion Quarterly 59(2):218-235.
16. Brown L., Cai T., Das Gupta A. (2001). Interval estimation for a binomial proportion. Statistical Science 16:101-133.
17. Bureau of Labor Statistics (2006). Household Data (A tables, monthly: D tables, quarterly). Employment and Earnings. URL http://www.bls.gov/cps/eetech methods. pdf.
18. Bureau of Labor Statistics (2009). Economic News Release: CPI Consumer Price Index, June 2009. URL http://www.bls.gov/news.release/cpi.nr0.htm.
19. Bureau of Labor Statistics (2012). American Time Use Survey User's Guide. URL http://stats.bls.gov/tus/atususersguide.pdf.
20. Canada S. (2009). Statistics Canada quality guidelines. Tech. rep., Ottawa CA.
21. Casella G., Berger R. (2002). Statistical Inference. Duxbury Press, Pacific Grove CA.
22. Center for Disease Control and Prevention (2005). National Hospital Discharge Survey: 2005 Annual summary with detailed diagnosis and procedure data. Vital and health Statistics (165), URL http://www.cdc.gov/nchs/data/series/sr 13/sr13 165. pdf.
23. Center for Disease Control and Prevention (2009). National Health and Nutrition Examination Survey: 1999-2010 survey content URL www.cdc.gov/nchs/data/ nhanes/survey content 99 10.pdf.
24. Chromy J.R. (1979). Sequential sample selection methods. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 401-406.
25. Chromy J.R., Myers L.E. (2001). Variance models applicable to the NHSDA. In: Proceedings of the Survey Research Methods Section, American Statistical Association.
26. Cochran W. (1968). The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics 24:295-313.
27. Cochran W. (1977). Sampling Techniques. John Wiley & Sons, Inc., New York.
28. Cohen J. (1988). Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, New Jersey.
29. Cook R.D., Weisberg S. (1982). Residuals and Influence in Regression. Chapman & Hall Ltd, London.
30. Council of the European Union (1998). Council regulation (ec) no. 577/98 on the organization of a labour force survey in the community. Official Journal of the European Communities.
31. Council of the European Union (2003). Council regulation (ec) no. 1177/2003 concerning community statistics on income and living conditions. Official Journal of the European Communities.
32. Crawley M. (2007). The R Book. John Wiley & Sons, Chichester UK.
33. Czajka J., Hirabayashi S., Little R.J.A., Rubin D.B. (1992). Projecting from advance data using propensity modeling: An application to income and tax statistics. Journal of Business and Economic Statistics 10:117-131.
34. D'Agostino R.B. (1998). Propensity score methods for bias reduction for the comparison of a treatment to a non-randomized control group. Statistics in Medicine 17:2265-2281.
35. Dantzig G.B. (1963). Linear Programming and Extensions. Princeton University Press, Princeton NJ.
36. Deak M.A., Helba C., Lee K., Rockwell D., Perry S., Simmons R.O., D'Amato-Neff A.L., Ferro G., Lappin B.M. (2002). Tabulations of Responses from the 2000 Survey of Reserve Component Personnel: Defense Manpower Data Center Volume 2 Military Plans, Military Training, and Military Unit. URL http://www.dtic.mil/ cgi-bin/GetTRDoc?AD=ADA415264&Location=U2&doc=GetTRDoc.pdf.
37. Defense Manpower Data Center (2004). May 2004 Status of Forces Survey of Reserve component members: Administration, datasets, and codebook. Tech. Rep. No. 2004-013, Defense Manpower Data Center, Arlington, VA.
38. DeMeyer A., Loch C.H., Pick M.T. (2002). Managing project uncertainty: From variation to chaos. MIT Sloan Management Review 30:60-67.
39. Deming W.E. (1982). Out of the Crisis. Cambridge University Press, Cambridge.
40. Dever J.A., Valliant R. (2010). A comparison of variance estimators for poststratification to estimated control totals. Survey Methodology 36:45-56.
41. Deville J.C., Särndal C. (1992). Calibration estimators in survey sampling. Journal of the American Statistical Association 87(418):376-382.
42. Dillman D.A., Smyth J.D., Christian L.M. (2009). Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method. John Wiley & Sons, Inc., Hoboken, NJ.
43. Dippo C.S., Fay R.E., Morganstein D.R. (1984). Computing variances from complex samples with replicate weights. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 489-494.
44. Durrant G.B., Steele F. (2009). Multilevel modelling of refusal and non-contact in household surveys: Evidence from six UK government surveys. Journal Of The Royal Statistical Society, Series A 172(2):361-381.
45. Eckman S. (2010). Errors in Housing Unit Listing and their Effects on Survey Estimates. University of Maryland, College Park MD, URL http://drum.lib.umd.edu// handle/1903/10302.
46. Eckman S., Kreuter F. (2011). Confirmation bias in housing unit listing. Public Opinion Quarterly 75(1):139-150.
47. Eckman S., O'Muircheartaigh C. (2011). Performance of the half-open interval missed housing unit procedure. Survey Research Methods 5(3):125-131.
48. Efron B. (1982). The Jackknife, the Bootstrap and Other Resampling Plans. SIAM [Society for Industrial and Applied Mathematics], Philadelphia.
49. Efron B., Tibshirani R. (1998). An Introduction to the Bootstrap. CRC Press LLC, Boca Raton FL.
50. Ezzati-Rice T., Rohde F., Greenblatt J. (2008). Sample design of the medical expenditure panel survey household component, 1998-2007. Tech. Rep. Methodology Report No. 22, Agency for Healthcare Research and Quality.
51. Fay R.E. (1984). Some properties of estimates of variance based on replication methods. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 495-500.
52. Folsom R.E., Singh A.C. (2000). The generalized exponential model for sampling weight calibration for extreme values, nonresponse, and poststratification. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 598-603.
53. Folsom R.E., Potter F.J., Williams S.R. (1987). Notes on a composite size measure for self-weighting samples in multiple domains. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 792-796.
54. Francisco C., Fuller W.A. (1991). Quantile estimation with a complex survey design. Annals of Statistics 19:454-469.
55. Freund R. (1994). Professor George Dantzig: Linear programming founder turns 80. SIAM News.
56. Fuller W.A. (1998). Replication variance estimation for two-phase samples. Statistica Sinica 8:1153-1164.
57. Gabler S., Haeder S., Lahiri P. (1999). A model based justification of Kish's formula for design effects for weighting and clustering. Survey Methodology 25(1):105-106.
58. Gambino J.G. (2005). pps: Functions for PPS sampling. URL http://CRAN. R-project.org/package=pps.
59. Gelman A., Carlin J., Stern H., Rubin D.B. (1995). Data Analysis. Chapman & Hall/CRC., Boca Raton FL.
60. Godambe V.P., Joshi V.M. (1965). Admissibility and Bayes estimation in sampling finite populations - I. Annals of Mathematical Statistics 36:1707-1723.
61. Groves R.M. (1989). Survey Errors and Survey Costs. John Wiley & Sons, Inc., New York.
62. Groves R.M. (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly 70(5):646-675.
63. Groves R.M., Heeringa S.G. (2006). Responsive design for household surveys: Tools for actively controlling survey errors and costs. Journal of the Royal Statistical Society, Series A: Statistics in Society 169(3):439-457.
64. Groves R.M., Peytcheva E. (2008). The impact of nonresponse rates on nonresponse bias. Public Opinion Quarterly 72:167-189.
65. Groves R.M., Fowler F., Couper M., Lepkowski J., Singer E., Tourangeau R. (2004). Survey Methodology. John Wiley & Sons, Inc., New York.
66. Hansen M.H., Hurwitz W.H. (1943). On the theory of sampling from finite populations. Annals of Mathematical Statistics 41:517-529.
67. Hansen M.H., Tepping B.J. (1990). Regression estimates in federal welfare quality control programs (C/R: P864-873). Journal of the American Statistical Association 85:856-864.
68. Hansen M.H., Hurwitz W.H., Madow W.G. (1953a). Sample Survey Methods and Theory, Volume I. John Wiley & Sons, Inc., New York.
69. Hansen M.H., Hurwitz W.H., Madow W.G. (1953b). Sample Survey Methods and Theory, Volume II. John Wiley & Sons, Inc., New York.
70. Hansen M.H., Madow W.G., Tepping B.J. (1983). An evaluation of model-dependent and probability sampling inferences in sample surveys. Journal of the American Statistical Association 78:776-793.
71. Harder V., Stuart E., Anthony J. (2010). Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychological Methods 15(3):234-249.
72. Hartley H.O., Rao J.N.K. (1962). Sampling with unequal probabilities and with replacement. Annals of Mathematical Statistics 33(2):350-374.
73. Hedges L.V., Olkin I. (1985). Statistical Methods for Meta-analysis. Academic Press, Orlando.
74. Heiberger R.M., Neuwirth E. (2009) R Through Excel: A Spreadsheet Interface for Statistics, Data Analysis, and Graphics. Springer, New York.
75. Henry K.A. (2011). Weight adjustment methods and their impact on sample-based inference. PhD thesis, College Park MD, URL http://drum.lib.umd.edu/handle/ 1903/12278.
76. Henry K.A., Valliant R. (2009). Comparing sampling and estimation strategies in establishment populations. Survey Research Methods 3:27-44.
77. Henry K.A., Testa V.L., Valliant R. (2008). Variance estimation for an estimator of between-year change in totals from two stratified Bernoulli samples. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 1108-1115.
78. Herzog T.N., Scheuren F.J., Winkler W.E. (2007). Data Quality and Record Linkage. Springer, New York.
79. Hidiroglou, M. A. (2001). Double sampling. Survey Methodology, 27, 143-154.
80. Højsgaard S., Halekoh U. (2012). doBy: doBy - Groupwise summary statistics, general linear contrasts, population means (least-squares-means), and other utilities. URL http://CRAN.R-project.org/package=doBy, (contributions from J. Robison-Cox, K.Wright, A. A. Leidi).
81. Hunter S.R., Bowman K.R., Chromy J.R. (2005). Results of the variance component analysis of sample allocation by age in the National Survey on Drug Use and Health. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 3132-3136.
82. Iannacchione V.G. (2011). Research synthesis: The changing role of address-based sampling in surveys. Public Opinion Quarterly 75(3):556-576.
83. Iannacchione V.G., Staab J.M., Redden D.T. (2003). Evaluating the use of residential mailing lists in a metropolitan household survey. Public Opinion Quarterly 67(2):202-210.
84. Iannacchione V.G., Dever J.A., Bann C.M., Considine K.A., Creel D., Carson C.P., Best H.L., Haley R.W. (2011). Validation of a research case definition of Gulf War illness in the 1991 U.S. military population. Neuroepidemiology 37(2):129-140.
85. Ingels S.J., Pratt D.J., Herget D., Dever J.A., Ottem R., Rogers J., Jin Y., Leinwand S. (2011). High School Longitudinal Study of 2009 (HSLS:09) base-year data file documentation (NCES 2011-328). Tech. rep., National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education, Washington DC.
86. Internal Revenue Service (2004). Internal Revenue Bulletin: 2004-20, Meals and Entertainment Expenses. URL http://www.irs.gov/irb/2007-23 IRB/ar10.html.
87. Internal Revenue Service (2007). Cost Segregation Audit Techniques Guide. URL http://www.irs.gov/Businesses/Cost-Segregation-Audit-Techn iques-Guide---Table-of-Contents.
88. International Organization for Standardization (1985). Information processing - documentation symbols and conventions for data, program and system flowcharts, program network charts and system resources charts. Tech. rep., Geneva, Switzerland, URL http://www.iso.org/iso/iso catalogue/catalogue tc/catalogue detail.htm?csnumber=11955.
89. Isaki C.T., Fuller W.A. (1982). Survey design under the regression superpopulation model. Journal of the American Statistical Association 77(377):89-96.
90. Isaki C.T., Tsay J.H., Fuller W.A. (2004). Weighting sample data subject to independent controls. Survey Methodology 30(1):35-44.
91. Jans M., Sirkis R., Morgan D. (2013). Managing data quality indicators with paradatabased statistical quality control tools. In: Kreuter F. (ed) Improving Surveys with Paradata: Making use of Process Information, John Wiley & Sons, Inc., New York.
92. Jovanovic B.D., Levy P.S. (1997). A look at the rule of three. The American Statistician 51:137-139.
93. Judkins D. (1990). Fay's method of variance estimation. Journal of Official Statistics 6:223-239.
94. Judkins D., Van de Kerckhove W. (2003). RECS 2005 optimization. prepared for U.S. Department of Energy, no. 16.3, Task 98-010, contract no.: De-ac01-96e123968. Tech. rep., Westat, Rockville MD.
95. Judkins D., Hao H., Barrett B., Adhikari P. (2005). Modeling and polishing of nonresponse propensity. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 3159-3166.
96. Kalton G. (1993). Sampling rare and elusive populations. Tech. Rep. INT-92-P80- 16E, Department for Economic and Social Information and Policy Analysis, United Nations.
97. Kalton G., Anderson D. (1986). Sampling rare populations. Journal of the Royal Statistical Society A 149:65-82.
98. Kalton G., Maligalig D.S. (1991). A comparison of methods of weighting adjustment for nonresponse. Proceedings of the US Bureau of the Census Annual Research Conference pp 409-428.
99. Kang J.D.Y., Schafer J.L. (2007). Demystifying double robustness: A comparison of alternative strategies for estimating a population mean from incomplete data. Statistical Science 22(4):523-539.
100. Kass G.V. (1980). An exploratory technique for investigating large quantities of categorical data. Applied Statistics 29(2):119-127.
101. Kim J.J., Li J., Valliant R. (2007). Cell collapsing in poststratification. Survey Methodology 33(2):139-150.
102. Kim J.K., Yu C.L. (2011). Replication variance estimation under two-phase sampling. Survey Methodology 37(1):67-74.
103. Kim J.K., Navarro A., Fuller W.A. (2006). Replication variance estimation for two-phase stratified sampling. Journal of the American Statistical Association 101(473):312-320.
104. Kirgis N., Lepkowski J. (2010). A management model for continuous data collection: Reflections from the National Survey of Family Growth, 2006-2010. NSFG Paper No 10-011 URL http://www.psc.isr.umich.edu/pubs/pdf/ng10-011.pdf.
105. Kish L. (1965). Survey Sampling. John Wiley & Sons, Inc., New York.
106. Kish L. (1987a). Statistical Design for Research. John Wiley & Sons, Inc., New York.
107. Kish L. (1987b). Weighting in deft. The Survey Statistician.
108. Kish L. (1992). Weighting for unequal pi. Journal of Official Statistics 8(2):183-200.
109. Kohler U. (2007). Surveys from inside: An assessment of unit nonresponse bias with internal criteria. Survey Research Methods 1(2):55-67.
110. Kohler U., Kreuter F. (2012). Data Analysis using Stata, 3rd edn. StataPress, College Station TX.
111. Korn E.L. (1986). Sample size tables for bounding small proportions. Biometrics 42:213-216.
112. Korn E.L., Graubard B.I. (1998). Confidence intervals for proportions with small expected number of positive counts estimated from survey data. Survey Methodology 24:193-201.
113. Korn E.L., Graubard B.I. (1999). Analysis of Health Surveys. John Wiley & Sons, New York.
114. Korn E.L., Graubard B.I. (2003). Estimating variance components by using survey data. Journal of the Royal Statistical Society, Series B: Statistical Methodology 65(1):175-190.
115. Kostanich D., Dippo C.S. (2002). Current Population Survey: Design and methodology (technical paper 63RV). Tech. rep., Census Bureau and Bureau of Labor Statistics, Washington, DC.
116. Kott P.S. (1988). Model-based finite population correction for the Horvitz-Thompson estimator. Biometrika 75:797-799.
117. Kott P.S. (1999). Some problems and solutions with a delete-a-group jackknife. In: Federal Committee on Statistical Methodology Research Conference,Vol.4, U.S. Bureau of the Census, pp 129-135.
118. Kott P.S. (2001). The delete-a-group jackknife. Journal of Official Statistics 17(4):521-526.
119. Kott P.S. (2006). Using calibration weighting to adjust for nonresponse and coverage errors. Survey Methodology 32(2):133-142.
120. Kott P.S. (2009). Calibration weighting: Combining probability samples and linear prediction models. In: Handbook of Statistics, Volume 29B, Sample Surveys: Inference and Analysis, Elsevier, Amsterdam.
121. Kott P.S., Liu Y. (2009). One-sided coverage intervals for a proportion estimated from a stratified simple random sample. International Statistical Review 77:251-265.
122. Kott P.S., Stukel D.M. (1997). Can the jackknife be used with a two-phase sample? Survey Methodology 23:81-89.
123. Kreuter F. (2002) Kriminalitätsfurcht: Messung und methodische Probleme. Leske and Budrich, Berlin.
124. Kreuter F., Olson K. (2011). Multiple auxiliary variables in nonresponse adjustment. Sociological Methods and Research 40:311-332.
125. Kreuter F., Couper M., Lyberg L. (2010). The use of paradata to monitor and manage survey data collection. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 282-296.
126. Krewski D., Rao J.N.K (1981). Inference from stratified samples: Properties of the linearization, jackknife, and balanced repeated replication methods. Annals of Statistics 9:1010-1019.
127. Lange K. (2004). Optimization. Springer, New York.
128. Lee H., Kim J.K. (2002). Jackknife variance estimation for two-phase samples with high sampling fractions. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 2024-2028.
129. Lehtonen R., Veijanen A. (1998). Logistic generalized regression estimators. Survey Methodology 24:51-55.
130. Lemeshow S., Hosmer D., Klar J., Lwanga S. (1990). Adequacy of Sample Size in Health Studies. John Wiley & Sons, Inc., Chichester.
131. Lepkowski J., Axinn W.G., Kirgis N., West B.T., Ndiaye S.K., Mosher W., Groves R.M. (2010). Use of paradata in a responsive design framework to manage a field data collection. NSFG Survey Methodology Working Papers (10-012), URL http:// www.psc.isr.umich.edu/pubs/pdf/ng10-012.pdf.
132. Li J., Valliant R. (2009). Survey weighted hat matrix and leverages. Survey Methodology 35:15-24.
133. Li J., Valliant R. (2011). Linear regression diagnostics for unclustered survey data. Journal of Official Statistics 27:99-119.
134. Liao D., Valliant R. (2012a). Condition indexes and variance decompositions for diagnosing collinearity in linear model analysis of survey data. Survey Methodology 38:53-62.
135. Liao D., Valliant R. (2012b). Variance inflation factors in the analysis of complex survey data. Survey Methodology 38:189-202.
136. Link M.W., Battaglia M.P., Frankel M.R., Osborn L., Mokdad A.H. (2008). A comparison of address-based sampling (ABS) versus random-digit dialing (RDD) for general population surveys. Public Opinion Quarterly 72(1):6-27.
137. Little R.J.A. (1986). Survey nonresponse adjustments for estimates of means. International Statistical Review 54(2):139-157.
138. Little R.J.A., Rubin D.B. (2002). Statistical Analysis with Missing Data. John Wiley & Sons, Inc., New Jersey.
139. Little R.J.A., Vartivarian S. (2003). On weighting the rates in non-response weights. Statistics in Medicine 22:1589-1599.
140. Little R.J.A., Vartivarian S. (2005). Does weighting for nonresponse increase the variance of survey means? Survey Methodology 31:161-168.
141. Liu J., Aragon E. (2000). Subsampling strategies in longitudinal surveys. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 307-312.
142. Liu J., Iannacchione V.G., Byron M. (2002). Decomposing design effects for stratified sampling. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 2124-2126.
143. Lohr S.L. (1999). Sampling: Design and Analysis. Duxbury Press, Pacific Grove CA.
144. Long J.S. (2009). The Workflow of Data Analysis Using Stata. StataPress, College Station TX.
145. Lu W., Brick J.M., Sitter R. (2006). Algorithms for constructing combined strata grouped jackknife and balanced repeated replications with domains. Journal of the American Statistical Association 101:1680-1692.
146. Lumley T. (2010). Complex Surveys. John Wiley & Sons, Inc., New York.
147. Lumley T. (2012). survey: analysis of complex survey samples. URL http://CRAN. R-project.org/package=survey.
148. Lyberg L., Biemer P., Collins M., de Leeuw E., Dippo C.S., Schwarz N., Trewin D. (1997). Survey Measurement and Process Quality. John Wiley & Sons, Inc., New York.
149. Madsen K., Nielsen H.B., Tingleff O. (2004). Optimization with constraints. Tech. rep., Technical University of Denmark, URL http://www2.imm.dtu.dk/pubdb/ views/edoc download.php/4213/pdf/imm4213.pdf, 2nd edn.
150. Manitz J. (2012). samplingbook: Survey Sampling Procedures. URL http://CRAN. R-project.org/package=samplingbook, (contributions by M. Hempelmann, G. Kauermann, H. Kuechenhoff, S. Shao, C. Oberhauser, N. Westerheide, M. Wiesenfarth).
151. Matsuo H., Billiet J., Loosveldt G., Berglund F., Kleven Ø. (2010). Measurement and adjustment of non-response bias based on non-response surveys: The case of Belgium and Norway in the European Social Survey round 3. Survey Research Methods 4:165-178.
152. McCarthy P.J. (1969). Pseudo-replication: Half-samples. Review of the International Statistical Institute 37:239-264.
153. Michie D. (1989). Problems of computer-aided concept formation. In Applications of Expert Systems 2. Turing Institute Press/Addison-Wesley.
154. Montaquila J., Bell B., Mohadjer L., Rizzo L. (1999). A methodology for sampling households late in a decade. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 311-315.
155. Morgan J.N., Sonquist J.A. (1963). Problems in the analysis of survey data and a proposal. Journal of the American Statistical Association 58:415-434.
156. Morganstein D.R., Marker D.A. (1997). Continuous quality improvement in statistical agencies. In: Lyberg L., Biemer P., Collins M., De Leeuw E.D., Dippo C.S., Schwarz N., Trewin D. (eds) Survey Measurement and Process Quality, John Wiley & Sons, Inc., New York.
157. Morton K., Chromy J.R., Hunter S.R., Martin P. (2006). 2005 National Survey on Drug Use and Health sample design report. Tech. Rep. Prepared under contract no. 283-2004-00022 by Research Triangle Institute, Substance Abuse and Mental Health Services Administration.
158. Müller G. (2011). Fieldwork monitoring in pass. Tech. rep., Institut für Arbeitsmarkt und Berufsforschung, URL http://www.iab.de/de/veranstaltungen/ konferenzen-und-workshops-2011/paradata.aspx.
159. National Center For Education Statistics (2008). NAEP weighting procedures: 2003 weighting procedures and variance estimation. Tech. rep., National Center for Education Statistics, URL http://nces.ed.gov/nationsreportcard/tdw/weighting/2002 2003/weighting 2003 studtrim.asp.
160. Newcombe R.G. (1998). Two-sided confidence intervals for the single proportion: Comparison of seven methods. Statistics in Medicine 17(8):857-872.
161. Neyman J. (1938). Contribution to the theory of sampling human populations. Journal of the American Statistical Association 33(201):101-116.
162. Olson K., Peytchev A. (2007). Effect of interviewer experience on interview pace and interviewer attitudes. Public Opinion Quarterly 71:273-286.
163. O'Muircheartaigh C., Campanelli P. (1998). The relative impact of interviewer effects and sample design effects on survey precision. Journal of the Royal Statistical Society, Series A 161(1):63-77.
164. O'Muircheartaigh C., Campanelli P. (1999). A multilevel exploration of the role of interviewers in survey non-response. Journal of the Royal Statistical Society, Series A 162(3):437-446.
165. Pfeffermann D., Skinner C.J., Holmes D.J., Goldstein H., Rasbash J. (1998). Weighting for unequal selection probabilities in multilevel models. Journal of the Royal Statistical Society Series B-Statistical Methodology 60(Part 1):23-40.
166. Pinheiro J.C., Bates D.M. (2000). Mixed-effects Models in S and S-PLUS. Springer, New York.
167. Porter E.H.,WinklerW.E. (1997). Approximate string comparison and its effect in an advanced record linkage system. In: Alvey W., Jamerson B. (eds) Record Linkage - 1997: Proceedings of an International Workshop and Exposition, U.S. Office of Management and Budget, pp 190-199.
168. Potter F.J. (1990). A study of procedures to identify and trim extreme sampling weights. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 225-230.
169. Potter F.J. (1993). The effect of weight trimming on nonlinear survey estimates. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 758-763.
170. Potter F.J., Iannacchione V.G., Mosher W., Mason R., Kavee J.A. (1998). Sample design, sampling weights, imputation, and variance estimation in the 1995 National Survey of Family Growth. Vital and Health Statistics, National Center for Health Statistics 124(2).
171. Powell S.G., Baker K.R. (2003). The Art of Modeling with Spreadsheets: Management Science, Spreadsheet Engineering, and Modeling Craft. John Wiley & Sons, Inc., New York.
172. R Core Team (2012). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, URL http://www. R-project.org/.
173. R Core Team and contributors worldwide (2012a). foreign: Read Data Stored by Minitab, S, SAS, SPSS, Stata, Systat, dBase,. URL http://CRAN.R-project.org/ package=foreign.
174. R Core Team and contributors worldwide (2012b). graphics: R functions for base graphics. URL http://finzi.psych.upenn.edu/R/library/graphics/html/ 00Index.html.
175. R Core Team and contributors worldwide (2012c). stats: R statistical functions. URL http://finzi.psych.upenn.edu/R/library/stats/html/00Index.html.
176. Rao J.N.K. (1973). On double sampling for stratification and analytical surveys (Corr: V60 p669). Biometrika 60:125-133.
177. Rao J.N.K., Shao J. (1999). Modified balanced repeated replication for complex survey data. Biometrika 86(2):403-415.
178. Rao J.N.K., Wu C.F.J. (1985). Inference from stratified samples: Second-order analysis of three methods for nonlinear statistics. Journal of the American Statistical Association 80:620-630.
179. Rao J.N.K., Wu C.F.J. (1988). Resampling inference with complex survey data. Journal of the American Statistical Association 83:231-241.
180. Rizzo L., Kalton G., Brick J.M. (1996). A comparison of some weighting adjustments for panel nonresponse. Survey Methodology 22:43-53.
181. Rosenbaum P., Rubin D.B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika 70:41-55.
182. Royall R.M. (1976). Current advances in sampling theory: Implications for human observational studies. American Journal of Epidemiology 104:463-473.
183. Royall R.M. (1986). The effect of sample size on the meaning of significance tests. The American Statistician 40:313-315.
184. RTI International (2012). SUDAAN Language Manual, Release 11.0. Research Triangle Park NC.
185. Rubin D.B. (1987). Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons, New York.
186. Rust K.F. (1984). Techniques for estimating variances for sample surveys. PhD thesis, University of Michigan, Ann Arbor MI, unpublished.
187. Rust K.F. (1985). Variance estimation for complex estimators in sample surveys. Journal of Official Statistics 1:381-397.
188. Saigo H., Shao J., Sitter R. (2001). A repeated half-sample bootstrap and balanced repeated replications for randomly imputed data. Survey Methodology 27(2): 189-196.
189. Särndal C. (2007). The calibration approach in survey theory and practice. Survey Methodology 33(2):99-119.
190. Särndal C., Lundström S. (2005). Estimation in Surveys with Nonresponse. John Wiley & Sons, Inc., England.
191. Särndal C., Lundström S. (2008). Assessing auxiliary vectors for control of nonresponse bias in the calibration estimator. Journal of Official Statistics 24:167-191.
192. Särndal C., Swensson B., Wretman J. (1992). Model Assisted Survey Sampling. Springer, New York.
193. Schlesselman J. (1982). Case-Control Studies: Design, Conduct, and Analysis. Oxford University Press, New York.
194. Schnell R., Kreuter F. (2005). Separating interviewer and sampling-point effects. Journal of Official Statistics 21(3):389-410.
195. Schnell R., Bachteler T., Bender S. (2004). A toolbox for record linkage. Austrian Journal of Statistics 33(1-2):125-133.
196. Schouten B., Cobben F. (2007). R-indexes for the comparison of different fieldwork strategies and data collection modes. Tech. Rep. Discussion Paper 07002, Voorburg, The Netherlands, URL http://www.risq-project.eu/papers/ schouten-cobben-2007-a.pdf.
197. Schouten B., Cobben F., Bethlehem J. (2009). Indicators for the representativeness of survey response. Survey Methodology 35(1):101-113.
198. Searle S., Casella G., McCulloch C. (1992). Variance Components. John Wiley & Sons, New York.
199. Shao J., Sitter R. (1996). Bootstrap for imputed survey data. Journal of the American Statistical Association 91:1278-1288.
200. Shewhart W.A. (1931). Economic Control of Quality of Manufactured Product. Van Nostrand Reinhold Co., Princeton, NJ, republished in 1981 by the American Society for Quality Control, Milwaukee, WI.
201. Singh A.C., Dever J.A., Iannacchione V.G. (2004). Composite response rates for surveys with nonresponse follow-up. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 4343-4350.
202. Singh A.C., Dever J.A., Iannacchione V.G., Chen S. (2005). Efficient estimation of response rates when a small subsample of nonrespondents is selected for followup conversion. In: Federal Committee on Statistical Methodology (FCSM) Conference, Arlington, VA, URL http://www.fcsm.gov/05papers/Singh Iannacchione etal VIIB.pdf.
203. Sitter R. (1992). Comparing three bootstrap methods for survey data. The Canadian Journal of Statistics / La Revue Canadienne de Statistique 20:135-154.
204. Smith P.J., Hoaglin D.C., Battaglia M.P., Khare M., Barker L.E. (2005). Statistical methodology of the National Immunization Survey, 1994-2002. Vital and Health Statistics, National Center for Health Statistics 2(138).
205. Smith T.M.F. (1976). The foundations of survey sampling: A review. Journal of the Royal Statistical Society A 139:183-204.
206. Smith T.M.F. (1984). Present position and potential developments: Some personal views, sample surveys. Journal of the Royal Statistical Society A 147:208-221.
207. Smith T.M.F. (1994). Sample surveys 1975-1990; an age of reconciliation? International Statistical Review 62:5-34.
208. Spencer B.D. (2000). An approximate design effect for unequal weighting when measurements may correlate with selection probabilities. Survey Methodology 26(2):137-138.
209. Stuart E. (2010). Matching methods for causal inference: A review and a look forward. Statistical Science 25(1):1-21.
210. Stukel D.M., Särndal C., Hidiroglou M.A. (1996). Variance estimation for calibration estimators: A comparison of jackknifing versus Taylor linearization. Survey Methodology 22(2):117-125.
211. Thayer W.C., Diamond G.L. (2002). Blood Lead Concentrations of U.S. Adult Females: Summary Statistics from Phases 1 and 2 of the National Health and Nutrition Evaluation Survey (NHANES III). URL http://www.epa.gov/superfund/lead/ products/nhanes.pdf.
212. Therneau T. (2012). survival: Survival analysis, including penalised likelihood. URL http://CRAN.R-project.org/package=survival.
213. Therneau T., Atkinson B., Ripley B. (2012). rpart: Recursive Partitioning. URL http://CRAN.R-project.org/package=rpart.
214. Thomas B. (1999). Probabilistic record linkage software: A Statistics Canada evaluation of GRLS and Automatch. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 187-192.
215. Tilĺe Y., Matei A. (2012). sampling: Survey Sampling. URL http://CRAN.R-project. org/package=sampling.
216. Tourangeau R., Kreuter F., Eckman S. (2012). Motivated underreporting in screening interviews. Public Opinion Quarterly 76(3):453-469.
217. Traugott M.W., Goldstein K. (1993). Evaluating dual frame samples and advance letters as a means of increasing response rates. In: Proceedings of the Survey Research Methods Section, American Statistical Association, pp 1284-1286.
218. Tufte E. (1990). Envisioning Information. Graphics Press, Cheshire CT.
219. Turlach B.A.,Weingessel A. (2011). quadprog: Functions to solve Quadratic Programming Problems. URL http://CRAN.R-project.org/package=quadprog.
220. US Census Bureau (1991). The 1990 Census of Population and Housing. Population and Housing Counts: 1790-1990.
221. US Census Bureau (2001a). Housing Characteristics: 2000. Census 2000 Brief. URL http://www.census.gov/prod/www/abs/briefs.html.
222. US Census Bureau (2001b). Population Change and Distribution 1990-2000. Census 2000 Brief. URL http://www.census.gov/prod/www/abs/briefs.html.
223. US Census Bureau (2002). Source and Accuracy of Estimates for Poverty in the United States: 2001. URL http://www.census.gov/prod/2002pubs/p60-219sa.pdf.
224. US Census Bureau (2006) Current Population Survey: Design and Methodology. URL http://www.census.gov/prod/2006pubs/tp-66.pdf.
225. US Census Bureau (2011). 2010 Census Redistricting Data (Public Law 94-171) Summary File. URL http://www.census.gov/prod/cen2010/doc/pl94-171.pdf.
226. Valliant R. (1985). Nonlinear prediction theory and the estimation of proportions in a finite population. Journal of the American Statistical Association 80:631-641.
227. Valliant R. (1993). Poststratification and conditional variance estimation. Journal of the American Statistical Association 88:89-96.
228. Valliant R. (2004). The effect of multiple weight adjustments on variance estimation. Journal of Official Statistics 20:1-18.
229. Valliant R., Rust K.F. (2010). Degrees of freedom approximations and rules-of-thumb. Journal of Official Statistics 26:585-602.
230. Valliant R., Dorfman A.H., Royall R.M. (2000). Finite Population Sampling and Inference: A Prediction Approach. John Wiley & Sons, Inc., New York.
231. Valliant R., Göksel H., Barrett B. (2003). 2003 Commercial Buildings Energy Consumption survey sample design report, prepared for U.S. Department of Energy under contract no. DE-AC01-96E123968. Tech. rep., Westat, Rockville MD.
232. Valliant R., Brick J.M., Dever J.A. (2008). Weight adjustments for the grouped jackknife variance estimator. Journal of Official Statistics 24(3):469-488.
233. Vapnik V.N. (1995) The Nature of Statistical Learning Theory. Springer, New York.
234. Varadhan R. (2010). alabama: Constrained nonlinear optimization. URL http:// CRAN.R-project.org/package=alabama, (with contributions from Gabor Grothendieck). R package version 2010.10-1.
235. Venables W.N., Ripley B.D. (2002). Modern Applied Statistics with S, 4th edn. Springer, New York.
236. Victor R.G., Haley R.W., Willett D.L., Peshock R.M., Vaeth P.C., Leonard D., Basit M., Cooper R.S., Iannacchione V.G., Visscher W.A., Staab J.M., Hobbs H.H., Dallas Heart Study Investigators (2004). The Dallas Heart Study: A population-based probability sample for the multidisciplinary study of ethnic differences in cardiovascular health. American Journal of Cardiology 93(12):1473-1480, URL http:// www.ncbi.nlm.nih.gov/pubmed/15194016.
237. Wagner J. (2010). The fraction of missing information as a tool for monitoring the quality of survey data. Public Opinion Quarterly 74(2):223-243.
238. Waksberg J., Sperry S., Judkins D., Smith V. (1993). National Survey of Family Growth, evaluation of linked design. Vital Health Statistics 2 (117), (PHS) 93- 1391.
239. Waksberg J., Judkins D., Massey J.T. (1997). Geographic-based oversampling in demographic surveys of the united states. Survey Methodology 23:61-71.
240. Weisberg S. (2005). Applied Linear Regression, 3rd edn. John Wiley & Sons, New York.
241. Weisstein E.W. (2010). Extreme Value Distribution. URL http://mathworld.wolfram. com/ExtremeValueDistribution.html, from MathWorld-A Wolfram Web Resource.
242. West B.T., Groves R.M. (2013). A propensity-adjusted interviewer performance indicator. Public Opinion Quarterly 77:to be published.
243. West B.T., Olson K. (2010). How much of interviewer variance is really nonresponse error variance? Public Opinion Quarterly 74(5):1027-1045.
244. Westat (2007). WesVar 4.3 User?s Guide. Westat, Rockville MD, URL www.westat. com.
245. Wickham H. (2011). reshape: Flexibly reshape data. URL http://CRAN.R-project. org/package=reshape.
246. Willenborg L., Heerschap H. (2012). Matching. Tech. rep., The Hague, URL http://www.cbs.nl/NR/rdonlyres/0EDC70A4-C776-43F6-94AD-A173EFE58915/ 0/2012Matchingart.pdf, method Series no. 12.
247. Wilson E.B. (1927). Probable inference, the law of succession, and statistical inference. Journal of the American Statistical Association 22:209-212.
248. Winston W., Venkataramanan M. (2003). Introduction to Mathematical Programming, 4th edn. Duxbury Press, Pacific Grove CA.
249. Winter N. (2002). svr: Stata SurVey Replication package. URL http://faculty.virginia. edu/nwinter/progs/.
250. Wolter K.M. (2007). Introduction to Variance Estimation, 2nd edn. Springer, New York.
251. Woodruff R.S. (1952). Confidence intervals for medians and other position measures. Journal of the American Statistical Association 47:635-646.
252. Woodward M. (1992). Formulas for sample size, power, and minimum detectable relative risk in medical studies. The Statistician 41:185-196.
253. Wright J., Marsden P. (2010). Handbook of Survey Research, 2nd edn. Emerald Group Publishing Limited, United Kingdom.