Statistical methods for handling incomplete data

Statistical Methods for Handling Incomplete Data

Volumn , Issue , 2013, Pages 1-208

  Kim, Jae Kwang ^a   Shao, Jun ^b  

^a IOWA STATE UNIVERSITY   (United States)

^b University of Wisconsin Madison   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; COMPUTATION THEORY; DATA HANDLING; STATISTICS; STUDENTS;

COMPUTATIONAL TECHNIQUE; GRADUATE STUDENTS; MISSING DATA ANALYSIS; NONPARAMETRIC METHODS; PRIOR EXPERIENCE; STATISTICAL COMPUTING; STATISTICAL MATCHING; STATISTICAL THEORY;

SAMPLING;

EID: 85054250021     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b13981     Document Type: Book

References (145)

1. Albert, P. S. and Follmann, D. A. (2000). Modeling repeated count data subject to informative dropout. Biometrics, 56:667–677.
2. Alho, J. M. (1990). Adjusting for nonresponse bias using logistic regression. Biometrika, 77:617– 624.
3. Allen, M. B. and Issacson, E. L. (1998). Numerical Analysis for Applied Science. John Wiley & Sons, New York.
4. Amemiya, T. (1985). Advanced Econometrics. Harvard University Press, Cambridge, MA.
5. Amstrup, S. C., McDonald, T. L., and Manly, B. F. J. (2005). Handbook of Capture–Recapture Analysis. Princeton University Press, Princeton, NJ.
6. Anderson, R. L. (1957). Maximum likelihood estimates for the multivariate normal distribution when some observations are missing. Journal of the American Statistical Association, 52:200– 203.
7. Baker, S. G. and Laird, N. M. (1988). Regression analysis for categorical variables with outcome subject to nonignorable nonresponse. Journal of the American Statistical Association, 83:62– 69.
8. Bang, H. and Robins, J. M. (2005). Doubly robust estimation in missing data and causal inference models. Biometrics, 61:962–973.
9. Beaumont, J. F. and Bocci, C. (2009). Variance estimation when donor imputation is used to fill in missing values. Canadian Journal of Statistics, 37:400–416.
10. Billingsley, P. (1986). Probability and Measure (2nd edition). John Wiley & Sons, New York.
11. Bishop, Y. M. M., Fienberg, S. E., and Holland, P. W. (1975). Discrete Multivariate Analysis: Theory and Practice. MIT Press, Cambridge, MA.
12. Booth, J. G. and Hobert, J. P. (1999). Maximizing generalized linear models with an automated Monte Carlo EM algorithm. Journal of the Royal Statistical Society: Series B, 61:625–685.
13. Cameron, A. C. and Trivedi, P. K. (2005). Microeconometrics: Methods and Applications. Cambridge University Press, New York, NY.
14. Cao, W., Tsiatis, A. A., and Davidian, M. (2009). Improving efficiency and robustness of the doubly robust estimator for a population mean with incomplete data. Biometrika, 96:723– 734.
15. Carroll, R. J., Ruppert, D., Stefanski, L. A., and Crainiceanu, C. M. (2006). Measurement Error in Nonlinear Models: A Modern Perspective. Chapman & Hall/CRC, Boca Raton, FL.
16. Cattaneo, M. D. (2010). Efficient semiparametric estimation of multi-valued treatment effects under ignorability. Journal of Econometrics, 155:138–154.
17. Chambers, R. L., Steel, D. G., Wang, S., and Welsh, A. (2012). Maximum Likelihood Estimation for Sample Surveys. Chapman & Hall / CRC, Boca Raton, FL.
18. Chen, J. and Shao, J. (2001). Jackknife variance estimation for nearest neighbor imputation. Journal of the American Statistical Association, 96:260–269.
19. Chen, Q. and Ibrahim, J. G. (2006). Semiparametric models for missing covariate and response data in regression models. Biometrics, 62:177–184.
20. Chen, S. (2013). A unified theory on empirical likelihood methods with missing data. Statistics and Its Interface, In press.
21. Cheng, P. E. (1994). Nonparametric estimation of mean functionals with data missing at random. Journal of the American Statistical Association, 89:81–87.
22. Copas, J. B. and Eguchi, S. (2001). Local sensitivity approximations for selectivity bias. Journal of the Royal Statistical Society: Series B, 63:871–895.
23. Copas, J. B. and Li, H. G. (1997). Inference for non-random samples. Journal of the Royal Statistical Society: Series B, 59:55–95.
24. Cox, D. R. (1972). Regression models and life-tables. Journal of the Royal Statistical Society: Series B, 34:187–220.
25. Cox, D. R. and Reid, N. (1987). Parameter orthogonality and approximate conditional inference. Journal of the Royal Statistical Society: Series B, 49:1–39.
26. Davidian, M. and Caroll, R. J. (1987). Variance function estimation. Journal of the American Statistical Association, 82:1079–1091.
27. Dawid, A. (1979). Conditional independence in statistical theory. Journal of the Royal Statistical Society: Series B, 41:1–31.
28. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B, 39:1–37.
29. D’Orazio, M., Zio, M. D., and Scanu, M. (2006). Statistical Matching: Theory and Practice. Wiley, Chichester, UK.
30. Drew, J. H. and Fuller, W. A. (1980). Modeling nonresponse in surveys with callbacks. In Proc. Survey Res. Meth. Sect., pages 639–642, Washington, DC. American Statistical Association.
31. Efron, B. and Hinkley, D. V. (1978). Assessing the accuracy of the maximum likelihood estimator: Observed versus expected fisher information. Biometrika, 65:457–487.
32. Elbers, C., Lanjouw, J. O., and Lanjouw, P. (2003). Micro-level estimation of poverty and inequality. Econometrika, 71:355–364.
33. Fay, R. E. (1992). When are inferences from multiple imputation valid? In Proceedings of the Survey Research Methods Section, pages 227–232, Washington, DC. American Statistical Association.
34. Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London A, 222:309–368.
35. Follmann, D. A. and Wu, M. (1995). An approximate generalized linear model with random effects for informative missing data. Biometrics, 51:151–168.
36. Fuller, W. A. (2003). Estimation for multiple phase samples. In Chambers, R. L. and Skinner, C. J., editors, Analysis of Survey Data, pages 307–322. Wiley: Chichester, England.
37. Fuller, W. A. (2009). Sampling Statistics. John Wiley & Sons, Inc., Hoboken, NJ.
38. Fuller, W. A. and Battese, G. E. (1973). Transformations for estimation of linear models with nested-error structure. Journal of the American Statistical Association, 68:626–632.
39. Fuller, W. A. and Kim, J. K. (2005). Hot deck imputation for the response model. Survey Methodology, 31:139–149.
40. Fuller, W. A., Loughin, M. M., and Baker, H. D. (1994). Regression weighting in the presence of nonresponse with application to the 1987-1988 Nationwide Food Consumption Survey. Survey Methodology, 20:75–85.
41. Geman, S. and Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6:721–741.
42. Gilks, W. R. and Wild, P. (1992). Adaptive rejection sampling for Gibbs sampling. Applied Statistics, 41:337–348.
43. Givens, G. H. and Hoeting, J. A. (2005). Computational Statistics. John Wiley & Sons, Inc., Hoboken, NJ.
44. Godambe, V. P. and Joshi, V. M. (1965). Admissibility and Bayes estimation in sampling finite populations. i. Annals of Mathematical Statistics, 36:1707–1722.
45. Godambe, V. P. and Thompson, M. E. (1986). Parameters of superpopulation and survey population: their relationships and estimation. International Statistical Review, 54:127–138.
46. Guo, Y. and Little, R. J. (2011). Regression analysis with covariates that have heteroscedastic measurement error. Statistics in Medicine, 30:2278–2294.
47. Hall, A. R. (2005). Generalized method of moments. Oxford University Press, New York.
48. Hansen, L. P. (1982). Large sample properties of generalized method of moments estimators. Econometrica, 50:1029–1054.
49. Haslett, S. J. and Jones, G. (2005). Small area estimation using surveys and censuses: Some practical and statistical issues. Statistics in Transition, 7:541–556.
50. Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57:97–109.
51. Heckman, J. J. (1979). Sample selection as a specification error. Econometrica, 47:153–161.
52. Henmi, M. and Eguchi, S. (2004). A paradox concerning nuisance parameters and projected estimating functions. Biometrika, 91:929–941.
53. Hirano, K., Imbens, G., and Ridder, G. (2003). Efficient estimation of average treatment effects using the estimated propensity score. Econometrica, 71:1161–1189.
54. Huggins, R. and Hwang, W. H. (2011). A review of the use of conditional likelihood in capture-recapture experiments. International Statistical Review, 79:385–400.
55. Ibrahim, J. G. (1990). Incomplete data in generalized linear models. Journal of the American Statistical Association, 85:765–769.
56. Ibrahim, J. G., Lipsitz, S. R., and Chen, M. H. (1999). Missing covariates in generalized linear models when the missing data mechanism is non-ignorable. Journal of the Royal Statistical Society, Series B, 61:173–190.
57. Isaki, C. T. and Fuller, W. A. (1982). Survey design under the regression superpopulation model. Journal of the American Statistical Association, 77:89–96.
58. Jiang, D. and Shao, J. (2012). Semiparametric pseudo likelihood for longitudinal data with outcome-dependent nonmonotone nonresponse. Submitted.
59. Kalton, G. and Kish, L. (1984). Some efficient random imputation methods. Communications in Statistics: Series A, 13:1919–1939.
60. Kang, J. D. Y. and Schafer, J. L. (2007). Demystifying double robustness: A comparison of alternative strategies for estimating a population mean from incomplete data. Statistical Science, 22:523–529.
61. Kenward, M. G. (1998). Selection models for repeated measurements with non-random dropout: An illustration of sensitivity. Statistics in Medicine, 17:2723–2732.
62. Kim, J. K. (2002). A note on approximate Bayesian bootstrap imputation. Biometrika, 89:470–477.
63. Kim, J. K. (2004). Finite sample properties of multiple imputation estimators. The Annals of Statistics, 32:766–783.
64. Kim, J. K. (2010). Calibration estimation using exponential tilting in sample surveys. Survey Methodology, 36:145–155.
65. Kim, J. K. (2011). Parametric fractional imputation for missing data analysis. Biometrika, 98:119– 132.
66. Kim, J. K., Brick, M. J., Fuller, W. A., and Kalton, G. (2006a). On the bias of the multiple imputation variance estimator in survey sampling. Journal of the Royal Statistical Society: Series B, 68:509–521.
67. Kim, J. K. and Fuller, W. A. (2004). Fractional hot deck imputation. Biometrika, 91:559–578.
68. Kim, J. K. and Fuller, W. A. (2013). Fractional hot deck imputation for multivariate missing data. Unpublished manuscript.
69. Kim, J. K. and Haziza, D. (2013). Doubly robust inference with missing data in survey sampling. Statistica Sinica. In press.
70. Kim, J. K. and Im, J. (2012). Propensity score adjustment with several followups. Unpublished manuscript.
71. Kim, J. K. and Kim, J. J. (2007). Nonresponse weighting adjustment using estimated response probability. Canadian Journal of Statistics, 35:501–514.
72. Kim, J. K., Navarro, A., and Fuller, W. A. (2006b). Replicate variance estimation after multi-phase stratified sampling. Journal of the American Statistical Association, 101:312–320.
73. Kim, J. K. and Park, H. A. (2006). Imputation using response probability. Canadian Journal of Statistics, 34:171–182.
74. Kim, J. K. and Park, M. (2010). Calibration estimation in survey sampling. International Statistical Review, 78:21–39.
75. Kim, J. K. and Rao, J. N. K. (2009). Unified approach to linearization variance estimation from survey data after imputation for item nonresponse. Biometrika, 96:917–932.
76. Kim, J. K. and Rao, J. N. K. (2012). Combining data from two independent surveys: A model-assisted approach. Biometrika, 99:85–100.
77. Kim, J. K. and Riddles, M. K. (2012). Some theory for propensity-score-adjustment estimators in survey sampling. Survey Methodology, 38:157–165.
78. Kim, J. K. and Shin, D. W. (2012). The factoring likelihood method for non-monotone missing data. Journal of the Korean Statistical Society, 41:375–386.
79. Kim, J. K. and Yu, C. L. (2011). A semi-parametric estimation of mean functionals with nonignorable missing data. Journal of the American Statistical Association, 106:157–165.
80. Kim, J. Y. and Kim, J. K. (2012). Parametric fractional imputation for nonignorable missing data. Journal of the Korean Statistical Society, 41:291–303.
81. Kott, P. S. and Chang, T. (2010). Using calibration weighting to adjust for nonignorable unit nonresponse. Journal of the American Statistical Association, 105:1265–1275.
82. Lahiri, P. and Larsen, M. D. (2005). Regression analysis with linked data. Journal of the American Statistical Association, 100:222–230.
83. Lehmann, E. L. (1983). Theory of Point Estimation. John Wiley & Sons, New York.
84. Li, K. C. (1991). Sliced inverse regression for dimension reduction. Journal of the American Statistical Association, 86:316–327.
85. Little, R. J. A. (1982). Models for nonresponse in sample surveys. Journal of the American Statistical Association, 77:237–250.
86. Little, R. J. A. (1995). Modeling the drop-out mechanism in longitudinal studies. Journal of the American Statistical Association, 90:1112–1121.
87. Little, R. J. A. and Rubin, D. B. (2002). Statistical Analysis with Missing Data (2nd Edition). John Wiley & Sons, Hoboken, NJ.
88. Loh, W. Y. (2002). Regression trees with unbiased variable selection and interaction detection. Statistica Sinica, 12:361–386.
89. Louis, T. A. (1982). Finding the observed information matrix when using the EM algorithm. Journal of the Royal Statistical Society: Series B, 44:226–233.
90. Magee, L. (1998). Improving survey-weighted least squares regression. Journal of the Royal Statistical Society: Series B, 60:115–126.
91. McLachlan, G. J. and Krishnan, T. (2008). The EM Algorithm and Extensions. John Wiley & Sons, Hoboken, NJ.
92. Meilijson, I. (1989). A fast improvement to the EM algorithm on its own terms. Journal of the Royal Statistical Society: Series B, 51:127–138.
93. Meng, X. L. (1994). Multiple-imputation inferences with uncongenial sources of input (with discussion). Statistical Science, 9:538–573.
94. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953). Equations of state calculations by fast computing machines. Journal of Chemical Physics, 21:1087– 1091.
95. Morgan, S. L. and Winship, C. (2007). Counterfactuals and Causal Inference: Methods and Principles for Social Research. Cambridge University Press, New York, USA.
96. Navidi, W. (1997). A graphical illustration of the EM algorithm. American Statistician, 51:29–31.
97. Nawata, K. and Nagase, N. (1996). Estimation of sample-selection bias models. Econometric Letters, 42:387–400.
98. Oakes, D. (1999). Direct calculation of the information matrix via the EM algorithm. Journal of the Royal Statistical Society: Series B, 61:479–482.
99. O’Muircheartaigh, C. and Moustaki, I. (1999). Symmetric pattern models: A latent variable approach to item non-response in attitude scales. Journal of the Royal Statistical Society: Series A, 162:177–194.
100. Orchard, T. and Woodbury, M. (1972). A missing information principle: Theory and applications. In Proceedings of the 6th Berkeley Symposium on Mathematical Statistics and Probability, volume 1, pages 695–715, Berkeley, California. University of California Press.
101. Owen, A. B. (1988). Empirical likelihood ratio confidence intervals for a single functional. Biometrika, 75:237–249.
102. Paik, M. C. (1997). The generalized estimating equaiton approach when data are not missing completely at random. Journal of the American Statistical Association, 92:1320–1329.
103. Park, T. and Brown, M. (1994). Models for categorical data with nonignorable nonresponse. Journal of the American Statistical Association, 89:44–52.
104. Qin, J., Leung, D., and Shao, J. (2002). Estimation with survey data under non-ignorable nonresponse or informative sampling. Journal of the American Statistical Association, 97:193–200.
105. Qin, J., Zhang, B., and Leung, D. (2009). Empirical likelihood in missing data problems. Journal of the American Statistical Association, 104:1492–1503.
106. Randles, R. H. (1982). On the asymptotic normality of statistics with estimated parameters. The Annals of Statistics, 10:462–474.
107. Rao, J. N. K. and Shao, J. (1992). Jackknife variance estimation with survey data under hot deck imputation. Biometrika, 79:811–822.
108. Rao, J. N. K. and Sitter, R. R. (1995). Variance estimation under two-phase sampling with application to imputation for missing data. Biometrika, 82:453–460.
109. Rässler, S. (2004). Data fusion: Identification problems, validity, and multiple imputation. Austrian Journal of Statistics, 33:153–171.
110. Redner, R. A. and Walker, H. F. (1984). Mixture densities, maximum likelihood and the EM algorithm. SIAM Review, 26:195–239.
111. Riddles, M. and Kim, J. K. (2013). Propensity score adjustment method for nonignorable nonresponse. Unpublished manuscript.
112. Robert, C. P. and Casella, G. (1999). Monte Carlo Statistical Methods. Springer, New York.
113. Robins, J. M., Rotnitzky, A., and Zhao, L. P. (1994). Estimation of regression coefficients when some regressors are not always observed. Journal of the American Statistical Association, 89:846–866.
114. Robins, J. M. and Wang, N. (2000). Inference for imputation estimators. Biometrika, 87:113–124.
115. Rosenbaum, P. R. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70:41–55.
116. Rosenbaum, P. R. (1987). Model-based direct adjustment. Journal of the American Statistical Association, 82:387–394.
117. Rubin, D. B. (1974). Characterizing the estimation of parameters in incomplete data problems. Journal of the American Statistical Association, 69:467–474.
118. Rubin, D. B. (1976). Inference and missing data. Biometrika, 63:581–590.
119. Rubin, D. B. (1978). Multiple imputation in sample surveys-a phenomenological Bayesian approach to nonresponse. In Proceedings of the Survey Research Methods Section, pages 20–34, Washington, DC. American Statistical Association.
120. Rubin, D. B. (1981). The Bayesian bootstrap. The Annals of Statistics, 9:130–134.
121. Rubin, D. B. (1987). Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons, New York.
122. Rubin, D. B. (2005). Causal inference using potential outcomes: design, modeling, decisions. Journal of the American Statistical Association, 100:322–331.
123. Rubin, D. B. and der Laan, M. J. V. (2008). Empirical efficiency maximization: Improved locally efficient covariate adjustment in randomized experiments and survival analysis. International Journal of Biostatistics, 4(1):Article 5.
124. Rubin, D. B. and Schenker, N. (1986). Multiple imputation for interval estimation from simple random samples with ignorable nonresponse. Journal of the American Statistical Association, 81:366–374.
125. Scharfstein, D., Rotnizky, A., and Robins, J. M. (1999). Adjusting for nonignorable dropout using semi-parametric models. Journal of the American Statistical Association, 94:1096–1146.
126. Scott, A. J. and Wild, C. J. (1997). Fitting regression models to case-control data by maximum likelihood. Biometrika, 84:57–71.
127. Seber, G. A. F. and Wild, C. J. (1989). Nonlinear regression. John Wiley & Sons, New York.
128. Serfling, R. J. (1980). Approximation Theorems of Mathematical Statistics. John Wiley & Sons, New York.
129. Shao, J. and Steel, P. (1999). Variance estimation for survey data with composite imputation and nonnegligible sampling fraction. Journal of the American Statistical Association, 94:254–265.
130. Shao, J. and Zhao, J. (2012). Estimation in longitudinal studies with nonignorable dropout. Submitted.
131. Tan, Z. (2006). A distributional appproach for causal inference using propensity scores. Journal of the American Statistical Association, 101:1619–1637.
132. Tang, G., Little, R. J. A., and Raghunathan, T. E. (2003). Analysis of multivariate missing data with nonignorable nonresponse. Biometrika, 90:747–764.
133. Tanner, M. A. and Wong, W. H. (1987). The calculation of posterior distribution by data augmentation. Journal of the American Statistical Association, 82:528–540.
134. Tobin, J. (1958). Estimation of relationships for limited dependent variables. Econometrica, 26:24–36.
135. Wang, D. and Chen, S. X. (2009). Empirical likelihood for estimating equations with missing values. The Annals of Statistics, 37:490–517.
136. Wang, N. and Robins, J. M. (1998). Large-sample theory for parametric multiple imputation procedures. Biometrika, 85:935–948.
137. Wang, S., Shao, J., and Kim, J. K. (2013). An instrument variable approach for identification and estimation with nonignorable nonresponse. Unpublished manuscript.
138. Wei, G. C. and Tanner, M. A. (1990). A Monte Carlo implementation of the EM algorithm and the poor man’s data augmentation algorithms. Journal of the American Statistical Association, 85:699–704.
139. Wu, C. F. J. (1983). On the convergence properties of the EM algorithm. The Annals of Statistics, 11:95–103.
140. Wu, M. and Follmann, D. A. (1999). Use of summary measures to adjust for informative missing-ness in repeated measures with random effects. Biometrics, 55:75–84.
141. Xu, J. (2007). Methods for intermittent missing responses in longitudinal data. PhD thesis, University of Wisconsin, Madison.
142. Xu, L. and Shao, J. (2009). Estimation in longitudinal or panel data models with random-effect-based missing responses. Biometrics, 65:1175–1183.
143. Yang, S. and Kim, J. K. (2013). Likelihood-based inference with missing data under missing-at-random. Unpublished manuscript.
144. Yang, S., Kim, J. K., and Zhu, Z. (2013). Parametric fractional imputation using adjusted profile likelihood for linear mixed models with nonignorable missing data. Statistics and Its Interface, In press.
145. Zhou, M. and Kim, J. K. (2012). An efficient method of estimation for longitudinal surveys with monotone missing data. Biometrika, 99:631–648.