We have to be discrete about this: A non-parametric imputation technique for missing categorical data

British Journal of Political Science

Volumn 43, Issue 2, 2013, Pages 425-449

  Cranmer, Skyler J ^a   Gill, Jeff ^b  

^a UNIVERSITY OF NORTH CAROLINA   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84875140733     PISSN: 00071234     EISSN: 14692112     Source Type: Journal    
DOI: 10.1017/S0007123412000312     Document Type: Review

References (97)

1. The term 'missing data' can mean either missing values (e.g. item non-response in a survey) or missing observations such as refusal to take an entire survey. Throughout this work, we use the term exclusively to mean the first case.
2. Rein Taagepera and Matthew Soberg Shugart, Seats and Votes: The Effects and Determinants of Electoral Systems (New Haven, Conn.: Yale University Press, 1989).
3. Peter Mair and Ingrid van Biezen, 'Party Membership in Twenty European Democracies, 1980-2000', Party Politics, 7 (2001), 5-21.
4. Harvey D. Palmer and Guy D. Whitten, 'The Electoral Impact of Unexpected Inflation and Economic Growth', British Journal of Political Science, 29 (1999), 623-39.
5. Dan Reiter, 'Does Peace Nurture Democracy?' Journal of Politics, 63 (2001), 935-48.
6. Recent book-length works on these topics include: Anastasios A. Tsiatis, Semiparametric Theory and Missing Data (New York: Springer, 2010);
7. Craig K. Enders, Applied Missing Data Analysis (New York: The Guilford Press, 2010);
8. Ming T. Tan, Guo-Liang Tian and Kai Wang Ng, Bayesian Missing Data Problems: EM, Data Augmentation and Noniterative Computation (New York: Chapman & Hall/CRC, 2009);
9. Geert Molenberghs and Michael G. Kenward, Missing Data in Clinical Studies (New York: Wiley, 2007);
10. Patrick E. McKnight, Katherine M. McKnight, Souraya Sidani and Aurelio Jose Figueredo, Missing Data: A Gentle Approach (New York: The Guilford Press, 2007).
11. Phil H. Rees and Oliver Duke-Williams, 'Methods for Estimating Missing Data on Migrants in the 1991 British Census', International Journal of Population Geography, 3 (1997), 323-68.
12. Rees and Duke-Williams, 'Methods for Estimating Missing Data on Migrants in the 1991 British Census'.
13. Roderick J. A. Little and Donald B. Rubin, Statistical Analysis with Missing Data, 2nd edn (New York: Wiley, 2002), p. 42.
14. Paul D. Allison, Missing Data (Thousand Oaks, Calif.: Sage, 2001);
15. Little and Rubin, Statistical Analysis with Missing Data;
16. Roderick J. A. Little, 'Regression with Missing X's: A Review', Journal of the American Statistical Association, 87 (1992), 1227-37;
17. Roderick J. A. Little, 'Approximately Calibrated Small Sample Inference about Means from Bivariate Normal Data with Missing Values', Computational Statistics & Data Analysis, 7 (1988), 161-78;
18. Donald B. Rubin, 'Inference and Missing Data (with Discussion)', Biometrika, 63 (1976), 581-92;
19. Gary King, James Honaker, Anne Joseph and Kenneth Scheve, 'Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation', American Political Science Review, 95 (2001), 49-69.
20. King, Honaker, Joseph and Scheve, 'Analyzing Incomplete Political Science Data';
21. James Honaker and Gary King, 'What to Do about Missing Values in Time-Series Cross-Section Data', American Journal of Political Science, 54 (2010), 561-81.
22. Rubin, 'Inference and Missing Data';
23. King, Honaker, Joseph and Scheve, 'Analyzing Incomplete Political Science Data'; Little and Rubin, Statistical Analysis with Missing Data.
24. Little and Rubin, Statistical Analysis with Missing Data, p. 12.
25. King, Honaker, Joseph and Scheve, 'Analyzing Incomplete Political Science Data'.
26. Andrew Gelman and Jennifer Hill, Data Analysis Using Regression and Multilevel/Hierarchical Models (New York: Cambridge University Press, 2007), pp. 540-1.
27. John C. Bailar III and Barbara A. Bailar, 'Comparison of the Biases of the "Hot Deck" Imputation Procedure with an "Equal Weights" Imputation Procedure', Symposium on Incomplete Data: Panel on Incomplete Data of the Committee on National Statistics, National Research Council, 1997), 422-47;
28. Brenda. G. Cox, 'The Weighted Sequential Hot Deck Imputation Procedure', Proceedings of the Section on Survey Research Methods, American Statistical Association (1980), 721-6;
29. Richard C. Rockwell, 'An Investigation of Imputation and Differential Quality of Data in the 1970 Census', Journal of the American Statistical Association, 70 (1975), 39-42.
30. Little and Rubin, Statistical Analysis with Missing Data; Donald B. Rubin, Multiple Imputation for Nonresponse in Surveys (New York: Wiley, 2004).
31. Rubin, 'Inference and Missing Data';
32. Donald B. Rubin, 'Formalizing Subjective Notions about the Effect of Nonrespondents in Sample Surveys', Journal of the American Statistical Association, 72 (1977), 538-43;
33. Donald B. Rubin, 'Multiple Imputations in Sample Surveys: A Phenomenological Bayesian Approach to Nonresponse', Proceedings of the Survey Research Methods Section of the American Statistical Association (1978), 20-34;
34. Donald B. Rubin and Nathaniel Schenker, 'Multiple Imputation for Interval Estimation from Simple Random Samples with Ignorable Nonresponse', Journal of the American Statistical Association, 81 (1986), 366-74;
35. Donald B. Rubin, 'Statistical Matching Using File Concatenation with Adjusted Weights and Multiple Imputations', Journal of Business and Economic Statistics, 4 (1986), 87-94;
36. Rubin, Multiple Imputation for Nonresponse in Surveys;
37. Donald B. Rubin, J. L. Schafer and Nathaniel Schenker, 'Imputation Strategies for Missing Values in Post-Enumeration Surveys', Survey Methodology, 14 (1988), 209-21;
38. Donald B. Rubin, 'Multiple Imputation after 18 + Years', Journal of the American Statistical Association, 91 (1996), 473-89.
39. Jae Kwang Kim, 'Finite Sample Properties of Multiple Imputation Estimators', Annals of Statistics, 32 (2004), 766-83;
40. Jae Kwang Kim and Wayne Fuller, 'Fractional Hot Deck Imputation', Biometrika, 91 (2004), 559-78;
41. Wayne Fuller and Jae Kwang Kim, 'Hot Deck Imputation for the Response Model', Statistics Canada, 31 (2005), 139-49.
42. King, Honaker, Joseph and Scheve, 'Analyzing Incomplete Political Science Data';
43. Honaker and King, 'What to Do about Missing Values in Time-Series Cross-Section Data';
44. Joseph L. Schafer, Analysis of Incomplete Multivariate Data (New York: Chapman & Hall/CRC, 1997).
45. King, Honaker, Joseph and Scheve, 'Analyzing Incomplete Political Science Data';
46. Honaker and King, 'What to Do about Missing Values in Time-Series Cross-Section Data'.
47. The articles describing the Amelia procedure have received over 330 ISI citations as of this writing.
48. Little and Rubin, Statistical Analysis with Missing Data;
49. Marie Reilly, 'Data Analysis Using Hot Deck Multiple Imputation', The Statistician, 42 (1993), 307-13;
50. Kim, 'Finite Sample Properties of Multiple Imputation Estimators';
51. Kim and Fuller, 'Fractional Hot Deck Imputation';
52. Fuller and Kim, 'Hot Deck Imputation for the Response Model'.
53. Graham Kalton and Leslie Kish, 'Some Efficient Random Imputation Methods', Communications in Statistics-Theory and Methods, 13 (1984), 1919-39;
54. Robert E. Fay, 'Alternative Paradigms for the Analysis of Imputed Survey Data', Journal of the American Statistical Association, 91 (1996), 490-8.
55. Reilly, 'Data Analysis Using Hot Deck Multiple Imputation'.
56. Reilly, 'Data Analysis Using Hot Deck Multiple Imputation'.
57. J. C. Gower, 'A General Coefficient of Similarity and Some of its Properties', Biometrics, 27 (1971), 857-71.
58. Paul R. Rosenbaum and Donald B. Rubin, 'The Central Role of the Propensity Score in Observational Studies for Causal Effects', Biometrika, 70 (1983), 41-55.
59. Kim, 'Finite Sample Properties of Multiple Imputation Estimators';
60. Kim and Fuller, 'Fractional Hot Deck Imputation';
61. Fuller and Kim, 'Hot Deck Imputation for the Response Model'.
62. Kim, 'Finite Sample Properties of Multiple Imputation Estimators'.
63. Little and Rubin, Statistical Analysis with Missing Data;
64. Rubin, 'Multiple Imputations in Sample Surveys';
65. Rubin, Multiple Imputation for Nonresponse in Surveys;
66. Rubin, 'Multiple Imputation after 181 Years'.
67. Little and Rubin, Statistical Analysis with Missing Data.
68. Our software formats its output so that the output can be used seamlessly with the R package Zelig; Koske Imai, Gary King and Olivia Lau, 'Zelig: Everyone's Statistical Software', Comprehensive R Archive Network (2006).
69. This has the advantage of allowing the user to run, in a single line of code, a great variety of models on the multiple imputed datasets and have the combination handled automatically.
70. King, Honaker, Joseph and Scheve, 'Analyzing Incomplete Political Science Data';
71. Honaker and King, 'What to Do about Missing Values in Time-Series Cross-Section Data'.
72. Stef van Buuren, Jaap P. L. Brand, C. G. M. Groothuis-Oudshoorn and Donald B. Rubin, 'Fully Conditional Specification in Multivariate Imputation', Journal of Statistical Computation and Simulation, 76 (2006), 1049-64;
73. Stef van Buuren, 'Multiple Imputation of Discrete and Continuous Data by Fully Conditional Specification', Statistical Methods in Medical Research, 16 (2007), 219-42.
74. A. P. Dempster, N. M. Laird and D. B. Rubin, 'Maximum Likelihood from Incomplete Data via the EM Algorithm', Journal of the Royal Statistical Society, Series B, 39 (1977), 493-510.
75. We also ran experiments where the missing values were MCAR, but, as we would expect theoretically, no method was biased under those conditions.
76. Seymour M. Lipset, 'Some Social Requisites of Democracy: Economic Development and Political Legitimacy', American Political Science Review, 53 (1959), 69-105.
77. Phillips Cutright, 'National Political Development: Its Measurement and Social Correlates', in Nelson W. Polsby, Robert A. Dentler and Paul A. Smith, eds, Politics and Social Life: An Introduction to Political Behavior (Boston, Mass.: Houghton Mifflin, 1963), 569-81;
78. Karl W. Deutsch, 'Social Mobilization and Political Development', American Political Science Review, 55 (1961), 493-510;
79. Robert A. Dahl, Polyarchy: Participation and Opposition (New Haven, Conn.: Yale University Press, 1971);
80. Ross E. Burkhart and Michael S. Lewis-Beck, 'The Economic Development Thesis', American Political Science Review, 88 (1994), 903-10;
81. John B. Londregan and Keith T. Poole, 'Does High Income Promote Democracy?' World Politics, 49 (1996) 1-30.
82. Adam Przeworski, Democracy and the Market: Political and Economic Reforms in Eastern Europe (New York: Cambridge University Press, 1991);
83. Adam Przeworski, Democracy and the Market: Political and Economic Reforms in Eastern Europe (New York: Cambridge University Press, 1991);
84. Adam Przeworski and Fernando Limongi, 'Political Regimes and Economic Growth', Journal of Economic Perspectives, 7 (1993), 51-69;
85. Adam Przeworski, Michael E. Alvarez, Jose A. Cheibub and Fernando Limongi, 'What Makes Democracies Endure?' Journal of Democracy, 7 (1996), 39-55;
86. Adam Przeworski and Fernando Limongi, 'Modernization: Theories and Facts', World Politics, 49 (1997), 155-83;
87. Adam Przeworski, Michael E. Alvarez, Jose A. Cheibub and Fernando Limongi, Democracy and Development: Political Institutions and Well-Being in the World, 1950-1990 (New York: Cambridge University Press, 2000).
88. Przeworski, Alvarez, Cheibub and Limongi, Democracy and Development.
89. Carles Boix, Democracy and Redistribution (New York: Cambridge University Press, 2002);
90. Carles Boix and Susan Stokes, 'Endogenous Democratization', World Politics, 55 (2003), 517-49;
91. David L. Epstein, Robert Bates, Jack Goldstone, Ida Kristensen and Sharyn O'Halloran, 'Democratic Transitions', American Journal of Political Science, 50 (2006), 551-69.
92. Przeworski, Alvarez, Cheibub and Limongi, Democracy and Development.
93. Przeworski, Alvarez, Cheibub and Limongi, Democracy and Development.
94. Przeworski, Alvarez, Cheibub and Limongi, Democracy and Development.
95. The true results are true to the extent that they are the results actually obtained by analysing the complete data. They are not true in the more traditional sense of being the true population parameters an empirical analysis attempts to estimate.
96. Przeworski, Alvarez, Cheibub and Limongi, Democracy and Development.
97. Przeworski, Alvarez, Cheibub and Limongi, Democracy and Development.