Indices of robustness for sample representation

Sociological Methodology

Volumn 37, Issue 1, 2007, Pages 349-392

  Frank, Kenneth ^a   Min, Kyung Seok ^b  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b Korea Institute for Curriculum and Evaluation   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34548761916     PISSN: 00811750     EISSN: 14679531     Source Type: Journal    
DOI: 10.1111/j.1467-9531.2007.00186.x     Document Type: Article

References (77)

1. Abbott, A. 1998 The Causal Devolution Sociological Methods and Research 27 : 148 81.
2. Allison, P. D. 2000. "Multiple Imputation for Missing Data Sociological Methods and Research 28 : 301 9.
3. Birnbaum, M. H., and B. A. Mellers. 1989. "Mediated Models for the Analysis of Confounded Variables and Self-Selected Samples Journal of Educational Statistics 14 : 121 40.
4. Bohrnstedt, G. W., and B. M. Stecher. 2002. What We Have Learned About Class Size Reduction in California. Sacramento, CA : California Department of Education.
5. Cohen, J., and P. Cohen. 1983. Applied Multiple Regression/Correlation Analysis for Behavioral Science. Hillsdale, NJ : Lawrence Erlbaum.
6. Cole, W. M. 2005 International Human Rights Covenants, 1966-1999 American Sociological Review 70 (3 472 95.
7. Collins, L. M., J. Shafer, and C. Kam. 2001 A Comparison of Restrictive Strategies in Modern Missing Data Procedures special issue) Psychological Methods 6 : 330 51.
8. Cook, T. D. 2002 Randomized Experiments in Education: Why Are They So Rare? Working Paper No. 02-19, Institute for Policy Research, Northwestern University.
9. Cook, T. D., and D. T. Campbell. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago, IL : Rand McNally.
10. Copas, J., and H.G. Li. 1997 Inference for Non-random Samples Journal of the Royal Statistical Society B 59 : 55 96.
11. Cornfield, J., and J. W. Tukey. 1956 Average Values of Mean Squares in Factorials Annals of Mathematical Statistics 27 : 907 49.
12. Cronbach, L. J. 1982. Designing Evaluations of Educational and Social Programs. San Francisco : Jossey Bass.
13. Cronbach, L. J., and R. E. Snow. 1977. Aptitudes and Instructional Methods: A Handbook of Research on Interactions. New York : Irvington.
14. CSR Research Consortium. 2000 Class Size Reduction in California: The 1998-99 Evaluation Findings http://www.classize.org/summary/98-99/).
15. Cudeck, R., and M. Browne. 1983 Cross-Validation of Covariance Structures Multivariate Behavioral Research 18 : 147 67.
16. D'Agostino, R. B., Jr., and D. B. Rubin. 2000 Estimating and Using Propensity Scores with Partially Missing Data Journal of the American Statistical Association 95 : 749 59.
17. Daniels, M. J., and J. W. Hogan. 2000 Reparameterizing the Pattern Mixture Model for Sensitivity Analyses Under Informative Dropout Biometrics 56 : 1241 48.
18. Day, N. E. 1969 Estimating the Components of a Mixture of Normal Distributions." Biometrika 56 (3 463 74.
19. Dehejia, R. H., and S. Wahba. 1999 Causal Effects in Nonexperimental Studies: Reevaluating the Evaluation of Training Programs Journal of the American Statistical Association 94 : 1053 62.
20. Diprete, T., and M. Gangl. 2004 Assessing Bias in the Estimation of Causal Effects: Rosenbaum Bounds on Matching Estimators and Instrumental Variables Estimation with Imperfect Instruments Pp. 271 310 in Sociological Methodology, vol. 34, edited by Ross M. Stolzenberg. Boston, MA : Blackwell Publishing.
21. Donoho, D. L., and P. J. Huber. 1983 The Notion of Breakdown Point Pp. 157 84 in A Festschrift for Erich L. Lehman, edited by P. J. Bickel, K. Doksun, and J. L. Hodge, Jr. Belmont, CA : Wadsworth International Group.
22. Duval, S., and R. Tweedie. 2000 Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis Biometrics 56 : 455 63.
23. Ed Source on Line. 2003. Rankings and Estimates. National Education Association.
24. Finn, J. D., and C. M. Achilles. 1990 Answers and Questions About Class Size: A Statewide Experiment American Educational Research Journal 27 : 557 77.
25. Fisher, R. A. 1924 The Distribution of the Partial Correlation Coefficient Metron 3 : 329 32.
26. Fisher, R. A. 1973. Statistical Methods for Research Workers. New York : Hafner.
27. Frank, K. A. 2000 Impact of a Confounding Variable on a Regression Coefficient Sociological Methods and Research 29 : 147 94.
28. Gilbert, J. P., and F. Mosteller. 1972 The Urgent Need for Experimentation In On Equality of Educational Opportunity, edited by F. Mosteller and D. P. Moynihan. New York : Random House.
29. Gill, R. D., and J. M. Robins. 2001 Causal Inference for Complex Longitudinal Data: The Continuous Case Annals of Statistics 29 (6 1785 811.
30. Greenland, S. 2000 An Introduction to Instrumental Variables for Epidemiologists International Journal of Epidemiology 29 : 722 29.
31. Hanushek, E. A. 1999 Some Findings from an Independent Investigation of the Tennessee STAR Experiment and from Other Investigations of Class Size Effects Educational Evaluation and Policy Analysis 21 : 143 63.
32. Harding, D. 2003 Counterfactual Models of Neighborhood Effect: The Effect of Neighborhood Poverty and High School Dropout on Teenage Pregnancy American Journal of Sociology 109 : 676 719.
33. Heckman, J. J. 2005 The Scientific Model of Causality Pp. 1 97 in Sociological Methodology, vol. 35, edited by Ross M. Stolzenberg. Boston, MA : Blackwell Publishing.
34. Hedges, L. 1992 Modeling Selection Effects in Meta-Analysis Statistical Science 7 : 246 55.
35. Holland, P. W. 1986 Statistics and Causal Inference Journal of the American Statistical Association 81 : 945 70.
36. Hunter, J. E. 1997 Needed: A Ban on the Significance Test American Psychological Society 8 (1 3 7.
37. Karinek, K., B. Entwisle, and A. Jampaklay. 2005 Social Ties and Urban Settlement among Tahi Immigrants American Sociological Review 70 (5 779 800.
38. Korinek, K., B. Entwisle, and A. Jampaklay. 2005 Through Thick and Thin Layers of Social Ties and Urban Settlement Among Thai Migrants American Sociological Review 70 (5 779 800.
39. Lee, P. M. 1989. Bayesian Statistics: An Introduction. New York : Oxford University Press.
40. Lindsay, B. G., and P. Basak. 1993 Multivariate Normal Mixtures: A Fast Consistent Method of Moments Journal of the American Statistical Association (88 468 76.
41. Little, R. J. A. 1992 Regression with Missing X's: A Review Journal of the American Statistical Association 87 : 1227 37.
42. Little, R. J. A., and D. B. Rubin. 1987. Statistical Analysis with Missing Data. New York : J. Wiley.
43. Mallard, G. 2005 Interpreters of the Literary Canon and Their Technical Instruments: The Case of Balzac Criticism American Sociological Review 70 (6 992 1010.
44. Manski, C. F. 1990 Nonparametric Bounds on Treatment Effects American Economic Review Papers and Proceedings 80 : 319 23.
45. Manski, C. F. 1995. Identification Problems in the Social Sciences. Cambridge, MA : Harvard University Press.
46. Marschak, J. 1953 Econometric Measurements for Policy and Prediction Pp. 1 26 in Studies in Econometric Method, edited by W. Hood and T. Koopmans. New York : Wiley.
47. McLachlan, G., and D. Peel. 2000. Finite Mixture Models. New York : Wiley.
48. Min, K.-S., and K. A. Frank. 2002 The Impact of Nonignorable Missing Data on the Inference of Regression Coefficients Presented at the annual meeting of Mid-Western Educational Research Association, October 16, Columbus, OH.
49. Morgan, S. L. 2001 Counterfactuals, Causal Effect Heterogeneity, and the Catholic School Effect on Learning Sociology of Education 74 : 341 74.
50. National Center for Educational Statistics (NCES). 2003. http://nces.ed.gov/pubs2003/hispanics/Section1.asp.
51. Nye, B., L.V. Hedges, and S. Konstantopoulos. 2000 Effects of Small Classes on Academic Achievement: The Results of the Tennessee Class Size Experiment American Educational Research Journal 37 : 123 51.
52. Nye, B. 2002 Do Low-Achieving Students Benefit More from Small Classes? Evidence from the Tennessee Class Size Experiment Education Evaluation and Policy Analysis 24 (3 201 17.
53. Orwin, R. G. 1983 A Fail-Safe N for Effect Size in Meta-Analysis Journal of Educational and Behavioral Statistics 8 : 157 59.
54. Pan, W., and K. A. Frank. 2004 A Probability Index of the Robustness of a Causal Inference Journal of Educational and Behavioral Statistics 28 : 315 37.
55. Raudenbush, S. W., and A. S. Bryk. 2002. Hierarchical Linear Models: Applications and Data Analysis Methods. 2nd ed. Newbury Park, CA : Sage.
56. Robins, J. 1987 A Graphical Approach to the Identification and Estimation of Causal Parameters in Mortality Studies with Sustained Exposure Periods Journal of Chronic Diseases 40 (2 1395 1615.
57. Robins J. M. 1989 The Analysis of Randomized and Non-Randomized AIDS Treatment Trials Using a New Approach to Causal Inference in Longitudinal Studies Pp. 113 159 in Health Services Research Methodology: A Focus on AIDS, edited by L. Sechrest, H. Freeman, and A. Mulley. Rockville, MD : U.S. Department of Health and Human Services, National Center for Health Services Research and Health Care Technology Assessment.
58. Robins, J., A. Rotnisky, and D. Scharfstein. 2000 Sensitivity Analysis for Selection Bias and Unmeasured Confounding in Missing Data and Causal Inference Models Pp. 1 95 in Statistical Models in Epidemiology, the Environment and Clinical Trials (The IMA Volumes in Mathematics and Its Applications), edited by E. Halloran and D. Berry. New York : Springer-Verlag.
59. Rosenbaum, P. R. 1986 Dropping Out of High School in the United States: An Observational Study Journal of Educational Statistics 11 (3 207 24.
60. Rosenbaum, P. R. 2002 Attribution Effects to Treatment in Matched Observational Studies. Journal of the American Statistical Association 97 : 183 92.
61. Rosenbaum, P. R., and D. B. Rubin. 1983 The Central Role of the Propensity Score in Observational Studies for Causal Effects Biometrika 70 (1 41 55.
62. Rosenthal, R. 1979 The "File-Drawer Problem" a Tolerance for Null Results Psychological Bulletin 86 : 638 41.
63. Rubin, D. B. 1974 Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies Journal of Educational Psychology 66 : 688 701.
64. Scharfstein, D. A. I. 2002 Generalized Additive Selection Models for the Analysis of Studies with Potentially Nonignorable Missing Data Biometrics 59 : 601 13.
65. Seltzer, M. H., J. Kim, and K. A. Frank. 2006 Studying the Sensitivity of Inferences to Possible Unmeasured ConfoundingVariables in Multisite Evaluations Paper presented at the American Educational Researcher Association, San Francisco, CA.
66. Shadish, W. R., T. D. Cook, and D. T. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston, MA : Houghton Mifflin.
67. Shadish, W. R., T. D. Cook, and L. C. Leviton. 1991. Foundations of Programme Evaluation: Theories of Practice. London : Sage.
68. Sobel, M. E. 1995 Causal Inference in the Social and Behavioral Sciences Pp. 1 38 in Handbook of Statistical Modeling for the Social and Behavioral Sciences, edited by G. Arminger, C. C. Clogg, and M. E. Sobel. New York : Plenum Press.
69. Sobel, M. E. 1996 An Introduction to Causal Interface Sociological Methods and Research 24 (3 353 79.
70. Sobel, M. E. 1998 Causal Inference in Statistical Models of the Process of Socioeconomic Achievement: A Case Study Sociological Methods and Research 27 : 318 48.
71. Suppes, P. 1970. A Probabilistic Theory of Causality. Amsterdam : North-Holland.
72. Tennessee State Department of Education. 1990 The State of Tennessee's Student/Teacher Achievement Ratio (STAR) Project." Retrieved April 17, 2007 http://www.heros-inc.org/summary.pdf).
73. U.S. Department of Education. 2002. Report on Scientifically Based Research Supported by U.S. Department of Education. Retrieved April 17, 2007 (http://www.excelgov.org/displayContent.asp?Keyword=prppcEvidence).
74. Wainer, H., and D. H. Robinson. 2003 Shaping Up the Practice of Null Hypothesis Significance Testing Educational Researcher 32 : 22 30.
75. Wilkinson, L., and Task Force on Statistical Inference. 1999 Statistical Methods in Psychology Journals: Guidelines and Explanations American Psychologist 54 : 594 604.
76. Winship, C., and M. Sobel. 2004 Causal Inference in Sociological Studies Pp. 481 503 in Handbook on Data Analysis, edited by M. Hardy and A. Bryman. Thousand Oaks, CA : Sage.
77. Worm, B., et al. 2006 Impacts of Biodiversity Loss on Ocean Ecosystem Services Science (314 787 90.