The indirect method: Inference based on intermediate statistics-a synthesis and examples

Statistical Science

Volumn 19, Issue 2, 2004, Pages 239-263

  Jiang, Wenxin ^a   Turnbull, Bruce ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b Department of Obstetrics Gynecology   (United States)

Author keywords

Asymptotic normality; Bias correction; Consistency; Efficiency; Estimating equations; Generalized method of moments; Graphical models; Indirect inference; Indirect likelihood; Measurement error; Missing data; Model selection; Naive estimators; Omitted covariates

Indexed keywords

EID: 14544276813     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/088342304000000152     Document Type: Review

References (89)

1. ANDERSEN, P. K., BORGAN, Ø., GILL, R. D. and KEIDING, N. (1993). Statistical Models Based on Counting Processes, Springer, New York.
2. BERK, R. H. (1966). Limiting behavior of posterior distributions when the model is incorrect. Ann. Math. Statist. 37 51-58. [Correction 37 745-746.]
3. BICKEL, P. (1988). Robust estimation. In Encyclopedia of Statistical Sciences (S. Kotz and N. L. Johnson, eds.) 8 157-163. Wiley, New York.
4. BICKEL, P. J. and DOKSUM, K. A. (2001). Mathematical Statistics 1, 2nd ed. Prentice Hall, Upper Saddle River, NJ.
5. BOX, G. E. P. and TIAO, G. C. (1973). Bayesian Inference in Statistical Analysis. Addison-Wesley, London.
6. BRESLOW, N. (1990). Tests of hypotheses in overdispersed Poisson regression and other quasi-likelihood models. J. Amer. Statist. Assoc. 85 565-571.
7. BROZE, L. and GOURIÉROUX, C. (1998). Pseudo-maximum likelihood method, adjusted pseudo-maximum likelihood method and covariance estimators. J. Econometrics 85 75-98.
8. CARRASCO, M. and FLORENS, J.-P. (2002). Simulation-based method of moments and efficiency. J. Bus. Econom. Statist. 20 482-492.
9. CARROLL, R. J., RUPPERT, D. and STEFANSKI, L. A. (1995). Measurement Error in Nonlinear Models. Chapman and Hall, London.
10. CHIANG, C. L. (1956). On regular best asymptotically normal estimates. Ann. Math. Statist. 27 336-351.
11. CLARK, L. C., COMBS, G. F., TURNBULL, B. W., SLATE, E. H., CHALKER, D. K., CHOW, J., DAVIS, L. S., GLOVER, R. A., GRAHAM, G. F., GROSS, E. G., KRONGRAD, A., LESHER, J. L., PARK, H. K., SANDERS, B. B., SMITH, C. L., TAYLOR, J. R. and THE NUTRITIONAL PREVENTION OF CANCER STUDY GROUP (1996). Effects of selenium supplementation for cancer prevention in patients with carcinoma of the skin: A randomized controlled trial. J. American Medical Association 276 1957-1963; Editorial 1984-1985.
12. COX, D. R. (1962). Further results on tests of separate families of hypotheses. J. Roy. Statist. Soc. Ser. B 24 406-424.
13. COX, D. R. (1972). Regression models and life-tables (with discussion). J. Roy. Statist. Soc. Ser. B 34 187-220.
14. COX, D. R. (1983). Some remarks on overdispersion. Biometrika 70 269-274.
15. COX, D. R. and WERMUTH, N. (1990). An approximation to maximum likelihood estimates in reduced models. Biometrika 77 747-761.
16. CROWDER, M. (1985). Gaussian estimation for correlated binomial data. J. Roy. Statist. Soc. Ser. B 47 229-237.
17. CROWDER, M. (2001). On repeated measures analysis with misspecified covariance structure. J. R. Stat. Soc. Ser. B Stat. Methodol. 63 55-62.
18. DAWID, A. P. (1998). Conditional independence. In Encyclopedia of Statistical Sciences, Update Volume (S. Kotz, C. B. Read and D. L. Banks, eds.) 2 146-155. Wiley, New York.
19. DE LUNA, X. and GENTON, M. G. (2001). Robust simulationbased estimation of ARMA models. J. Comput. Graph. Statist. 10 370-387.
20. DE LUNA, X. and GENTON, M. G. (2002). Simulation-based inference for simultaneous processes on regular lattices. Stat. Comput. 12 125-134.
21. DEMPSTER, A. P., LAIRD, N. M. and RUBIN, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B 39 1-38.
22. DRAPER, D. (1995). Assessment and propagation of model uncertainty (with discussion). J. Roy. Statist. Soc. Ser. B 57 45-97.
23. FERGUSON, T. S. (1958). A method of generating best asymptotically normal estimates with application to the estimation of bacterial densities. Ann. Math. Statist. 29 1046-1062.
24. FISHER, R. A. (1946). Statistical Methods for Research Workers, 10th ed. Oliver and Boyd, Edinburgh.
25. FLOREY, C. DU V., MELIA, R. J. W., CHINN, S., GOLDSTEIN, B. D., BROOKS, A. G. P., JOHN, H. H., CRAIGHEAD, E. B. and WEBSTER, X. (1979). The relation between respiratory illness in primary schoolchildren and the use of gas for cooking, III-Nitrogen dioxide, respiratory illness and lung function. International J. Epidemiology 8 347-353.
26. FOUTZ, R. V. and SRIVASTAVA, R. C. (1977). The performance of the likelihood ratio test when the model is incorrect. Ann. Statist. 5 1183-1194.
27. FULLER, W. A. (1987). Measurement Error Models. Wiley, New York.
28. GAIL, M. H., SANTNER, T. and BROWN, C. C. (1980). An analysis of comparative carcinogenesis experiments based on multiple times to tumor. Biometrics 36 255-266.
29. GAIL, M. H., WIEAND, S. and PIANTADOSI, S. (1984). Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates. Biometrika 71 431-444.
30. GALLANT, A. R. and LONG, J. R. (1997). Estimating stochastic differential equations efficiently by minimum chi-squared. Biometrika 84 125-141.
31. GALLANT, A. R. and TAUCHEN, G. (1996), Which moments to match? Econometric Theory 12 657-681.
32. GALLANT, A. R. and TAUCHEN, G. (1999). The relative efficiency of method of moments estimators. J. Econometrics 92 149-172.
33. GENTON, M. G. and DE LUNA, X. (2000). Robust simulationbased estimation. Statist. Probab. Lett. 48 253-259.
34. GENTON, M. G. and RONCHETTI, E. (2003). Robust indirect inference. J. Amer. Statist. Assoc. 98 67-76.
35. GOURIÉROUX, C. and MONFORT, A. (1993). Simulation-based inference-A survey with special reference to panel-data models. J. Econometrics 59 5-33.
36. GOURIÉROUX, C., MONFORT, A. and RENAULT, E. (1993). Indirect inference. J. Applied Econometrics 8S 85-118.
37. HÁJEK, J. (1970). A characterization of limiting distributions of regular estimates. Z. Wahrsch. Verw. Gebiete 14 323-330.
38. HAMPEL, F. R. (1968). Contributions to the theory of robust estimation. Ph.D. dissertation, Univ. California, Berkeley.
39. HAMPEL, F. R., RONCHETTI, E. M., ROUSSEEUW, P. J. and STAHEL, W. A. (1986). Robust Statistics. The Approach Based on Influence Functions. Wiley, New York.
40. HAND, D. and CROWDER, M. (1996). Practical Longitudinal Data Analysis. Chapman and Hall/CRC, London.
41. HANSEN, L. P. (1982). Large sample properties of generalized method of moments estimators. Econometrica 50 1029-1054.
42. HAUSMAN, J. A. (1978). Specification tests in econometrics. Econometrica 46 1251-1271.
43. HECKMAN, J. (1976). The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. Annals of Economic and Social Measurement 5 475-492.
44. HENGARTNER, N. W. and SPERLICH, S. (2002). Rate optimal estimation with the integration method in the presence of many covariates. Working Paper 01-69, Carlos III de Madrid. Available at http://halweb.uc3m.es/esp/Personal/personas/stefan/papers/ may2002.pdf.
45. HUBER, P. J. (1964). Robust estimation of a location parameter. Ann. Math. Statist. 35 73-101.
46. HUBER, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. Proc. Fifth Berkeley Symp. Math. Statist. Probab. 1 221-233. Univ. California Press.
47. IMBENS, G. W. (2002). Generalized method of moments and empirical likelihood. J. Bus. Econom. Statist. 20 493-506.
48. JIANG, W. (1996). Aspects of misspecification in statistical models: Applications to latent variables, measurement error, random effects, omitted covariates and incomplete data. Ph.D. dissertation, Cornell Univ.
49. JIANG, W. and TURNBULL, B. W. (2003). The indirect method-Robust inference based on intermediate statistics. Technical Report 1377, School of Operations Research and Industrial Engineering, Cornell Univ. Available at http://www.orie.cornell. edu/trlist/trlist.html.
50. JIANG, W., TURNBULL, B. W. and CLARK, L. C. (1999). Semiparametric regression models for repeated events with random effects and measurement error. J. Amer. Statist. Assoc. 94 111-124.
51. KENT, J. T. (1982). Robust properties of likelihood ratio tests. Biometrika 69 19-27.
52. KUK, A. Y. C. (1995). Asymptotically unbiased estimation in generalised linear models with random effects. J. Roy. Statist. Soc. Ser. B 57 395-407.
53. LAWLESS, J. F. and NADEAU, C. (1995). Some simple robust methods for the analysis of recurrent events. Technometrics 37 158-168.
54. LEADERER, B. P., ZAGRANISKI, R. T., BERWICK, M. and STOLWIJK, J. A. J. (1986). Assessment of exposure to indoor air contaminants from combustion sources: Methodology and application. American J. Epidemiology 124 275-289.
55. LE CAM, L. (1956). On the asymptotic theory of estimation and testing hypotheses. Proc. Third Berkeley Symp. Math. Statist. Probab. 1 129-156. Univ. California Press.
56. LEHMANN, E. L. and CASELLA, G. (1998). Theory of Point Estimation, 2nd ed. Springer, New York.
57. LIANG, K. Y. and ZEGER, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika 73 13-22.
58. LITTLE, R. J. A. (1994). A class of pattern-mixture models for normal incomplete data. Biometrika 81 471-483.
59. MACKINNON, J. G. and SMITH, A. A. (1998). Approximate bias correction in econometrics. J. Econometrics 85 205-230.
60. MAMMEN, E., LINTON, O. and NIELSEN, J. (1999). The existence and asymptotic properties of a backfilling projection algorithm under weak conditions. Ann. Statist. 27 1443-1490.
61. MARDIA, K. V., KENT, J. T. and BIBBY, J. (1979). Multivariate Analysis. Academic Press, New York.
62. MÁTYÁS, L., ed. (1999). Generalized Method of Moments Estimation. Cambridge Univ. Press.
63. MCCULLAGH, P. and NELDER, J. A. (1989). Generalized Linear Models, 2nd ed. Chapman and Hall, New York.
64. MCFADDEN, D. (1989). A method of simulated moments for estimation of discrete response models without numerical integration. Econometrica 57 995-1026.
65. NEWEY, W. K. (1994). Kernel estimation of partial means and a general variance estimator. Econometric Theory 10 233-253.
66. NEWEY, W. K. and MCFADDEN, D. (1994). Large sample estimation and hypothesis testing, In Handbook of Econometrics (R. F. Engle and D. L. McFadden, eds.) 4 2111-2245. NorthHolland, Amsterdam.
67. PARES, A. and POLLARD, D. (1989). Simulation and the asymptotics of optimization estimators. Econometrica 57 1027-1057.
68. QU, A., LINDSAY, B. G. and LI, B. (2000). Improving generalised estimating equations using quadratic inference functions. Biometrika 87 823-836.
69. QUANDT, R. E. and RAMSEY, J. B. (1978). Estimating mixtures of normal distributions and switching regressions (with discussion). J. Amer. Statist. Assoc. 73 730-752.
70. RAO, C. R. (1973). Linear Statistical Inference and Its Applications, 2nd ed. Wiley, New York.
71. REID, N. (1988). Influence functions. In Encyclopedia of Statistical Sciences (S. Kotz and N. L. Johnson, eds.) 4 117-119. Wiley, New York.
72. RONCHETTI, E. and TROJANI, F. (2001). Robust inference with GMM estimators. J. Econometrics 101 37-69.
73. ROSNER, B., SPIEGELMAN, D. and WILLETT, W. C. (1990). Correction of logistic regression relative risk estimates and confidence intervals for measurement error: The case of multiple covariates measured with error. American J. Epidemiology 132 734-745.
74. ROTNITZKY, A. and WYPIJ, D. (1994). A note on the bias of estimators with missing data. Biometrics 50 1163-1170.
75. SCHMIDT, P. (1982). An improved version of the Quandt-Ramsey MGF estimator for mixtures of normal distributions and switching regressions. Econometrica 50 501-516.
76. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6 461-464.
77. SEN, P. K. and SINGER, J. M. (1993). Large Sample Methods in Statistics. Chapman and Hall, New York.
78. SEN, S. (1998). Confidence intervals for gene location: The effect of model misspecification and smoothing. Ph.D. dissertation, Dept. Statistics, Univ. Chicago.
79. SERFLING, R. J. (1980). Approximation Theorems of Mathematical Statistics. Wiley, New York.
80. TAYLOR, J. R. (1997). An Introduction to Error Analysis, 2nd ed. University Science Books, Sausalito, CA.
81. THOMPSON, H. F., GRUBBS, C. J., MOON, R. C. and SPORN, M. B. (1978). Continual requirement of retinoid for maintenance of mammary cancer inhibition. Proc. Annual Meeting of the American Association for Cancer Research 19 74.
82. TURNBULL, B. W., JIANG, W. and CLARK, L. C. (1997). Regression models for recurrent event data: Parametric random effects models with measurement error. Statistics in Medicine 16 853-864.
83. WEDDERBURN, R. W. M. (1974). Quasi-likelihood functions, generalized linear models and the Gauss-Newton method. Biometrika 61 439-447.
84. WEI, L. J., LIN, D. Y. and WEISSFELD, L. (1989). Regression analysis of multivariate incomplete failure time data by modeling marginal distributions. J. Amer. Statist. Assoc. 84 1065-1073.
85. WHITE, H. (1994). Estimation, Inference and Specification Analysis. Cambridge Univ. Press.
86. WHITTAKER, J. (1990). Graphical Models in Applied Multivariate Statistics. Wiley, New York.
87. WHITTEMORE, A. S. and KELLER, J. B. (1988). Approximations for regression with covariate measurement error. J. Amer. Statist. Assoc. 83 1057-1066.
88. WHITTLE, P. (1961). Gaussian estimation in stationary time series. Bull. Internat. Statist. Inst. 39 105-129.
89. WRIGHT, F. A. and KONG, A. (1997). Linkage mapping in experimental crosses: The robustness of single-gene models. Genetics 146 417-425.