Cross-validation and the estimation of conditional probability densities

Journal of the American Statistical Association

Volumn 99, Issue 468, 2004, Pages 1015-1026

  Hall, Peter ^a   Racine, Jeff ^b   Li, Qi ^c  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b SYRACUSE UNIVERSITY   (United States)

^c TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Bandwidth choice; Binary data; Categorical data; Continuous data; Dimension reduction; Discrete data; Kernel methods; Mixed data: Nonparametric density estimation; Relevant and irrelevant data; Smoothing parameter choice

Indexed keywords

EID: 10144254861     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214504000000548     Document Type: Article

References (30)

1. Aitchison, J., and Aitken, C. G. G. (1976), Mullivariate Binary Discrimination by the Kernel Method, Biometrika, 63, 413-420.
2. Bowman, A. W. (1984), An Alternative Method of Cross-Validation for the Smoothing of Density Estimates, Biometrika, 71, 353-360.
3. Burman, P. (1987), Smoothing Sparse Contingency Tables, Sankhyā, Ser. A, 49, 24-36.
4. Fan, J., and Yim, T. H. (2004), A Data-Driven Method for Estimating Conditional Densities, Research Report 2003-05, Institute of Mathematical Sciences, Chinese University of Hong Kong.
5. Friedman, J. H., and Stuetzle, W. (1981), Projection Pursuit Regression, Journal of the American Statistical Association, 76, 817-823.
6. Friedman, J. H., Stuetzle, W., and Schroeder, A. (1984), Projection Pursuit Density Estimation, Journal of the American Statistical Association, 79, 599-608.
7. Habhema, J. D. F., Hermans, J., and Van den Broek, K. (1974), A Stepwise Discriminant Analysis Program Using Density Estimation, in Compstat 1974, ed. G. Bruckmann, Vienna: Physica-Verlag, pp. 101-110.
8. Hahn, J. (1998), On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects, Econometrica, 66, 315-331.
9. Hall, P. (1983a), Orthogonal Series Methods for Both Qualitative and Quantitative Data, The Annals of Statistics, 11, 1004-1007.
10. _ (1983b), Large Sample Optimality of Least Squares Cross-Validation in Density Estimation, The Annals of Statistics 11, 1156-1174.
11. _ (1985), Asymptotic Theory of Minimum Integrated Square Error for Multivariate Density Estimation, in Multivariate Analysis VI, ed. P. R. Krishnaiah, Amsterdam: North-Holland, pp. 289-309.
12. Hall, P., and Marron, J. S. (1987), Extent to Which Least-Squares Cross-Validation Minimises Integrated Square Error in Nonparametric Density Estimation, Probability Theory and Related Fields, 74, 567-581.
13. Hall, P., and Titterington, D. M. (1987), On Smoothing Sparse Multinomial Data, Australian Journal Statistics, 29, 19-37.
14. Hirano, K., Imbens, G., and Ridder, G. (2002), Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score, Econometrica, 71, 1161-1189.
15. Horowitz, J. (2001), Nonparametric Estimation of a Generalized Additive Model With an Unknown Link Function, Econometrica, 69, 499-513.
16. Huber, P. J. (1985), Projection Pursuit (with discussion), The Annals of Statistics, 13, 435-525.
17. Jones, M. C., and Sibson, R. (1987), What Is Projection Pursuit? (with discussion), Journal of the Royal Statistical Society, Ser. A, 150, 1-36.
18. Kalbfleisch, J., and Prentice, R. (1980), The Statistical Analysis of Failure Time Data, New York: Wiley.
19. Klein, R., and Spady, R. (1993), An Efficient Semiparametric Estimator for Binary Response Models, Econometrica, 61, 387-422.
20. Lewbel, A., and Linton, O. (2002), Nonparametric Censored and Truncated Regression, Econometrica, 70, 765-779.
21. Mroz, T. A. (1987), The Sensitivity of an Empirical Model of Married Women's Hours of Work to Economic and Statistical Assumptions, Econometrica, 55, 765-799.
22. Li, Q., and Racine, J. S. (2003), Nonparametric Estimation of Joint Distribution With Mixed Continuous and Categorical Data, Journal of Mullivariate Analysis, 86, 266-292.
23. Powell, J. L., Stock, J. H., and Stoker, T. M. (1989), Semiparametric Estimation of Index Coefficients, Econometrica, 57, 1403-1430.
24. Rio, E. (1996), Vitesses de Convergence Dans le Principe d'Invariance Faible Pour la Fonction de Répartition Empirique Multivariée, Comptes Rendus de l'Academie des Sciences, Série I Math., 322, 169-172.
25. Rudemo, M. (1982), Empirical Choice of Histograms and Kernel Density Estimators, Scandinavian Journal of Statistics, 9, 65-78.
26. Sain, S. R. (2001), Bias Reduction and Elimination With Kernel Estimators, Communications in Statistics Theory Methods, 30, 1869-1888.
27. Simonoff, J. S. (1996), Smoothing Methods in Statistics, New York: Springer-Verlag.
28. Stone, C. J. (1984), An Asymptotically Optimal Window Selection Rule for Kernel Density Estimates, The Annals of Statistics, 12, 1285-1297.
29. Tutz, G. (1991), Sequential Models in Categorical Regression, Computational Statistics and Data Analysis, 11, 275-295.
30. Wang, M. C., and van Ryzin, J. A. (1981), A Class of Smooth Estimators for Discrete Distributions, Biometrika, 68, 301-309.