Consistency of data-driven histogram methods for density estimation and classification

Annals of Statistics

Volumn 24, Issue 2, 1996, Pages 687-706

  Lugosi, Gábor ^a   Nobel, Andrew ^a  

^a NONE

Author keywords

Histogram classification; Histogram density estimation; Partitioning rules; Statistically equivalent blocks; Vapnik chervonenkis inequality

Indexed keywords

EID: 0030490122     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1032894460     Document Type: Article

References (30)

1. 1 en probabilité de l'histogramme pour une densité. Ann. Inst. H. Poincaré Sec. B (N. S.) 12 213-231.
2. ∞ de l'estimateur de la partition aléatoire pour une densité. Ann. Inst. H. Poincaré 12 299-317.
3. 1-convergence presque complète de l'estimateur de la partition fixe pour une densité. C. R. Acad. Sci. Paris 283 1107-1110.
4. ANDERSON, T. W. (1966). Some nonparametric multivariate procedures based on statistically equivalent blocks. In Multivariate Analysis (P. R. Krishnaiah, ed.) 5-27. Academic Press, New York.
5. BREIMAN, L., FRIEDMAN, J. H., OLSHEN, R. A. and STONE, C. J. (1984). Classification and Regression Trees. Wadsworth, Belmont, CA.
6. 1-norm convergence for data-based histogram density estimates. J. Multivariate Anal. 21 179-188.
7. COVER, T. M. (1965). Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition. IEEE Transactions on Electronic Computers 14 326-334.
8. CSISZÁR, I. and KÖRNER, J. (1981). Information Theory: Coding Theorems for Discrete Memoryless Systems. Academic Press, New York.
9. DEVROYE, L. (1988). Automatic pattern recognition: a study of the probability of error. IEEE Transactions on Pattern Analysis and Machine Intelligence 10 530-543.
10. 1 error of partitioning estimates of a regression function. In Proceedings of the Fourth Pannonian Symposium on Mathematical Statistics (F. Konecny, J. Mogyoródi and W. Wertz, eds.) 67-76. Akadémiai Kiadó, Budapest, Hungary.
11. 1 View. Wiley, New York.
12. GERSHO, A. and GRAY, R. M. (1992). Vector Quantization and Signal Compression. Kluwer, Boston.
13. GESSAMAN, M. P. (1970). A consistent nonparametric multivariate density estimator based on statistically equivalent blocks. Ann. Math. Statist. 41 1344-1346.
14. GORDON, L. and OLSHEN, R. A. (1978). Asymptotically efficient solutions to the classification problem. Ann. Statist. 6 515-533.
15. GORDON, L. and OLSHEN, R. A. (1980). Consistent nonparametric regression from recursive partitioning schemes. J. Multivariate Anal. 10 611-627.
16. GORDON, L. and OLSHEN, R. (1984). Almost surely consistent nonparametric regression from recursive partitioning schemes. J. Multivariate Anal. 15 147-163.
17. HARTIGAN, J. A. (1975). Clustering Algorithms. Wiley, New York.
18. LINDER, T., LUGOSI, G. and ZEGER, K. (1994). Rates of convergence in the source coding theorem, empirical quantizer design, and universal lossy source coding. IEEE Trans. Inform. Theory 40 1728-1740.
19. LUGOSI, G. and NOBEL, A. B. (1993). Consistency of data-driven histogram methods for density estimation and classification. Technical Report UIUC-BI-93-01, Beckman Institute, Univ: Illinois, Urbana-Champaign.
20. MAHALANOBIS, P. C. (1961). A method of fractile graphical analysis. Sankhyā Ser. A 23 41-64.
21. NOBEL, A. (1995). Recursive partitioning to reduce distortion. Technical Report UIUC-BI-95-01, Beckman Institute, Univ. Illinois, Urbana-Champaign.
22. NOBEL, A. (1996). Histogram regression estimation using data-dependent partitions. Ann. Statist. 24 (3).
23. PARTHASARATHY, K. R. and BHATTACHARYA, P. K. (1961). Some limit theorems in regression theory. Sankhyā Ser. A 23 91-102.
24. PATRICK, E. A. and FISHER, F. P., II (1967). Introduction to the performance of distribution-free conditional risk learning systems. Technical Report TR-EE-67-12, Purdue Univ.
25. POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, New York.
26. STONE, C. J. (1977). Consistent nonparametric regression. Ann. Statist. 5 595-645.
27. STONE, C. J. (1985). An asymptotically optimal histogram selection rule. In Proc. Berkeley Conf. in Honor of Jerzy Neyman and Jack Kiefer (L. Le Cam and R. A. Olshen, eds.) 2 513-520. Wadsworth, Belmont, CA.
28. VAN RYZIN, J. (1973). A histogram method of density estimation. Communications in Statistics 2 493-506.
29. VAPNIK, V. N. and CHERVONENKIS, A. YA. (1971). On the uniform convergence of relative frequencies of events to their probabilities. Theory Probab. Appl. 16 264-280.
30. 1-norm convergence for data-based histogram estimates. Theory Probab. Appl. 35 396-403.