The stochastic approximation method for the estimation of a multivariate probability density

Journal of Statistical Planning and Inference

Volumn 139, Issue 7, 2009, Pages 2459-2478

  Mokkadem, Abdelkader ^a   Pelletier, Mariane ^a   Slaoui, Yousri ^a  

^a LABORATOIRE DES SCIENCES DU CLIMAT ET DE L ENVIRONNEMENT   (France)

Author keywords

Density estimation; Stochastic approximation algorithm

Indexed keywords

EID: 62049085815     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jspi.2008.11.012     Document Type: Article

References (35)

1. Arcones M.A. The law of the iterated logarithm for a triangular array of empirical processes. Electron. J. Probab. 2 (1997) 1-39
2. Blum J.R. Multidimensional stochastic approximation methods. Ann. Math. Statist. 25 (1954) 737-744
3. Bojanic R., and Seneta E. A unified theory of regularly varying sequences. Math. Z. 134 (1973) 91-106
4. Chen H. Lower rate of convergence for locating a maximum of a function. Ann. Statist. 16 (1988) 1330-1334
5. Chen H.F., Duncan T.E., and Pasik-Duncan B. A Kiefer-Wolfowitz algorithm with randomized differences. IEEE Trans. Automat. Control 44 (1999) 442-453
6. Davies H.L. Strong consistency of a sequential estimator of a probability density function. Bull. Math. Statist. 15 (1973) 49-54
7. Deheuvels P. Sur l'estimation séquentielle de la densité. C.R. Acad. Sci. Paris Ser. A-B 276 (1973) 1119-1121
8. Devroye L. On the pointwise and integral convergence of recursive kernel estimates of probability densities. Utilitas Math. 15 (1979) 113-128
9. Dippon J. Accelerated randomized stochastic optimization. Ann. Statist. 31 (2003) 1260-1281
10. Dippon J., and Renz J. Weighted means in stochastic approximation of minima. SIAM J. Control Optim. 35 (1997) 1811-1827
11. Duflo M. Algorithmes stochastiques. Collection Applications of Mathematics (1996), Springer, Berlin
12. Duflo M. Random iterative models. Collection Applications of Mathematics (1997), Springer, Berlin
13. Fabian V. Stochastic approximation of minima with improved asymptotic speed. Ann. Math. Statist. 38 (1967) 191-200
14. Galambos J., and Seneta E. Regularly varying sequences. Proc. Amer. Math. Soc. 41 (1973) 110-116
15. Hall P. Laws of the iterated logarithm for nonparametric density estimators. Z. Warsch. Verw. Gebiete 56 (1981) 47-61
16. Hall P. Effect of bias estimation on coverage accuracy of bootstrap confidence intervals for a probability density. Ann. Statist. 20 (1992) 675-694
17. Hall P., and Heyde C.C. Martingale Limit Theory and its Application (1980), Academic Press, Inc., New York, London
18. Hall P., and Patil P. On the efficiency of on-line density estimators. IEEE Trans. Inform. Theory 40 (1994) 1504-1512
19. Kiefer J., and Wolfowitz J. Stochastic approximation of the maximum of a regression functions. Ann. Math. Statist. 23 (1952) 462-466
20. Kushner H.J., and Clark D.S. Stochastic Approximation Methods for Constrained and Unconstrained Systems (1978), Springer, New York
21. Mokkadem A., and Pelletier M. A companion for the Kiefer-Wolfowitz-Blum stochastic approximation algorithm. Ann. Statist. 35 4 (2007) 1749-1772
22. Mokkadem A., and Pelletier M. Compact law of the iterated logarithm for matrix-normalized sums of random vectors. Teor. Veroyatn. Primen. 52 (2007)
23. Parzen E. On estimation of a probability density and mode. Ann. Math. Statist. 33 (1962) 1065-1076
24. Polyak B.T., and Tsybakov A.B. Optimal orders of accuracy for search algorithms of stochastic optimization. Problems Inform. Transmission 26 (1990) 126-133
25. Révész P. Robbins-Monro procedure in a Hilbert space and its application in the theory of learning processes I. Studia Sci. Math. Hung. 8 (1973) 391-398
26. Révész P. How to apply the method of stochastic approximation in the non-parametric estimation of a regression function. Math. Operationsforsch. Statist. Ser. Statist. 8 (1977) 119-126
27. Rosenblatt M. Remarks on some nonparametric estimates of a density function. Ann. Math. Statist. 27 (1956) 832-837
28. Roussas G. Exact rates of almost sure convergence of a recursive kernel estimate of a probability density function: application to regression and hazard rate estimate. J. Nonparam. Statist. 3 (1992) 171-195
29. Ruppert D. Almost sure approximations to the Robbins-Monro and Kiefer-Wolfowitz processes with dependent noise. Ann. Probab. 10 (1982) 178-187
30. Spall, J.C., 1988. A stochastic approximation algorithm for large-dimensional systems in the Kiefer-Wolfowitz setting. In: Proceedings of the Conference on Decision and Control. IEEE, New York, pp. 1544-1548.
31. Spall J.C. A one-measurement form of simultaneous perturbation stochastic approximation. Automat. J. IFAC 33 (1997) 109-112
32. Tsybakov A.B. Recurrent estimation of the mode of a multidimensional distribution. Problems Inform. Transmission 26 (1990) 31-37
33. Wegman E.J., and Davies H.I. Remarks on some recursive estimators of a probability density. Ann. Statist. 7 (1979) 316-327
34. Wolverton C.T., and Wagner T.J. Asymptotically optimal discriminant functions for pattern classification. IEEE Trans. Inform. Theory 15 (1969) 258-265
35. Yamato H. Sequential estimation of a continuous probability density function and mode. Bull. Math. Statist. 14 (1971) 1-12