A forward-constrained regression algorithm for sparse kernel density estimation

IEEE Transactions on Neural Networks

Volumn 19, Issue 1, 2008, Pages 193-198

  Hong, Xia ^a   Chen, Sheng ^b   Harris, Chris J ^b  

^a UNIVERSITY OF READING   (United Kingdom)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Cross validation; Jackknife parameter estimator; Parzen window (PW); Probability density function (pdf)

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; PARAMETER ESTIMATION; PROBABILITY DENSITY FUNCTION;

CROSS VALIDATION; FORWARD-CONSTRAINED REGRESSION (FCR); JACKKNIFE PARAMETER ESTIMATOR; PARZEN WINDOW (PW); SPARSE KERNEL DENSITY ESTIMATION;

REGRESSION ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; HUMAN; REGRESSION ANALYSIS; SIGNAL PROCESSING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; HUMANS; NEURAL NETWORKS (COMPUTER); REGRESSION ANALYSIS; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 39549091331     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.908645     Document Type: Article

References (21)

1. B. W. Silverman, Density Estimation for Statistics and Data Analysis London, UX.: Chapman & Hall, 1986.
2. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis New York: Wiley, 1973.
3. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
4. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Statist., vol. 33, pp. 1065-1076, 1962.
5. G. McLachlan and D. Peel, Finite Mixture Models. New York: Wiley, 2000.
6. J. Weston, A. Gammerman, M. O. Stitson, V. Vapnik, v. Vovk, and C. Watkins, "Suppot vector density estimation," in Advances in Kernel Methods, C. Burges, B. Schölkopf, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 293-306.
7. V. Vapnik and S. Mukherjee, "Support vector machine for multivariate density estimation," in Advances in Neural Information Processing Systems, T. Leen, S. Solla, and K. R. Muller, Eds. Cambridge, MA: MIT Press, 2000, pp. 659-665.
8. M. Girolami and C. He, "Probability density estimation from optimally condensed data samples," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1253-1264, Oct. 2003.
9. A. Choudhury, "Fast machine learning algorithms for large data," Ph.D. dissertation, School Eng. Sci., Univ. Southampton, Southampton, U.K., 2002.
10. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their applications to non-linear system identification," Int. J. Control, vol. 50, pp. 1873-1896, 1989.
11. X. Hong, P. M. Sharkey, and K. Warwick, "Automatic nonlinear predictive model construction using forward regression and the PRESS statistic," Inst. Electr. Eng. Proc.-Control Theory Appl., vol. 150, no. 3, pp. 245-254, 2003.
12. S. Chen, X. Hong, C. J. Harris, and P. M. Sharkey, "Sparse modeling using orthogonal forward regression with PRESS statistic and regularization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 898-911, Apr. 2004.
13. S. Chen, X. Hong, and C. J. Harris, "Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization," IEEE Trans. Syst., Man, Cybern. B, Cybern. vol. 34, no. 4, pp. 1708-1717, Aug. 2004.
14. S. Chen, X. Hong, and C. J. Harris, "An orthogonal forward regression technique for sparse kernel density estimation," Neurocomputing, 2007, to be published.
15. K. F. Cheng, C. K. Chu, and D. K. J. Lin, "Quick multivariate kernel density estimation for massive data sets," Appl. Stochastic Models Business Industry, vol. 22, pp. 533-546, 2006.
16. X. Hong and C. J. Harris, "A mixture of experts network structure construction algorithm for modelling and control," Appl. Intell., vol. 16, no. 1, pp. 59-69, 2002.
17. M. J. D. Powell, "Problems related to unconstrained optimization," in Numerical Methods for Unconstrained Optimization, W. Murray, Ed. London, UX.: Academic, 1972, pp. 29-55.
18. M. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Comput., vol. 6, pp. 181-214, 1994.
19. M. Quenoulle, "Notes on bias in estimation," Biometrica, vol. 43, pp. 353-360, 1956.
20. R. G. Miller, "An unbalanced jacknife," Ann. Statist., vol. 2, no. 5, pp. 880-891, 1974.
21. F. Sha, L. K. Saul, and D. D. Lee, "Multiplicative updates for nonnegative quadratic programming in support vector machines," Univ. Pensylvania, Philadelphia, PA, Tech. Rep. MS-CIS-02-09, 2002.