Kernel discriminant analysis using case-specific smoothing parameters

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 5, 2008, Pages 1413-1418

  Ghosh, Anil K ^a,b  

^a INDIAN INSTITUTE OF TECHNOLOGY KANPUR   (India)

^b INDIAN STATISTICAL INSTITUTE   (India)

Author keywords

Bandwidth; Bayes risk; Bootstrap; Cross validation; Kernel smoothing; Misclassification rate; Nearest neighbor; p value

Indexed keywords

CLASSIFICATION (OF INFORMATION); DISCRIMINANT ANALYSIS; ESTIMATION;

BANDWIDTH; BAYES RISK; BENCHMARK DATA; BOOTSTRAP; CROSS VALIDATION; KERNEL DISCRIMINANT ANALYSIS; KERNEL SMOOTHING; MISCLASSIFICATION RATE; NEAREST NEIGHBOR; P-VALUE; SIMPLE METHODS; SMOOTHING PARAMETERS; TRAINING DATA;

PARAMETER ESTIMATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; DISCRIMINANT ANALYSIS; METHODOLOGY; SIGNAL PROCESSING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DISCRIMINANT ANALYSIS; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 52349086789     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.925754     Document Type: Article

References (36)

1. I. Abramson, "On bandwidth variation in kernel estimates - A square root law," Ann. Stat., vol. 10, no. 4, pp. 1217-1223, Dec. 1982.
2. T. Bailey and A. Jain, "A note on distance-weighted k-nearest neighbor rules," IEEE Trans. Syst., Man, Cybern., vol. S MC- 8, no. 4, pp. 311-313, Apr. 1978.
3. O. Chapelle, A. Zien, and B. Scholkopf, Eds., Semi Supervised Learning. Cambridge, MA: MIT Press, 2006.
4. T. M. Cover and P. E. Hart, "Nearest neighbor pattern classification," IEEE Trans. Inf. Theory, vol. IT-13, no. 1, pp. 21-27, Jan. 1967.
5. B. Efron, "Estimating the error rate of a prediction rule: Improvement on cross-validation," J. Amer. Stat. Assoc., vol. 78, no. 382, pp. 316-331, Jun. 1983.
6. J. H. Friedman, "On bias, variance, 0-1 loss, and the curse of dimensionality," Data Mining Knowl. Discov., vol. 1, no. 1, pp. 55-77, 1997.
7. A. K. Ghosh and P. Chaudhuri, "Optimal smoothing in kernel discriminant analysis," Stat. Sin., vol. 14, no. 2, pp. 457-483, Apr. 2004.
8. A. K. Ghosh, "On nearest neighbor classification using adaptive choice of k," J. Comput. Graph. Stat., vol. 16, no. 2, pp. 482-502, Jun. 2007.
9. A. K. Ghosh and S. Bose, "Feature extraction and classification using statistical networks," Int. J. Pattern Recog. Artif Intell., vol. 21, pp. 1103-1126, 2007.
10. A. K. Ghosh, "Kernel discriminant analysis using case-specific smoothing parameters," Dept. Math. Stat., IIT Kanpur, India, 2008. Tech. Rep. Online. Available: http://www.geocities.com/ghosh_anilk
11. P. Hall and M. P. Wand, "On nonparametric discrimination using density differences," Biometrika, vol. 68, pp. 287-294, 1988.
12. P. Hall and K.-H. Kang, "Bandwidth choice for nonparametric classification," Ann. Stat., vol. 33, no. 1, pp. 284-306, 2005.
13. D. J. Hand, Kernel Discriminant Analysis. Chichester, U.K.: Wiley, 1982.
14. W. Hardle and J. S. Marron, "Optimal bandwidth selection in nonparametric regression function estimation," Ann. Stat., vol. 13, no. 4, pp. 1465-1481, Dec. 1985.
15. T. Hastie and R. Tibshirani, "Discriminant adaptive nearest neighbor classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 6, pp. 607-616, Jun. 1996.
16. T. Hastie and R. Tibshirani, "Classification by pairwise coupling," Ann. Stat., vol. 26, no. 2, pp. 451-471, 1998.
17. M.C. Jones, J. S. Marron, and S. J. Sheather, "A brief survey of bandwidth selection for density estimation," J. Amer. Stat. Assoc. vol. 91, no. 433, pp. 401-407, Mar. 1996.
18. D.O. Loftsgaarden and C. P. Quesenberry, "A nonparametric estimate of a multivariate density function," Ann. Math. Stat., vol. 36, no. 3, pp. 1049-1051, Jun. 1965.
19. H.G. Muller, "Smooth optimum kernel estimators of densities, regression curves and modes," Ann. Stat., vol. 12, no. 2, pp. 766-774, Jun. 1984.
20. H. G. Muller and U. Stadtmuller, "Variable bandwidth kernel estimators of regression curves," Ann. Stat., vol. 15, no. 1, pp. 182-201, Mar. 1987.
21. G.E. Peterson and H. L. Barney, "Control methods used in a study of the vowels," J. Acoust. Soc. Amer., vol. 24, no. 2, pp. 175-184, Mar. 1952.
22. J. Rice, "Bandwidth choice for nonparametric regression," Ann. Stat., vol. 12, no. 4, pp. 1215-1230, Dec. 1984.
23. B. D. Ripley, Pattern Recognition and Neural Networks. Cambridge, U.K.: Cambridge Univ. Press, 1996.
24. S. R. Saan and D. W. Scott, "On locally adaptive density estimation," J. Amer. Stat. Assoc., vol. 91, no. 436, pp. 1525-1534, Dec. 1996.
25. W. Schucany, "Adaptive bandwidth choice for kernel regression," J. Amer. Stat. Assoc., vol. 90, no. 430, pp. 535-540, Jun. 1995.
26. D.W. Scott, Multivariate Density Estimation: Theory, Practice and Visualization. New York: Wiley, 1992.
27. S.J. Sheather and M. C. Jones, "A reliable data-based bandwidth selection method for kernel density estimation," J. R. Stat. Soc., B vol. 53, no. 3, pp. 683-690, 1991.
28. B. W. Silverman, Density Estimation for Statistics and Data Analysis London, U.K.: Chapman & Hall, 1986.
29. J. Sklansky and G. N. Wassel, Pattern Classifiers and Trainable Machines. New York: Springer-Verlag, 1981.
30. J. G. Stainwalis, "Local bandwidth selection for kernel estimates," J. Amer. Stat. Assoc., vol. 84, no. 405, pp. 284-288, 1989.
31. G. Terrel and D. W. Scott, "Variable kernel density estimation," Ann. Stat., vol. 20, no. 3, pp. 1236-1265, 1992.
32. J. W. Tukey, Exploratory Data Analysis. New York: Addison-Wesley, 1977.
33. P. Vieu, "Nonparametric regression: Optimal local bandwidth choice," J. R. Stat. Soc., B, vol. 53, no. 2, pp. 453-464, 1991.
34. M. P. Wand and M. C. Jones, Kernel Smoothing. London, U.K.: Chapman & Hall, 1995.
35. G. N. Wassel and J. Sklansky, "Training a one dimensional classifier to minimize the probability of error," IEEE Trans. Syst., Man, Cybern. vol. SMC-2, no. 4, pp. 533-541, Sep. 1972.
36. Z. Zhang, J. T. Kwok, and D.-Y. Yeung, "Model based transductive learning of the kernel matrix," Mach. Learn., vol. 63, no. 1, pp. 69-101, Apr. 2006.