35 Use of distance measures, information measures and error bounds in feature evaluation

Handbook of Statistics

Volumn 2, Issue , 1982, Pages 773-791

  Ben Bassat, Moshe ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 70350346892     PISSN: 01697161     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0169-7161(82)02038-0     Document Type: Review

References (66)

1. Aczel J., and Daroczy Z. On Measures of Information and Their Characterization (1975), Academic Press, New York
2. Ali S.M., and Silvey S.D. A general class of coefficients of divergence of one distribution from another. J. Royal Statis. Soc. Ser. B. 28 (1966) 131-142
3. San Diego, CA. Backer E., and Jain A.K. On feature ordering in practice and some finite sample effects. Proc. Third Internat. Joint Conf. Pattern Recognition (1976) 45-49
4. Ben-Bassat M. Myopic policies in sequential classification. IEEE Trans. Comput. 27 (1978) 170-174
5. Ben-Bassat M. ε-equivalence of feature selection rules. IEEE Trans. Inform. Theory 24 (1978) 769-772
6. Ben-Bassat M. f-entropies, probabilities of error and feature selection. Inform. and Control 39 (1978) 227-242
7. Ben-Bassat M., and Raviv J. Renyi's entropy and the probability of error. IEEE Trans. Inform. Theory 24 (1978) 324-331
8. Ben-Bassat M. On the sensitivity of the probability of error rule for feature selection. IEEE Trans. Pattern Anal. Machine Intell. 2 (1980) 57-60
9. Chen C.H. Theoretical comparison of a class of feature selection criteria in pattern recognition. IEEE Trans. Comput. 20 (1971) 1054-1056
10. Chen C.H. On information and distance measures, error bounds and feature selection. Inform. Sci. 10 (1976) 159-173
11. Cover T.M. The best two independent measurements are not the two best. IEEE Trans. Systems Man Cybernet. 4 (1974) 116-117
12. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory 13 (1967) 21-27
13. Cover T.M., and Van Campenhout J.M. On the possible orderings in the measurement selection problem. IEEE Trans. Systems Man Cybernet. 7 (1977) 657-660
14. Daroczy Z. Generalized information functions. Inform. and Control 16 (1970) 36-51
15. DeGroot M. Uncertainty, information and sequential experiments. Ann. Math. Statist. 33 (1962) 404-419
16. DeGroot M. Optimal Statistical Decisions (1970), McGraw-Hill, New York
17. Devijver P.A. On a class of bounds on Bayes risk in multihypothesis pattern recognition. IEEE Trans. Comput. 23 (1973) 70-80
18. Devijver P.A. Entropies of degree β and lower bounds for the average error rate. Inform. and Control 34 (1977) 222-226
19. Devijver P.A. Nonparametric estimation by the method of ordered nearest neighbor sample sets. Proc. Fourth Internat. Joint. Conf. Pattern Recognition (1978) 217-223
20. Copenhagen, Denmark. Duin R.P.W., and van Haresma Buma C.E. Some methods for the selection of independent binary features. Proc. Second Internat. Joint Conf. Pattern Recognition (1974) 65-70
21. Elashoff J.D., Elashoff R.M., and Goldman G.E. On the choice of variables in classification problems with dichotomous variables. Biometrika 54 (1971) 668-670
22. Fu K.S., Min P.J., and Li T.J. Feature selection in pattern recognition. IEEE Trans. Systems Sci. Cybernet. 6 (1970) 33-39
23. Fukunaga K. Introduction to Statistical Pattern Recognition (1972), Academic Press, New York
24. Glick N. Separation and probability of correct classification among two or more distributions. Ann. Inst. Statist. Math. 25 (1973) 373-382
25. Good I.J., and Card W.I. The diagnostic process with special reference to errors. Math. Inform. Med. 10 (1971) 176-188
26. Greetenberg T.L. Signal selection in communication and radar systems. IEEE Trans. Inform. Theory 9 (1963) 265-275
27. Hellman M.E., and Raviv J. Probability of error, equivocation and the Chernoff bound. IEEE Trans. Inform. Theory 16 (1970)
28. Jain A.K. On an estimate of the Bhattacharyya distance. IEEE Trans. Systems Man Cybernet. 6 (1976) 763-766
29. Kailath T. The divergence and Bhattacharyya distance in signal selection. IEEE Trans. Comm. Tech. 15 (1967) 52-60
30. Kanal L. Patterns in pattern recognition: 1968-1974. IEEE Trans. Inform. Theory 18 (1974) 697-722
31. Kaufman H., and Mathai A.M. An axiomatic foundation for a multivariate measure of affinity among a number of distributions. J. Multivariate Anal. 3 (1973) 236-242
32. Kittler J. Mathematical methods of feature selection in pattern recognition. Internat. J. Man-Mach. Stud. 7 (1975) 609-637
33. Kittler J. On the divergence and Joshi dependence measure in feature selection. Information Processing Lett. 3 (1975) 135-137
34. Kovalevsky V.A. The problem of character recognition from the point of view of mathematical statistics. In: Kovalevsky V.A. (Ed). Character Readers and Pattern Recognition (1968), Spartan, New York
35. Kullback S., and Leibler R.A. Information and sufficiency. Ann. Math. Statist 22 (1951) 79-86
36. Lainiotis D.G. A class of upper bounds on probability of error for multihypothesis pattern recognition. IEEE Trans. Inform. Theory 15 (1969) 730-731
37. Lewis P.M. The characteristic selection problem in recognition systems. IEEE Trans. Inform. Theory 8 (1962) 161-171
38. Lindley D.V. On a measure of the information provided by an experiment. Ann. Math. Statist. 27 (1956) 986-1005
39. α-distance between posterior density functions. IEEE Trans. Inform. Theory 22 (1976) 34-45
40. Marill T., and Green D.M. On the effectiveness of receptors in recognition systems. IEEE Trans. Inform. Theory 9 (1963) 11-17
41. Mathai A.M., and Rathie P.N. Basic Concepts in information Theory and Statistics (1975), Wiley, New York
42. Matusita K. On the notion of affinity of several distributions and some of its applications. Ann. Inst. Statist. Math. 19 (1967) 181-192
43. Matusita K. Discrimination and the affinity of distributions. In: Cacoullos T. (Ed). Discriminant Analysis and Applications (1973), Academic Press, New York 213-223
44. Mucciardi A.N., and Gose E.E. A comparison of seven techniques for choosing subsets of pattern recognition properties. IEEE Trans. Comput. 20 (1971) 1023-1031
45. Narendra P.M., and Fukunaga K. A branch and bound algorithm for feature subset selection. IEEE Trans. Comput. 26 (1977) 917-919
46. Renyi A. On measures of dependence. Acta Math. Acad. Sci. Hungar. 10 (1959) 441-451
47. Renyi A. On measures of entropy and information. Proc. Fourth Berkeley Symposium Math. Statist. and Probability 1 (1960) 547-561
48. Renyi A. On the amount of information concerning an unknown parameter in a sequence of observations. Publ. Math. Inst. Hungar. Acad. Sci. 9 (1964) 617-624
49. Renyi A. On the amount of missing information and Neyman-Pearson lemma. In: David F.N. (Ed). Research Papers in Statistics (1966), Wiley, New York 281-288
50. Renyi A. On some problems of statistics from the point of view of information theory. Proc. Fifth Berkeley Symposium on Math. Statist (1967) 531-543
51. Renyi A. Statistics and information theory. Studia Sci. Math. Hungar. 2 (1967) 249-256
52. Renyi A. Probability Theory (1970), North-Holland, New York
53. Shannon C. A mathematical theory of communication. Bell Systems Tech. J. 7 (1948) 379-423
54. Silvey S.D. On a measure of association. Ann. Math. Stat. 35 (1964) 1157-1166
55. San Diego, CA. Stearns S.D. On selecting features for pattern recognition. Proc. Third Internat. Joint Conf. Pattern Recognition (1976) 245-248
56. Toussaint G.T. Some upper bounds on error probability for multiclass pattern recognition. IEEE Trans. Comput. 20 (1971) 943-944
57. Toussaint G.T. Note on the optimal selection of independent binary valued features for pattern recognition. IEEE Trans. Comput. 17 (1971) 618
58. Toussaint G.T. Feature evaluation with quadratic mutual information. Information Processing Lett. 1 (1972) 153-156
59. Toussaint G.T. Recent progress in statistical methods applied to pattern recognition. Proc. Second Internat. Joint Conf. Pattern Recognition (1974) 479-488
60. Toussaint G.T. On the divergence between two distributions and the probability of misclassification of several decision rules. Proc. Second Internat. Joint Conf. Pattern Recognition (1974)
61. Toussaint G.T. On information transmission, nonparametric classification and measuring dependence between random variables. Proc. Symp. Statist., Related Topics (1974), Carleton University, Amsterdam
62. Toussaint G.T. An upper bound on the probability of misclassification in terms of the affinity. Proc. IEEE 65 (1977) 275-276
63. Toussaint G.T. Probability of error, expected divergence and the affinity of several distributions. IEEE Trans. Systems Man Cybernet. 8 (1978) 482-485
64. Unpublished manuscript. Toussaint G.T. Probability of error and equivocation of order α (1978)
65. Vajda I. Bounds on the minimal error probability and checking a finite or countable number of hypotheses. Inform. Transmis. Problems 4 (1968) 9-19
66. Vilmansen T.R. Feature evaluation with measures of probabilistic dependence. IEEE Trans. Comput. 22 (1973) 381-388