39 Dimensionality and sample size considerations in pattern recognition practice

Handbook of Statistics

Volumn 2, Issue , 1982, Pages 835-855

  Jain, A K ^a   Chandrasekaran, B ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 63249112814     PISSN: 01697161     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0169-7161(82)02042-2     Document Type: Review

References (73)

1. Abend K., Harley Jr. T.J., Chandrasekaran B., and Hughes G.F. Comments on "On the mean recognition accuracy of statistical pattern recognizers". IEEE Trans. Inform. Theory 15 (1969) 420-423
2. Aitchison J. Goodness of prediction fit. Biometrika 62 (1975) 547-554
3. Aitchison J., Habbema J.D.F., and Kay J.W. A critical comparison of two methods of statistical discrimination. Appl. Statist. 26 (1977) 15-25
4. Allais D.C. The problem of too many measurements in pattern recognition. IEEE Int. Con. Rec. 7 (1966) 124-130
5. Anderson T.W. Classification by multivariate analysis. Psychometrika 16 (1951) 31-50
6. Bailey T., and Jain A.K. A note on distance-weighted k-nearest-neighbor rules. IEEE Trans. Systems Man Cybernet. 8 (1978) 311-313
7. Ben-Bassat M., and Gal S. Properties and convergence of a posteriori probabilities in classification problems. Pattern Recognition 9 (1977) 99-107
8. Boullion T.L., Odell P.L., and Duran B.S. Estimating the probability of misclassification and variate selection. Pattern Recognition 7 (1975) 139-145
9. 2 and Anderson's classification statistic W in terms of simple statistics. In: Solomon H. (Ed). Studies in Item Analysis and Prediction (1961), Stanford University Press, Monterey, CA 271-284
10. Bowker A.H., and Sitgreaves R. An asymptotic expansion for the distribution function of the W-classification statistic. In: Solomon H. (Ed). Studies in Item Analysis and Prediction (1961), Stanford University Press, Stanford, CA 292-310
11. Chandrasekaran B. Independence of measurements and the mean recognition accuracy. IEEE Trans. Inform. Theory 17 (1971) 452-456
12. Chandrasekaran B., and Jain A.K. Quantization complexity and independent measurements. IEEE Trans. Comput. 23 (1974) 102-106
13. Chandrasekaran B., and Jain A.K. Independence, measurement complexity and classification performance. IEEE Trans. Systems Man Cybernet. 5 (1975) 240-244
14. Chandrasekaran B., and Jain A.K. Independence, measurement complexity and classification performance: An emendation. IEEE Trans. Systems Man Cybernet. 7 (1977) 564-566
15. Chandrasekaran B., and Jain A.K. On balancing decision functions. J. Cybernet. Inform. Sci. 2 (1979) 12-15
16. Chow C.K. On optimum recognition error and reject trade-off. IEEE Trans. Inform. Theory 16 (1970) 41-46
17. Chu J.T., and Chueh J.C. Error probability in decision functions for character recognition. J. Assoc. Comput. Mach. 14 (1967) 273-280
18. Cover T.M. Geometrical and statistical properties of systems of linear inequalities with application in pattern recognition. IEEE Trans. Elec. Comput. 14 (1965) 326-334
19. Cover T.M., and Hart P.E. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory 13 (1967) 21-27
20. Duda R.O., and Hart P.E. Pattern Classification and Scene Analysis (1973), Wiley, Stanford, CA
21. Duin R.P.W. A sample size dependent error bound. Proc. Third Internat. Joint Conf. Pattern Recognition. Coronado, CA (1976) 156-160
22. Fischer II F.P. K-nearest neighbor rules. Ph.D. dissertation (1971), School of Elect. Engr., Purdue University, New York
23. Also in. Fix E., and Hodges J.L. Discriminatory analysis, nonparametric discrimination: Small sample performance. Project 21-49-004, Rep. 11 (1952), USAF School of Aviation Medicine, Lafayette, IN
24. Also in. Fix E., and Hodges J.L. Discriminatory analysis, nonparametric discrimination: Small sample performance. In: Agarwala A.K. (Ed). Machine Recognition of Patterns (1977), IEEE Press, Randolph AFB, TX 280-322
25. Foley D.M. Considerations of sample and feature size. IEEE Trans. Inform. Theory 18 (1972) 618-626
26. Fukunaga K., and Hostetler L.D. Optimization of k-nearest neighbor density estimates. IEEE Trans. Inform. Theory 19 (1973) 320-326
27. Fukunaga K., and Kessell D.L. Application of optimum error-reject functions. IEEE Trans. Inform. Theory 18 (1972) 814-817
28. Gaffey W.R. Discriminatory analysis: Perfect discrimination as the number of variables increases. Report No. 5, Project No. 21-49-004 (1951), USAF School of Aviation Medicine, New York
29. Harter H.L. On the distribution of Wald's classification statistics. Ann. Math. Statist. 22 (1951) 58-67
30. Highleyman W.H. The design and analysis of pattern recognition experiments. Bell System Tech. J. 41 (1962) 723-744
31. Hughes G.F. On the mean accuracy of statistical pattern recognizers. IEEE Trans. Inform. Theory 14 (1968) 55-63
32. Jain A.K. On an estimate of the Bhattacharyya distance. IEEE Trans. Systems Man Cybernet. 6 (1976) 763-766
33. Jain A.K., and Dubes R. Feature definition in pattern recognition with small sample size. Pattern Recognition 10 (1978) 85-97
34. Jain A.K., and Waller W. On the optimum number of features in the classification of multivariate Gaussian data. Pattern Recognition 10 (1978) 365-374
35. John S. Errors in discrimination. Ann. Math. Statist. 32 (1961) 1125-1144
36. Kabe D.G. Some results on the distribution of two random matrices used in classification procedures. Ann. Math. Statist. 34 (1963) 181-185
37. Kain R.Y. The mean accuracy of pattern recognizers with many pattern classes. IEEE Trans. Inform. Theory 15 (1969) 424-425
38. Kaminuma T., and Watanabe S. Fast-converging adaptive algorithms for well-balanced separating linear classifier. Pattern Recognition 4 (1972) 289-305
39. Kanal L. Patterns in pattern recognition, 1968-1974. IEEE Trans. Inform. Theory 20 (1974) 697-722
40. Kanal L., and Chandrasekaran B. On dimensionality and sample size in statistical pattern classification. Pattern Recognition 3 (1971) 225-234
41. Keehn D.G. A note on learning for Gaussian properties. IEEE Trans. Inform. Theory 11 (1965) 126-132
42. Kittler J. Mathematical methods of feature selection in pattern recognition. Internat. J. Man-Mach. Stud. 7 (1975) 609-637
43. Lachenbruch P.A., and Mickey M.R. Estimation of error rates in discriminant analysis. Technometrics 10 (1968) 1-11
44. Levine A., Lustick L., and Saltzberg B. The nearest-neighbor rule for small samples drawn from uniform distributions. IEEE Trans. Inform. Theory 19 (1973) 697-699
45. Lindley D.V. The choice of variables in multiple regression. J. Roy. Statist. Soc. Ser. B 30 (1968) 31-66
46. Lindley D.V. The Bayesian Approach. Seventh Scandin. Conf. in Math. Statist (1977) 55-72
47. Loftsgaarden D.O., and Quesenberry C.P. A nonparametric estimate of a multivariate density function. Ann. Math. Statist. 36 (1965) 1049-1051
48. Mehrotra K.G. Some further considerations on probability of error in discriminant analysis. Report on RADC contract no. f 30602-72-C-0281 (1973)
49. Morgera S.D., and Cooper D.B. Structured estimation: sample size reduction for adaptive pattern classification. IEEE Trans. Inform. Theory 23 (1977) 728-741
50. Murray G.D. A cautionary note on selection of variables in discriminant analysis. Appl. Statist. 26 (1977) 246-250
51. Okamoto M. An asymptotic expansion for the distribution of the linear discriminant function. Ann. Math. Statist. 34 (1963) 1286-1301
52. Correction. Ann. Math. Statist. 39 (1968) 1358-1359
53. Pettis K., Bailey T., Jain A.K., and Dubes R. An intrinsic dimensionality estimator from near-neighbor information. IEEE Trans. Pattern Anal. Mach. Intelligence 1 (1979) 25-37
54. Rao C.R. On some problems arising out of discrimination with multiple characters. Sankhyā 9 (1949) 343-364
55. Raudys S. On dimensionality, learning sample size and complexity of classification algorithms. Proc. Third Internat. Joint Conf. Pattern Recognition. Coronado, CA (1976) 166-169
56. Rejto L., and Revesz P. Density estimation and pattern recognition. Problems Control Inform. Theory 2 (1973) 67-80
57. Roucos S., and Childers D.G. On dimensionality and learning set size in feature extraction. Proc. Internat. Conf. Cybernet., Soc. Cambridge, MA (1980) 26-31
58. Schaafsma W., and Steerneman A.G.M. Proofs and extensions of the results in the paper on classification and discrimination if p → ∞. Internal Rept. (1980), Dept. Math, University of Groningen, Randolph Field, TX
59. Sitgreaves R. On the distribution of two matrices used in classification procedures. Ann. Math. Statist. 23 (1952) 263-270
60. Sitgreaves R. Some results on the distribution of the W-classification. In: Solomon H. (Ed). Studies in Item Analysis and Prediction (1961), Stanford University Press, Groningen 241-251
61. Sitgreaves R. Some operating characteristics of linear discriminant functions. In: Cacoullos T. (Ed). Discriminant Analysis and Applications (1973), Academic Press, Stanford, CA 365-374
62. Teichroew D., and Sitgreaves R. Computation of an empirical sampling distribution for the W-classification statistic. In: Solomon H. (Ed). Studies in Item Analysis and Prediction (1961), Stanford University Press, New York 271-284
63. Toussaint G.T. Bibliography on estimation of misclassification. IEEE Trans. Inform. Theory 20 (1974) 472-479
64. Trunk G.V. A problem of dimensionality. IEEE Trans. Pattern Anal. Mach. Intelligence 1 (1979) 306-307
65. n-nearest neighbor pattern classification. Proc. Second Internat. Joint Conf. Pattern Recognition. Lyngby, Denmark (1974) 547-549
66. Van Campenhout J.M. On the peaking of the Hughes mean recognition accuracy: The resolution of an apparent paradox. IEEE Trans. Systems Man Cybernet. 8 (1978) 390-395
67. Van Ness J.W. Dimensionality and classification performance with independent coordinates. IEEE Trans. Systems Man Cybernet. 7 (1977) 560-564
68. Van Ness J.W. On the dominance of non-parametric Bayes rule discriminant algorithms in high dimensions. Pattern Recognition 12 (1980) 355-368
69. Van Ness J.W., and Simpson C. On the effects of dimension in discriminant analysis. Technometrics 18 (1976) 175-187
70. Wald A. On a statistical problem arising in the classification of an individual into one of two groups. Ann. Math. Statist. 15 (1944) 145-162
71. Waller W., and Jain A.K. Mean recognition accuracy of dependent binary measurements. Proc. Seventh Internat. Conf. Cybernet. Soc. Washington, DC (1977) 586-590
72. Waller W.G., and Jain A.K. On the monotonicity of the performance of Bayesian classifiers. IEEE Trans. Inform. Theory 24 (1978) 392-394
73. Young I.T. Further consideration of sample and feature size. IEEE Trans. Inform. Theory 24 (1978) 773-775