Pattern discovery by residual analysis and recursive partitioning

IEEE Transactions on Knowledge and Data Engineering

Volumn 11, Issue 6, 1999, Pages 833-852

  Chau, Tom ^a,b   Wong, Andrew K C ^a,c  

^a IEEE   (Canada)

^b HOLLAND BLOORVIEW KIDS REHABILITATION HOSPITAL   (Canada)

^c UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CONTINGENCY TABLES; PATTERN DISCOVERY; RECURSIVE PARTITIONING; RESIDUAL ANALYSIS;

BACKPROPAGATION; COMPUTATIONAL METHODS; IMAGE ANALYSIS; ITERATIVE METHODS; KNOWLEDGE BASED SYSTEMS; MULTILAYER NEURAL NETWORKS; PROBABILITY DISTRIBUTIONS; RECURSIVE FUNCTIONS; STATISTICAL METHODS;

PATTERN RECOGNITION;

EID: 0033307261     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/69.824592     Document Type: Article

References (48)

1. D.W. Scott, Multivariate Density Estimation. John Wiley and Sons, 1992.
2. P.J. Huber, "Projection Pursuit (with Discussion)," Annals of Statistics, vol. 13, pp. 435-525, 1985.
3. M. Rosenblatt, "Remarks on Some Nonparametric Estimates of a Density Function," Annals of Math. Statistics, vol. 27, pp. 832-837, 1956.
4. E. Parzen, "On Estimation of Probability Density Function and Mode," Annals of Math. Statistics, vol. 33 pp. 1,065-1,076, 1962.
5. J. Moody and C.J. Darken, "Fast Learning in Networks of Locally-Tuned Processing Units," Neural Computation, vol. 1, no. 2, pp. 281-294, 1989.
6. R.O. Duda and P.H. Hart, Pattern Classification and Scene Analysis. John Wiley and Sons, 1973.
7. E.J. Hartman, J.D. Keeler, and J.M. Kowalski, "Layered Neural Networks with Gaussian Hidden Units as Universal Approximations," Neutral Computation, vol. 2, no. 2, pp. 210-215, 1990.
8. J. Park and I.W. Sandberg, "Approximation and Radial Basis Function Networks," Neural Computation, vol. 5, no. 2, pp. 305-316, 1993.
9. C. Bishop, Neural Networks for Pattern Recognition, Oxford Univ. Press, 1995.
10. D.E. Rumelhart, G.E. Hinton, and R.J. Williams, "Learning Representations by Backpropagating Errors," Nature, vol. 323, pp. 533-536, 1986.
11. G. Cybenko, "Approximation by Superpositions of a Sigmoidal Function," Math. of Control, Signals, and Systems, vol. 2, pp. 303-314, 1989.
12. H. White, "Learning in Artificial Neural Networks: A Statistical Perspective"," Neural Computation, vol. 1, pp. 425-464, 1989.
13. G.E. Hinton, J.L. McClelland, and D.B. Rumelhart, "Distributed Representations," Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D.E. Rumelhart and J.L. McClelland, eds., vol. 1, MIT Press, Cambridge, Mass., 1985.
14. J. Wejchert and G. Tesauro, "Visualizing Processes in Neural Networks," IBM J. Research and Development, vol. 35, pp. 244-253, 1991.
15. H. Narazaki, M. Yamamoto, and T. Watanabe, "Reorganizing Knowledge in Neural Networks: An Explanation Mechanism for Neural Networks in Data Classification Problems," IEEE Trans. Systems, Man, and Cybernetics, part B, vol. 26, no. 1, pp. 107-117, 1996.
16. S. Avner, "Extraction of Comprehensive Symbolic Rules from a Multilayer Porceptron," Eng. Applications, vol. 9, no. 2., pp. 137-43, 1996.
17. R. Andrews, R. Cable, J. Diederich, S. Geva, M. Golea, R. Hayward, C. Ho-Stuart, and A. Tickle, "Survey and Critique of Techniques for Extracting Rules from Trained Artificial Neural Networks," Knowledge-Based Systems, vol. 8, no. 6, pp. 373-389, 1995.
18. M. Dolson, "Discriminative Nonlinear Dimensionality Reduction for Improved Classification," Int'l J. Neural Systems, vol. 5, no. 4, pp. 313-333, 1994.
19. T. Kohonen, Self-Organizing Maps. Springer, Berlin, 1995.
20. B.D. Ripley, Pattern Recognition and Neural Networks, Cambridge Univ. Press, 1996.
21. A. Papoulis, Probability, Random Variables, and Stochastic Processes. McGraw-Hill, 1991.
22. A.K.C. Wong and Y. Wang, "High-Order Pattern Discovery from Discrete-Valued Data Sets," IEEE Trans. Knowledge and Data Eng., pp. 877-893, vol. 9, no. 6, Nov./Dec. 1997.
23. S.C. Port, Theoretical Probability for Applications. John Wiley and Sons, 1994.
24. R.A. Christensen, Log-Linear Models. Springer-Verlag, 1990.
25. S. Haberman, The Analysis of Qualitative Data, vol. 1. Academic Press, 1978.
26. B.S. Everitt, The Analysis of Contingency Tables. Wiley, New York, 1977.
27. A. Agresti, Categorical Data Analysis. Wiley, New York, 1990.
28. R.N. Forthofer, Public Program Analysis: A New Categorical Data Approach. Lifetime Learning Publications, 1981.
29. S.J. Haberman, The Analysis of Frequency Data. Univ. of Chicago Press, 1974.
30. C. Cox, "An Elementary Introduction to Maximum Likelihood Estimaton for Multinomial Models: Birch's Theorem and the Delta Method," Amer. Statistician, vol. 38, no. 4, pp. 283-287, 1984.
31. A.K.C. Wong, D.K.Y. Chiu, and B, Cheung, "Information Discovery Through Hierarchical Maximum Entropy Discretization," Knowledge Discovery in Databases, G. Piatetsky-Shapiro and W.J. Frawley, eds.,pp. 125-140, AAAI/MIT Press, 1987.
32. M. Lascurain, "On Maximum Entropy Discretization and its Applications in Pattern Recognition," PhD thesis, Systems Design Engineering, Univ. of Waterloo, Waterloo, Ont., Canada, 1983.
33. C.E. Shannon, "Mathematical Theory of Communication," Bell Systems Technical J., vol. 27, no. 3, pp. 379-423, 1948.
34. E.T. Jaynes, "Information Theory and Statistical Mechanics," Physical Rev., vol. 106, no. 1, pp. 620-630, 1957.
35. D.K.Y. Chiu, B. Cheung, and A.K.C. Wong, "Information Synthesis Based on Hierarchical Maximum Entropy Discretization," J. Experimental and Theoretical Artificial Intelligence, vol. 2, pp. 117-129, 1990.
36. J. Sonquist, Multivariate Model Building: The Validation of a Search Strategy, Inst. for Social Research, Univ. of Michigan, Ann Arbor, 1970.
37. L. Gordon and R.A. Olshen, "Asymptotically Efficient Solutions to the Classification Problem," Annals of Statistics, vol. 6, no. 3, pp. 515-533, 1978.
38. J.H. Friedman, "A Recursive Partitioning Decision Rule for Nonparametric Classification," IEEE Trans. Computers, pp. 404-408, 1977.
39. E.G. Henrichon and K.S. Fu, "A Nonparametric Partitioning Procedure for Pattern Classification," IEEE Trans. Computers, vol. 18, no. 7, pp. 614-024, 1969.
40. A. Ciampi, C.H. Chang, S.A. Hogg, and S. McKinney, "Recursive Partition: A Versatile Method for Exploratory Data Analysis in Biostatistics," Biostatistics, I.B. MacNeil and G.J. Umphrey, eds., vol. 5, pp. 23-50, Dordrecht, Netherlands, 1987.
41. D.K.Y. Chiu and A.K.C. Wang, "Synthesizing Knowledge: A Cluster Analysis Approach Using Event Covering," IEEE Trans. Systems, Man, and Cybernetics, vol. 16, no. 2, pp. 251-259, 1986.
42. R. Fletcher, Practical Methods of Optimization. John Wiley and Sons, second ed., 1987.
43. T.W. Anderson, "Some Nonparametric Multivariate Procedures Based on Statistically Equivalent Blocks," Multivariate Analysis, P.R. Krishnaiah, ed., pp. 5-28, Academic Press, 1966.
44. L.P. Devroye, "A Universal k-Nearest Neighbor Procedure in Discrimination," Proc. IEEE Computer Soc. Conf. Pattern Recognition and Image Processing," pp. 142-147, 1978.
45. W.S. Meisel and D.A. Michalopoulos, "A Partitioning Algorithm with Application in Pattern Classification and the Optimization of Decision Trees," IEEE Trans. Computers, vol. 22, no. 1, pp. 93-103, 1973.
46. D.W. Scott, A.M. Gotto, J.S. Cole, and G.A, Gorry, "Plasma Lipids as Collateral Risk Factors in Coronary Artery Disease - A Study of 371 Males with Chest Pain," J. Chronic Diseases, vol. 31, pp. 337-345, 1978.
47. D. Coomans, I. Broeckaert, M. Jonckheer, and D.L. Massart, "Comparison of Multivariate Discrimination Techniques for Clinical Data," Methods of Information in Medicine, vol. 22, pp. 93-101, 1983.
48. E.J. Wegman, "Hyperdimensional Data Analysis Using Parallel Coordinates," J. Amer. Statistical Assoc., vol. 85, no. 411, pp. 664-675, 1990.