Fuzzy classification using pattern discovery

IEEE Transactions on Fuzzy Systems

Volumn 15, Issue 5, 2007, Pages 772-783

  Hamilton Wright, Andrew ^a,b   Stashuk, Daniel W ^c   Tizhoosh, Hamid R ^c  

^a UNIVERSITY OF GUELPH   (Canada)

^b MOUNT ALLISON UNIVERSITY   (Canada)

^c UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Decision support systems; Deductive databases; Fuzzy logic; Fuzzy systems; Pattern classification; Pattern clustering methods; Pattern matching; Statistical databases

Indexed keywords

CLUSTERING ALGORITHMS; DATABASE SYSTEMS; DECISION SUPPORT SYSTEMS; FUZZY LOGIC; PATTERN MATCHING;

DEDUCTIVE DATABASES; PATTERN CLASSIFICATION; PATTERN CLUSTERING; STATISTICAL DATABASES;

FUZZY SYSTEMS;

EID: 35348928130     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2006.889930     Document Type: Article

References (67)

1. L. A. Zadeh, "A fuzzy-algorithmic approach to the definition of complex or imprecise concepts," Int. J. Man Mach. Stud., vol. 8, pp. 249-291, 1976, reprinted in [58].
2. L. A. Zadeh, "Fuzzy sets as a basis for a theory of possibility," Fuzzy Sets Syst., vol. 1, pp. 3-28, 1978.
3. L. A. Zadeh, "The role of fuzzy logic in the management of uncertainty in expert systems," Fuzzy Sets Syst., vol. 11, pp. 199-227, 1983.
4. E. H. Mamdani, "Applications of fuzzy algorithms for simple dynamic plant," in Proc. Inst. Elect. Eng., 1974, vol. 121, pp. 1585-1588.
5. E. Cox, The Fuzzy Systems Handbook. Cambridge, MA: Academic, 1994.
6. T. Heske and J. N. Heske, Fuzzy Logic for Real World Design. San Diego, CA: Annabooks, 1999.
7. L. O. Hall, "Rule chaining in fuzzy expert systems," IEEE Trans. Fuzzy Syst., vol. 9, no. 6, pp. 822-828, Dec. 2001.
8. G. Beliakov and J. Warren, "Appropriate choice of aggregation operators in fuzzy decision support systems," IEEE Trans. Fuzzy Syst., vol. 9, no. 6, pp. 773-784, Dec. 2001.
9. R. J. Hathaway and J. C. Bezdek, "Clustering incomplete relational data using the non-Euclidean relational fuzzy c-means algorithm," Pattern Recog. Lett., vol. 23, pp. 151-160, 2002.
10. N. R. Pal, J. C. Bezdek, and R. J. Hathaway, "Sequential competitive learning and the fuzzy c-means clustering algorithms," Neural Netw., vol. 9, no. 5, pp. 787-796, 1996.
11. N. R. Pal, K. Pal, and J. C. Bezdek, "A mixed c-means clustering model," in Proc. 6th IEEE Int. Conf. Fuzzy Syst., Jul. 1997, vol. 1, pp. 11-21.
12. R. Krishnapuram and J. M. Keller, "The possibilistic c-means algorithm: Insights and recommendations," IEEE Trans. Fuzzy Syst. vol. 4, no. 3, pp. 385-393, Jun. 1996.
13. R. Krishnapuram and J. M. Keller, "A possibilistic approach to clustering," IEEE Trans. Fuzzy Syst., vol. 1, no. 2, pp. 98-110, Apr. 1993.
14. I. Rojas, H. Pomares, J. Ortega, and A. Prieto, "Self-organized fuzzy system generation from training examples," IEEE Trans. Fuzzy Syst. vol. 8, no. 1, pp. 23-36, Feb. 2000.
15. A. Ghosh, N. R. Pal, and S. K. Pal, "Self-organization for object extraction using a multilayer neural network and fuzziness measures," IEEE Trans. Fuzzy Syst., vol. 1, no. 1, pp. 54-68, Feb. 1993.
16. S. Mitra and Y. Hayashi, "Neuro-fuzzy rule generation: Survey in soft computing framework," IEEE Trans. Neural Netw., vol. 11, no. 3, pp. 748-768, May 2000.
17. A. Labbi and E. Gauthier, "Combining fuzzy knowledge and data for neuro-fuzzy modeling," J. Int. Syst., vol. 6, no. 4, 1997.
18. S. K. Pal and S. Mitra. Neuro-Fuzzy Pattern Recognition: Methods in Soft Computing, ser. Wiley Series on Intelligent Systems. New York: Wiley-Interscience, 1999.
19. W. Pedrycz, Fuzzy Sets Engineering. Boca Raton, FL: CRC, 1995.
20. R. Kruse, J. E. Gebhardt, and F. Klawonn, Foundations of Fuzzy Systems. New York: Wiley, 1994.
21. D. Nauck, F. Klawonn, and R. Kruse, Foundations of Neuro-Fuzzy Systems. New York: Wiley, 1997.
22. F. Höppner, F. Klawonn, R. Kruse, and T. A. Runkler, Fuzzy Cluster Analysis. Chichester, U.K.: Springer-Verlag, 1999.
23. D. Nauck and R. Kruse, Designing Neuro-Fuzzy Systems Through Backpropagation. Boston, MA: Kluwer, 1996, pp. 203-228.
24. D. Nauck and R. Kruse, "A neuro-fuzzy method to learn fuzzy classification rules from data," Fuzzy Sets Syst., vol. 89, no. 3, pp. 277-288, 1997.
25. B. Gabrys, "Learning hybrid neuro-fuzzy classifier models from data: To combine or not to combine?," Fuzzy Sets Syst., vol. 147, no. 1, pp. 39-56, 2004.
26. Q. Song and N. K. Kasabov, "NFI: A neuro-fuzzy inference method for transductive reasoning," IEEE Trans. Fuzzy Syst., vol. 13, no. 6, pp. 799-808, Dec. 2005.
27. J.-S. Wang and C. S. G. Lee, "Self-adaptive neuro-fuzzy inference systems for classification applications," IEEE Trans. Fuzzy Syst. vol. 10, no. 6, pp. 790-802, Dec. 2002.
28. D. Spiegel and T. Sudkamp, "Sparse data in the evolutionary generation of fuzzy models," Fuzzy Sets Syst., vol. 138, pp. 363-379, 2003.
29. F. Hoffmann, "Combined boosting and evolutionary algorithms for learning of fuzzy classification rules," Fuzzy Sets Syst., vol. 141, pp. 47-58, 2004.
30. H. Ishibuchi and T. Murata, "Learning of fuzzy classification rules by a genetic algorithm," Electron. Commun. Jpn., vol. 80, no. 3, pp. 37-46, 1997.
31. H. Ishibuchi, K. Nozaki, N. Yamamoto, and H. Tanaka, "Construction of fuzzy classification systems with rectangular fuzzy rules using genetic algorithms," Fuzzy Sets Syst., vol. 65, no. 2/3, pp. 237-253, 1994.
32. O. Cordón, F. Herrera, F. Hoffmann, and L. Magkalena, Genetic Fuzzy Systems: Evolutionary Tuning and Learning of Fuzzy Knowledge Bases Singapore: World Scientific, 2001, ch. 11, pp. 375-382.
33. R. R. Yager and D. P. Filev, "Relational partitioning of fuzzy rules," Fuzzy Sets Syst., vol. 80, pp. 57-69, 1996.
34. A. Chong, T. D. Gedon, K. W. Wong, and L. T. Koczy, "A histogram-based rule extraction technique for fuzzy systems," in Proc. Fuzzy Systems FUZZ-IEEE'01. Melbourne, Australia: IEEE, 2001, pp. 638-641.
35. T.-P. Hong and C.-Y. Lee, "Induction of fuzzy rules and membership function from training examples," Fuzzy Sets Syst., vol. 84, pp. 33-47, Nov. 1996.
36. X. Z. Wang, Y. D. Wang, X. F. Xu, W. D. Ling, and D. S. Yeung, "A new approach to fuzzy rule generation: Fuzzy extension matrix," Fuzzy Sets Syst., vol. 123, pp. 291-306, 2001.
37. H. Xing, S. H. Huang, and J. Shi, "Rapid development of knowledge-based systems via integrated knowledge acquisition," Artif. Intell. Eng. Design, Anal. Manuf., vol. 17, pp. 221-234, 2003.
38. J. R. Quinlan, C4.5: Programs for Machine Learning. San Francisco, CA: Morgan Kaufman, 1993.
39. J. R. Quinlan, "Learning first-order definitions of functions," J. Artif. Intell. Res., vol. 5, pp. 139-161, 1996.
40. Q. Shen and A. Chouchoulas, "A rough-fuzzy approach for generating classification rules," Pattern Recog., vol. 35, pp. 2425-2438, 2002.
41. S. Tsumoto, "Statistical evidence for rough set analysis," in Proc. Fuzzy Systems FUZZ-IEEE'02. Honolulu, Hawaii: IEEE, 2002, pp. 757-762.
42. W. Ziarko, "Acquisition of hierarchy-structured probabalistic decision tables and rules from data," in Proc. Fuzzy Systems FUZZ-IEEE'02. Honolulu, Hawaii: IEEE, 2002, pp. 779-784.
43. C. L. Bean, C. Kambhampati, and S. Rajasekharan, "A rough set solution to a fuzzy set problem," in Proc. Fuzzy Systems FUZZ-IEEE'02. Honolulu, Hawaii: IEEE, 2002, pp. 18-23.
44. D. Kukolj, "Design of adaptive Takagi-Sugeno-Kang fuzzy models," Appl. Soft Comput., vol. 2, pp. 89-103, 2002.
45. L. Chen, N. Tokuda, X. Zhang, and Y. He, "A new scheme for an automatic generation of multi-variable fuzzy systems," Fuzzy Sets Syst., vol. 120, pp. 323-329, 2001.
46. M.-Y. Chen, "Establishing interpretable fuzzy models from numeric data," in Proc. 4th World Congr. Intell. Control Automat., Jun. 2002, vol. 3, pp. 1857-1861.
47. Y. Wang, "High order pattern discovery and analysis of discrete-valued data sets," Ph.D. dissertation, Syst. Design Eng., Univ. Waterloo, Waterloo, ON, Canada, 1997.
48. A. K. C. Wong and Y. Wang, "High-order pattern discovery from discrete-valued data," IEEE Trans. Knowledge Data Eng., vol. 9, no. 6, pp. 877-893, Nov.-Dec. 1997.
49. A. K. C. Wong and Y. Wang, "Pattern discovery: A data driven approach to decision support," IEEE Trans. Syst., Man, Cybern. C, vol. 33, no. 1, pp. 114-124, Feb. 2003.
50. Y. Wang and A. K. C. Wong, "From association to classification: Inference using weight of evidence," IEEE Trans. Knowledge Data Eng. vol. 15, no. 3, pp. 764-767, May-Jun. 2003.
51. A. Hamilton-Wright and D. W. Stashuk, "Comparing 'pattern discovery' and back-propagation classifiers," in Proc. Int. Joint Conf. Neural Networks (IJCNN), Montréal, QC, Canada, Jul. 2005, vol. 2, pp. 1286-1291, IEEE/INNS.
52. T. Chau, "Marginal maximum entropy partitioning yields asymptotically consistent probability density functions," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, no. 4, pp. 414-417, Apr. 2001.
53. D. V. Gokhale, "On joint and conditional entropies," Entropy, vol. 1, no. 2, pp. 21-24, 1999.
54. S. J. Haberman, "The analysis of residuals in cross-classified tables," Biomet., vol. 29, no. 1, pp. 205-220, Mar. 1973.
55. B. Kosko, "Fuzzy systems as universal approximators," IEEE Trans. Comput., vol. 43, no. 11, pp. 1329-1333, Nov. 1994.
56. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its application to modeling," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, no. 1, pp. 116-132, Jan. 1985.
57. M. Sugeno and G. T. Kang, "Structure identification of fuzzy model," Fuzzy Sets Syst., vol. 28, pp. 15-33, 1988.
58. R. R. Yager, S. Ovchinnikov, R. M. Tong, and H. T. Nguyen, Eds., Fuzzy Sets and Applications: Selected Papers by L.A. Zadeh. New York: Wiley, 1987.
59. P. K. Simpson, Artificial Neural Systems. New York: Windcrest/ Mcgraw-Hill, 1991.
60. J. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation. Santa Fe, NM: Santa Fe Institute Studies in the Sciences of Complexity, 1991.
61. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
62. D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz, UCI Repository of Machine Learning Databases 1998 [Online]. Available: http:// www.ics.uci.edu/~mlearn/MLRepository.html
63. A. Hamilton-Wright and D. W. Stashuk, "Transparent decision support using statistical reasoning and fuzzy inference," IEEE Trans. Knowledge Data Eng., vol. 18, no. 8, pp. 1125-1137, Aug. 2007.
64. A. Hamilton-Wright, D. W. Stashuk, and L. Pino, "On weight of evidence based reliability in 'pattern discovery'," in Proc. 11th Int. Conf. Inform. Process. Manag. Uncertainty Knowledge-Based Syst., Paris, France, 2006, IPMU.
65. A. Hamilton-Wright, D. W. Stashuk, and L. Pino, "Internal measures of reliability in "pattern discovery" based fuzzy inference," in Proc. 11th Int. Conf. Inform. Process. Manag. Uncertainty Knowledge-Based Syst., Paris, France, 2006, IPMU.
66. A. Hamilton-Wright and D. W. Stashuk, "Fuzzy rule based decision making for electromyographic characterization," in Proc. 11th Int. Conf. Inform. Process. Manag. Uncertainty Knowledge-Based Syst., Paris, France, 2006, IPMU.
67. A. Hamilton-Wright and D. W. Stashuk, "A framework for incorporating 'weight of evidence' within a fuzzy rule based classification system," in Proc. Int. Joint Conf. North Amer. Fuzzy Inform. Process. Soc. Biannu. Conf., Jun. 2005, pp. 466-471.