A Bayesian Classification Approach Using Class-Specific Features for Text Categorization

IEEE Transactions on Knowledge and Data Engineering

Volumn 28, Issue 6, 2016, Pages 1602-1606

  Tang, Bo ^a   He, Haibo ^a   Baggenstoss, Paul M ^b   Kay, Steven ^a  

^a The University of Rhode Island   (United States)

^b FRAUNHOFER FKIE   (Germany)

Author keywords

class specific features; dimension reduction; Feature selection; naive Bayes; PDF projection and estimation; text categorization

Indexed keywords

BENCHMARKING; DATA MINING; FEATURE EXTRACTION; TEXT PROCESSING;

AUTOMATIC TEXT CATEGORIZATION; BAYESIAN CLASSIFICATION; BAYESIAN CLASSIFICATION APPROACH; CLASS SPECIFIC FEATURES; CLASSIFICATION PERFORMANCE; DIMENSION REDUCTION; NAIVE BAYES; TEXT CATEGORIZATION;

CLASSIFICATION (OF INFORMATION);

EID: 84968876693     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2016.2522427     Document Type: Article

References (25)

1. W. Lam, M. Ruiz, and P. Srinivasan, "Automatic text categorization and its application to text retrieval," IEEE Trans. Knowl. Data Eng., vol. 11, no. 6, pp. 865-879, Nov./Dec. 1999.
2. F. Sebastiani, "Machine learning in automated text categorization," ACM Comput. Surveys, vol. 34, no. 1, pp. 1-47, 2002.
3. G. Forman, "An extensive empirical study of feature selection metrics for text classification," The J. Mach. Learn. Res., vol. 3, pp. 1289-1305, 2003.
4. H. Liu and L. Yu, "Toward integrating feature selection algorithms for classification and clustering," IEEE Trans. Knowl. Data Eng., vol. 17, no. 4, pp. 491-502, Apr. 2005.
5. P. M. Baggenstoss, "Class-specific feature sets in classification," IEEE Trans. Signal Process., vol. 47, no. 12, pp. 3428-3432, Dec. 1999.
6. P. M. Baggenstoss, "The pdf projection theorem and the class-specific method," IEEE Trans. Signal Process., vol. 51, no. 3, pp. 672-685, Mar. 2003.
7. A. McCallum and K. Nigam, "A comparison of event models for naive Bayes text classification," in Proc. Workshop Learn. for Text Categorization, 1998, vol. 752, pp. 41 -48.
8. V. Kecman, Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models. Cambridge, MA, USA: MIT Press, 2001.
9. L. Wang and X. Fu, Data Mining with Computational Intelligence. New York, NY, USA: Springer, 2006.
10. D. D. Lewis, "Naive (Bayes) at forty: The independence assumption in information retrieval," in Proc. 10th Eur. Conf. Mach. Learn., 1998, pp. 4-15.
11. D. Koller and M. Sahami, "Hierarchically classifying documents using very few words," in Proc. 14th Int. Conf. Mach. Learn., 1997, pp. 170-178.
12. Y. H. Li and A. K. Jain, "Classification of text documents," The Comput. J., vol. 41, no. 8, pp. 537-546, 1998.
13. T. Joachims, "Text categorization with support vector machines: Learning with many relevant features," in Proc. 10th Eur. Conf. Mach. Learn., 1998, pp. 137-142.
14. B. Tang and H. He, "ENN: Extended nearest neighbor method for pattern recognition [research frontier]," IEEE Comput. Intell. Mag., vol. 10, no. 3, pp. 52-60, Aug. 2015.
15. S. Eyheramendy, D. D. Lewis, and D. Madigan, "On the naive Bayes model for text categorization," in Proc. 9th Int. Workshop Artif. Intell. Statist., 2003, pp. 332-339.
16. L. Galavotti, F. Sebastiani, and M. Simi, "Experiments on the use of feature selection and negative evidence in automated text categorization," in Proc. 4th Eur. Conf. Res. Adv. Technol. Digit. Libraries, 2000, pp. 59-68.
17. B. Tang, S. Kay, and H. He, "Toward optimal feature selection in naive Bayes for text categorization," Preprint, arXiv:1602.02850 [stat.ML], 2016.
18. X. Fu and L. Wang, "A GA-based RBF classifier with class-dependent features," in Proc. Congress Evol. Comput., 2002, vol. 2, pp. 1890-1894.
19. L. Wang, N. Zhou, and F. Chu, "A general wrapper approach to selection of class- dependent features," IEEE Trans. Neural Netw., vol. 19, no. 7, pp. 1267-1278, Jul. 2008.
20. S. Kay, "Asymptotically optimal approximation of multidimensional pdf's by lower dimensional pdf's," IEEE Trans. Signal Process., vol. 55, no. 2, pp. 725-729, Feb. 2007.
21. B. Tang, H. He, Q. Ding, and S. Kay, "A parametric classification rule based on the exponentially embedded family," IEEE Trans. Neural Netw. Learn. Syst., vol. 26, no. 2, pp. 367-377, Feb. 2015.
22. D. Cai, X. He, and J. Han, "Document clustering using locality preserving indexing," IEEE Trans. Knowl. Data Eng., vol. 17, no. 12, pp. 1624-1637, Dec. 2005.
23. D. Cai, Q. Mei, J. Han, and C. Zhai, "Modeling hidden topics on document manifold," in Proc. 17th ACM Conf. Inf. Knowl. Manage., 2008, pp. 911-920.
24. H. He and E. Garcia, "Learning from imbalanced data," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
25. B. Tang and H. He, "KernelADASYN: Kernel based adaptive synthetic data generation for imbalanced learning," in Proc. IEEE Congress Evol. Comput., 2015, pp. 664-671.