Deep Learning with MCA-based Instance Selection and Bootstrapping for Imbalanced Data Classification

Proceedings - 2015 IEEE Conference on Collaboration and Internet Computing, CIC 2015

Volumn , Issue , 2016, Pages 288-295

  Guan, Sheng ^a   Chen, Min ^b   Ha, Hsin Yu ^a   Chen, Shu Ching ^a   Shyu, Mei Ling ^c   Zhang, Chengde ^d  

^a FLORIDA INTERNATIONAL UNIVERSITY   (United States)

^b UNIVERSITY OF WASHINGTON BOTHELL   (United States)

^c University of Miami College of Engineering   (United States)

^d ZHONGNAN UNIVERSITY OF ECONOMICS AND LAW   (China)

Author keywords

Bootstrapping; Classification; Convolutional neural network (CNN); Imbalanced data; Multiple correspondence analysis (MCA); Supervised learning

Indexed keywords

CONVOLUTION; INTERNET; NEURAL NETWORKS; PRINCIPAL COMPONENT ANALYSIS; STATISTICAL METHODS; SUPERVISED LEARNING;

BOOTSTRAPPING; CLASSIFICATION PERFORMANCE; COMPUTATIONAL TIME; CONVOLUTIONAL NEURAL NETWORK; IMBALANCED DATA; INSTANCE SELECTION; MULTIPLE CORRESPONDENCE ANALYSIS; STATE-OF-THE-ART METHODS;

CLASSIFICATION (OF INFORMATION);

EID: 84964895866     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIC.2015.40     Document Type: Conference Paper

References (51)

1. X. Huang, S.-C. Chen, M.-L. Shyu, and C. Zhang, "User Concept Pattern Discovery Using Relevance Feedback and Multiple Instance Learning for Content-Based Image Retrieval, " Proceedings of the Third International Workshop on Multimedia Data Mining (MDM/KDD'2002), in conjunction with the 8th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 100-108, July 23, 2002, Edmonton, Alberta, Canada.
2. S.-C. Chen, S. Sista, M.-L. Shyu, and R. L. Kashyap, "Augmented Transition Networks as Video Browsing Models for Multimedia Databases and Multimedia Information Systems, " Proceedings of the 11th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'99), pp. 175-182, November 9-11, 1999, Chicago, IL, USA.
3. S.-C. Chen, S. H. Rubin, M.-L. Shyu, and C. Zhang, "A Dynamic User Concept Pattern Learning Framework for Content-Based Image Retrieval, " IEEE Transactions on Systems, Man, and Cybernetics: Part C, Vol. 36, Issue 6, pp. 772-783, November 2006.
4. S.-C. Chen, S. H. Rubin, M.-L. Shyu, and C. Zhang, "A Dynamic User Concept Pattern Learning Framework for Content-Based Image Retrieval, " IEEE Transactions on Systems, Man, and Cybernetics: Part C, Vol. 36, Issue 6, pp. 772-783, November 2006.
5. X. Li, S.-C. Chen, M.-L. Shyu, and B. Furht, "Image Retrieval by Color, Texture, and Spatial Information, " Proceedings of the 8th International Conference on Distributed Multimedia Systems (DMS'2002), pp. 152-159, September 26-28, 2002, San Francisco Bay, California, USA.
6. M.-L. Shyu, C. Haruechaiyasak, and S.-C. Chen, "Category Cluster Discovery from Distributed WWW Directories, " Journal of Information Sciences, special issue on Knowledge Discovery from Distributed Information Sources, Vol. 155, Issues 3-4, pp. 181-197, October 2003.
7. X. Li, S.-C. Chen, M.-L. Shyu, and B. Furht, "An Effective Content-Based Visual Image Retrieval System, " Proceedings of the 26th IEEE Computer Society International Computer Software and Applications Conference (COMPSAC), pp. 914-919, August 26-29, 2002, Oxford, England.
8. M.-L. Shyu, S.-C. Chen, M. Chen, C. Zhang, and K. Sarinnapakorn, "Image Database Retrieval Utilizing Affinity Relationships, " Proceedings of the First ACM International Workshop on Multimedia Databases (ACM MMDB'03), pp. 78-85, November 7, 2003, New Orleans, Louisiana, USA.
9. X. Chen, C. Zhang, S.-C. Chen, and S. H. Rubin, "A Human-Centered Multiple Instance Learning Framework for Semantic Video Retrieval, " IEEE Transactions on Systems, Man, and Cybernetics: Part C, Vol. 39, Issue 2, pp. 228-233, March 2009.
10. M.-L. Shyu, S.-C. Chen, and R. L. Kashyap, "Generalized Affinity-Based Association Rule Mining for Multimedia Database Queries, " Knowledge and Information Systems (KAIS): An International Journal, vol. 3, no. 3, pp. 319-337, August 2001.
11. Q. Zhu, L. Lin, M.-L. Shyu, and S.-C. Chen, "Effective Supervised Discretization for Classification based on Correlation Maximization, " Proceedings of the 12th IEEE International Conference on Information Reuse and Integration (IRI 2011), Las Vegas, Nevada, USA, pp. 390-395, August 3-5, 2011.
12. H.-B. He and E. A. Garcia, "Learning from Imbalanced Data, " IEEE Transactions on Knowledge and Data Engineering, Vol. 21, No. 9, pp. 1263-1284. September 2009.
13. S.-C. Chen, M.-L. Shyu, and C. Zhang, "An Intelligent Framework for Spatio-Temporal Vehicle Tracking, " Proceedings of the 4th International IEEE Conference on Intelligent Transportation Systems, pp. 213-218, August 25-29, 2001, Oakland, California, USA.
14. L. Lin and M.-L. Shyu, "Weighted Association Rule Mining for Video Semantic Detection, " International Journal of Multimedia Data Engineering and Management (IJMDEM), Vol. 1, No. 1, pp. 37-54, 2010.
15. S.-C. Chen, M.-L. Shyu, C. Zhang, and R. L. Kashyap, "Identifying Overlapped Objects for Video Indexing and Modeling in Multimedia Database Systems, " International Journal on Artificial Intelligence Tools, Vol. 10, No. 4, pp. 715-734, December 2001
16. X. Chen, C. Zhang, S.-C. Chen, and M. Chen, "A Latent Semantic Indexing Based Method for Solving Multiple Instance Learning Problem in Region-based Image Retrieval, " Proceedings of the IEEE International Symposium on Multimedia (ISM 2005), pp. 37-44, December 12-14, 2005, Irvine, California, USA.
17. S.-C. Chen, S. Sista, M.-L. Shyu, and R. L. Kashyap, "Indexing and Searching Structure for Multimedia Database Systems, " Proceedings of the IS&T/SPIE conference on Storage and Retrieval for Media Databases 2000, pp. 262-270, January 23-28, 2000, San Jose, CA, USA.
18. S.-C. Chen, "Multimedia Databases and Data Management: A Survey, " International Journal of Multimedia Data Engineering and Management, Vol. 1, No. 1, pp. 1-11, January-March 2010.
19. S.-C. Chen, S. Sista, M.-L. Shyu, and R. L. Kashyap, "Indexing and Searching Structure for Multimedia Database Systems, " Proceedings of the IS&T/SPIE conference on Storage and Retrieval for Media Databases 2000, pp. 262-270, January 23-28, 2000, San Jose, CA, USA.
20. C. Chen and M.-L. Shyu, "Integration of Semantics Information and Clustering in Binary-class Classification for Handling Imbalanced Multimedia Data, " Edited by Tansel Ozyer, Keivan Kianmehr, Mehmet Tan, and Jia Zeng, Information Reuse and Integration in Academia and Industry, Chapter 14, Springer Verlag, 2013.
21. C. Chen and M.-L. Shyu, "Clustering-based Binary-class Classification for Imbalanced Data Sets, " Proceedings of the 12th IEEE International Conference on Information Reuse and Integration, pp. 384-389, Las Vegas, Nevada, USA, August 2011.
22. L. Lin, G. Ravitz, M.-L. Shyu, and S.-C. Chen, "Video Semantic Concept Discovery using Multimodal-based Association Classification, " Proceedings of the IEEE International Conference on Multimedia & Expo, pp. 859-862, Beijing, China, July 2-5, 2007.
23. M.-L. Shyu, S.-C. Chen, Q. Sun, and H. Yu, "Overview and Future Trends of Multimedia Research for Content Access and Distribution, " International Journal of Semantic Computing (IJSC), Vol. 1, No. 1, pp. 29-66, March 2007.
24. L.-S. Chen, C.-C. Hsu, and Y.-S. Chang, "MDS: A Novel Method for Class Imbalance Learning, " Proceedings of the International Conference on Ubiquitous Information Management and Communication, pp. 544-549, Janurary 2009.
25. J. Wan, D. Wang, S. C. H. Hoi, P. Wu, J. Zhu, Y. Zhang, and J. Li, "Deep Learning for Content-Based Image Retrieval: A Comprehensive Study, " Proceedings of the ACM International Conference on Multimedia, pp. 157-166, Novemember 2014.
26. H.-B. He, Y. Bai, E. A. Garcia and S.-T. Li, "ADASYN: Adaptive Synthetic Sampling Approach for Imbalanced Learning, " Proceedings of the International Joint Conference on Neural Networks, pp. 1322-1328, June 2008
27. L. Zhang and W. Wang, "A Re-sampling Method for Class Imbalance Learning with Credit Data, " Proceedings of the 2011 International Conference on Information Technology, Computer Engineering and Management Sciences, pp. 393-397, September 2011.
28. N. V. Chawla and K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic Minority Overbootstrapping Technique, " Journal of Artijcial Intelligence Research, 16, pp. 321-357, 2002.
29. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. "Gradient-based Learning Applied to Document Recognition, " Proceedings of the IEEE, Vol. 86, No. 11, pp. 2278-2324, November 1998.
30. E. R. Kandel, "An Introduction to the Work of David Hubel and Torsten Wiesel, " The Journal of Physiology 587 (Pt 12), pp. 2733-2741, April 2009.
31. J. Bouvrie, "Notes on Convolutional Neural Networks., " Technical Report, 2006.
32. P. Swietojanski, A. Ghoshal, and S. Renals, "Convolutional Neural Networks for Distant Speech Recognition, " IEEE Signal Processing Letters, Vol. 21, No. 9, pp. 1120-1124, September 2014.
33. X. Chen, S. Xiang, C.-L. Liu, and C.-H. Pan, "Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks, " IEEE Geoscience and Remote Sensing Letters, Vol. 11, No. 10, pp. 1797-1801, Octorber 2014.
34. Q. Mao, M. Dong, Z. Huang, and Y. Zhan, "Learning Salient Features for Speech Emotion Recognition Using Convolutional Neural Networks, " IEEE Transactions on Multimedia, Vol. 16, No. 8, pp. 2203-2213, December 2014.
35. Y. Yan, Y. Liu, M.-L. Shyu, and M. Chen, "Utilizing Concept Correlations for Effective Imbalanced Data Classification, " Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration, pp. 561-568, August 13-15, 2014.
36. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei, "Large-Scale Video Classification with Convolutional Neural Networks, " Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1725-1732, June 2014.
37. D. Verma and V. Maru. "An Efficient Approach for Color Image Retrieval using Haar Wavelet, " Proceedings of the IEEE International Conference on In Methods and Models in Computer Science, pp. 1-5, 2009.
38. N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection, " Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1, pp. 886-893, June 2005.
39. J. C. Femiani and A. Razdan, "Interval HSV: Extracting ink annotations" Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2520-2527, June 2009
40. S. Sural, G. Qian, and S. Pramanik, "Segmentation and Histogram Generation using the HSV Color Space for Image Retrieval, " Proceedings of the International Conference on Image Processing (ICIP), pp. 589-592, 2002.
41. S. A. Chatzichristofis and Y. S. Boutalis, "CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval, " Proceedings of the 6th International Conference on Computer Vision Systems, pp. 312-322, Berlin, Heidelberg, 2008.
42. K. He, X. Zhang, S. Ren, and J. Sun, "Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition, " Proceedings of the European Conference on Computer Vision, pp. 346-361, Zurich, Switzerland, September 6-12, 2014.
43. M. Buckland and F. Gey, "The Relationship Between Recall and Precision, " Journal of the American Society for Information Science, Vol. 45, No. 1, pp. 12-19, January 1999.
44. A. F. Smeaton, P. Over, and W. Kraaij, "Evaluation Campaigns and TRECVid, " Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321-330, 2006.
45. T. Meng and M.-L. Shyu, "Leveraging Concept Association Network for Multimedia Rare Concept Mining and Retrieval, " Proceedings of the 2012 IEEE International Conference on Multimedia and Expo, pp. 860-865, Washington DC, USA, July 2012.
46. T. Meng and M.-L. Shyu, "Automatic Annotation of Drosophila Developmental Stages using Association Classification and Information Integration, " Proceedings of the 2011 IEEE International Conference on Information Resue and Integration, pp. 142-147, Las Vegas, Nevada, August 2011.
47. Y. Sun, T. Osawa, K. Sudo, Y. Taniguchi, H. Li, Y. Guan, and L. Liu, "TRECVid 2013 Semantic Video Concept Detection by NTT-MDDUT, " TRECVID 2013, November 26-28, 2013.
48. C. G. M. Snoekyz, K. E. A. van de Sandeyz, D. Fontijnez, A. Habibiany, M. Jain, S. Kordumovay, Z. Liy, M. Mazloomy, S. L. Pinteay, R. Taoy, D. C. Koelmayz, and A. W. M. Smeulders, "MediaMill at TRECVID 2013: Searching Concepts, Objects, Instances and Events in Video, " TRECVID 2013, November 26-28, 2013.
49. A. F. Smeaton, P. Over, and W. Kraaij, "Evaluation Campaigns and TRECVid, " Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321-330, 2006.
50. N. Inoue, T. Wada, Y. Kamishima, K. Shinoda, and S. Sato, "TokyoTech+Canon at TRECVID 2011, " Proceedings of the TRECVID Workshop 2011, December 5, 2011.
51. N. Inoue and K. Shinoda, "A Fast and Accurate Video Semantic-Indexing System Using Fast MAP Adaptation and GMM Supervectors, " IEEE Transactions on Multimedia, Vol. 14, No. 4-2, pp. 1196-1205, 2012.