Big data opportunities and challenges: Discussions from data analytics perspectives [Discussion Forum]

IEEE Computational Intelligence Magazine

Volumn 9, Issue 4, 2014, Pages 62-74

  Zhou, Zhi Hua ^a   Chawla, Nitesh V ^b   Jin, Yaochu ^c   Williams, Graham J ^d  

^a NANJING UNIVERSITY   (China)

^b University of Notre Dame   (United States)

^c UNIVERSITY OF SURREY   (United Kingdom)

^d Australian Tax Office   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ANALYTICS; DISCUSSION FORUM;

EID: 84908019121     PISSN: 1556603X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCI.2014.2350953     Document Type: Review

References (63)

1. J. Abello, P. M. Pardalos, and M. G. Resende, Handbook of Massive Data Sets (Massive Computing). vol. 4, New York: Springer, 2002.
2. C. C. Aggarwal and P. S. Yu, Eds., Privacy-Preserving Data Mining: Models and Algorithms. New York: Springer, 2008.
3. C. C. Aggarwal, Data Streams: Models and Algorithms. vol. 31, New York: Springer, 2007.
4. (2013). Australian Dept. Immigration. Fact sheet 70- Managing the border Internet. [Online]. Available: http:// www. immi. gov. au/media/fact-sheets/70border. htm
5. J. Bader and E. Zitzler, "HypE: An algorithm for fast hypervolume-based manyobjective optimization," Evol. Comput., vol. 19, no. 1, pp. 45-76, 2011.
6. P. Baldi and P. J. Sadowski, "Understanding dropout," in Advances in Neural Information Processing Systems 26. Cambridge, MA: MIT Press, 2013, pp. 2814-2822.
7. M. Banko and E. Brill, "Scaling to very very large corpora for natural language disambiguation," in Proc. 39th Annu. Meeting Association Computational Linguistics, Toulouse, France, 2001, pp. 26-33.
8. A.-L. Barabási, Linked: The New Science of Networks. New York: Basic Books, 2002.
9. M. Basu and T. K. Ho, Data Complexity in Pattern Recognition. London, U. K. : Springer, 2006.
10. Y. Bengio, "Learning deep architectures for AI," Foundations Trends Mach. Learn., vol. 2, no. 1, pp. 1-127, 2009.
11. E. Brynjolfsson, L. Hitt, and H. Kim. (2011). Strength in numbers: How does data-driven decision making affect firm performance? [Online]. Available: http://ssrn. com/abstract=1819486
12. T. Chai, Y. Jin, and S. Bernhard, "Evolutionary complex engineering optimization: Opportunities and challenges," IEEE Comput. Intell. Mag., vol. 8, no. 3, pp. 12-15, 2013.
13. N. V. Chawla, "Data mining for imbalanced datasets: An overview," in Data Mining and Knowledge Discovery Handbook, O. Maimon and L. Rokach, Eds. New York: Springer, 2005, pp. 853-867.
14. N. V. Chawla, Learning on Extremes-Size and Imbalance-of Data. Tampa, FL: Univ. South Florida, 2002.
15. Q. Da, Y. Yu, and Z.-H. Zhou, "Learning with augmented class by exploiting unlabeled data," in Proc. 28th AAAI Conf. Artificial Intelligence, Quebec City, QC, Canada, 2014.
16. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: NSGAII," IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182-197, 2002.
17. T. G. Dietterich, "Approximate statistical tests for comparing supervised classification learning algorithms," Neural Comput., vol. 10, no. 7, pp. 1895-1923, 1998.
18. D. Easley and J. Kleinberg, Networks, Crowds, and Markets. Cambridge, U. K. : Cambridge Univ. Press, 2010.
19. A. Farhangfar, L. Kurgan, and J. Dy, "Impact of imputation of missing values on classification error for discrete data," Pattern Recognit., vol. 41, no. 12, pp. 3692-3705, 2008.
20. L. Feng, Y.-S. Ong, I. Tsang, and A.-H. Tan, "An evolutionary search paradigm that learns with past experiences," in Proc. IEEE Congr. Evolutionary Computation, Brisbane QLD, Australia, 2012, pp. 1-8.
21. M. M. Gaber, A. Zaslavsky, and S. Krishnaswamy, "Mining data streams: A review," ACM SIGMOD Record, vol. 34, no. 2, pp. 18-26, 2005.
22. W. Gao, R. Jin, S. Zhu, and Z.-H. Zhou, "Onepass AUC optimization," in Proc. 30th Int. Conf. Machine Learning, Atlanta, GA, 2013, pp. 906-914.
23. W. Gao and Z.-H. Zhou, "Dropout rademacher complexity of deep neural networks," CORR abs/1402. 3811, 2014.
24. J. A. Hanley and B. J. McNeil, "A method of comparing the areas under receiver operating characteristic curves derived from the same cases," Radiology, vol. 148, no. 3, pp. 839-843, 1983.
25. G. E. Hinton, P. Dayan, B. J. Frey, and R. M. Neal, "The "wake-sleep" algorithm for unsupervised neural networks," Science, vol. 268, no. 5214, pp. 1158-1161, 1995.
26. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
27. H. Ishibuchi, M. Yamane, N. Akedo, and Y. Nojima, "Many-objective and many-variable test problems for visual examination of multiobjective search," in Proc. IEEE Congr. Evolutionary Computation, Cancun, QROO, 2013, pp. 1491-1498.
28. H. Ishibuchi and T. Murata, "Multi-objective genetic local search algorithm," in Proc. IEEE Int. Conf. Evolutionary Computation, Nagoya, Japan, 1996, pp. 119-124.
29. Y. Jin and J. Branke, "Evolutionary optimization in uncertain environments-A survey," IEEE Trans. Evol. Comput., vol. 9, no. 3, pp. 303-317, 2005.
30. Y. Jin, K. Tang, X. Yu, B. Sendhoff, and X. Yao, "A framework for finding robust optimal solutions over time," Memetic Comput., vol. 5, no. 1, pp. 3-18, 2013.
31. T. Joachims, "Making large-scale SVM training practical," in Advances in Kernel Methods, B. SchÖlkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 169-184.
32. Y. LeCun and Y. Bengio, "Convolutional networks for images, speech, and time series," in The Handbook of Brain Theory and Neural Networks, M. A. Arbib, Ed. Cambridge, MA: MIT Press, 1995.
33. J. Leskovec, A. Krause, C. Guestrin, C. Faloutsos, J. VanBriesen, and N. Glance, "Cost-effective outbreak detection in networks," in Proc. 13th ACM SIGKDD Int. Conf. Knowledge Discovery Data Mining, 2007, pp. 420-429.
34. M. Li, W. Wang, and Z.-H. Zhou, "Exploiting remote learners in internet environment with agents," Sci. China: Inform. Sci., vol. 53, no. 1, pp. 47-76, 2010.
35. N. Li, I. W. Tsang, and Z.-H. Zhou, "Efficient optimization of performance measures by classifier adaptation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1370-1382, 2013.
36. R. N. Lichtenwalter, J. T. Lussier, and N. V. Chawla, "New perspectives and methods in link prediction," in Proc. 16th ACM SIGKDD Int. Conf. Knowledge Discovery Data Mining, 2010, pp. 243-252.
37. V. Mayer-SchÖnberger and K. Cukier, Big Data: A Revolution That Transforms How We Work, Live, and Think. Boston, MA: Houghton Miff lin Harcourt, 2012. (Chinese translated version by Y. Sheng and T. Zhou, Zhejiang Renmin Press).
38. M. Mohri and A. Rostamizadeh, "Stability bounds for stationary {-mixing and b-mixing processes," J. Mach. Learn. Res., vol. 11, pp. 789-814, 2010.
39. J. G. Moreno-Torres, T. Raeder, R. Alaiz-Rodríguez, N. V. Chawla, and F. Herrera, "A unifying view on dataset shift in classification," Pattern Recognit., vol. 45, no. 1, pp. 521-530, 2012.
40. National Research Council, Frontiers in Massive Data Analysis. Washington, D. C. : The National Academies Press, 2013.
41. M. E. Newman, "The structure and function of complex networks," SIAM Rev., vol. 45, no. 2, pp. 167-256, 2003.
42. T. T. Nguyen, S. Yang, and J. Branke, "Evolutionary dynamic optimization: A survey of the state of the art," Swarm Evol. Comput., vol. 6, pp. 1-24, Oct. 2012.
43. B.-H. Park and H. Kargupta, "Distributed data mining: Algorithms, systems, and applications," in The Handbook of Data Mining, N. Ye, Ed. Mahwah, New Jersey, US: Lawrence Erlbaum Associates, 2002, pp. 341-358.
44. J. Pearl, Causality: Models, Reasoning and Inference. Cambridge, U. K. : Cambridge Univ. Press, 2000.
45. G. Piatetsky-Shapiro and W. Frawley, Eds., Proceedings of IJCAI89 Workshop on Knowledge Discovery in Databases. Detroit, MI: AAAI, 1989.
46. J. C. Schlimmer and D. Fisher, "A case study of incremental concept induction," in Proc. 5th Nat. Conf. Artificial Intelligence, Philadelphia, PA, 1986, pp. 496-501.
47. B. Settles. (2009). Active learning literature survey. Dept. Comput. Sci., Univ. Wisconsin at Madison. Wisconsin, WI. Tech. Rep. 1648. [Online]. Available: http:// pages. cs. wisc. edu/~bsettles/pub/settles. activelearning. pdf
48. J. A. Silva, E. R. Faria, R. C. Barros, E. R. Hruschka, A. C. de Carvalho, and J. Gama, "Data stream clustering: A survey," ACM Computing Surveys (CSUR), vol. 46, no. 1, p. 13, 2013.
49. P. Smyth, "Recent advances in knowledge discovery and data mining (invited talk)," in Proc. 14th Nat. Conf. Artificial Intelligence, Providence, RI, 1997.
50. A. Srivastava, E.-H. Han, V. Kumar, and V. Singh, Parallel Formulations of Decision-Tree Classification Algorithms. New York: Springer, 2002.
51. S. A. Thomas and Y. Jin, "Reconstructing biological gene regulatory networks: Where optimization meets big data," Evol. Intell., vol. 7, no. 1, pp. 29-47, 2013.
52. S. Wager, S. Wang, and P. Liang, "Dropout training as adaptive regularization," in Advances in Neural Information Processing Systems 26. Cambridge, MA: MIT Press, 2013, pp. 351-359.
53. D. Walker, R. Everson, and J. E. Fieldsend, "Visualising mutually non-dominating solution sets in manyobjective optimisation," IEEE Trans. Evol. Comput., vol. 17, no. 2, pp. 165-184, 2013.
54. D. J. Watts, Six Degrees: The Science of a Connected Age. New York: W. W. Norton, 2004.
55. G. J. Williams, "Combining decision trees: Initial results from the MIL algorithm," in Artificial Intelligence Developments and Applications, J. S. Gero and R. B. Stanton, Eds. North Holland, The Netherlands: Elsevier Science Publishers, 1988, pp. 273-289.
56. G. J. Williams and Z. Huang, "A case study in knowledge acquisition for insurance risk assessment using a KDD methodology," in Proc. Pacific Rim Knowledge Acquisition Workshop, P. Compton, R. Mizoguchi, H. Motoda, and T. Menzies, Eds., Sydney, Australia, 1996, pp. 117-129.
57. G. J. Williams and Z. Huang, "Mining the knowledge mine: The hot spots methodology for mining large, real world databases," in Advanced Topics in Artificial Intelligence, A. Sattar, Ed. New York: Springer-Verlag, 1997, pp. 340-348.
58. X. Wu and X. Zhu, "Mining with noise knowledge: Error-aware data mining," IEEE Trans. Syst., Man Cybern. A, vol. 38, no. 4, pp. 917-932, 2008.
59. M. Xiao, L. Zhang, B. He, J. Xie, and W. Zhang, "A parallel algorithm of constructing gene regulatory networks," in Proc. 3rd Int. Symp. Optimization Systems Biology, D.-Z. Du and X.-S. Zhang, Eds., Zhangjiajie, China, 2009, pp. 184-188.
60. M. J. Zaki and C.-T. Ho, Eds., Large-Scale Parallel Data Mining. Berlin, Germany: Springer, 2000.
61. D. Zhou, J. C. Platt, S. Basu, and Y. Mao, "Learning from the wisdom of crowds by minimax entropy," in Advances in Neural Information Processing Systems 25, P. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, Eds. Cambridge, MA: MIT Press, 2012.
62. Z.-H. Zhou, "Rule extraction: Using neural networks or for neural networks?" J. Comput. Sci. Technol., vol. 19, no. 2, pp. 249-253, 2004.
63. X. Zhu, (2006). Semi-supervised learning literature survey. Dept. Comput. Sci., Univ. Wisconsin at Madison. Madison, WI, Tech. Rep. 1530. [Online]. Available: http://www. cs. wisc. edu/~jerryzhu/pub/ssl-survey. pdf