Data stream mining in ubiquitous environments: State-of-the-art and current directions

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

Volumn 4, Issue 2, 2014, Pages 116-138

  Gaber, Mohamed Medhat ^a   Gama, João ^b   Krishnaswamy, Shonali ^c   Gomes, João Bártolo ^d   Stahl, Frederic ^e  

^a ROBERT GORDON UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF PORTO   (Portugal)

^c MONASH UNIVERSITY   (Australia)

^d INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^e UNIVERSITY OF READING   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84894638896     PISSN: 19424787     EISSN: 19424795     Source Type: Journal    
DOI: 10.1002/widm.1115     Document Type: Review

References (84)

1. Gama J, May M. Ubiquitous knowledge discovery. Intell Data Anal 2011, 15:1.
2. Gaber M, Krishnaswamy S, Zaslavsky A. Ubiquitous data stream mining. In: Current Research and Future Directions Workshop Proceedings held in conjunction with The Eighth Pacific-Asia Conference on Knowledge Discovery and Data Mining, Sydney, Australia. Citeseer, 2004.
3. Muthukrishnan S. Data Streams: Algorithms and Applications. Hanover, MA: Now Publishers; 2005.
4. Gama J. Knowledge Discovery from Data Streams. Data Mining and Knowledge Discovery. Atlanta, US: Chapman & Hall CRC Press; 2010.
5. Chaudhry N. Stream Data Management, Chapter Introduction to Stream Data Management. New York, NY: Springer; 2005.
6. Babu S, Widom J. Continuous queries over data streams. SIGMOD Rec 2001, 30:109-120.
7. Aggarwal C, ed. Data Streams-Models and Algorithms. New York, NY: Springer; 2007.
8. Motwani R, Raghavan P. Randomized Algorithms. New York, NY: Cambridge University Press; 1997.
9. Chakrabarti A, Ba KD, Muthukrishnan S. Estimating entropy and entropy norm on data streams. In: STACS: 23rd Annual Symposium on Theoretical Aspects of Computer Science, Marseille, France, 2006, 196-205.
10. Manku GS, Motwani R. Approximate frequency counts over data streams. In: Proceedings of 28th International Conference on Very Large Data Bases, Hong Kong; 2002, 346-357.
11. Cormode G, Muthukrishnan S, Zhuang W. Conquering the divide: continuous clustering of distributed data streams. In: ICDE: Proceedings of the International Conference on Data Engineering, Istanbul, Turkey; 2007, 1036-1045.
12. Flajolet P, Martin GN. Probabilistic counting algorithms for data base applications. J Comput Syst Sci 1985, 31:182-209.
13. Babcock B, Datar M, Motwani R. Sampling from a moving window over streaming data. In: Proceedings of the Annual ACM SIAM Symposium on Discrete Algorithms, San Francisco, USA, SIAM, 2002, 633-634.
14. Datar M, Gionis A, Indyk P, Motwani R. Maintaining stream statistics over sliding windows. In: Proceedings of Annual ACM-SIAM Symposium on Discrete Algorithms, San Francisco, USA, Society for Industrial and Applied Mathematics; 2002, 635-644.
15. Bifet A, Gavaldà R. Kalman filters and adaptive windows for learning in data streams. In: Todorovski L, Lavrac N, eds. Proceedings of the 9th Discovery Science, Volume 4265 of Lecture Notes Artificial Intelligence. Barcelona, Spain: Springer; 2006, 29-40.
16. Aggarwal C. On biased reservoir sampling in the presence of stream evolution. In: Proceedings International Conference on Very Large Data Bases, Seoul, Korea, 2006, 607-618.
17. Vitter JS. Random sampling with a reservoir. ACM Trans Math Softw 1985, 11:37-57.
18. Tatbul N, Çetintemel U, Zdonik S, Cherniack M, Stonebraker M. Load shedding in a data stream manager. In: Proceedings of the 29th International Conference on Very Large Data Bases, vol 29, VLDB '03, VLDB Endowment, 2003, 309-320.
19. Gilbert AC, Kotidis Y, Muthukrishnan S, Strauss M. Surfing wavelets on streams: one-pass summaries for approximate aggregate queries. In: VLDB, Rome, Italy, 2001, 79-88.
20. Alon N, Matias Y, Szegedy M. The space complexity of approximating the frequency moments. J Comput Syst Sci 1999, 58:137-147.
21. Cormode G, Muthukrishnan S. An improved data stream summary: the count-min sketch and its applications. J Algorithms 2005, 55:58-75.
22. Domingos P, Hulten G. Mining high-speed data streams. In: Parsa I, Ramakrishnan R, Stolfo S, eds. Proceedings of the ACM Sixth International Conference on Knowledge Discovery and Data Mining. Boston, MA: ACM Press; 2000, 71-80.
23. Rodrigues PP, Gama J, Pedroso JP. Hierarchical clustering of time series data streams. IEEE Trans Knowl Data Eng 2008, 20:615-627.
24. Hulten G, Spencer L, Domingos P. Mining time-changing data streams. In: Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco, CA: ACM Press; 2001, 97-106.
25. Ikonomovska E, Gama J, Dzeroski S. Learning model trees from evolving data streams. Data Min Knowl Discov 2011, 23:128-168.
26. Gama J, Kosina P. Learning decision rules from data streams. In: Proceedings of the 22nd International Joint Conference on Artificial Intelligence, IJCAI; 2011, 1255-1260.
27. Sharfman I, Schuster A, Keren D. A geometric approach to monitoring threshold functions over distributed data streams. ACM Trans Database Syst 2007, 32:301-312.
28. May M, Saitta L. Ubiquitous Knowledge Discovery. Springer; 2010, LNAI 6202.
29. Kargupta H, Bhargava R, Liu K, Powers M, Blair P, Bushra S, Dull J, Sarkar K, Klein M, Vasa M, et al. VEDAS: a mobile and distributed data stream mining system for real-time vehicle monitoring. In: Proceedings of SIAM International Conference on Data Mining, Volume 334, 2004.
30. Kargupta H, Joshi A, Sivakumar K, Yesha Y. Data Mining: Next Generation Challenges and Future Directions. New York, NY: AAAI Press and MIT Press; 2004.
31. Kargupta H, Park B-H. Mining decision trees from data streams in a mobile environment. In: IEEE International Conference on Data Mining. San Jose, CA: IEEE Computer Society; 2001, 281-288.
32. Chen R, Sivakumar K, Kargupta H. Collective mining of Bayesian networks from heterogeneous data. Knowl Inf Syst J 2004, 6:164-187.
33. Kargupta H, Park B-H, Dutta H. Orthogonal decision trees. IEEE Trans Knowl Data Eng 2006, 18:1028-1042.
34. Gaber MM, Krishnaswamy S, Zaslavsky A. On-board mining of data streams in sensor networks. In: Advanced Methods for Knowledge Discovery from Complex Data, Springer; 2005, 307-335.
35. Gaber MM, Zaslavsky A, Krishnaswamy S. Mining data streams: a review. ACM SIGMOD Rec 2005, 34:18-26.
36. Gaber M, Yu P. A holistic approach for resource-aware adaptive data stream mining. New Generation Comput 2006, 25:95-115.
37. Gaber MM. Data stream mining using granularity-based approach. In: Foundations of Computational, Intelligence, vol. 6. Ohmsha, Ltd.: Springer; 2009, 47-66.
38. Haghighi PD, Gaber MM, Krishnaswamy S, Zaslavsky A. Situation-aware adaptive processing (saap) of data streams. In: Pervasive Computing. New York, NY: Springer; 2010, 313-338.
39. Haghighi PD, Zaslavsky A, Krishnaswamy S, Gaber MM, Loke S. Context-aware adaptive data stream mining. Intell Data Anal 2009, 13:423-434.
40. Padovitz A, Loke SW, Zaslavsky A. Towards a theory of context spaces. In: Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications Workshops. Los Alamitos, CA: IEEE; 2004, 38-42.
41. Domingos P, Hulten G. A general method for scaling up machine learning algorithms and its application to clustering. In: ICML, 2001, 106-113.
42. Lin J, Keogh E, Wei L, Lonardi S. Experiencing sax: a novel symbolic representation of time series. Data Min Knowl Discov 2007, 15:107-144.
43. Krishnaswamy S, Gaber M, Harbach M, Hugues C, Sinha A, Gillick B, Haghighi P, Zaslavsky A. Open mobile miner: a toolkit for mobile data stream mining. In: Demo and Short paper, the 15th ACM SIGKDD Conference on Knowledge Discovery and Data Mining 2009, Paris, 2009. Available at: http://eprints.port.ac.uk/4140/1/D02-kdd09demo.pdf. (Accessed May 2012).
44. Haghighi P. D, Krishnaswamy S, Zaslavsky A, Gaber M. M, Sinha A, Gillick B. Open mobile miner: a toolkit for building situation-aware data mining applications. J Organ Comput Electr Commer 2009, 23:224-248.
45. Sherchan W, Jayaraman PP, Krishnaswamy S, Zaslavsky A, Loke S, Sinha A. Using on-the-move mining for mobile crowdsensing. In: IEEE 13th International Conference on Mobile Data Management (MDM), 2012. Washington, DC: IEEE; 2012, 115-124.
46. Gomes JB, Krishnaswamy S, Gaber MM, Sousa PA, Menasalvas E. Mars: a personalised mobile activity recognition system. In: 2012 IEEE 13th International Conference on Mobile Data Management (MDM), IEEE; 2012, 316-319.
47. Gomes JB, Krishnaswamy S, Gaber MM, Sousa PA, Menasalvas E. Mobile activity recognition using ubiquitous data stream mining. In: Data Warehousing and Knowledge Discovery. Vienna, Austria: Springer; 2012, 130-141.
48. Gomes J, Gaber M, Sousa P, Menasalvas E. Mining recurring concepts in a dynamic feature space. IEEE Trans Neural Netw Learn Syst 2013, 24:1-16.
49. Gomes JB, Medhat Gaber M, Sousa P, Menasalvas Ruiz E. Collaborative data stream mining in ubiquitous environments using dynamic classifier selection. Int J Inf Technol Decis Making 2013, 12:1-12.
50. Gomes JB, Phua C, Krishnaswamy S. Where will you go? mobile data mining for next place prediction. In: Data Warehousing and Knowledge Discovery. Prague, Czech Republic: Springer; 2013, 146-158.
51. Chong SK, Gaber MM, Krishnaswamy S, Loke SW. Energy conservation in wireless sensor networks: a rule-based approach. Knowl Inf Syst 2011, 28:579-614.
52. Tayebi H, Krishnaswamy S, Waluyo AB, Sinha A, Gaber MM. Ra-sax: resource-aware symbolic aggregate approximation for mobile ECG analysis. In: 12th IEEE International Conference on Mobile Data Management (MDM), 2011, vol. 1. Milan, Italy: IEEE; 2011, 289-290.
53. Sinha A, Tayebi H, Krishnaswamy S, Waluyo AB, Gaber MM. Resource-aware ecg analysis on mobile devices. In: Proceedings of the 2011 ACM Symposium on Applied Computing. Taichung, Taiwan: ACM; 2011, 1012-1013.
54. Gillick B, AlTaiar H, Krishnaswamy S, Liono J, Nicoloudis N, Sinha A, Zaslavsky A, Gaber MM Clutter-adaptive visualization for mobile data mining. In: 2010 IEEE International Conference on Data Mining Workshops (ICDMW), IEEE, 2010, 1381-1384.
55. Kargupta H, Park B, Pittie S, Liu L, Kushraj D, Sarkar K. MobiMine: monitoring the stock market from a PDA. ACM SIGKDD Explor Newsl 2002, 3:37-46.
56. Page J, Padovitz A, Gaber M. Mobility in agents, a stumbling block or a building block? In: Proceedings of Second International Conference on Intelligent Computing and Information Systems, 2005.
57. Stahl F, Gaber MM, Bramer M, Yu PS. Pocket data mining: towards collaborative data mining in mobile computing environments. In: 22nd IEEE International Conference on Tools with Artificial Intelligence (ICTAI), 2010, vol. 2. Arras, France: IEEE; 2010, 323-330.
58. Kargupta H, Hamzaoglu I, Stafford B. Scalable, distributed data mining-an agent architecture. In: Proceedings of Third International Conference on Knowledge Discovery and Data Mining, 1997, 211-214.
59. Bellifemine FL, Caire G, Greenwood D. Developing Multi-Agent Systems With JADE, vol. 7. Wiley; 2007.
60. Bäumer C, Magedanz T. Grasshopper: a mobile agent platform for active telecommunication networks. In: Intelligent Agents for Telecommunication Applications. Stockholm, Sweden: Springer; 1999, 19-32.
61. Bifet A, Holmes G, Kirkby R, Pfahringer B. Moa: Massive online analysis. J Mache Learn Res 2010, 99:1601-1604.
62. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH. The weka data mining software: an update. ACM SIGKDD Explor Newsl 2009, 11:10-18.
63. Stahl F, Gaber MM, Aldridge P, May D, Liu H, Bramer M, Philip SY. Homogeneous and heterogeneous distributed classification for pocket data mining. In: Transactions on Large-Scale Data-and Knowledge-Centered Systems V. New York, NY: Springer; 2012, 183-205.
64. Talia D, Trunfio P, Verta O. The weka4ws framework for distributed data mining in service-oriented grids. Concurrency Comput: Pract Exp 2008, 20:1933-1951.
65. Frank E, Hall MA, Holmes G, Kirkby R, Pfahringer B. Weka-a machine learning workbench for data mining. In: The Data Mining and Knowledge Discovery Handbook; 2005, 1305-1314.
66. Masud MM, Gao J, Khan L, Han J, Thuraisingham B. A practical approach to classify evolving data streams: training with limited amount of labeled data. In: Proceedings of the 2008 Eighth IEEE International Conference on Data Mining. Washington, DC: IEEE Computer Society; 2008, 929-934.
67. Gomes JB. Learning recurring concepts from data streams in ubiquitous environments. PhD Thesis, Technical University of Madrid, 2011.
68. Katakis I, Tsoumakas G, Vlahavas I. On the utility of incremental feature selection for the classification of textual data streams. In: Proceedings of the 10th Panhellenic conference on Advances in Informatics, PCI'05. Berlin, Heidelberg: Springer-Verlag; 2005, 338-348.
69. Tsymbal A. The Problem of Concept Drift: Definitions and Related Work. Dublin, Ireland: Computer Science Department, Trinity College 2004.
70. Cortez P, Lopes C, Sousa P, Rocha M, Rio M. Symbiotic data mining for personalized spam filtering. In: IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technologies, 2009. WI-IAT'09, Volume 1, IEEE, 2009, 149-156.
71. Datta S, Bhaduri K, Giannella C, Wolff R, Kargupta H. Distributed data mining in peer-to-peer networks. IEEE Internet Comput 2006, 10:18-26.
72. Wurst M, Morik K. Distributed feature extraction in a p2p setting-a case study. Future Generation Comput Syst 2007, 23:69-75.
73. Daumé H III, Marcu D. Domain adaptation for statistical classifiers. J Artif Int Res 2006, 26:101-126.
74. Pan S, Yang Q. A survey on transfer learning. IEEE Trans Knowl Data Eng 2010, 22:1345-1359.
75. Hotho A, Pedersen R, Wurst M. Ubiquitous data. Ubiquitous Knowl Discov 2010:61-74.
76. Street W, Kim Y. A streaming ensemble algorithm (SEA) for large-scale classification. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, NY: ACM; 2001, 377-382.
77. Wang H, Fan W, Yu P, Han J. Mining concept-drifting data streams using ensemble classifiers. In: Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining. New York: ACM; 2003, 226-235.
78. Kolter J, Maloof M. Dynamic weighted majority: an ensemble method for drifting concepts. J Mach Learn Res 2007, 8:2755-2790.
79. Zhu X, Wu X, Yang Y. Effective classification of noisy data streams with attribute-oriented dynamic classifier selection. Knowl Inf Syst 2006, 9:339-363.
80. Tsymbal A, Pechenizkiy M, Cunningham P, Puuronen S. Dynamic integration of classifiers for handling concept drift. Inf Fusion 2008, 9:56-68.
81. Widmer G, Kubat M. Learning in the presence of concept drift and hidden contexts. Mach Learn 1996, 23:69-101.
82. Gomes JB, Sousa PA, Menasalvas E. Tracking recurrent concepts using context. Intell Data Anal 2012, 16:803-825.
83. Gomes J, Menasalvas E, Sousa P. Learning recurring concepts from data streams with a context-aware ensemble. In: ACM Symposium on Applied Computing. TaiChung, Taiwan: ACM; 2011, 994-999.
84. Gomes JB, Gaber MM, Sousa PA, Menasalvas E. Context-aware collaborative data stream mining in ubiquitous devices. In: Advances in Intelligent Data Analysis X. Porto, Portugal: Springer; 2011, 22-33.