Lightweight monitoring of distributed streams

ACM Transactions on Database Systems

Volumn 43, Issue 2, 2018, Pages

  Lazerson, Arnon ^a   Keren, Daniel ^b   Schuster, Assaf ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b UNIVERSITY OF HAIFA   (Israel)

Author keywords

Continuous Distributed Monitoring; Disributed Stream Mining

Indexed keywords

ENERGY UTILIZATION;

APPLICATION SCENARIO; COMMUNICATION EFFICIENCY; COMMUNICATION OVERHEADS; COMPUTATIONAL BURDEN; CONTINUOUS DISTRIBUTED MONITORING; ORDERS OF MAGNITUDE; RESOURCE-LIMITED DEVICES; STREAM MINING;

SENSOR NODES;

EID: 85051841436     PISSN: 03625915     EISSN: 15574644     Source Type: Journal    
DOI: 10.1145/3226113     Document Type: Article

References (68)

1. Amir Ali Ahmadi and Georgina Hall. 2015. DC decomposition of nonconvex polynomials with algebraic techniques. Mathematical Programming (2015), 1-26.
2. Chrisil Arackaparambil, Joshua Brody, Amit Chakrabarti. 2009. Functional monitoring without monotonicity. In ICALP. 95-106.
3. B. Babcock and C. Olston. 2003. Distributed top-k monitoring. In SIGMOD. 28-39.
4. Shivnath Babu and Jennifer Widom. 2001. Continuous queries over data streams. SIGMOD 30, 3 (2001), 109-120.
5. Marco Balduini, Irene Celino, Daniele Dell'Aglio, Emanuele Della Valle, Yi Huang, Tony Lee, Seon-Ho Kim, Volker Tresp. 2012. BOTTARI: An augmented reality mobile application to deliver personalized and location-based recommendations by continuous analysis of social media streams. Web Semant. 16 (2012), 33-41.
6. Ziv Bar-Yossef, T. S. Jayram, Ravi Kumar, D. Sivakumar, Luca Trevisan. 2002. Counting distinct elements in a data stream. In RANDOM. 1-10.
7. Steven Bird. 2006. NLTK: The natural language toolkit. In COLING/ACL. 69-72.
8. S. Boyd and L. Vandenberghe. 2004. Convex Optimization. Cambridge University Press.
9. Joshua Brody and Amit Chakrabarti. 2009. A multi-round communication lower bound for gap hamming and some consequences. In CCC. 358-368.
10. Sabbas Burdakis and Antonios Deligiannakis. 2012. Detecting outliers in sensor networks using the geometric approach. In ICDE. 1108-1119.
11. Graham Cormode. 2013. The continuous distributed monitoring model. SIGMOD Rec. 42, 1 (2013), 5-14.
12. Graham Cormode and Minos N. Garofalakis. 2005. Sketching streams through the net: Distributed approximate query tracking. In VLDB. 13-24.
13. Graham Cormode and Minos N. Garofalakis. 2008. Approximate continuous querying over distributed streams. ACM Trans. Database Syst. 33, 2 (2008), 1-39.
14. Abhinandan Das, Sumit Ganguly, Minos N. Garofalakis, Rajeev Rastogi. 2004. Distributed set expression cardinality estimation. In VLDB. 312-323.
15. Mark Dilman and Danny Raz. 2002. Efficient reactive monitoring. SAC 20, 4 (2002), 668-676.
16. Manfredo P. Do Carmo. 2016. Differential Geometry of Curves and Surfaces: Revised and Updated (2nd ed.). Courier Dover Publications.
17. Ky Fan. 1949. On a theorem of weyl concerning eigenvalues of linear transformations I. In Proc. Natl. Acad. Sci. U.S.A 35, 11 (1949), 652-655.
18. Arik Friedman, Izchak Sharfman, Daniel Keren, Assaf Schuster. 2014. Privacy-preserving distributed streammonitoring. In NDSS. 1-12.
19. Moshe Gabel, Daniel Keren, Assaf Schuster. 2015. Monitoring least squares models of distributed streams. In SIGKDD. ACM, 319-328.
20. Moshe Gabel, Daniel Keren, Assaf Schuster. 2017. Anarchists, unite: Practical entropy approximation for distributed streams. KDD, 837-846.
21. Moshe Gabel, Assaf Schuster, Daniel Keren. 2014. Communication-efficient distributed variance monitoring and outlier detection for multivariate time series. In IPDPS. 37-47.
22. Minos N. Garofalakis, Daniel Keren, Vasilis Samoladas. 2013. Sketch-based geometric monitoring of distributed stream queries. PVLDB 6, 10 (2013), 937-948.
23. Nikos Giatrakos, Antonios Deligiannakis, Minos Garofalakis, Izchak Sharfman, Assaf Schuster. 2014. Distributed geometric query monitoring using prediction models. TODS 39, 2 (2014), 16:1-16:42.
24. Nikos Giatrakos, Antonios Deligiannakis, Minos N. Garofalakis, Izchak Sharfman, Assaf Schuster. 2012. Prediction-based geometric monitoring over distributed data streams. In SIGMOD. 265-276.
25. G. H. Golub and C. F. Van Loan. 1996. Matrix Computations, (3rd ed.). Johns Hopkins University Press.
26. Rajeev Gupta, Krithi Ramamritham, Mukesh K. Mohania. 2013. Ratio threshold queries over distributed data sources. In Proceedings of the VLDB Endowment 6, 8 (2013), 565-576.
27. Didier Henrion, Jean-Bernard Lasserre, Johan Lofberg. 2009. GloptiPoly 3: Moments, optimization and semidefinite programming. 24, 4-5 (2009), 761-779.
28. Ling Huang, Michael I. Jordan, Anthony Joseph, MinosGarofalakis, Nina Taft. 2006. In-network PCA and anomaly detection. In In NIPS. 617-624.
29. Ling Huang, XuanLong Nguyen, Minos N. Garofalakis, Joseph M. Hellerstein, Michael I. Jordan, Anthony D. Joseph, Nina Taft. 2007. Communication-efficient online detection of network-wide anomalies. In INFOCOM. 134-142.
30. Antonios Igglezakis, Antonios Deligiannakis, Aggelos Bletsas. 2014. Geometric monitoring for CSI reduction in amplify-and-forward relay networks. In ICASSP. 2729-2733.
31. S. M. Riazul Islam, Daehan Kwak, M. D. Humaun Kabir, Mahmud Hossain, Kyung-Sup Kwak. 2015. The internet of things for health care: A comprehensive survey. IEEE Access 3 (2015), 678-708.
32. S. Ratnasamy Jain, J. M. Hellerstein, D.Wetherall. 2004. A wakeup call for internet monitoring systems: The case for distributed triggers. In HotNets-III. 1-6.
33. Jiong Jin, Jayavardhana Gubbi, Slaven Marusic, Marimuthu Palaniswami. 2014. An information framework for creating a smart city through internet of things. IEEE Internet Things J. 1, 2 (2014), 112-121.
34. Bhargav Kanagal and Amol Deshpande. 2008. Online filtering, smoothing and probabilistic modeling of streaming data. In ICDE. 1160-1169.
35. Srinivas R. Kashyap, Jeyashankher Ramamirtham, Rajeev Rastogi, Pushpraj Shukla. 2008. Efficient constraint monitoring using adaptive thresholds. In ICDE. 526-535.
36. Ram Keralapura, Graham Cormode, Jeyashankher Ramamirtham. 2006. Communication-efficient distributed monitoring of thresholded counts. In SIGMOD. 289-300.
37. Daniel Keren, Guy Sagy, Amir Abboud, David Ben-David, Assaf Schuster, Izchak Sharfman, Antonios Deligiannakis. 2014. Geometric monitoring of heterogeneous streams. TKDE 26, 8 (2014), 1890-1903.
38. Daniel Keren, Izchak Sharfman, Assaf Schuster, Avishay Livne. 2012. Shape sensitive geometric monitoring. TKDE 24, 8 (2012), 1520-1535.
39. Anukool Lakhina, Mark Crovella, Christophe Diot. 2004. Diagnosing network-wide traffic anomalies. In SIGCOMM. 219-230.
40. Arnon Lazerson, Moshe Gabel, Daniel Keren, Assaf Schuster. 2017. One for all and all for one: Simultaneous approximation of multiple functions over distributed streams. In DEBS. 203-214.
41. Arnon Lazerson, Daniel Keren, Assaf Schuster. 2016. Lightweight monitoring of distributed streams. In KDD. 1685-1694.
42. Arnon Lazerson, Izchak Sharfman, Daniel Keren, Assaf Schuster, Minos N. Garofalakis, Vasilis Samoladas. 2015. Monitoring distributed streams using convex decompositions. PVLDB 8, 5 (2015), 545-556.
43. David D. Lewis, Yiming Yang, Tony G. Rose, Fan Li. 2004. RCV1: A new benchmark collection for text categorization research. J. Mach. Learn. Res. 5 (2004), 361-397.
44. Feifei Li, Ke Yi, Jeffrey Jestes. 2009. Ranking distributed probabilistic data. In SIGMOD. 361-374.
45. Rui Li, ShengjieWang, Hongbo Deng, RuiWang, Kevin Chen-Chuan Chang. 2012. Towards social user profiling: Unified and discriminative influence model for inferring home locations. In KDD. 1023-1031.
46. Samuel R. Madden, Michael J. Franklin, Joseph M. Hellerstein, Wei Hong. 2005. TinyDB: An acquisitional query processing system for sensor networks. ACM Trans. Database Syst. 30, 1 (2005), 122-173.
47. Sebastian Michel, Peter Triantafillou, Gerhard Weikum. 2005. KLEE: A framework for distributed top-k query algorithms. In Proceedings of the VLDB Endowment. 637-648.
48. Ilya S. Molchanov and Pedro Teran. 2003. Distance transforms for real-valued functions. J. Math. Anal. Appl. 278, 2 (2003), 472-484.
49. Oluwole Okunola, A. Uzairu, C. Gimba, G. Ndukwe. 2012. Assessment of gaseous pollutants along high traffic roads in Kano, Nigeria. Intl. J. Environment Sustainability 1, 1 (2012).
50. Themis Palpanas. 2013. Real-time data analytics in sensor networks. In Managing and Mining Sensor Data. 173-210.
51. Themistoklis Palpanas, Dimitris Papadopoulos, Vana Kalogeraki, Dimitrios Gunopulos. 2003. Distributed deviation detection in sensor networks. SIGMOD Record 32, 4 (2003), 77-82.
52. Odysseas Papapetrou and Minos Garofalakis. 2014. Continuous fragmented skylines over distributed streams. In ICDE. 124-135.
53. Jeff M. Phillips, Elad Verbin, Qin Zhang. 2012. Lower bounds for number-in-hand multiparty communication complexity, made easy. In SODA. 486-501.
54. Mohammad Rouhani and Angel Domingo Sappa. 2012. Implicit polynomial representation through a fast fitting error estimation. IEEE T. Image. Process. 21, 4 (2012), 2089-2098.
55. Guy Sagy, Daniel Keren, Izchak Sharfman, Assaf Schuster. 2010. Distributed threshold querying of general functions by a difference of monotonic representation. In Proceedings of the VLDB Endowment 4, 2 (2010), 46-57.
56. Shetal Shah and Krithi Ramamritham. 2008. Handling non-linear polynomial queries over dynamic data. In ICDE. 1043-1052.
57. IzchaK. Sharfman, Assaf Schuster, Daniel Keren. 2006. A geometric approach to monitoring threshold functions over distributed data streams. In SIGMOD. 301-312.
58. Izcha K. Sharfman, Assaf Schuster, Daniel Keren. 2007. Aggregate threshold queries in sensor networks. In IPDPS. 1-10.
59. IzchaK. Sharfman, Assaf Schuster, Daniel Keren. 2007. A geometric approach to monitoring threshold functions over distributed data streams. ACM Trans. Database Syst. 32, 4 (2007), 23.
60. IzchaK. Sharfman, Assaf Schuster, Daniel Keren. 2008. Shape sensitive geometric monitoring. In PODS. 301-310.
61. Marshall H. Stone. 1948. The generalized weierstrass approximation theorem. Math. Mag. 21, 5 (1948), 237-254.
62. Mingwang Tang, Feifei Li, Jeff M. Phillips, Jeffrey Jestes. 2012. Efficient threshold monitoring for distributed probabilistic data. In ICDE. 1120-1131.
63. Ran Wolff. 2015. Distributed convex thresholding. In PODC. 325-334.
64. Ran Wolff, Kanishka Bhaduri, Hillol Kargupta. 2009. A generic local algorithm for mining data streams in large distributed systems. TKDE 21, 4 (2009), 465-478.
65. James Yeh. 2006. Real Analysis: Theory of Measure and Integration Second Edition. World Scientific Publishing Company.
66. Gal Yehuda, Daniel Keren, Islam Akaria. 2017. Monitoring properties of large, distributed, dynamic graphs. In IPDPS. 2-11.
67. B.-K. Yi, Nikolaos D. Sidiropoulos, Theodore Johnson, H. V. Jagadish, Christos Faloutsos, Alexandros Biliris. 2000. Online data mining for co-evolving time sequences. In ICDE. 13-22.
68. Yunyue Zhu and Dennis Shasha. 2002. Statstream: Statistical monitoring of thousands of data streams in real time. In VLDB. 358-369.