One for all and all for one: Simultaneous approximation of multiple functions over distributed streams

DEBS 2017 - Proceedings of the 11th ACM International Conference on Distributed Event-Based Systems

Volumn , Issue , 2017, Pages 203-214

  Lazerson, Arnon ^a   Gabel, Moshe ^a   Keren, Daniel ^b   Schuster, Assaf ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b UNIVERSITY OF HAIFA   (Israel)

Author keywords

Continous approximation; Distriubted streams; Multiple fuinctions

Indexed keywords

COMMUNICATION COST; COMMUNICATION REDUCTION; CONTINOUS APPROXIMATION; DISTRIBUTED MONITORING; DISTRIUBTED STREAMS; MULTIPLE FUINCTIONS; REAL-WORLD DATASETS; SIMULTANEOUS APPROXIMATION;

SOFTWARE ARCHITECTURE;

EID: 85023201401     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3093742.3093918     Document Type: Conference Paper

References (53)

1. Noga Alon, Phillip B. Gibbons, Yossi Matias, and Mario Szegedy. 1999. Tracking Join and Self-Join Sizes in Limited Storage. In PODS '99.
2. Chrisil Arackaparambil, Joshua Brody, and Amit Chakrabarti. 2009. Functional monitoring without monotonicity. In ICALP '09.
3. Arvind Arasu and Jennifer Widom. 2004. Resource sharing in continuous sliding-window aggregates. In VLDB '04.
4. B. Babcock and C. Olston. 2003. Distributed top-k monitoring. In SIGMOD '03.
5. Amir Bar-Or, Daniel Keren, Assaf Schuster, and Ran Wolff. 2005. Hierarchical decision tree induction in distributed genomic databases. TKDE (2005).
6. Steven Bird, Ewan Klein, and Edward Loper. 2009. Natural Language Processing with Python. O'Reilly Media.
7. Peter Bodik, Wei Hong, Carlos Guestrin, Sam Madden, Mark Paskin, and Romain Tnibaux. 2004. Intel Lab Data. (2004). http://db.csail.mit.edu/labdata/labdata.html
8. Andries E Brouwer and Willem H Haemers. 2011. Spectra of graphs. Springer Science & Business Media.
9. Sabbas Burdakis and Antonios Deligiannakis. 2012. Detecting Outliers in Sensor Networks Using the Geometric Approach. In ICDE '12.
10. Richard Cangelosi and Alain Goriely. 2007. Component retention in principal component analysis with application to cDNA microarray data. Biology direct (2007).
11. Graham Cormode. 2011. Sketch techniques for approximate query processing. Synposes for Approximate Query Processing: Samples, Histograms, Wavelets and Sketches, Foundations and Trends in Databases. NOW publishers (2011).
12. Graham Cormode. 2013. The continuous distributed monitoring model. SIGMOD Record (2013).
13. Graham Cormode and Minos Garofalakis. 2008. Approximate continuous querying over distributed streams. TODS (2008).
14. Graham Cormode, S Muthukrishnan, and Ke Yi. 2011. Algorithms for distributed functional monitoring. TALG (2011).
15. Alin Dobra, Minos Garofalakis, Johannes Gehrke, and Rajeev Rastogi. 2004. Sketch-based multi-query processing over data streams. In EDBT '04.
16. Ky Fan. 1949. On a Theorem of Weyl Concerning Eigenvalues of Linear Transformations I. In PANS '49.
17. Arik Friedman, Izchak Sharfman, Daniel Keren, and Assaf Schuster. 2014. Privacy-Preserving Distributed Stream Monitoring. In NDSS '14.
18. Moshe Gabel, Daniel Keren, and Assaf Schuster. 2013. Communication-efficient Outlier Detection for Scale-out Systems. In BD3 @ VLDB.
19. Moshe Gabel, Daniel Keren, and Assaf Schuster. 2015. Monitoring least squares models of distributed streams. In KDD '15.
20. Moshe Gabel, Daniel Keren, and Assaf Schuster. 2017. Anarchists, Unite: Practical Entropy Approximation for Distributed Streams. In KDD '17.
21. Moshe Gabel, Assaf Schuster, and Daniel Keren. 2014. Communication-efficient distributed variance monitoring and outlier detection for multivariate time series. In IPDPS '14.
22. Minos Garofalakis and Vasilis Samoladas. 2017. Distributed Query Monitoring through Convex Analysis: Towards Composable Safe Zones. In ICDT '17.
23. Minos N. Garofalakis, Daniel Keren, and Vasilis Samoladas. 2013. Sketch-based Geometric Monitoring of Distributed Stream Queries. PVLDB (2013).
24. Nikos Giatrakos, Antonios Deligiannakis, and Minos Garofalakis. 2016. Scalable approximate query tracking over highly distributed data streams. In SIGMOD'16.
25. Nikos Giatrakos, Antonios Deligiannakis, Minos Garofalakis, Izchak Sharfman, and Assaf Schuster. 2012. Prediction-based geometric monitoring over distributed data streams. In SIGMOD '12.
26. Nikos Giatrakos, Antonios Deligiannakis, Minos Garofalakis, Izchak Sharfman, and Assaf Schuster. 2014. Distributed geometric query monitoring using prediction models. TODS (2014).
27. Shenoda Guirguis, Mohamed A Sharaf, Panos K Chrysanthis, and Alexandros Labrinidis. 2011. Optimized processing of multiple aggregate continuous queries. In CIKM '11.
28. Ling Huang, XuanLong Nguyen, Minos N. Garofalakis, Joseph M. Hellerstein, Michael I. Jordan, Anthony D. Joseph, and Nina Taft. 2007. Communication-Efficient Online Detection of Network-Wide Anomalies. In TNFOCOM '07.
29. Ryan Huebsch, Minos Garofalakis, Joseph M Hellerstein, and Ion Stoica. 2007. Sharing aggregate computation for distributed queries. In SIGMOD '07.
30. Michael Kamp, Mario Boley, Daniel Keren, Assaf Schuster, and Izchak Sharfman. 2014. Communication-efficient distributed online prediction by dynamic model synchronization. In ECML '14.
31. Srinivas R. Kashyap, Jeyashankher Ramamirtham, Rajeev Rastogi, and Pushpraj Shukla. 2008. Efficient Constraint Monitoring Using Adaptive Thresholds. In ICDE '08.
32. KDD. 1999. KDD99 cup dataset. (1999). https://kdd.ics.uci.edu/databases/kddcup99/kddcup99.html
33. Ram Keralapura, Graham Cormode, and Jeyashankher Ramamirtham. 2006. Communication-efficient distributed monitoring of thresholded counts. In SIGMOD '06.
34. Daniel Keren, Guy Sagy, Amir Abboud, David Ben-David, Assaf Schuster, Izchak Sharfman, and Antonios Deligiannakis. 2014. Geometric monitoring of heterogeneous streams. TXDE(2014).
35. Daniel Keren, Izchak Sharfman, Assaf Schuster, and Avishay Livne. 2012. Shape Sensitive Geometric Monitoring. TKDE (2012).
36. Arnon Lazerson, Daniel Keren, and Assaf Schuster. 2016. Lightweight Monitoring of Distributed Streams. In KDD '16.
37. Arnon Lazerson, Izchak Sharfman, Daniel Keren, Assaf Schuster, Minos N. Garofalakis, and Vasilis Samoladas. 2015. Monitoring Distributed Streams using Convex Decompositions. PVLDB (2015).
38. David D Lewis, Yiming Yang, Tony G Rose, and Fan Li. 2004. Rcvl: A new benchmark collection for text categorization research. JMLR (2004).
39. Rui Li, Shengjie Wang, Hongbo Deng, Rui Wang, and Kevin Chen-Chuan Chang. 2012. Towards social user profiling: unified and discriminative influence model for inferring home locations. In KDD '12.
40. Wen Liu, Yan-Ming Shen, and Peng Wang. 2016. An Efficient Approach of Processing Multiple Continuous Queries. JCSIT (2016).
41. Charlotte H Mason and William D Perreault Jr. 1991. Collinearity, power, and interpretation of multiple regression analysis. JMR (1991).
42. Sebastian Michel, Peter Triantafillou, and Gerhard Weikum. 2005. KLEE: a framework for distributed top-k query algorithms. In VLDB '05.
43. Shanmugavelayutham Muthukrishnan and others. 2005. Data streams: Algorithms and applications. FnT-TCS (2005).
44. Noam Palatin, Arie Leizarowitz, Assaf Schuster, and Ran Wolff. 2008. Mining for misconfigured machines in grid systems. Data Mining Techniques in Grid Computing Environments (2008).
45. Themistoklis Palpanas, Dimitris Papadopoulos, Vana Kalogeraki, and Dimitrios Gunopulos. 2003. Distributed deviation detection in sensor networks. SIGMOD Record (2003).
46. Guy Sagy, Daniel Keren, Izchak Sharfman, and Assaf Schuster. 2010. Distributed threshold querying of general functions by a difference of monotonic representation. PVLDB (2010).
47. Ausra Saudargienė. 1999. Structurization of the covariance matrix by process type and block-diagonal models in the classifier design. Informatica (1999).
48. Shetal Shah and Krithi Ramamritham. 2008. Handling Non-linear Polynomial Queries over Dynamic Data. In ICDE '08.
49. Izchak Sharfman, Assaf Schuster, and Daniel Keren. 2007. Aggregate threshold queries in sensor networks. In IPDPS '07.
50. Izchak Sharfman, Assaf Schuster, and Daniel Keren. 2007. A geometric approach to monitoring threshold functions over distributed data streams. TODS (2007).
51. Izchak Sharfman, Assaf Schuster, and Daniel Keren. 2008. Shape sensitive geometric monitoring. In PODS '08.
52. Daniel A Spielman. 2007. Spectral graph theory and its applications. In FOCS'07.
53. Ke Yi and Qin Zhang. 2009. Optimal tracking of distributed heavy hitters and quantiles. In PODS '09.