Anarchists, unite: Practical entropy approximation for distributed streams

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn Part F129685, Issue , 2017, Pages 837-846

  Gabel, Moshe ^a   Keren, Daniel ^b   Schuster, Assaf ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

^b UNIVERSITY OF HAIFA   (Israel)

Author keywords

Data mining; Distributed streams; Entropy estimation

Indexed keywords

ADAPTIVE ALGORITHMS; BANDWIDTH; ENTROPY; ERROR ANALYSIS; SENSOR NODES; SIGNAL PROCESSING; WIRELESS SENSOR NETWORKS;

BANDWIDTH REDUCTIONS; DISTRIBUTED DATA SOURCES; DISTRIBUTED STREAMS; ENTROPY APPROXIMATIONS; ENTROPY ESTIMATION; ESTIMATION ALGORITHM; FUNDAMENTAL PROPERTIES; HIGH-DIMENSIONAL PROBLEMS;

DATA MINING;

EID: 85023172997     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3097983.3098092     Document Type: Conference Paper

References (50)

1. 2016. Technical Assistance Document for the Reporting of Daily Air Quality - the Air Quality Index (AQI). (May 2016). https://www.airnow.gov/index.cfm?action=pubs.index
2. R. E. Anderson. 2004. Entropy of EEG during anaesthetic induction: a comparative study with propofol or nitrous oxide as sole agent. British Journal of Anaesthesia 92, 2 (2004), 167-170.
3. C. Arackaparambil, S. Bratus, J. Brody, and A. Shubina. 2010. Distributed Monitoring of Conditional Entropy for Anomaly Detection in Streams. In 2010 IEEE International Symposium on Parallel Distributed Processing, Workshops and PhD Forum (IPDPSW).
4. Chrisil Arackaparambil, Joshua Brody, and Amit Chakrabarti. 2009. Functional Monitoring Without Monotonicity. In Proc. ICALP '09.
5. Martin Arlitt and Tai Jin. 1998. 1998 World Cup Web Site Access Logs. (1998). http://ita.ee.lbl.gov/html/contrib/WorldCup.html
6. Christoph Bandt and Bernd Pompe. 2002. Permutation Entropy: A Natural Complexity Measure for Time Series. Phys. Rev. Lett. 88, 17 (2002), 174102.
7. Przemyslaw Berezinski, Bartosz Jasiul, and Marcin Szpyrka. 2015. An Entropy-Based Network Anomaly Detection Method. Entropy 17, 4 (2015), 2367-2408.
8. Lakshminath Bhuvanagiri and Sumit Ganguly. 2006. Estimating Entropy over Data Streams. In Proceedings of the 14th Conference on Annual European Symposium - Volume 14 (ESA'06).
9. J. Bruhn. 2006. Depth of anaesthesia monitoring: what's available, what's validated and what's next? British Journal of Anaesthesia 97, 1 (2006), 85-94.
10. G.C. Calafore and L. El Ghaoui. 2014. Optimization Models. Cambridge University Press.
11. Amit Chakrabarti, Khanh Do Ba, and S. Muthukrishnan. 2006. Estimating Entropy and Entropy Norm on Data Streams. In Proc. STACS '06.
12. Wan-Li Cheng, Yu-Chih Kuo, Pay-Liam Lin, Ken-Hui Chang, Yu-Song Chen, Tso-Mei Lin, and Ruth Huang. 2004. Revised air quality index derived from an entropy function. Atmospheric Environment 38, 3 (2004), 383-391.
13. Peter Clifford and Ioana Cosma. 2013. A simple sketching algorithm for entropy estimation over streaming data. In Proc. AISTATS '13, Vol. 31.
14. Graham Cormode. 2013. The Continuous Distributed Monitoring Model. SIGMOD Rec. 42, 1 (2013), 5-14.
15. Graham Cormode, S. Muthukrishnan, Ke Yi, and Qin Zhang. 2012. Continuous Sampling from Distributed Streams. J. ACM 59, 2, Article 10 (2012), 10:1-10:25 pages.
16. Steven Diamond and Stephen Boyd. 2016. CVXPY: A Python-Embedded Modeling Language for Convex Optimization. JMLR 17, 83 (2016), 1-5.
17. Richard Klaus Ellerkmann, Vidal-Markus Liermann, Thorsten Michael Alves, Ingobert Wenningmann, Sascha Kreuer, Wolfram Wilhelm, Heiko Roepcke, Andreas Hoeft, and Jörgen Bruhn. 2004. Spectral Entropy and Bispectral Index as Measures of the Electroencephalographic Effects of Sevoflurane. Anesthesiology 101, 6 (2004), 1275-1282.
18. M. Ermes, J. Parkka, J. Mantyjarvi, and I. Korhonen. 2008. Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions. IEEE Transactions on Information Technology in Biomedicine 12, 1 (2008), 20-26.
19. Arik Friedman, Izchak Sharfman, Daniel Keren, and Assaf Schuster. 2014. Privacy-Preserving Distributed Stream Monitoring. In 21st Annual Network and Distributed System Security Symposium (NDSS '14).
20. Moshe Gabel, Daniel Keren, and Assaf Schuster. 2014. Communication-efficient Distributed Variance Monitoring and Outlier Detection for Multivariate Time Series. In Proc. IPDPS '14.
21. Moshe Gabel, Daniel Keren, and Assaf Schuster. 2015. Monitoring Least Squares Models of Distributed Streams. In Proc. KDD '15.
22. S. García, M. Grill, J. Stiborek, and A. Zunino. 2014. An Empirical Comparison of Botnet Detection Methods. Computers & Security 45 (2014), 100-123.
23. Minos Garofalakis, Daniel Keren, and Vasilis Samoladas. 2013. Sketch-based Geometric Monitoring of Distributed Stream Queries. Proc. VLDB Endow. 6, 10 (2013), 937-948.
24. Nikos Giatrakos, Antonios Deligiannakis, Minos Garofalakis, Izchak Sharfman, and Assaf Schuster. 2012. Prediction-based Geometric Monitoring over Distributed Data Streams. In Proc. SIGMOD '12.
25. Nikos Giatrakos, Antonios Deligiannakis, Minos Garofalakis, Izchak Sharfman, and Assaf Schuster. 2014. Distributed Geometric Query Monitoring Using Prediction Models. TODS 39, 2 (2014), 16:1-16:42.
26. Nikos Giatrakos, Yannis Kotidis, Antonios Deligiannakis, Vasilis Vassalos, and Yannis Theodoridis. 2013. In-network Approximate Computation of Outliers with Quality Guarantees. Inf. Syst. 38, 8 (2013), 1285-1308.
27. Nicholas J. A. Harvey, Jelani Nelson, and Krzysztof Onak. 2008. Sketching and Streaming Entropy via Approximation Theory. In Proc. FOCS '08.
28. Siu-Wai Ho and Sergio Verdú. 2015. Convexity/Concavity of Renyi Entropy and α-mutual Information. In 2015 IEEE International Symposium on Information Theory (ISIT).
29. Piotr Indyk. 2006. Stable Distributions, Pseudorandom Generators, Embeddings, and Data Stream Computation. J. ACM 53, 3 (2006), 307-323.
30. Michael Kamp, Mario Boley, Daniel Keren, Assaf Schuster, and Izchak Sharfman. 2014. Communication-Efficient Distributed Online Prediction by Dynamic Model Synchronization. In Proc. ECML PKDD '14.
31. N. Kannathal, Min Lim Choo, U. Rajendra Acharya, and P.K. Sadasivan. 2005. Entropies for detection of epilepsy in EEG. Computer Methods and Programs in Biomedicine 80, 3 (2005), 187-194.
32. Daniel Keren, Guy Sagy, Amir Abboud, David Ben-David, Assaf Schuster, Izchak Sharfman, and Antonios Deligiannakis. 2014. Geometric Monitoring of Heterogeneous Streams. IEEE TKDE 26, 8 (2014), 1890-1903.
33. Daniel Keren, Izchak Sharfman, Assaf Schuster, and Avishay Livne. 2012. Shape Sensitive Geometric Monitoring. IEEE TKDE 24, 8 (2012), 1520-1535.
34. Arnon Lazerson, Moshe Gabel, Daniel Keren, and Assaf Schuster. 2017. One for All and All for One: Simultaneous Approximation of Multiple Functions over Distributed Streams. In Proc. DEBS '17.
35. Arnon Lazerson, Daniel Keren, and Assaf Schuster. 2016. Lightweight Monitoring of Distributed Streams. In Proc. KDD '16.
36. Arnon Lazerson, Izchak Sharfman, Daniel Keren, Assaf Schuster, Minos Garofalakis, and Vasilis Samoladas. 2015. Monitoring Distributed Streams Using Convex Decompositions. Proc. VLDB Endow. 8, 5 (2015), 545-556.
37. S. Muthukrishnan. 2003. Data Streams: Algorithms and Applications. In Proc. SODA '03.
38. Muhammad Anis Uddin Nasir, Gianmarco De Francisci Morales, David Garcia-Soriano, Nicolas Kourtellis, and Marco Serafini. 2015. The Power of Both Choices: Practical Load Balancing for Distributed Stream Processing Engines. In Proc. ICDE '15.
39. Ilya Nemenman, William Bialek, and Rob de Ruyter van Steveninck. 2004. Entropy and information in neural spike trains: Progress on the sampling problem. Physical Review E 69, 5 (2004).
40. George Nychis, Vyas Sekar, David G. Andersen, Hyong Kim, and Hui Zhang. 2008. An Empirical Evaluation of Entropy-based Traffic Anomaly Detection. In Proceedings of the 8th ACM SIGCOMM Conference on Internet Measurement (IMC '08).
41. Liam Paninski. 2003. Estimation of entropy and mutual information. Neural computation 15, 6 (2003), 1191-1253.
42. Philippe Renevey and Andrzej Drygajlo. 2001. Entropy Based Voice Activity Detection in Very Noisy Conditions. In EUROSPEECH 2001 Scandinavia, 7th European Conference on Speech Communication and Technology, 2nd INTERSPEECH Event. 1887-1890.
43. Guy Sagy, Daniel Keren, Izchak Sharfman, and Assaf Schuster. 2010. Distributed Threshold Querying of General Functions by a Difference of Monotonic Representation. Proc. VLDB Endow. 4, 2 (2010), 46-57.
44. Nicola Scafetta and Paolo Grigolini. 2002. Scaling detection in time series: Diffusion entropy analysis. Phys. Rev. E 66, 3 (2002), 036130.
45. Izchak Sharfman, Assaf Schuster, and Daniel Keren. 2007. A geometric approach to monitoring threshold functions over distributed data streams. TODS 32, 4 (2007), 23.
46. Adwitiya Sinha and Daya Krishan Lobiyal. 2013. Performance evaluation of data aggregation for cluster-based wireless sensor network. Human-centric Computing and Information Sciences 3, 1 (2013).
47. Ran Wolff. 2015. Distributed Convex Thresholding. In Proc. PODC '15.
48. David P. Woodruff and Qin Zhang. 2012. Tight Bounds for Distributed Functional Monitoring. In Proc. STOC '12.
49. Gal Yehuda, Daniel Keren, and Islam Akaria. 2017. Monitoring Properties of Large, Distributed, Dynamic Graphs. In Proc. IPDPS '17.
50. Haiquan (Chuck) Zhao, Ashwin Lall, Mitsunori Ogihara, Oliver Spatscheck, Jia Wang, and Jun Xu. 2007. A Data Streaming Algorithm for Estimating Entropies of OD Flows. In Proceedings of the 7th ACM SIGCOMM Conference on Internet Measurement (IMC '07).