Real-time data analytics in sensor networks

Managing and Mining Sensor Data

Volumn 9781461463092, Issue , 2014, Pages 173-210

  Palpanas, Themis ^a  

^a UNIVERSITY OF TRENTO   (Italy)

Author keywords

Data Analytics; Data Collection; Data Aware Network Protocols; Deviation Detection; Outliers; Uncertain Data Series; Wireless Sensor Networks

Indexed keywords

DATA ACQUISITION; DATA ANALYTICS; DATA HANDLING; NETWORK PROTOCOLS;

DATA ANALYTICS; DATA COLLECTION; DATA SERIES; DATA-AWARE NETWORK PROTOCOL; DEVIATION DETECTION; OUTLIER; REAL-TIME DATA; SENSORS NETWORK; UNCERTAIN DATA SERIES; UNCERTAIN DATAS;

WIRELESS SENSOR NETWORKS;

EID: 84906668423     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-4614-6309-2_7     Document Type: Chapter

References (115)

1. Pacific Northwest Weather Data. http://www-k12.atmos. washington.edu/k12/grayskies/, 2012.
2. SmartSantander: A City-wide Experimental Facility. http://www. smartsantander.eu/, 2012.
3. C. C. Aggarwal, A. Bar-Noy, and S. Shamoun. On sensor selection in linked information networks. In DCOSS, pages 1-8, 2011.
4. C. C. Aggarwal, Y. Xie, and P. S. Yu. On dynamic data-driven selection of sensor streams. In KDD, pages 1226-1234, 2011.
5. R. Agrawal, C. Faloutsos, and A. Swami. Efficient similarity search in sequence databases. Foundations of Data Organization and Algorithms, pages 69-84, 1993.
6. A. Ali, A. Khelil, F. Karim Shaikh, and N. Suri. MPM: Map based predictive monitoring for wireless sensor networks. In Proc. of Int. Conf. on Autonomic Computing and Communication Systems, 2009.
7. M. H. Ali, M. F. Mokbel, W. G. Aref, and I. Kamel. Detection and tracking of discrete phenomena in sensor-network databases. In SSDBM, pages 163-172, Santa Barbara, CA, 2005.
8. J. Asfalg, H.-P. Kriegel, P. Kröger, and M. Renz. Probabilistic similarity search for uncertain time series. In SSDBM, pages 435- 443, 2009.
9. E. Baralis and T. Cerquitelli. Selecting representatives in a sensor network. In In Proceedings of the SEBD, pages 351-360, 2006.
10. A. Barreto, A. Araujo, and S. Kremer. A taxonomy for spatiotemporal connectionist networks revisited: the unsupervised case. Neural Computation, 15:1255-1320, 2003.
11. D. J. Berndt and J. Clifford. Using dynamic time warping to find patterns in time series. In KDD Workshop, pages 359-370, 1994.
12. L. M. A. Bettencourt, A. A. Hagberg, and L. B. Larkey. Separating the wheat from the chaff: Practical anomaly detection schemes in ecological applications of distributed sensor networks. In DCOSS, pages 223-239, 2007.
13. J. W. Branch, B. K. Szymanski, C. Giannella, R. Wolff, and H. Kargupta. In-network outlier detection in wireless sensor networks. In ICDCS, page 51, 2006.
14. L. Brenna, J. Gehrke, M. Hong, and D. Johansen. Distributed event stream processing with non-deterministic finite automata. In Proc. of ACM Conference on Distributed Event-Based Systems (DEBS), pages 1-12, 2009.
15. M. M. Breunig, H.-P. Kriegel, R. T. Ng, and J. Sander. Lof: Identifying density-based local outliers. In SIGMOD Conference, pages 93-104, 2000.
16. A. Bulut and A. K. Singh. SWAT: Hierarchical Stream Summarization in Large Networks. In International Conference on Data Engineering, pages 303-314, Bangalore, India, March 2003.
17. S. Burdakis and A. Deligiannakis. Detecting outliers in sensor networks using the geometric approach. In ICDE, 2012.
18. M. Ceriotti, M. Corra, L. D'Orazio, R. Doriguzzi, D. Facchin, S. Guna, G. P. Jesi, R. Lo Cigno, L. Mottola, A. L. Murphy, M. Pescalli, G. P. Picco, D. Pregnolato, and C. Torghele. Is There Light at the Ends of the Tunnel? Wireless Sensor Networks for Adaptive Lighting in Road Tunnels. In International Conference on Information Processing in Sensor Networks (IPSN), pages 187- 198, 2011.
19. M. Ceriotti, L. Mottola, G. P. Picco, A. L. Murphy, S. Guna, M. Corrà, M. Pozzi, D. Zonta, and P. Zanon. Monitoring heritage buildings with wireless sensor networks: The torre aquila deployment. In IPSN, pages 277-288, 2009.
20. K. Chakrabarti, E. J. Keogh, S. Mehrotra, and M. J. Pazzani. Locally Adaptive Dimensionality Reduction for Indexing Large Time Series Databases. ACM Transactions on Database Systems, 27(2):188-228, 2002.
21. K. Chan and W. Fu. Efficient Time Series Matching by Wavelets. In International Conference on Data Engineering, pages 126-133, Sydney, Australia, March 1999.
22. K.P. Chan and A.W.C. Fu. Efficient time series matching by wavelets. In Data Engineering, 1999. Proceedings., 15th International Conference on, pages 126-133. IEEE, 2002.
23. M. Charikar. Similarity estimation techniques from rounding algorithms. In STOC, pages 380-388, 2002.
24. K. Chintalapudi and R. Govindan. Localized edge detection in sensor fields. Ad-hoc Networks Journal, 2003.
25. D. Chu, A. Deshpande, J. M. Hellerstein, and W. Hong. Approximate data collection in sensor networks using probabilistic models. In Proc. of the Int. Conf. on Data Eng. (ICDE), 2006.
26. R. Cole, D. Shasha, and X. Zhao. Fast window correlations over uncooperative time series. In KDD, pages 743-749, 2005.
27. M. Dallachiesa, B. Nushi, T. Palpanas, and K. Mirylenka. Similarity matching for uncertain time series: analytical and experimental comparison. In QUeST, 2011.
28. M. Dallachiesa, B. Nushi, T. Palpanas, and K. Mirylenka. Uncertain time series similarity: Return to the basics. In VLDB, 2012.
29. B. de Vries and J. C. Principe. The gamma model- A new neural model for temporal processing. Neural Networks, 5:565-576, 1992.
30. A. Deligiannakis, Y. Kotidis, V. Vassalos, V. Stoumpos, and A. Delis. Another outlier bites the dust: Computing meaningful aggregates in sensor networks. In ICDE, pages 988-999, 2009.
31. A. Deshpande, C. Guestrin, and S. Madden. Using probabilistic models for data management in acquisitional environments. In CIDR, pages 317-328, 2005.
32. A. Deshpande, C. Guestrin, S. R. Madden, J. M. Hellerstein, and W. Hong. Model-Driven Data Acquisition in Sensor Networks. In VLDB, Toronto, ON, Canada, 2004.
33. H. Ding, G. Trajcevski, P. Scheuermann, X. Wang, and E. Keogh. Querying and mining of time series data: experimental comparison of representations and distance measures. Proceedings of the VLDB Endowment, 1(2):1542-1552, 2008.
34. E. Elnahrawy and B. Nath. Context-aware sensors. In EWSN, pages 77-93, 2004.
35. C. Faloutsos, M. Ranganathan, and Y. Manolopoulos. Fast subsequence matching in time-series databases. ACM SIGMOD Record, 23(2):419-429, 1994.
36. C. Faloutsos, M. Ranganathan, and Y. Manolopoulos. Fast Subsequence Matching in Time-Series Databases. In ACM SIGMOD International Conference, pages 419-429, Minneapolis, MI, USA, May 1994.
37. E. Fidler, H. a. Jacobsen, G. Li, and S. Mankovski. The padres distributed publish/subscribe system. In Proc. of the Conference on Feature Interactions in Telecommunications and Software Systems, 2005.
38. D. Ganesan, B. Greenstein, D. Estrin, J. Heidemann, and R. Govindan. Multiresolution storage and search in sensor networks. ACM TOS, 1(3):27-315, 2005.
39. N. Giatrakos, Y. Kotidis, and A. Deligiannakis. Pao: powerefficient attribution of outliers in wireless sensor networks. In DMSN, pages 33-38, 2010.
40. N. Giatrakos, Y. Kotidis, A. Deligiannakis, V. Vassalos, and Y. Theodoridis. Taco: tunable approximate computation of outliers in wireless sensor networks. In SIGMOD Conference, pages 279- 290, 2010.
41. A. C. Gilbert, Y. Kotidis, S. Muthukrishnan, and M. Strauss. Surfing wavelets on streams: One-pass summaries for approximate aggregate queries. In VLDB, pages 79-88, 2001.
42. O. Gnawali, R. Fonseca, K. Jamieson, D. Moss, and P. Levis. The collection tree protocol. In Proc. of the Int. Conf. on Embedded Networked Sensor Systems (SenSys), 2009.
43. D. Golovin, M. Faulkner, and A. Krause. Online distributed sensor selection. In IPSN, pages 220-231, 2010.
44. L. Gruenwald, Md. S. Sadik, R. Shukla, and H. Yang. DEMS: A Data Mining Based Technique to Handle Missing Data in Mobile Sensor Network Applications. In Proc. of the Int. Conf. on Data Mgmt. for Sensor Networks (DMSN), 2010.
45. C. Guestrin, P. Bodik, R. Thibaux, M. Paskin, and S. Madden. Distributed Regression: an Efficient Framework for Modeling Sensor Network Data. In IPSN, Berkeley, CA, 2004.
46. M. Hassani, E. Müller, and T. Seidl. EDISKCO: Energy efficient distributed in-sensor-network k-center clustering with outliers. In In Proceedings of the Third International Workshop on Knowledge Discovery from Sensor Data SensorKDD, pages 39-48, 2009.
47. M. Hassani, E. Müller, P. Spaus, A. Faqolli, T. Palpanas, and T. Seidl. Self-organizing energy aware clustering of nodes in sensor networks using relevant attributes. In Proc. of the Int. Wkshp. on Kowledge Discovery from Sensor Data (SensorKDD), 2010.
48. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer-Verlag, 2001.
49. J. M. Hellerstein, W. Hong, S. Madden, and K. Stanek. Beyond average: Toward sophisticated sensing with queries. In IPSN, pages 63-79, 2003.
50. C. Intanagonwiwat, D. Estrin, R. Govindan, and J. Heidemann. Impact of network density on data aggregation in wireless sensor networks. In ICDCS, 2002.
51. A. Jain, E. Y. Chang, and Y.-F. Wang. Adaptive stream resource management using Kalman filters. In Proc. of the Int. Conf. on Management of Data (SIGMOD), 2004.
52. H. Jiang, S. Jin, and C. Wang. Prediction or not? An energyefficient framework for clustering-based data collection in wireless sensor networks. IEEE Trans. on Parallel Distributed Systems, 22, June 2011.
53. E. Keogh, K. Chakrabarti, M. Pazzani, and S. Mehrotra. Dimensionality reduction for fast similarity search in large time series databases. Knowledge and Information Systems, 3(3):263-286, 2001.
54. E. J. Keogh and M. J. Pazzani. An Enhanced Representation of Time Series Which Allows Fast and Accurate Classification, Clustering and Relevance Feedback. In International Conference on Knowledge Discovery and Data Mining, pages 239-243, New York, NY, USA, August 1998.
55. E. M. Knorr and R. T. Ng. Algorithms for Mining Distance-Based Outliers in Large Datasets. In VLDB, NY, NY, 1998.
56. Y. Kotidis. Snapshot queries: Towards data-centric sensor networks. In Proceeding of the 21st International Conference on Data Engineering, ICDE, 2005.
57. L. Krishnamurthy, R. Adler, P. Buonadonna, J. Chhabra, M. Flanigan, N. Kushalnagar, L. Nachman, and M. Yarvis. Design and deployment of industrial sensor networks: experiences from a semiconductor plant and the north sea. In Proceedings of the 3rd international conference on Embedded networked sensor systems, pages 64-75. ACM, 2005.
58. I. Lazaridis and S. Mehrotra. Capturing Sensor-Generated Time Series with Quality Guarantees. In International Conference on Data Engineering, pages 429-440, Bangalore, India, March 2003.
59. S. Madden and M. J. Franklin. Fjording the stream: An architecture for queries over streaming sensor data. In Proc. of the Int. Conf. on Data Eng. (ICDE), 2002.
60. S. Madden, M. J. Franklin, J. M. Hellerstein, and W. Hong. Tag: A tiny aggregation service for ad-hoc sensor networks. In OSDI, 2002.
61. N. Malpani, J. Welch, and N. Vaidya. Leader Election Algorithms for Mobile Ad Hoc Networks. In Proc. Fourth International Workshop on Discrete Algorithms and Methods for Mobile Computing and Communications, 2000.
62. A. Meka and A. K. Singh. Distributed special clustering in sensor networks. In EDBT 2006, LNCS 3896, pages 980-1000, 2006.
63. R. A. F. Mini, M. Do Val Machado, A. A. F. Loureiro, and B. Nath. Prediction-based energy map for wireless sensor networks. Ad Hoc Networks, 3, 2005.
64. M. Moshtaghi, C. Leckie, S. Karunasekera, J. C. Bezdek, S. Rajasegarar, and M. Palaniswami. Incremental elliptical boundary estimation for anomaly detection in wireless sensor networks. In ICDM, pages 467-476, 2011.
65. D. Moss and P. Levis. BoX-MACs: Exploiting Physical and Link Layer Boundaries in Low-Power Networking. Technical Report SING-08-00, 2008.
66. L. Mottola, G.P. Picco, M. Ceriotti, S. Guna, and A.L. Murphy. Not All Wireless Sensor Networks Are Created Equal: A Comparative Study On Tunnels. ACM Trans. on Sensor Networks (TOSN), 7(2), 2010.
67. S. Nath. Energy efficient sensor data logging with amnesic flash storage. In IPSN, pages 157-168, 2009.
68. R. Nowak and U. Mitra. Boundary estimation in sensor networks: Theory and methods. In IPSN, pages 80-95, Palo Alto, CA, 2003.
69. T. Palpanas, V. Kalogeraki, and D. Gunopulos. Online distribution estimation for streaming data: Framework and applications. In SEBD, pages 430-438, 2007.
70. T. Palpanas, M. Vlachos, E. J. Keogh, and D. Gunopulos. Streaming time series summarization using user-defined amnesic functions. IEEE Trans. Knowl. Data Eng., 20(7):992-1006, 2008.
71. S. Papadimitriou, H. Kitagawa, P. Gibbons, and C. Faloutsos. Loci: Fast outlier detection using the local correlation integral, 2003.
72. S. Papadimitriou, J. Sun, and C. Faloutsos. Streaming pattern discovery in multiple time-series. In VLDB, pages 697-708, 2005.
73. N. D. Pham, T. D. Le, and H. Choo. SCCS: Spatiotemporal clustering and compressing schemes for efficient data collection applications in WSNs. Int. Journal of Communication Systems, 23, 2010.
74. J. Polastre, R. Szewczyk, and D. Culler. Telos: Enabling ultra-low power wireless research. In Proc. of the Int. Conf. on Information Processing in Sensor Networks (IPSN), 2005.
75. I. Popivanov and R. J. Miller. Similarity Search Over Time Series Data Using Wavelets. In International Conference on Data Engineering, pages 802-813, San Jose, CA, USA, February 2002.
76. D. Rafiei. On Similarity-Based Queries for Time Series Data. In International Conference on Data Engineering, Sydney, Australia, March 1999.
77. S. Rajasegarar, C. Leckie, M. Palaniswami, and J. C. Bezdek. Quarter sphere based distributed anomaly detection in wireless sensor networks. In ICC, pages 3864-3869, 2007.
78. S. Ramaswamy, R. Rastogi, and K. Shim. Efficient algorithms for mining outliers from large data sets. In SIGMOD Conference, pages 427-438, 2000.
79. U. Raza, A. Camerra, A. L. Murphy, T. Palpanas, and G. P. Picco. What does model-driven data acquisition really achieve in wireless sensor networks? In IEEE International Conference on Pervasive Computing and Communications, Lugano, Switzerland, 2012.
80. P. P. Rodrigues, J. Gama, and L. Lopes. Clustering distributed sensor data streams. In ECML PKDD 2008, LNAI. Springer- Verlag, 2008.
81. G. Sagy, D. Keren, I. Sharfman, and A. Schuster. Distributed threshold querying of general functions by a difference of monotonic representation. PVLDB, 4(2):46-57, 2010.
82. Y. Sakurai, S. Papadimitriou, and C. Faloutsos. Braid: Stream mining through group lag correlations. In SIGMOD Conference, pages 599-610, 2005.
83. S.R. Sarangi and K. Murthy. DUST: a generalized notion of similarity between uncertain time series. In Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 383-392. ACM, 2010.
84. D. Scott. Multivariate Density Estimation: Theory, Practice and Visualization. Wiley & Sons, 1992.
85. B. Sheng, Q. Li, W. Mao, and W. Jin. Outlier detection in sensor networks. In MobiHoc, pages 219-228, 2007.
86. A. Silberstein, R. Braynard, and J. Yang. Constraint chaining: on energy-efficient continuous monitoring in sensor networks. In SIGMOD Conference, pages 157-168, 2006.
87. A. Silberstein, G. Filpus, K. Munagala, and J. Yang. Data-driven processing in sensor networks. In Proc. of the Conf. on Innovative Data Systems Research (CIDR), 2007.
88. A. Silberstein, A. E. Gelfand, K. Munagala, G. Puggioni, and J. Yang. Making sense of suppressions and failures in sensor data: A bayesian approach. In Proc. of the Int. Conf. on Very Large Data Bases (VLDB), 2007.
89. E. Soroush, K. Wu, and J. Pei. Fast and quality-guaranteed data streaming in resource-constrained sensor networks. In MobiHoc, pages 391-400, 2008.
90. D. Steere, A. Baptista, D. McNamee, C. Pu, and J. Walpole. Research Challenges in Environmental Observation and Forecasting Systems. In Mobile Computing and Networking, Boston, MA, USA, August 2000.
91. M. Stonebraker, J. Becla, D. J. DeWitt, K.-T. Lim, D. Maier, O. Ratzesberger, and S. B. Zdonik. Requirements for science data bases and scidb. In CIDR, 2009.
92. S. Subramaniam, V. Kalogeraki, and T. Palpanas. Distributed Real-Time Detection and Tracking of Homogeneous Regions in Sensor Networks. In RTSS, Rio de Janeiro, Brazil, 2006.
93. S. Subramaniam, T. Palpanas, D. Papadopoulos, V. Kalogeraki, and D. Gunopulos. Online Outlier Detection in Sensor Data Using Non-Parametric Models. In VLDB, Seoul, Korea, 2006.
94. D. Suciu, A. Connolly, and B. Howe. Embracing uncertainty in large-scale computational astrophysics. In MUD, pages 63-77, 2009.
95. A. S. Tanenbaum and M. van Steen. Distributed Systems: Principles and Paradigms (2nd Edition), chapter 13, pages 603-607. Prentice Hall, 2006.
96. T. T. L. Tran, L. Peng, B. Li, Y. Diao, and A. Liu. Pods: a new model and processing algorithms for uncertain data streams. In SIGMOD Conference, pages 159-170, 2010.
97. D. Tulone and S. Madden. An energy-efficient querying framework in sensor networks for detecting node similarities. In Proc. of the Int. Conf. on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM), 2006.
98. D. Tulone and S. Madden. PAQ: Time series forecasting for approximate query answering in sensor networks. In Proceedings of the European Wkshp. on Wireless Sensor Networks (EWSN), 2006.
99. M. C. Vuran, O. B. Akan, and I. F. Akyildiz. Spatio-temporal correlation: theory and applications for wireless sensor networks. Computer Networks, 45(3), 2004.
100. B. Warneke, M. Last, B. Liebowitz, and K. Pister. Smart dust: Communicating with a cubic-millimeter computer. IEEE Computer Magazine, pages 44-51, January 2001.
101. W. Wu, H.-B. Lim, and K.-L. Tan. Query-driven data collection and data forwarding in intermittently connected mobile sensor networks. In Proc. of Int. Conf. on Data Mgmt. for Sensor Networks (DMSN), 2010.
102. W. Wu, X. Cheng, M. Ding, K. Xing, F. Liu, and P. Deng. Localized outlying and boundary data detection in sensor networks. IEEE Trans. Knowl. Data Eng., 19(8):1145-1157, 2007.
103. Y. Yao and J. Gehrke. Query processing in sensor networks. In Proc. of the Conf. on Innovative Data Systems Research (CIDR), 2003.
104. F. Ye, H. Luo, J. Cheng, S. Lu, and L. Zhang. A Two-Tier Data Dissemination Model for Large-Scale Wireless Sensor Networks. In MOBICOM, Atlanta, GA, USA, 2002.
105. M.Y. Yeh, K.L. Wu, P.S. Yu, and M.S. Chen. PROUD: a probabilistic approach to processing similarity queries over uncertain data streams. In Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology, pages 684-695. ACM, 2009.
106. B. Yi and C. Faloutsos. Fast Time Sequence Indexing for Arbitrary LP-Norms. In VLDB International Conference, pages 385-394, Cairo, Egypt, September 2000.
107. B.-K. Yi, N. Sidiropoulos, T. Johnson, H. V. Jagadish, C. Faloutsos, and A. Biliris. Online data mining for co-evolving time sequences. In ICDE, pages 13-22, 2000.
108. J. Yin and M. M. Gaber. Clustering distributed time series in sensor networks. In In Proceedings of the Eighth IEEE Conference on Data Mining, ICDM, 2008.
109. K. Zhang, S. Shi, H. Gao, and J. Li. Unsupervised outlier detection in sensor networks using aggregation tree. In ADMA, pages 158- 169, 2007.
110. S. Zhao, K. Tepe, I. Seskar, and D. Raychaudhuri. Routing protocols for self-organizing hierarchical ad hoc wireless networks. In IEEE Sarnoff Symposium, 2003.
111. Y. Zhao and S. Zhang. Generalized dimension-reduction framework for recent-biased time series analysis. IEEE Trans. Knowl. Data Eng., 18(2):231-244, 2006.
112. Y. Zhao, C. C. Aggarwal, and P. S. Yu. On wavelet decomposition of uncertain time series data sets. In CIKM, pages 129-138, 2010.
113. Z. Zhou, S. Das, and H. Gupta. Connected k-coverage problem in sensor networks. In Proc. of the Int. Conf. on Computer Communications and Networks (IC3N), 2004.
114. Y. Zhu and D. Shasha. Statstream: Statistical monitoring of thousands of data streams in real time. In VLDB, pages 358-369, 2002.
115. Y. Zhuang and L. Chen. In-network outlier cleaning for data collection in sensor networks. In CleanDB, pages 41-48, 2006.