An evaluation of model-based approaches to sensor data compression

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 11, 2013, Pages 2434-2447

  Hung, Nguyen Quoc Viet ^a   Jeung, Hoyoung ^b   Aberer, Karl ^a  

^a EPFL   (Switzerland)

^b SAP RESEARCH   (Australia)

Author keywords

benchmark; Lossy compression; sensor data

Indexed keywords

COMPRESSION PERFORMANCE; COMPRESSION TECHNIQUES; DATA COMPRESSION TECHNIQUES; HETEROGENEOUS SENSORS; LOSSY COMPRESSIONS; PERFORMANCE COMPARISON; SENSOR DATA; STATE-OF-THE-ART METHODS;

BENCHMARKING; SENSORS;

DATA COMPRESSION;

EID: 84884798265     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.237     Document Type: Article

References (45)

1. A. Deligiannakis, Y. Kotidis, and N. Roussopoulos, "Compressing Historical Information in Sensor Networks," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 527-538, 2004.
2. N. Kimura and S. Latifi, "A Survey on Data Compression in Wireless Sensor Networks," Proc. Int'l Conf. Information Technology: Coding and Computing (ITCC '05), pp. 8-13, 2005. (Pubitemid 41290198)
3. H. Elmeleegy et al., "Online Piece-Wise Linear Approximation of Numerical Streams with Precision Guarantees," Proc. VLDB Endowment, vol. 2, no. 1, pp. 145-156, 2009.
4. D. Chu et al., "Approximate Data Collection in Sensor Networks Using Probabilistic Models," Proc. Int'l Conf. Data Eng. (ICDE), p. 48, 2006. (Pubitemid 44539840)
5. D. Tulone and S. Madden, "PAQ: Time Series Forecasting for Approximate Query Answering in Sensor Networks," Proc. Third European Conf. Wireless Sensor Networks (EWSN), pp. 21-37, 2006. (Pubitemid 43978605)
6. J. Yick, B. Mukherjee, and D. Ghosal, "Wireless Sensor Network Survey," Computer Networks, vol. 52, no. 12, pp. 2292-2330, 2008.
7. E. Keogh et al., "Locally Adaptive Dimensionality Reduction for Indexing Large Time Series Databases," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 151-162, 2001.
8. H. Ding et al., "Querying and Mining of Time Series Data: Experimental Comparison of Representations and Distance Measures," Proc. VLDB Endowment, vol. 1, no. 2, pp. 1542-1552, 2008.
9. G. Reeves et al., "Managing Massive Time Series Streams with Multi-Scale Compressed Trickles," Proc. VLDB Endowment, vol. 2, no. 1, pp. 97-108, 2009.
10. L. Yu et al., "Enabling-Approximate Querying in Sensor Networks," Proc. Int'l Conf. Very Large Data Bases, pp. 563-574, 2009.
11. X. Lian and L. Chen, "Efficient Processing of Probabilistic Reverse Nearest Neighbor Queries over Uncertain Data," Proc. VLDB Endowment, vol. 18, no. 3, pp. 787-808, 2009.
12. T. Westmann et al., "The Implementation and Performance of Compressed Databases," SIGMOD Record, vol. 29, no. 3, pp. 55-67, 2000.
13. C. Buragohain, N. Shrivastava, and S. Suri, "Space Efficient Streaming Algorithms for the Maximum Error Histogram," Proc. Int'l Conf. Data Eng. (ICDE), pp. 1026-1035, 2007. (Pubitemid 47422106)
14. X.T. Dang, N. Bulusu, and W. chi Feng, "RIDA: A Robust Information-Driven Data Compression Architecture for Irregular Wireless Sensor Networks," Proc. European Conf. Wireless Sensor Networks, pp. 133-149, 2007.
15. S. Gandhi et al., "GAMPS: Compressing Multi Sensor Data by Grouping and Amplitude Scaling," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 771-784, 2009.
16. K. Sayood, Introduction to Data Compression. Elsevier, 2000.
17. K.C. Barr and K. Asanovic, "Energy Aware Lossless Data Compression," Proc. Int'l Conf. Mobile Systems, Applications and Services, pp. 231-244, 2003.
18. M. Burrows and D.J. Wheeler, A Block-Sorting Lossless Data Compression Algorithm. Digital, Systems Research Center, 1994.
19. J. Ziv and A. Lempel, "A Universal Algorithm for Sequential Data Compression," IEEE Trans. Information Theory, vol. IT-23, no. 3, pp. 337-343, May 1977.
20. J. Ziv and A. Lempel, "Compression of Individual Sequences via Variable-Rate Coding," IEEE Trans. Information Theory, vol. IT-24, no. 5, pp. 530-536, Sept. 1978. (Pubitemid 8631609)
21. C. John and W. Ian, "Data Compression Using Adaptive Coding and Partial String Matching," IEEE Trans. Comm., vol. COM-32, no. 4, pp. 396-402, Apr. 1984.
22. Y. Diao et al., "Rethinking Data Management for Storage-centric Sensor Networks," Proc. Biennial Conf. Innovative Data Systems Research, pp. 22-31, 2007.
23. Y.L. Tan, V. Sehgal, and H.H. Shahri, "SensoClean: Handling Noisy and Incomplete Data in Sensor Networks Using Modeling," technical report, Univ. of Maryland, 2005.
24. Y. Zhang, N. Meratnia, and P. Havinga, "Outlier Detection Techniques for Wireless Sensor Networks: A Survey," J. IEEE Comm. Survey & Tutorials, vol. 12, no. 2, pp. 159-160, second quarter 2010.
25. E. Elnahrawy and B. Nath, "Cleaning and Querying Noisy Sensors," Proc. Second ACM Int'l Conf. Wireless Sensor Networks and Applications, pp. 78-87, 2003.
26. E. Elnahrawy and B. Nath, "Online Data Cleaning in Wireless Sensor Networks," Proc. ACM Conf. Embedded Networked Sensor Systems, pp. 294-295, 2003. (Pubitemid 40682355)
27. S.R. Jeffery, M. Garofalakis, and M.J. Franklin, "Adaptive Cleaning for RFID Data Streams," Proc. Int'l Conf. Very Large Data Bases, pp. 163-174, 2006.
28. Y. Cai and R. Ng, "Indexing Spatio-Temporal Trajectories with Chebyshev Polynomials," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 599-610, 2004.
29. I. Lazaridis and S. Mehrotra, "Capturing Sensor-Generated Time Series with Quality Guarantees," Proc. Int'l Conf. Data Eng. (ICDE), pp. 429-440, 2003.
30. R. Shumway and D. Stoffer, Time Series Analysis and Its Applications. Springer-Verlag, 2005.
31. A. Klein, "Incorporating Quality Aspects in Sensor Data Streams," Proc. ACM First PhD Workshop CIKM (PIKM), pp. 77-84, 2007.
32. E. Keogh et al., "Dimensionality Reduction for Fast Similarity Search in Large Time Series Databases," Knowledge Information Systems, vol. 3, no. 3, pp. 263-286, 2000.
33. C. Olston, J. Jiang, and J. Widom, "Adaptive Filters for Continuous Queries over Distributed Data Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 563-574, 2003.
34. Q. Chen et al., "Indexable PLA for Efficient Similarity Search," Proc. 33rd Int'l Conf. Very Large Data Bases, pp. 435-446, 2007.
35. E.J. Keogh et al., "An Online Algorithm for Segmenting Time Series," Proc. IEEE Int'l Conf. Data Mining, pp. 289-296, 2001.
36. T. Schoellhammer et al., "Lightweight Temporal Compression of Microclimate Data Sets," Proc. 29th Ann. IEEE Int'l Conf. Local Computer Networks, pp. 516-524, 2004. (Pubitemid 40845264)
37. A.F. Cheng et al., "Data Compression Using Chebyshev Transform," Patent US 7,249,153 B2, 2007.
38. A. Arion, H. Jeung, and K. Aberer, "Efficiently Maintaining Distributed Model-Based Views on Real-Time Data Streams," Proc. IEEE GLOBECOM, pp. 1-6, 2011.
39. P. Levis et al., "TOSSIM: Accurate and Scalable Simulation of Entire Tinyos Applications," Proc. Int'l Conf. Embedded Networked Sensor Systems, pp. 126-137, 2003. (Pubitemid 40682340)
40. E. Perla et al., "Powertossim Z: Realistic Energy Modelling for Wireless Sensor Network Environments," Proc. ACM Workshop Performance Monitoring and Measurement of Heterogeneous Wireless and Wired Networks (PM2HW2N), pp. 35-42, 2008.
41. S. Gandhi, L. Foschini, and S. Suri, "Space-Efficient Online Approximation of Time Series Data: Streams, Amnesia, and Out-of-Order," Proc. Int'l Conf. Data Eng. (ICDE), pp. 924-935, 2010.
42. D. Carney et al., "Monitoring Streams: A New Class of Data Management Applications," Proc. Int'l Conf. Very Large Data Bases, pp. 215-226, 2002.
43. S. Subramaniam et al., "Online Outlier Detection in Sensor Data Using Non-Parametric Models," Proc. Int'l Conf. Very Large Data Bases, pp. 187-198, 2006.
44. N. Giatrakos et al., "TACO: Tunable Approximate Computation of Outliers in Wireless Sensor Networks," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 279-290, 2010.
45. R. Graham, "An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set," Information Processing Letters, vol. 1, pp. 132-133, 1972.