A Scalable and Flexible Repository for Big Sensor Data

IEEE Sensors Journal

Volumn 15, Issue 12, 2015, Pages 7284-7294

  Lee, Dongeun ^a   Choi, Jaesik ^a   Shin, Heonshik ^b  

^a Ulsan National Institute of Science and Technology   (South Korea)

^b Seoul National University   (South Korea)

Author keywords

big data archiving; data compression; Quality adjustable sensor data; storage management; wireless sensor network

Indexed keywords

BIG DATA; DIGITAL STORAGE; INFORMATION MANAGEMENT; STORAGE MANAGEMENT; WIRELESS SENSOR NETWORKS;

DATA ARCHIVING; DATA GENERATION; LOSSY CODING; SENSOR DATA; SENSOR SIGNALS; SPATIAL AND TEMPORAL CORRELATION; STORAGE EFFICIENCY; STORAGE SPACES;

DATA COMPRESSION;

EID: 84960192953     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2015.2471802     Document Type: Article

References (42)

1. D. Lee and J. Choi, "Low complexity sensing for big spatio-temporal data," in Proc. Int. Conf. Big Data (BigData), Oct. 2014, pp. 323-328.
2. D. Lee and J. Choi, "Learning compressive sensing models for big spatio-temporal data," in Proc. Int. Conf. Data Mining (SDM), 2015, pp. 667-675.
3. A. Zaslavsky, C. Perera, D. Georgakopoulos, "Sensing as a service and big data," in Proc. Int. Conf. Adv. Cloud Comput. (ACC), 2012, pp. 21-29.
4. C. Perera, A. Zaslavsky, C. H. Liu, M. Compton, P. Christen, D. Georgakopoulos, "Sensor search techniques for sensing as a service architecture for the Internet of things," IEEE Sensors J., vol. 14, no. 2, pp. 406-420, Feb. 2014.
5. J. F. Roddick, E. Hoel, M. J. Egenhofer, D. Papadias, B. Salzberg, "Spatial, temporal and spatio-temporal databases-Hot issues and directions for PhD research," SIGMOD Rec., vol. 33, no. 2, pp. 126-131, Jun. 2004.
6. P. Ranganathan, "From microprocessors to nanostores: Rethinking data-centric systems," Computer, vol. 44, no. 1, pp. 39-48, Jan. 2011.
7. J. F. Gantz et al., "The diverse and exploding digital universe: An updated forecast of worldwide information growth through 2011," IDC, Framingham, MA, USA, White Paper, Mar. 2008.
8. M. Hilbert and P. López, "The world's technological capacity to store, communicate, compute information," Science, vol. 332, no. 6025, pp. 60-65, Apr. 2011.
9. T. Palpanas, M. Vlachos, E. Keogh, D. Gunopulos, W. Truppel, "Online amnesic approximation of streaming time series," in Proc. Int. Conf. Data Eng. (ICDE), 2004, pp. 339-349.
10. D. Ganesan, D. Estrin, J. Heidemann, "Dimensions: Why do we need a new data handling architecture for sensor networks?" SIGCOMM Comput. Commun. Rev., vol. 33, no. 1, pp. 143-148, Jan. 2003.
11. D. Ganesan, B. Greenstein, D. Estrin, J. Heidemann, R. Govindan, "Multiresolution storage and search in sensor networks," ACM Trans. Storage, vol. 1, no. 3, pp. 277-315, Aug. 2005.
12. Y.-C. Wang, Y.-Y. Hsieh, Y.-C. Tseng, "Multiresolution spatial and temporal coding in a wireless sensor network for long-term monitoring applications," IEEE Trans. Comput., vol. 58, no. 6, pp. 827-838, Jun. 2009.
13. C. M. Sadler and M. Martonosi, "Data compression algorithms for energy-constrained devices in delay tolerant networks," in Proc. 4th Int. Conf. Embedded Netw. Sensor Syst. (SenSys), 2006, pp. 265-278.
14. K. C. Barr and K. Asanovíc, "Energy-aware lossless data compression," ACM Trans. Comput. Syst., vol. 24, no. 3, pp. 250-291, Aug. 2006.
15. F. Marcelloni and M. Vecchio, "Enabling energy-efficient and lossy-aware data compression in wireless sensor networks by multi-objective evolutionary optimization," Inf. Sci., vol. 180, no. 10, pp. 1924-1941, May 2010.
16. D. Lee, J. Ryu, H. Shin, "Scalable management of storage for massive quality-adjustable sensor data," Computing, vol. 97, no. 8, pp. 769-793, Aug. 2015.
17. T. Srisooksai, K. Keamarungsi, P. Lamsrichan, K. Araki, "Practical data compression in wireless sensor networks: A survey," J. Netw. Comput. Appl., vol. 35, no. 1, pp. 37-59, Jan. 2012.
18. H. Esmaeilzadeh, A. Sampson, L. Ceze, D. Burger, "Architecture support for disciplined approximate programming," in Proc. 7th Int. Conf. Archit. Support Program. Lang. Oper. Syst. (ASPLOS), 2012, pp. 301-312.
19. A. Sampson, J. Nelson, K. Strauss, L. Ceze, "Approximate storage in solid-state memories," in Proc. 46th Annu. IEEE/ACM Int. Symp. Microarchitecture (MICRO), 2013, pp. 25-36.
20. M. C. Vuran, Ó. B. Akan, I. F. Akyildiz, "Spatio-temporal correlation: Theory and applications for wireless sensor networks," Comput. Netw., vol. 45, no. 3, pp. 245-259, Jun. 2004.
21. K. Sayood, Introduction to Data Compression, 4th ed. San Mateo, CA, USA: Morgan Kaufmann, 2012.
22. E. Cohen and H. Kaplan, "Aging through cascaded caches: Performance issues in the distribution of Web content," in Proc. SIGCOMM, 2001, pp. 41-53.
23. M. Palmer, "Seven principles of effective RFID data management," Progress Software, Bedford, MA, USA, Tech. Rep., 2005.
24. H. Cao, O. Wolfson, G. Trajcevski, "Spatio-temporal data reduction with deterministic error bounds," Int. J. Very Large Data Bases, vol. 15, no. 3, pp. 211-228, Sep. 2006.
25. N. Ahmed, T. Natarajan, K. R. Rao, "Discrete cosine transform," IEEE Trans. Comput., vol. 23, no. 1, pp. 90-93, Jan. 1974.
26. S. K. Raman, V. Pentkovski, J. Keshava, "Implementing streaming SIMD extensions on the Pentium III processor," IEEE Micro, vol. 20, no. 4, pp. 47-57, Jul. 2000.
27. Y.-K. Chen, E. Q. Li, X. Zhou, S. Ge, "Implementation of H.264 encoder and decoder on personal computers," J. Vis. Commun. Image Represent., vol. 17, no. 2, pp. 509-532, Apr. 2006.
28. M. Wien, R. Cazoulat, A. Graffunder, A. Hutter, P. Amon, "Realtime system for adaptive video streaming based on SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1227-1237, Sep. 2007.
29. H.-M. Hang and J.-J. Chen, "Source model for transform video coder and its application. I. Fundamental theory," IEEE Trans. Circuits Syst. Video Technol., vol. 7, no. 2, pp. 287-298, Apr. 1997.
30. Coding of Audio-Visual Objects-Part 10: Advanced Video Coding, document ISO/IEC 14496-10 and ITU-T Rec. H.264, 2003.
31. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York, NY, USA: Wiley, 2006.
32. M. Dai, D. Loguinov, H. M. Radha, "Rate-distortion analysis and quality control in scalable Internet streaming," IEEE Trans. Multimedia, vol. 8, no. 6, pp. 1135-1146, Dec. 2006.
33. H. Everett, III, "Generalized Lagrange multiplier method for solving problems of optimum allocation of resources," Oper. Res., vol. 11, no. 3, pp. 399-417, Jun. 1963.
34. Y. Shoham and A. Gersho, "Efficient bit allocation for an arbitrary set of quantizers," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 9, pp. 1445-1453, Sep. 1988.
35. Sensorscope: Sensor Networks for Environmental Monitoring. [Online]. Available: http://lcav.epfl.ch/op/edit/sensorscope-en, accessed Sep. 2015.
36. Gzip. [Online]. Available: http://www.gzip.org, accessed Sep. 2015.
37. Bzip2. [Online]. Available: http://www.bzip.org, accessed Sep. 2015.
38. A. Moffat, "Implementing the PPM data compression scheme," IEEE Trans. Commun., vol. 38, no. 11, pp. 1917-1921, Nov. 1990.
39. 7-Zip. [Online]. Available: http://www.7-zip.org, accessed Sep. 2015.
40. Sensirion. [Online]. Available: http://www.sensirion.com/en/home/, accessed Sep. 2015.
41. Z. Xiong, K. Ramchandran, M. T. Orchard, Y.-Q. Zhang, "A comparative study of DCT-and wavelet-based image coding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 5, pp. 692-695, Aug. 1999.
42. D. Lambert, "Zero-inflated Poisson regression, with an application to defects in manufacturing," Technometrics, vol. 34, no. 1, pp. 1-14, Feb. 1992.