Performance analysis of object store systems in a fog and edge computing infrastructure

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 10430, Issue , 2017, Pages 40-79

  Confais, Bastien ^a   Lebre, Adrien ^b   Parrein, Benoît ^c  

^a INSTITUT DE RECHERCHE EN COMMUNICATIONS ET CYBERNÉTIQUE DE NANTES   (France)

^b ECOLE DES MINES DE NANTES   (France)

^c UNIVERSITÉ DE NANTES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING; DIGITAL STORAGE; INTERNET OF THINGS;

CURRENT CLOUD COMPUTING; DISTRIBUTED INFRASTRUCTURE; INTERNET OF THINGS (IOT); NETWORK LATENCIES; NETWORK TRAFFIC; PERFORMANCE ANALYSIS; SIMULTANEOUS OBSERVATION; STORAGE SYSTEMS;

FOG;

EID: 85027372757     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-662-55696-2_2     Document Type: Chapter

References (59)

1. 3GPP: Network architecture. TS 23.002, 3rd Generation Partnership Project (3GPP), September 2008
2. Aazam, M., Huh, E.N.: Fog computing and smart gateway based communication for cloud of things. In: Proceedings of the 2014 International Conference on Future Internet of Things and Cloud. FICLOUD 2014, pp. 464–470. IEEE Computer Society, Washington, DC (2014)
3. Abramova, V., Bernardino, J.: NoSQL databases: MongoDB vs Cassandra. In: Proceedings of the International C* Conference on Computer Science and Software Engineering. C3S2E 2013, pp. 14–22. ACM, New York (2013)
4. Abramova, V., Bernardino, J., Furtado, P.: Evaluating Cassandra scalability with YCSB. In: Decker, H., Lhotská, L., Link, S., Spies, M., Wagner, R.R. (eds.) DEXA 2014. LNCS, vol. 8645, pp. 199–207. Springer, Cham (2014). doi:10.1007/ 978-3-319-10085-218
5. Anwar, A., Cheng, Y., Gupta, A., Butt, A. R: MOS: workload-aware elasticity for cloud object stores. In: Proceedings of the 25th ACM International Symposium on High-Performance Parallel and Distributed Computing. HPDC 2016, pp. 177–188. ACM, New York (2016)
6. Balouek, D., et al.: Adding virtualization capabilities to the Grid’5000 testbed. In: Ivanov, I.I., Sinderen, M., Leymann, F., Shan, T. (eds.) CLOSER 2012. CCIS, vol. 367, pp. 3–20. Springer, Cham (2013). doi:10.1007/978-3-319-04519-11
7. Benet, J.: IPFS - Content Addressed, Versioned, P2P File System. Technical report, Protocol Labs, Inc. (2014)
8. Bonomi, F., Milito, R., Natarajan, P., Zhu, J.: Fog computing: a platform for Internet of Things and analytics. In: Bessis, N., Dobre, C. (eds.) Big Data and Internet of Things: A Roadmap for Smart Environments. SCI, vol. 546, pp. 169–186. Springer, Cham (2014). doi:10.1007/978-3-319-05029-47
9. Bonomi, F., Milito, R., Zhu, J., Addepalli, S.: Fog computing and its role in the Internet of Things. In: Proceedings of the First Edition of the MCC Workshop on Mobile cloud computing. MCC 2012, pp. 13–16 (2012)
10. Brand, G.B., Lebre, A.: GBFS: efficient data-sharing on hybrid platforms: towards adding WAN-wide elasticity to DFSes. In: 2014 International Symposium on Computer Architecture and High Performance Computing Workshop (SBAC-PADW), pp. 126–131, October 2014
11. Brewer, E.A.: Towards robust distributed systems (abstract). In: Proceedings of the Nineteenth Annual ACM Symposium on Principles of Distributed Computing. PODC 2000, p. 7. ACM, New York (2000)
12. Byers, C.C., Wetterwald, P.: Fog computing distributing data and intelligence for resiliency and scale necessary for IoT: the Internet of Things. In: Ubiquity, pp. 4:1–4:12, November 2015
13. Carns, P.H., Ligon L, W.B., Ross, R.B., Thakur, R.: PVFS: a parallel file system for Linux clusters. In: Proceedings of the 4th Annual Linux Showcase & Conference. ALS 2000, vol. 4, p. 28. USENIX Association, Berkeley (2000)
14. Castro, M., Druschel, P., Hu, Y.C.: Exploiting network proximity in distributed hash tables. In: International Workshop on Future Directions in Distributed Computing (FuDiCo), pp. 52–55 (2002)
15. Clarke, I., Sandberg, O., Wiley, B., Hong, T.W.: Freenet: a distributed anonymous information storage and retrieval system. In: Federrath, H. (ed.) Designing Privacy Enhancing Technologies. LNCS, vol. 2009, pp. 46–66. Springer, Heidelberg (2001). doi:10.1007/3-540-44702-44
16. Cooper, B.F., Silberstein, A., Tam, E., Ramakrishnan, R., Sears, R.: Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing. SoCC 2010, pp. 143–154. ACM, New York (2010)
17. Croman, K., et al.: On scaling decentralized blockchains. In:Clark, J., Meiklejohn, S., Ryan, P.Y.A.,Wallach,D., Brenner, M.,Rohloff, K. (eds.) FC2016. LNCS, vol. 9604, pp. 106–125. Springer, Heidelberg (2016). doi:10.1007/978-3-662-53357-48
18. Dabek, F., Cox, R., Kaashoek, F., Morris, R.: Vivaldi: a decentralized network coordinate system. SIGCOMM Comput. Commun. Rev. 34(4), 15–26 (2004)
19. Donovan, S., Huizenga, G., Hutton, A., Ross, C., Petersen, M., Schwan, P.: Lustre: building a file system for 1000-node clusters. In: Proceedings of the Linux Symposium (2003)
20. Dubey, H., Yang, J., Constant, N., Amiri, A.M., Yang, Q., Makodiya, K.: Fog data: enhancing telehealth big data through fog computing. In: Proceedings of the ASE BigData & SocialInformatics. ASE BD&SI 2015, pp. 14:1–14:6 (2015)
21. Farinacci, D., Fuller, V., Meyer, D., Lewis, D.: The Locator/ID Separation Protocol (LISP). Technical report. Request for Comments 6830, Internet Engineering Task Force, October 2015
22. Firdhous, M., Ghazali, O., Hassan, S.: Fog computing: will it be the future of Cloud Computing? In: Third International Conference on Informatics & Applications, Kuala Terengganu, pp. 8–15 (2014)
23. Garcia, P.G., Montresor, A., Epema, D., Datta, A., Higashino, T., Iamnitchi, A., Barcellos, M., Felber, P., Riviere, E.: Edge-centric computing: vision and challenges. SIGCOMM Comput. Commun. Rev. 45(5), 37–42 (2015)
24. Gettys, J., Nichols, K.: Bufferbloat: dark buffers in the internet. Commun. ACM 55(1), 57–65 (2012)
25. Hong, K., Lillethun, D., Ramachandran, U., Ottenwälder, B., Koldehofe, B.: Mobile fog: a programming model for large-scale applications on the Internet of Things. In: Proceedings of the Second ACM SIGCOMM Workshop on Mobile Cloud Computing. MCC 2013, pp. 15–20. ACM, New York (2013)
26. Hupfeld, F., Cortes, T., Kolbeck, B., Stender, J., Focht, E., Hess, M., Malo, J., Marti, J., Cesario, E.: The Xtreem FS architecture – a case for object-based file systems in grids. Concurr. Comput. Pract. Exp. 20(17), 2049–2060 (2008)
27. Jararweh, Y., Ababneh, F., Khreishah, A., Dosari, F., et al.: Scalable cloudletbased mobile computing model. Procedia Comput. Sci. 34, 434–441 (2014)
28. Johnson, D.D.B., Arkko, J., Perkins, C.E.: Mobility Support in IPv6. Technical report. Request for Comments 6275, Internet Engineering Task Force, October 2015
29. Jorgensen, N.T.K., Rodriguez, I., Elling, J., Mogensen, P.: 3G Femto or 802.11g WiFi: which is the best indoor data solution today? In: 2014 IEEE 80th Vehicular Technology Conference (VTC2014-Fall), pp. 1–5, September 2014
30. Lakshman, A., Malik, P.: Cassandra: a decentralized structured storage system. SIGOPS Oper. Syst. Rev. 44(2), 35–40 (2010)
31. Lamport, L.: Paxos made simple, fast, and byzantine. In: Procedings of the 6th International Conference on Principles of Distributed Systems. OPODIS 2002, Reims, 11–13 December 2002, pp. 7–9 (2002)
32. Legout, A., Urvoy-Keller, G., Michiardi, P.: Understanding BitTorrent: an experimental perspective. Technical report, INRIA, Institut Eurecom (2005)
33. Lindgren, A., Doria, A., Davies, E.B., Grasic, S.: Probabilistic routing protocol for intermittently connected networks. Technical report. Request for Comments 6693, Internet Engineering Task Force, October 2015
34. Markopoulou, A., Tobagi, F., Karam, M.: Loss and delay measurements of internet backbones. Comput. Commun. 29(10), 1590–1604 (2006). Monitoring and Measurements of IP Networks
35. Maymounkov, P., Mazières, D.: Kademlia: a peer-to-peer information system based on the XOR metric. In: Druschel, P., Kaashoek, F., Rowstron, A. (eds.) IPTPS 2002. LNCS, vol. 2429, pp. 53–65. Springer, Heidelberg (2002). doi:10. 1007/3-540-45748-85.
36. Nielsen, J: Nielsen’s law of internet bandwidth (1998).
37. Padhye, J., Firoiu, V., Towsley, D., Kurose, J.: Modeling TCP throughput: a simple model and its empirical validation. SIGCOMM Comput. Commun. Rev. 28(4), 303–314 (1998)
38. Palankar, M.R., Iamnitchi, A., Ripeanu, M., Garfinkel, S.: Amazon S3 for science grids: a viable solution? In: Proceedings of the 2008 International Workshop on Data-Aware Distributed Computing. DADC 2008, pp. 55–64. ACM, New York (2008)
39. Pallis, G., Vakali, A.: Insight and perspectives for content delivery networks. Commun. ACM 49(1), 101–106 (2006)
40. Pertin, D., David, S., Évenou, P., Parrein, B., Normand, N.: Distributed file system based on erasure coding for I/O intensive applications. In: 4th International Conference on Cloud Computing and Service Science (CLOSER), Barcelone, April 2014
41. Qiu, D., Srikant, R.: Modeling and performance analysis of bittorrent-like peer-topeer networks. SIGCOMM Comput. Commun. Rev. 34(4), 367–378 (2004)
42. Ridoux, J., Kassar, M., Boc, M., Fladenmuller, A., Viniotis, Y.: Performance of Taroko: a cluster-based addressing and routing scheme for self-organized networks. In: Proceedings of the 2006 International Conference on Wireless Communications and Mobile Computing. IWCMC 2006, pp. 109–114. ACM, New York (2006)
43. Ripeanu, M.: Peer-to-Peer architecture case study: Gnutella network. In: Proceedings of the First International Conference on Peer-to-Peer Computing, pp. 99–100, August 2001
44. Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST). MSST 2010, pp. 1–10. IEEE Computer Society, Washington, DC (2010)
45. Couto Souza, R.D.S., Secci, S., Campista, M.E.M., Costa, L.H.M.K.: Network design requirements for disaster resilience in IaaS Clouds. IEEE Commun. Mag. 52(10), 52–58 (2014) L.H. , : Network design requirements for disaster resilience in IaaS Clouds. IEEE Commun. Mag. 52(10), 52–58 (2014)
46. Sui, K., Zhou, M., Liu, D., Ma, M., Pei, D., Zhao, Y., Li, Z., Moscibroda, T.: Characterizing and improving wifi latency in large-scale operational networks. In: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services. MobiSys 2016, pp. 347–360. ACM, New York (2016)
47. Tang, B., Chen, Z., Hefferman, G., Wei, T., He, H., Yang, Q: A hierarchical distributed fog computing architecture for big data analysis in smart cities. In: Proceedings of the ASE BigData & SocialInformatics. ASE BD&SI 2015, pp. 28:1–28:6. ACM, New York (2015)
48. Tatebe, O., Hiraga, K., Soda, N.: Gfarm grid file system. New Gener. Comput. 28(3), 257–275 (2010)
49. Vaquero, L.M., Rodero-Merino, L.: Finding your way in the fog: towards a comprehensive definition of fog computing. SIGCOMM Comput. Commun. Rev. 44(5), 27–32 (2014)
50. Vorick, D., Champine, L.: Sia: simple decentralized storage. Technical report, Nebulous Labs, Boston (2014)
51. Weil, S.A., Brandt, S.A., Miller, E.L., Maltzahn, C.: CRUSH: controlled, scalable, decentralized placement of replicated data. In: Proceedings of the 2006 ACM/IEEE Conference on Supercomputing. SC 2006 (2006)
52. Weil, S.A., Leung, A.W., Brandt, S.A., Maltzahn, C.: RADOS: a scalable, reliable storage service for petabyte-scale storage clusters. In: Proceedings of the 2nd International Workshop on Petascale Data Storage: Held in Conjunction with Supercomputing 2007. PDSW 2007, pp. 35–44 (2007)
53. Wilkinson, S., Boshevski, T., Brandoff, J., Buterin, V.: Storj a peer-to-peer cloud storage network. Technical report, Storj Labs Inc. (2014)
54. Yannuzzi, M., Milito, R., Serral-Gracia, R., Montero, D., Nemirovsky, M.: Key ingredients in an IoT recipe: Fog Computing, Cloud Computing, and more Fog Computing. In: 2014 IEEE 19th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD), pp. 325–329, December 2014
55. Yi, S., Hao, Z., Qin, Z., Li, Q.: Fog computing: platform and applications. In: Proceedings of the 2015 Third IEEE Workshop on Hot Topics in Web Systems and Technologies (HotWeb). HOTWEB 2015, pp. 73–78. IEEE Computer Society, Washington, DC (2015)
56. Yi, S., Li, C., Li, Q.: A survey of fog computing: concepts, applications and issues. In: Proceedings of the 2015 Workshop on Mobile Big Data. Mobidata 2015, pp. 37–42. ACM, New York (2015)
57. Yi, S., Qin, Z., Li, Q.: Security and privacy issues of fog computing: a survey. In: Xu, K., Zhu, H. (eds.) WASA 2015. LNCS, vol. 9204, pp. 685–695. Springer, Cham (2015). doi:10.1007/978-3-319-21837-367
58. Zao, J.K., Gan, T.T., You, C.K., Méndez, S.J.R., Chung, C.E., Wang, Y.T., Mullen, T., Jung, T.P.: Augmented brain computer interaction based on fog computing and linked data. In: 2014 International Conference on Intelligent Environments (IE), pp. 374–377, June 2014
59. Zhang, B., Mor, N., Kolb, J., Chan, D.S., Goyal, N., Lutz, K., Allman, E., Wawrzynek, J., Lee, E., Kubiatowicz, J.: The cloud is not enough: saving IoT from the cloud. In: Proceedings of the 7th USENIX Conference on Hot Topics in Cloud Computing. HotCloud 2015, p. 21. USENIX Association, Berkeley (2015).