Utilising condor for data parallel analytics in an IoT context - An experience report

International Conference on Wireless and Mobile Computing, Networking and Communications

Volumn , Issue , 2013, Pages 325-331

  Mukherjee, Arijit ^a   Dey, Swarnava ^a   Paul, Himadri Sekhar ^a   Das, Batsayan ^a  

^a TATA CONSULTANCY SERVICES   (India)

Author keywords

analytics; black box; cyber physical; mobile data mining; mobile grid; parallel execution; ubiquitous systems

Indexed keywords

ANALYTICS; BLACK BOXES; CYBER PHYSICALS; MOBILE DATA MINING; MOBILE GRID; PARALLEL EXECUTIONS; UBIQUITOUS SYSTEMS;

EMBEDDED SYSTEMS; INTERNET; MOBILE COMPUTING;

ALGORITHMS;

EID: 84891712192     PISSN: 21619646     EISSN: 21619654     Source Type: Conference Proceeding    
DOI: 10.1109/WiMOB.2013.6673380     Document Type: Conference Paper

References (28)

1. Amazon EC2 Instance Types. http://aws.amazon.com/ec2/ instance-types/.
2. Amazon Elastic Compute Cloud(Amazon EC2). http://aws.amazon. com/ec2/.
3. Apache Hadoop. http://hadoop.apache.org/.
4. Big data, brewer and a couple of webinars. http://blogs.forrester.com/ brian hopkins/11-08-29-big data brewer and a couple of webinars.
5. Constrained Application Protocol. http://tools.ietf.org/html/ draft-ietf-core-coap-13.
6. Hadoop Distributed File System. http://hadoop.apache.org/core.
7. High Frequency Computing. http://wikibin.org/articles/ high-frequency-computing.html.
8. High frequency computing design and progress. https://htcondor-wiki. cs.wisc.edu/index.cgi/wiki?p=HfcDesignAndProgress&t=1267039355.
9. High Performance Computing. http://www.gartner.com/it-glossary/ high-performance-computing-hpc/.
10. High Throughput Computing. http://research.cs.wisc.edu/htcondor/htc. html.
11. Rserve-Binary R server. http://www.rforge.net/Rserve/.
12. Sensor observation service. http://www.opengeospatial.org/standards/ sos.
13. The Apache Cassandra Project. http://cassandra.apache.org/.
14. S. Bandyopadhyay and A. Bhattacharyya. Lightweight internet protocols for web enablement of sensors using constrained gateway devices. In To be published at the Workshop on Cyber Physical Systems, 2013 International Conference on Computing, Networking and Communication, 2013.
15. F. Bonomi, R. Milito, J. Zhu, and S. Addepalli. Fog computing and its role in the internet of things. In Proceedings of the first edition of the MCC workshop on Mobile cloud computing, MCC '12, pages 13-16, New York, NY, USA, 2012. ACM.
16. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1):107-113, Jan. 2008.
17. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Sci. Program., 13(3):219-237, July 2005.
18. J. Frey. Condor dagman: handling inter-job dependencies. http://www. bo.infn.it/calcolo/condor/dagman/.
19. A. Ghose, C. Bhaumik, D. Das, and A. K. Agrawal. Mobile healthcare infrastructure for home and small clinic. In Proceedings of the 2nd ACM international workshop on Pervasive Wireless Healthcare, MobileHealth '12, pages 15-20, New York, NY, USA, 2012. ACM.
20. F. J. Gonzalez-Castano, J. Vales-Alonso, M. Livny, E. Costa-Montenegro, and L. Anido-Rifon. Condor grid computing from mobile handheld devices. SIGMOBILE Mob. Comput. Commun. Rev., 7(1):117-126, Jan. 2003.
21. J. Gubbi, R. Buyya, S. Marusic, and M. Palaniswami. Internet of Things (IoT): A Vision, Architectural Elements, and Future Directions. Future Generation Comp. Syst., 29(7):1645-1660, 2013.
22. P. MISRA, A. PAL, B. PURUSHOTHAMAN, C. BHAUMIK, D. SWAMY, V. S. SUBRAHMANIAN, D. KAR, S. NASKAR, S. ADAK, S. GHOSH, et al. A computing platform for development and deployment of sensor data based applications and services, 2013. WO Patent 2,013,072,925.
23. A. Pal, C. Bhaumik, J. Shukla, and S. Kolay. Energy information gateway for home. In 2nd International Conference on Intelligent Systems, Modelling and Simulation, pages 235-240, jan. 2011.
24. A. Pal, M. Prashant, A. Ghose, and C. Bhaumik. Home Infotainment Platform-A Ubiquitous Access Device for Masses. Ubiquitous Computing and Multimedia Applications, pages 11-19, 2010.
25. T. Phan, L. Huang, and C. Dulan. Challenge: integrating mobile wireless devices into the computational grid. In Proceedings of the 8th annual international conference on Mobile computing and networking, MobiCom '02, pages 271-278, New York, NY, USA, 2002. ACM.
26. T. Tannenbaum, D. Wright, K. Miller, and M. Livny. Condor-a distributed job scheduler. In T. Sterling, editor, Beowulf Cluster Computing with Linux. MIT Press.
27. F. Wang, V. Ercegovac, et. al. Large-scale multimodal mining for healthcare with mapreduce. In Proceedings of the 1st ACM International Health Informatics Symposium, IHI '10, pages 479-483, New York, NY, USA, 2010. ACM.
28. S.-Y. Yi and M. Livny. Extending the condor distributed systems for mobile clients. SIGMOBILE Mob. Comput. Commun. Rev., 3(1):38-46, Jan. 1999