Big data parallelism: Challenges in different computational paradigms

Proceedings of the 2015 3rd International Conference on Computer, Communication, Control and Information Technology, C3IT 2015

Volumn , Issue , 2015, Pages

  Mondai, Koushik ^a   Dutta, Paramartha ^b  

^a INDIAN INSTITUTE OF TECHNOLOGY INDORE   (India)

^b VISVA BHARATI UNIVERSITY   (India)

Author keywords

Big Data; Data Science; High Dimensional Data; Machine learning; Parallel Computing; Scalable framework; Semi stochastic

Indexed keywords

CLUSTERING ALGORITHMS; DATA SCIENCE; INFORMATION SYSTEMS; INFORMATION USE; LEARNING SYSTEMS; PARALLEL PROCESSING SYSTEMS; STOCHASTIC SYSTEMS;

COMPUTATIONAL ENVIRONMENTS; COMPUTATIONAL PARADIGM; DESIGN CHARACTERISTICS; DIGITAL ELEVATION MODEL; DISTRIBUTED FRAMEWORK; HIGH DIMENSIONAL DATA; SCALABLE FRAMEWORK; SEMI-STOCHASTIC;

BIG DATA;

EID: 84936088376     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/C3IT.2015.7060186     Document Type: Conference Paper

References (20)

1. J. Dean, S. Ghemawat, MapReduce: simplified data processing on large clusters, Communications of ACM 51, Vol.1, 2008, pp. 107-113.
2. Apache Hadoop. .
3. M. Zaharia, M. Chowdhury, M.J. Franklin, S. Shenker, I. Stoica, Spark: cluster computing with working sets, in the Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing, 2010, pp. 10-14.
4. G. Malewicz, M.H. Austern, A.J. Bik, J.C. Dehnert, I. Horn, N. Leiser,G. Czajkowski, Pregel: a system for large-scale graph processing, in: Proceedings of the 2010 ACM SIGMOD International Conference on Management of data, ACM, 2010, pp. 135-146.
5. S. Seo, E.J. Yoon, J. Kim, S. Jin, J.-S. Kim, S. Maeng, Hama: an efficient matrix computation with the mapreduce framework, in IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), IEEE, 2010, pp. 721-726.
6. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, J.M. Hellerstein, Graphlab: a new parallel framework for machine learning, in: Conference on Uncertainty in Artificial Intelligence (UAI), Catalina Island, California, 2010.
7. Apache Giraph, .
8. Apache Mahout, .
9. U. Kang, C.E. Tsourakakis, C. Faloutsos, Pegasus: a peta-scale graph mining system implementation and observations, in the Ninth IEEE International Conference on Data Mining, ICDM'09, IEEE, 2009, pp. 229-238.
10. M.F. Pace, BSP vs MapReduce, Procedeeings of Computer Science, Vol. 9, 2012, pp. 246-255.
11. L. Bottou and O. Bousquet, The tradeoffs off of large scale learning,Advance Neural Information Process Systems, Vol. 20, 2008, pp. 161-168.
12. Byrd R.H. Sample size selection in optimization methods for machine learning, Mathematical Programmin 2012 135 127-155.
13. Y. Bu, B. Howe, M. Balazinska, M.D. Ernst, HaLoop: efficient iterative data processing on large clusters, Proceedings of VLDB Endowments, Vol. 3 (1-2), 2010), pp. 285-296.
14. L.G. Valiant, A bridging model for parallel computation, Communnications of ACM , Vol. 33 (8), 1990, pp. 103-111.
15. B.Recht, C.Re, S. Wright,F.Niu, Hogwild: A lock-free approach to parallelizing stochastic grapient descent, Advance Neural Informtion Processing System,s Vol. 24, 2011, pp. 693-701.
16. R. Rabenseifner, G. Hager, G. Jost, Hybrid mpi/openmp parallel programming on clusters of multi-core smp nodes, in 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing, IEEE, 2009, pp. 427-436.
17. L. Page, S. Brin, R. Motwani, T. Winograd, The PageRank citation ranking: bringing order to the WEB.
18. I.S. Dhillon, D.S. Modha, Concept decompositions for large sparse text data using clustering, Mach. learn. 42 (1-2) (2001) 143-175
19. B. Recht, C. Re, Parallel stochastic gradient algorithms for large-scale matrix completion, Math. Prog. Comput. 5 (2) (2013) 201-226. .
20. Nigam, K., & Ghani, R., Analyzing the effectiveness and applicability of co-training, in the Ninth International Conference on Information and Knowledge Management (CIKM-2000), 2000, pp. 86-93