Big data parallelism: Issues in different X-information paradigms

Procedia Computer Science

Volumn 50, Issue , 2015, Pages 395-400

  Mondal, Koushik ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY INDORE   (India)

Author keywords

Big data; Data science; High dimensional data; Machine learning; Parallel computing; Scalable framework; Semi stochastic; Xinformatics

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; COMPUTATIONAL CHEMISTRY; DATA HANDLING; DECISION MAKING; EARTH (PLANET); LEARNING SYSTEMS; MEDICINE; PARALLEL PROCESSING SYSTEMS; RADAR ASTRONOMY; STOCHASTIC SYSTEMS;

DATA SCIENCE; HIGH DIMENSIONAL DATA; SCALABLE FRAMEWORK; SEMI-STOCHASTIC; XINFORMATICS;

BIG DATA;

EID: 84937425704     PISSN: None     EISSN: 18770509     Source Type: Conference Proceeding    
DOI: 10.1016/j.procs.2015.04.028     Document Type: Conference Paper

References (21)

1. Gartner's 2014 Hype Cycle for Emerging Technologies Maps the Journey to Digital Business, http: //www.gartner.com/newsroom/id/2819918
2. J. Dean, S. Ghemawat, MapReduce: Simplified data processing on large clusters, Communications of ACM 51, Vol.1, 2008, pp. 107-113.
3. Apache Hadoop. http: //hadoop.apache.org.
4. M. Zaharia, M. Chowdhury, M.J. Franklin, S. Shenker, I. Stoica, Spark: Cluster computing with working sets, in the Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing, 2010, pp. 10-14.
5. G. Malewicz, M.H. Austern, A.J. Bik, J.C. Dehnert, I. Horn, N. Leiser, G. Czajkowski, Pregel: A system for large-scale graph processing, in: Proceedings of the 2010 ACM SIGMOD International Conference on Management of data, ACM, 2010, pp. 135-146.
6. S. Seo, E.J. Yoon, J. Kim, S. Jin, J.-S. Kim, S. Maeng, Hama: An efficient matrix computation with the mapreduce framework, in IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom) , IEEE, 2010, pp. 721-726.
7. Y. Low, J. Gonzalez, A. Kyrola, D. Bickson, C. Guestrin, J.M. Hellerstein, Graphlab: A new parallel framework for machine learning, in: Conference on Uncertainty in Artificial Intelligence (UAI) , Catalina Island, California, 2010.
8. Apache Giraph, http: //giraph.apache.org.
9. Apache Mahout, http: //mahout.apache.org/.
10. U. Kang, C.E. Tsourakakis, C. Faloutsos, Pegasus: A peta-scale graph mining system implementation and observations, in the Ninth IEEE International Conference on Data Mining, ICDM'09, IEEE, 2009, pp. 229-238.
11. M.F. Pace, BSP vs MapReduce, Procedeeings of Computer Science, Vol. 9, 2012, pp. 246-255.
12. L. Bottou and O. Bousquet, The tradeoffs off of large scale learning, Advance Neural Information Process Systems, Vol. 20, 2008, pp. 161-168.
13. R.H. Byrd, G.M. Chin, J. Nocedal, Y.Wu, Sample size selection in optimization methods for machine learning, Mathematical Programming 134: 1, 2012, pp. 127-155.
14. Y. Bu, B. Howe, M. Balazinska, M.D. Ernst, HaLoop: Efficient iterative data processing on large clusters, Proceedings of VLDB Endowments, Vol. 3 (1-2) , 2010) , pp. 285-296.
15. L.G. Valiant, A bridging model for parallel computation, Communnications of ACM, Vol. 33 (8) , 1990, pp. 103-111.
16. B.Recht, C.Re, S. Wright,F.Niu, Hogwild: A lock-free approach to parallelizing stochastic grapient descent, Advance Neural Informtion Processing System,s Vol. 24, 2011, pp. 693-701.
17. R. Rabenseifner, G. Hager, G. Jost, Hybrid mpi/openmp parallel programming on clusters of multi-core smp nodes, in 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing, IEEE, 2009, pp. 427-436.
18. L. Page, S. Brin, R. Motwani, T. Winograd, The PageRank citation ranking: Bringing order to the web.
19. I.S. Dhillon, D.S. Modha, Concept decompositions for large sparse text data using clustering, Mach. learn. 42 (1-2) (2001) 143-175.
20. B. Recht, C. Re, Parallel stochastic gradient algorithms for large-scale matrix completion, Math. Prog. Comput. 5 (2) (2013) 201-226. http: //dx.doi.org/10.1007/s12532-013-0053-8.
21. Nigam, K., & Ghani, R., Analyzing the effectiveness and applicability of co-training, in the Ninth International Conference on Information and Knowledge Management (CIKM-2000) , 2000, pp. 86-93.