Direct QR factorizations for tall-and-skinny matrices in MapReduce architectures

Proceedings - 2013 IEEE International Conference on Big Data, Big Data 2013

Volumn , Issue , 2013, Pages 264-272

  Benson, Austin R ^a   Gleich, David F ^b   Demmel, James ^c  

^a Stanford University   (United States)

^b Purdue University   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Hadoop; MapReduce; matrix factorization; QR; SVD; TSQR

Indexed keywords

BIG DATA; FACTORIZATION; GRID COMPUTING; Q FACTOR MEASUREMENT; SINGULAR VALUE DECOMPOSITION;

COMMUNICATION AVOIDING ALGORITHMS; GRID COMPUTING ENVIRONMENT; HADOOP; HIGH PERFORMANCE COMPUTING; MAP-REDUCE; MATRIX FACTORIZATIONS; THEORETICAL PERFORMANCE; TSQR;

MATRIX ALGEBRA;

EID: 84893246494     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.2013.6691583     Document Type: Conference Paper

References (20)

1. H. Avron, P. Maymounkov, and S. Toledo. Blendenpik: Supercharging LAPACK's least-squares solver. SIAM J. Sci. Comput., 32(3):1217-1236, Apr. 2010.
2. K. Bosteels. Dumbo. http://klbostee.github.io/dumbo/, 2012.
3. C. T. Chu, S. K. Kim, Y. A. Lin, Y. Yu, G. R. Bradski, A. Y. Ng, and K. Olukotun. Map-Reduce for machine learning on multicore. In B. Scḧolkopf, J. C. Platt, and T. Hoffman, editors, Advances in Neural Information Processing Systems 19, pages 281-288. MIT Press, 2006.
4. K. L. Clarkson, P. Drineas, M. Magdon-Ismail, M. W. Mahoney, X. Meng, and D. P. Woodruff. The fast Cauchy transform and faster robust linear regression. In SODA, pages 466-477, 2013.
5. P. Constantine and D. F. Gleich. Tall and skinny QR factorizations in MapReduce architectures. In MAPREDUCE2012, page 43.50, 2011.
6. P. G. Constantine, D. F. Gleich, Y. Hou, and J. Templeton. Model Reduction with MapReduce-enabled Tall and Skinny Singular Value Decomposition. arXiv, math.NA:1306.4690, June 2013.
7. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating Systems Design and Implementation (OSDI2004), pages 137-150, 2004.
8. J. Demmel, L. Grigori, M. Hoemmen, and J. Langou. Communication-optimal parallel and sequential QR and LU factorizations. EECS-2008-89, Aug. 2008.
9. Z. Fadika, E. Dede, M. Govindaraju, and L. Ramakrishnan. Benchmarking MapReduce implementations for application usage scenarios. GRID '11, pages 90-97, 2011.
10. G. H. Golub and C. F. van Loan. Matrix Computations. The Johns Hopkins University Press, third edition, October 1996.
11. N. J. Higham. Accuracy and Stability of Numerical Algorithms. SIAM, 2002.
12. M. W. Mahoney. Randomized algorithms for matrices and data. arXiv, cs.DS, 2011.
13. D. Mori, Y. Yamamoto, and S.-L. Zhang. Backward error analysis of the AllReduce algorithm for Householder QR decomposition. Jpn. J. Ind. Appl. Math., 29(1):111-130, Feb. 2012.
14. B. N. Parlett. The Symmetric Eigenvalue Problem. SIAM, Philadelphia, PA, USA, 1998.
15. S. J. Plimpton and K. D. Devine. MapReduce in MPI for largescale graph algorithms. Parallel Comput., 37(9):610-632, 2011.
16. V. Rokhlin and M. Tygert. A fast randomized algorithm for overdetermined linear least-squares regression. Proceedings of the National Academy of Sciences, 105(36):13212-13217, 2008.
17. A. Stathopoulos and K. Wu. A block orthogonalization procedure with constant synchronization requirements. SIAM J. Sci. Comput., 23:2165-2182, June 2001.
18. J. Talbot, R. M. Yoo, and C. Kozyrakis. Phoenix++: modular mapreduce for shared-memory systems. MAPREDUCE 2011, pages 9-16, New York, NY, USA, 2011. ACM.
19. Various. Hadoop version 0.21. http://hadoop.apache.org, 2012.
20. J. Zhao and J. Pjesivac-Grbovic. MapReduce: The programming model and practice. http://research.google.com/archive/ papers/mapreduce-sigmetrics09- tutorial.pdf, 2009. Tutorial.