Simple and deterministic matrix sketching

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn Part F128815, Issue , 2013, Pages 581-588

  Liberty, Edo ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

Frequent items; Matrix sketching; Streaming

Indexed keywords

ACOUSTIC STREAMING; DATA MINING; DIGITAL STORAGE;

BUILDING BLOCKES; CONVERGENCE BOUNDS; FREQUENT ITEMS; IMPROVED CONVERGENCE; RANDOM PROJECTIONS; SAMPLING-BASED ALGORITHMS; STREAMING ALGORITHM; STREAMING MODEL;

MATRIX ALGEBRA;

EID: 84980400461     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2487575.2487623     Document Type: Conference Paper

References (31)

1. Dimitris Achlioptas. Database-friendly random projections. In Proceedings of the twentieth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, PODS '01, pages 274-281, New York, NY, USA, 2001. ACM.
2. Dimitris Achlioptas and Frank Mcsherry. Fast computation of low-rank matrix approximations. J. ACM, 54(2), 2007.
3. Rudolf Ahlswede and Andreas Winter. Strong converse for identification via quantum channels. IEEE Transactions on Information Theory, 48(3):569-579, 2002.
4. Sanjeev Arora, Elad Hazan, and Satyen Kale. A fast random sampling algorithm for sparsifying matrices. In Proceedings of the 9th international conference on Approximation Algorithms for Combinatorial Optimization Problems, and 10th international conference on Randomization and Computation, APPROX'06/RANDOM'06, pages 272-279, Berlin, Heidelberg, 2006. Springer-Verlag.
5. Christos Boutsidis, Petros Drineas, and Malik Magdon-Ismail. Near optimal column-based matrix reconstruction. In Proceedings of the 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science, FOCS '11, pages 305-314, Washington, DC, USA, 2011. IEEE Computer Society.
6. Christos Boutsidis, Michael W. Mahoney, and Petros Drineas. An improved approximation algorithm for the column subset selection problem. In Proceedings of the twentieth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA '09, pages 968-977, Philadelphia, PA, USA, 2009. Society for Industrial and Applied Mathematics.
7. Kenneth L. Clarkson and David P. Woodruff. Numerical linear algebra in the streaming model. In Proceedings of the 41st annual ACM symposium on Theory of computing, STOC '09, pages 205-214, New York, NY, USA, 2009. ACM.
8. Kenneth L. Clarkson and David P. Woodruff. Low rank approximation and regression in input sparsity time. In Proceedings of the 45th annual ACM symposium on Symposium on theory of computing, STOC '13, pages 81-90, New York, NY, USA, 2013. ACM.
9. Anirban Dasgupta, Ravi Kumar, and Taḿas Sarĺos. A sparse johnson: Lindenstrauss transform. In STOC, pages 341-350, 2010.
10. Erik D. Demaine, Alejandro Ĺopez-Ortiz, and J. Ian Munro. Frequency estimation of internet packet streams with limited space. In Proceedings of the 10th Annual European Symposium on Algorithms, ESA '02, pages 348-360, London, UK, UK, 2002. Springer-Verlag.
11. Amit Deshpande and Santosh Vempala. Adaptive sampling and fast low-rank matrix approximation. In APPROX-RANDOM, pages 292-303, 2006.
12. Petros Drineas and Ravi Kannan. Pass efficient algorithms for approximating large matrices. In Proceedings of the fourteenth annual ACM-SIAM symposium on Discrete algorithms, SODA '03, pages 223-232, Philadelphia, PA, USA, 2003. Society for Industrial and Applied Mathematics.
13. Petros Drineas, Michael W. Mahoney, and S. Muthukrishnan. Relative-error cur matrix decompositions. SIAM J. Matrix Analysis Applications, 30(2):844-881, 2008.
14. Petros Drineas, Michael W. Mahoney, S. Muthukrishnan, and Tamas Sarlos. Faster least squares approximation. Numer. Math., 117(2):219-249, February 2011.
15. Petros Drineas and Anastasios Zouzias. A note on element-wise matrix sparsification via a matrix-valued bernstein inequality. Inf. Process. Lett., 111(8):385-389, March 2011.
16. Alan Frieze, Ravi Kannan, and Santosh Vempala. Fast monte-carlo algorithms for finding low-rank approximations. In Proceedings of the 39th Annual Symposium on Foundations of Computer Science, FOCS '98, pages 370-, Washington, DC, USA, 1998. IEEE Computer Society.
17. Phillip B. Gibbons and Yossi Matias. External memory algorithms, 1999.
18. Daniel M. Kane and Jelani Nelson. Sparser johnson-lindenstrauss transforms. In SODA, pages 1195-1206, 2012.
19. Richard M. Karp, Scott Shenker, and Christos H. Papadimitriou. A simple algorithm for finding frequent elements in streams and bags. ACM Trans. Database Syst., 28(1):51-55, March 2003.
20. Edo Liberty. www.cs.yale.edu/homes/el327/public/experimentalresults/.
21. Edo Liberty, Franco Woolfe, Per-Gunnar Martinsson, Vladimir Rokhlin, and Mark Tygert. Randomized algorithms for the low-rank approximation of matrices. Proceedings of the National Academy of Sciences,, 104(51):20167-20172, December 2007.
22. Michael W. Mahoney, Petros Drineas, Malik Magdon-Ismail, and David P. Woodruff. Fast approximation of matrix coherence and statistical leverage. In ICML, 2012.
23. Jayadev Misra and David Gries. Finding repeated elements. Technical report, Ithaca, NY, USA, 1982.
24. Roberto Imbuzeiro Oliveira. Sums of random hermitian matrices and an inequality by rudelson. arXiv:1004.3821v1, April 2010.
25. Christos H. Papadimitriou, Hisao Tamaki, Prabhakar Raghavan, and Santosh Vempala. Latent semantic indexing: A probabilistic analysis. In Proceedings of the seventeenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, PODS '98, pages 159-168, New York, NY, USA, 1998. ACM.
26. Mark Rudelson and Roman Vershynin. Sampling from large matrices: An approach through geometric functional analysis. J. ACM, 54(4), July 2007.
27. Tamas Sarlos. Improved approximation algorithms for large matrices via random projections. In FOCS, pages 143-152, 2006.
28. S. S. Vempala. The Random Projection Method. American Mathematical Society, 2004.
29. Roman Vershynin. A note on sums of independent random matrices after ahlswede-winter. Lecture Notes.
30. Roman Vershynin. Spectral norm of products of random and deterministic matrices. Probability Theory and Related Fields, 150(3-4):471-509, 2011.
31. Kilian Weinberger, Anirban Dasgupta, John Langford, Alex Smola, and Josh Attenberg. Feature hashing for large scale multitask learning. In Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, pages 1113-1120, New York, NY, USA, 2009. ACM.