Bayesian Factorizations of Big Sparse Tensors

Journal of the American Statistical Association

Volumn 110, Issue 512, 2015, Pages 1562-1576

  Zhou, Jing ^a   Bhattacharya, Anirban ^b   Herring, Amy H ^a   Dunson, David B ^c  

^a IL   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c Duke University   (United States)

Author keywords

Bayesian; Categorical data; Contingency table; Log linear model; Low rank; PARAFAC; Sparsity; Tensor factorization

Indexed keywords

EID: 84954446636     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2014.983233     Document Type: Article

References (39)

1. A.Agresti, (2002), Categorical Data Analysis (vol. 359), New York: Wiley-Interscience.
2. E.Arias-Castro,, and K.Lounici, (2012), “Variable Selection With Exponential Weights and -Penalization,” Electronic Journal of Statistics 8, 328–354.
3. A.Armagan,, D.Dunson,, and J.Lee, (2013a), “Generalized Double Pareto Shrinkage,” Statistica Sinica, 23, 119–143.
4. A.Armagan,, D.B.Dunson,, J.Lee,, W.U.Bajwa,, and N.Strawn, (2013b), “Posterior Consistency in Linear Models Under Shrinkage Priors,” Biometrika, 100, 1011–1018.
5. E.Belitser,, and S.Ghosal, (2003), “Adaptive Bayesian Inference on the Mean of an Infinite-Dimensional Normal Distribution,” The Annals of Statistics, 31, 536–559.
6. A.Bhattacharya,, and D.Dunson, (2011), “Sparse Bayesian Infinite Factor Models,” Biometrika, 98, 291–306.
7. D.Bontemps, (2011), “Bernstein–von Mises Theorems for Gaussian Regression With Increasing Number of Regressors,” The Annals of Statistics, 39, 2557–2584.
8. R.Bro, (1997), “PARAFAC. Tutorial and Applications,” Chemometrics and Intelligent Laboratory Systems, 38, 149–171.
9. C.Carvalho,, J.Lucas,, Q.Wang,, J.Nevins,, and M.West, (2008), “High-Dimensional Sparse Factor Modelling: Applications in gene Expression Genomics,” Journal of the American Statistical Association, 103, 1438–1456.
10. C.Carvalho,, N.Polson,, and J.Scott, (2010), “The Horseshoe Estimator for Sparse Signals,” Biometrika, 97, 465–480.
11. I.Castillo,, and A.van der Vaart, (2012), “Needles and Straws in a Haystack: Posterior Concentration for Possibly Sparse Sequences,” The Annals of Statistics, 40, 2069–2101.
12. D.B.Dunson,, and C.Xing, (2009), “Nonparametric Bayes Modeling of Multivariate Categorical Data,” Journal of the American Statistical Association, 104, 1042–1051.
13. S.Fienberg,, and A.Rinaldo, (2007), “Three Centuries of Categorical Data Analysis: Log-Linear Models and Maximum Likelihood Estimation,” Journal of Statistical Planning and Inference, 137, 3430–3445.
14. Y.Ge,, and W.Jiang, (2006), “On Consistency of Bayesian Inference With Mixtures of Logistic Regression,” Neural Computation, 18, 224–243.
15. A.Gelman,, A.Jakulin,, M.Pittau,, and Y.Su, (2008), “A Weakly Informative Default Prior Distribution for Logistic and Other Regression Models,” Annals of Applied Statistics, 2, 1360–1383.
16. S.Ghosal, (1999), “Asymptotic Normality of Posterior Distributions in High-Dimensional Linear Models,” Bernoulli, 5, 315–331.
17. ——— (2000), “Asymptotic Normality of Posterior Distributions for Exponential Families When the Number of Parameters Tends to Infinity,” Journal of Multivariate Analysis, 74, 49–68.
18. S.Ghosal,, J.Ghosh,, and A.van der Vaart, (2000), “Convergence Rates of Posterior Distributions,” The Annals of Statistics, 28, 500–531.
19. C.Hans, (2011), “Elastic Net Regression Modeling With the Orthant Normal Prior,” Journal of the American Statistical Association, 106, 1383–1393.
20. R.Harshman, (1970), “Foundations of the PARAFAC Procedure: Models and Conditions for an ‘Explanatory’ Multi-Modal Factor Analysis,” UCLA Working Papers in Phonetics, 16, 1–84.
21. W.Jiang, (2007), “Bayesian Variable Selection for High Dimensional Generalized Linear Models: Convergence Rates of the Fitted Densities,” The Annals of Statistics, 35, 1487–1511.
22. T.Kolda,, and B.Bader, (2009), “Tensor Decompositions and Applications,” SIAM Review, 51, 455–500.
23. L.Lim,, and P.Comon, (2009), “Nonnegative Approximations of Nonnegative Tensors,” Journal of Chemometrics, 23, 432–441.
24. M.Lopes, (2013), “Estimating Unknown Sparsity in Compressed Sensing,” in Proceedings of the 30th International Conference on Machine Learning (ICML-13), pp. 217–225.
25. J.E.Lucas,, C.Carvalho,, Q.Wang,, A.Bild,, J.Nevins,, and M.West, (2006), “Sparse Statistical Modelling in Gene Expression Genomics,” in Bayesian Inference for Gene Expression and Proteomics, eds. K.Do, P.Müller, and M.Vannucci, Cambridge, UK: Cambridge University Press, pp. 155–176.
26. H.Massam,, J.Liu,, and A.Dobra, (2009), “A Conjugate Prior for Discrete Hierarchical Log-Linear Models,” The Annals of Statistics, 37, 3431–3467.
27. T.Park,, and G.Casella, (2008), “The Bayesian Lasso,” Journal of the American Statistical Association, 103, 681–686.
28. D.Pati,, A.Bhattacharya,, N.S.Pillai,, and D.B.Dunson, (2014), “Posterior Contraction in Sparse Bayesian Factor Models for Massive Covariance Matrices,” The Annals of Statistics, 42, 1102–1130.
29. D.Pati,, D.B.Dunson,, and S.T.Tokdar, (2013), “Posterior Consistency in Conditional Distribution Estimation,” Journal of Multivariate Analysis, 116, 456–472.
30. N.Polson,, and J.Scott, (2010), “Shrink Globally, Act Locally: Sparse Bayesian Regularization and Prediction,” in Bayesian Statistics 9, eds. J.M.Bernardo, M.J.Bayarri, J.O.Berger, A.P.Dawid, D.Heckerman, A.F.M.Smith, and M.West, New York: Oxford University Press, pp. 501–538.
31. J.Scott,, and J.Berger, (2010), “Bayes and Empirical-Bayes Multiplicity Adjustment in the Variable-Selection Problem,” The Annals of Statistics, 38, 2587–2619.
32. J.Sethuraman, (1994), “A Constructive Definition of Dirichlet Priors,” Statistica Sinica, 4, 639–650.
33. W.Shen,, S.T.Tokdar,, and S.Ghosal, (2013), “Adaptive Bayesian Multivariate Density Estimation With Dirichlet Mixtures,” Biometrika, 100, 623–640.
34. M.Talagrand, (1996), “A New Look at Independence,” The Annals of Probability, 24, 1–34.
35. R.Tibshirani, (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
36. A.van der Vaart,, and J.van Zanten, (2008), “Rates of Contraction of Posterior Distributions Based on Gaussian Process Priors,” The Annals of Statistics, 36, 1435–1463.
37. R.Vershynin, (2010), “Introduction to the Non-Asymptotic Analysis of Random Matrices,” Arxiv preprint arxiv:1011.3027, unpublished note.
38. M.West, (2003), “Bayesian Factor Regression Models in the ‘Large p, Small n’ Paradigm,” in Bayesian Statistics 7, eds. J.M.Bernardo, M.J.Bayarri, J.O.Berger, A.P.Dawid, D.Heckerman, A.F.M.Smith. and M.West, New York: Oxford University Press, pp. 733–742.
39. Y.Yang,, and D.B.Dunson, (2013), “Bayesian Conditional Tensor Factorizations for High-dimensional Classification,” arXiv preprint arXiv:1301.4950.