Distributed parameter estimation via pseudo-likelihood

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 2, Issue , 2012, Pages 1487-1494

  Liu, Qiang ^a   Ihler, Alexander ^a  

^a Irvine   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMBINATION METHOD; COMPUTATIONAL COSTS; DISTRIBUTED LEARNING; DISTRIBUTED PARAMETER ESTIMATION; EXPERIMENTAL ANALYSIS; GENERAL APPROACH; JOINT OPTIMIZATION; LINEAR COMBINATIONS; PSEUDO-LIKELIHOOD; SECOND ORDERS; STATISTICAL MODELS;

ALGORITHMS; LEARNING SYSTEMS; PARAMETER ESTIMATION; SENSOR NETWORKS; SENSOR NODES;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84867118611     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Barabási, A.-L. and Albert, R. Emergence of scaling in random networks. Science, 286(5439):509-512, 1999.
2. Bertsekas, D. and Tsitsiklis, J. Parallel and distributed computation: numerical methods. Prentice-Hall, 1989.
3. Besag, J. Statistical analysis of non-lattice data. J. Royal Stat Soc. D, 24(3):179-195, 1975.
4. Boyd, S., Parikh, N., Chu, E., Peleato, B., and Eckstein, J. Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends in Machine Learn., 3(1):1-122, 2011.
5. Bradley, J. K. and Guestrin, C. An asymptotic analysis of generative, discriminative, and pseudolikelihood estimators. In AISTATS, 2011.
6. Cetin, M., Chen, L., Fisher III, J., Ihler, A., Kreidl, O., Moses, R., Wainwright, M., Williams, J., and Willsky, A. Graphical models and fusion in sensor networks. Wireless Sensor Networks, pp. 215-249, 2007.
7. Eidsvik, J., Shaby, B. A., Reich, B. J., Wheeler, M., and Niemi, J. Estimation and prediction in spatial models with block composite likelihoods using parallel computing, in submission, NTNU, Duke, NCSU, UCSB, 2010.
8. Godambe, V. P. An optimum property of regular maximum likelihood estimation. Ann. Math. Stat, 31(4):pp. 1208-1211, 1960.
9. Liang, P. and Jordan, M.I. An asymptotic analysis of generative, discriminative, and pseudolikelihood estimators. In ICML, pp. 584-591, 2008.
10. Lindsay, B.G. Composite likelihood methods. Contemporary Mathematics, 80(1):221-39, 1988.
11. Liu, Q. and Ihler, A. Learning scale free networks by reweighted L1 regularization. In AISTATS, pp. 40-48. 2011.
12. Ravikumar, P., Wainwright, M. J., and Lafferty, J. High-dimensional Ising model selection using L1-regularized logistic regression. Ann. Stat, 38(3):1287-1319, 2010.
13. Sutton, C. and McCallum, A. Piecewise training for structured prediction. Mach. Learn., 77(2-3):165-194, 2009.
14. van der Vaart, A. Asymptotic statistics. Cambridge, 1998.
15. Wainwright, M. Estimating the wrong graphical model: Benefits in the computation-limited setting. J. Machine Learn. Res., 7:1829-1859, 2006.
16. Wainwright, M. and Jordan, M. Graphical models, exponential families, and variational inference. Found. Trends Mach. Learn., 1(1-2):1-305, 2008.
17. Wiesel, A. and Hero, A.O. Distributed covariance estimation in Gaussian graphical models. IEEE Trans. Sig. Proc, 60(1):211-220, January 2012.