Combinatorial clustering and the beta negative binomial process

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 2, 2015, Pages 290-306

  Broderick, Tamara ^a   Mackey, Lester ^b   Paisley, John ^c   Jordan, Michael I ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b STANFORD UNIVERSITY   (United States)

^c Department of Earth and Environmental Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HIERARCHICAL SYSTEMS; IMAGE SEGMENTATION; OBJECT RECOGNITION; RANDOM PROCESSES; STOCHASTIC SYSTEMS;

ASYMPTOTIC PROPERTIES; COMBINATORIAL CLUSTERING; DOCUMENT ANALYSIS; HIERARCHICAL MODEL; INFINITE DIMENSIONAL; NONPARAMETRIC APPROACHES; POSTERIOR DISTRIBUTIONS; POWER-LAW BEHAVIOR;

INFERENCE ENGINES;

ALGORITHM; BAYES THEOREM; CLUSTER ANALYSIS; COMPUTER SIMULATION; IMAGE PROCESSING; INFORMATION SCIENCE; NONPARAMETRIC TEST; PROCEDURES; THEORETICAL MODEL;

ALGORITHMS; BAYES THEOREM; CLUSTER ANALYSIS; COMPUTER SIMULATION; IMAGE PROCESSING, COMPUTER-ASSISTED; INFORMATICS; MODELS, THEORETICAL; STATISTICS, NONPARAMETRIC;

EID: 84920964358     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2318721     Document Type: Article

References (53)

1. D. M. Blei, A. Y. Ng, and M. I. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
2. T. Broderick, M. I. Jordan, and J. Pitman, "Beta processes, stickbreaking, and power laws," Bayesian Anal., vol. 7, pp. 439-476, 2012.
3. L. Cao and F.-F. Li, "Spatially coherent latent topic model for concurrent segmentation and classification of objects and scenes," in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
4. H. Chen, H. Xing, and N. R. Zhang, "Stochastic segmentation models for allele-specific copy number estimation with SNP-array data," PLoS Comput. Biol., vol. 7, p. e1001060, 2011.
5. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. Conf. Comput. Vis. Pattern Recog., 2005, pp. 886-893.
6. P. Damien, J. Wakefield, and S. Walker, "Gibbs sampling for Bayesian non-conjugate and hierarchical models by using auxiliary variables," J. Roy. Statist. Soc. Series B, vol. 61, pp. 331-344, 1999.
7. E. A. Erosheva and S. E. Fienberg, "Bayesian mixed membership models for soft clustering and classification," in Classification-The Ubiquitous Challenge, NewYork,NY, USA: Springer, 2005, pp. 11-26.
8. T. S. Ferguson, "A Bayesian analysis of some nonparametric problems," Ann. Statist., vol. 1, no. 2, pp. 209-230, 1973.
9. E. Fox, E. Sudderth, M. Jordan, and A. Willsky, "Sharing features among dynamical systems with beta processes," Adv. Neural Inf. Process. Syst., vol. 22, pp. 549-557, 2009.
10. C. Fraley and A. E. Raftery, "Model-based clustering, discriminant analysis and density estimation," J. Amer. Statis. Assoc., vol. 97, pp. 611-631, 2002.
11. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Pattern Anal. Mach. Intell., vol. PAMI-6, no. 6, pp. 721-741, Nov. 1984.
12. A. Gnedin, B. Hansen, and J. Pitman, "Notes on the occupancy problem with infinitely many boxes: General asymptotics and power laws," Probability Surveys, vol. 4, pp. 146-171, 2007.
13. S. Goldwater, T. Griffiths, and M. Johnson, "Interpolating between types and tokens by estimating power-law generators," in Proc. Adv. Neural Inf. Process. Syst. 18, 2006, vol. 18, pp. 459-466.
14. T. Griffiths and Z. Ghahramani, "Infinite latent feature models and the Indian buffet process," in Proc. Adv. Neural Inf. Process. Syst. 18, 2006, pp. 475-482.
15. T. L. Griffiths and M. Steyvers, "Finding scientific topics," in Proc. Nat. Academy Sci. USA, vol. 101, no. suppl. 1, pp. 5228-5235, Apr. 2004.
16. N. Hjort, "Nonparametric bayes estimators based on beta processes in models for life history data," Ann. Statist., vol. 18, no. 3, pp. 1259-1294, 1990.
17. M. Kalli, J. E. Griffin, and S. G. Walker, "Slice sampling mixture models," Statist. Comput., vol. 21, pp. 93-105, Jan. 2011.
18. Y. Kim, "Nonparametric Bayesian estimators for counting processes," Ann. Statist., vol. 27, no. 2, pp. 562-588, 1999.
19. J. F. C. Kingman, "Completely random measures," Pacific J. Math., vol. 21, no. 1, pp. 59-78, 1967.
20. J. F. C. Kingman, Poisson Processes. New York, NY, USA: Oxford Univ. Press, 1993.
21. R. M. Korwar and M. Hollander, "Contributions to the theory of Dirichlet processes," Ann. Probability, vol. 1, pp. 705-711, 1973.
22. A. Lijoi, R. H. Mena, and I. Prünster, "Controlling the reinforcement in Bayesian non-parametric mixture models," J. Roy. Statist. Soc.: Series B (Statist. Methodol.), vol. 69, no. 4, pp. 715-740, 2007.
23. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
24. S. N. MacEachern and P. Müller, "Estimating mixture of Dirichlet process models," J. Comput. Graph. Statist., vol. 7, pp. 223-238, 1998.
25. J. W. McCloskey, "A model for the distribution of individuals by species in an environment," Ph.D. dissertation, Department of Statistics and Probability, Michigan State Univ., East Lansing, MI, USA, 1965.
26. G. McLachlan and K. Basford, Mixture Models: Inference and Applications to Clustering. New York, NY, USA: Dekker, 1988.
27. M. Mitzenmacher, "A brief history of generative models for power law and lognormal distributions," Internet Math., vol. 1, no. 2, pp. 226-251, 2004.
28. R. M. Neal, "Markov chain sampling methods for Dirichlet process mixture models," J. Comput. Graph. Statist., vol. 9, no. 2, pp. 249-265, 2000.
29. R. M. Neal, "Slice sampling," Ann. Statist., vol. 31, no. 3, pp. 705- 741, 2003.
30. M. Newman, "Power laws, Pareto distributions and Zipf's law," Contemporary Phys., vol. 46, no. 5, pp. 323-351, 2005.
31. J. Paisley, A. Zaas, C. W. Woods, G. S. Ginsburg, and L. Carin, "A stick-breaking construction of the beta process," presented at the Int. Conf. Machine Learning, Haifa, Israel, 2010.
32. O. Papaspiliopoulos, "A note on posterior sampling from Dirichlet mixture models," Univ. Warwick, Centre Res. Statist. Methodol., Coventry, U.K., Tech. Rep. 8, 2008.
33. J. Pitman, Combinatorial Stochastic Processes, series Lecture Notes in Mathematics. Berlin, Germany: Springer-Verlag, 2006, vol. 1875.
34. J. Pitman and M. Yor, "The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator," Ann. Probability, vol. 25, pp. 855-900, 1997.
35. J. K. Pritchard, M. Stephens, and P. Donnelly, "Inference of population structure using multilocus genotype data," Genetics, vol. 155, no. 2, pp. 945-959, 2000.
36. F. Qi, "Bounds for the ratio of two gamma functions," J. Inequalities Appl., vol. 2010, p. 204, 2010.
37. B. C. Russell, W. T. Freeman, A. A. Efros, J. Sivic, and A. Zisserman, "Using multiple segmentations to discover objects and their extent in image collections," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., 2006, pp. 1605-1614.
38. J. Sivic, B. Russell, A. Efros, A. Zisserman, and W. Freeman, "Discovering object categories in image collections," MIT AI Lab Memo, MIT, Cambridge, MA, USA, Tech. Rep. AIM-2005-005, 2005..
39. Y. W. Teh, "A hierarchical Bayesian language model based on pitman- yor processes," in Proc. 21st Int. Conf. Comput. Linguistics 44th Annu. Meet. Assoc. Comput. Linguistics, 2006, pp. 985-992.
40. Y. W. Teh and D. Görür, "Indian buffet processes with power-law behavior," in Proc. Adv. Neural Inf. Process. Syst. 22, 2009, pp. 1838-1846.
41. Y. W. Teh, D. Görür, and Z. Ghahramani, "Stick-breaking construction for the Indian buffet process," in Proc. Int. Conf. Artif. Intell. Statist., 2007, vol. 11.
42. Y. W. Teh, M. I. Jordan, M. J. Beal, and D. M. Blei, "Hierarchical Dirichlet processes," J. Amer. Statist. Assoc., vol. 101, no. 476, pp. 1566-1581, 2006.
43. R. J. Thibaux, "Nonparametric Bayesian models for machine learning," Ph.D. dissertation, EECS Dept., Univ. California, Berkeley, CA, USA, Oct. 2008.
44. R. Thibaux and M. Jordan, "Hierarchical beta processes and the Indian buffet process," in Proc. Int. Conf. Artif. Intell. Statist., 2007, vol. 11.
45. M. Titsias, "The infinite gamma-Poisson feature model," in Proc. Adv. Neural Inform. Process. Syst. 20, Cambridge, MA, USA: MIT Press, 2008, pp. 1513-1520.
46. F. G. Tricomi and A. Erd-elyi, "The asymptotic expansion of a ratio of gamma functions," Pacific. J. Math., vol. 1, no. 1, pp. 133-142, 1951.
47. J. Van De Weijer and C. Schmid, "Coloring local feature extraction," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 334-348.
48. J. J. Verbeek and B. Triggs, "Region classification with Markov field aspect models," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
49. S. G. Walker, "Sampling the Dirichlet mixture model with slices," Commun. Statist.-Simul. Comput., vol. 36, pp. 45-54, 2007.
50. G. A. Watterson, "The sampling theory of selectively neutral alleles," Adv. Appl. Probability, vol. 6, pp. 463-488, 1974.
51. M. West, "Hyperparameter estimation in Dirichlet process mixture models," Inst. Statist. Decision Sci. Discussion Paper, Duke Univ., Durham, NC, USA , Tech. Rep. 92-A03, 1992.
52. F. Wood, C. Archambeau, J. Gasthaus, L. James, and Y. W. Teh, "A stochastic memoizer for sequence data," in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 1129-1136.
53. M. Zhou, L. Hannah, D. Dunson, and L. Carin, "Beta-negative binomial process and Poisson factor analysis," in Proc. Int. Conf. Artif. Intell. Statist., 2012, pp. 1462-1471.