Hierarchical latent class models for cluster analysis

Proceedings of the National Conference on Artificial Intelligence

Volumn , Issue , 2002, Pages 230-237

  Zhang, Nevin L ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Bayesian networks; Latent class models; Learning; Local dependence; Model based clustering

Indexed keywords

COMPUTATIONAL COMPLEXITY; DATABASE SYSTEMS; HEURISTIC METHODS; HIERARCHICAL SYSTEMS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS;

CLUSTER ANALYSIS;

ARTIFICIAL INTELLIGENCE;

EID: 0036931802     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (43)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Trans. Autom. Contr., 19, 716-723.
2. Alvord, W. G., Drummond, J. E., Arthur. L.O., Biggar, R. J., Goedert, J. J., Levine, P. H., Murphy, E. L. Jr, Weiss, S. H., Blattner, W. A. (1988). A method for predicting individual HIV infection status in the absence of clinical information. AIDS Res Hum Retroviruses, 4(4):295-304.
3. Bartholomew, D. J. and Knott, M. (1999). Latent variable models and factor analysis, 2nd edition. Kendall's Library of Statistics 7. London: Arnold.
4. Bohrnstedt, G. W. and Knoke D. (1994). Statistics for social data analysis (3rd Edition). F. E. Peacock Publishers Inc., Itasca, Illinois.
5. Cheeseman, P. and Stutz, J. (1995). Bayesian classification (AutoClass): Theory and results. In Fayyad, U., Piatesky-Shaoiro, G., Smyth, P., and Uthurusamy, R. (eds.), Advancesin Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, CA.
6. Chickering, D. M. and Heckerman, D. (1997). Efficient approximations for the marginal likelihood of Bayesian networks with hidden variables. Machine Learning 29(2-3): 181-212.
7. Chow, C. K. and Liu, C. N. (1968). Approximating discrete probability distributions with dependence trees. IEEE Transactions on Information Theory, IT-14(3): 462-467.
8. Coleman, J. S. (1964). Introduction to Mathematical Sociology. London: Free Press.
9. Connolly, D. (1993). Constructing hidden variables in Bayesian networks via conceptual learning. ICML-93, 65-72.
10. Cover, T. M., Thomas, J. A. (1991). Elements of Information Theory, John Wiley & Sons.
11. Cowell, R. G., Dawid, A. P., Lauritzen, S. L., and Spiegelhalter, D. J. (1999). Probabilistic networks and expert systems, Springer.
12. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Statist. Soc. B, 39:1-38.
13. Durbin, R., Eddy, S., Krogh, A., and Mitchison, G. (1998). Biological sequence analysis: probabilistic models of proteins and nucleic acids. Cambridge University Press.
14. Eaton, W. W., Dryman, A., Sorenson, A., and McCutcheon, A. (1989). DSM-III Major depressive disorder in the community: A latent class analysis of data from the NIMH epidemiologic catchment area programme. British Journal of Psychiatry, 155, 48-54.
15. Elidan, G., Lotner, N., Friedman, N. and Koller, D. (2000). Discovering hidden variables: A structure-based approach. NIPS-01.
16. Elidan, G. and N. Friedman (2001). Learning the dimensionality of hidden variables. UAI-01.
17. Espeland, M. A. and Handelman, S. L. (1989). Using latent class models to characterize and assess relative error in discrete measurements. Biometrics, 45, 587-599.
18. Everitt, B. S. (1993). Cluster Analysis. London: Edward Arnold.
19. Fraley, C. (1998). Algorithms for model-based Gaussian hierarchical clustering. SIAM J. Sci. Comput., 20 (1), 270-281.
20. Friedman, N., Ninio, M., Pe'er, I., and Pupko, T. (2002). A structural EM algorithm for phylogenetic inference. Journal of Computational Biology, to appear.
21. Garrett, E. S. and Zeger, S. L. (2000). Latent class model diagnosis. Biometrics, 56, 1055-1067.
22. Geiger, D., Heckerman, D., King, H., and Meek, C. (1998). Stratified exponential families: Graphical models and model selection. Technical Report MSR-TR-98-31, Microsoft Research.
23. Gibson, W. A. (1959). Three multivariate models: Factor analysis, latent structure analysis, and latent profile analysis. Psychometrika, 24: 229-252.
24. Goodman, L. A. (1974a). The analysis of systems of qualitative variables when some of the variables are unobservable. Part I-A Modified latent structure approach. American Journal of Sociology, 7(5), 1179-1259.
25. Green, P. (1998). Penalized likelihood. In Encyclopedia of Statistical Sciences, Update Volume 2. John Wiley & Sons.
26. Goodman, L. A. (1974b). Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika, 61, 215-231.
27. Hagenaars, J. A. (1988). Latent structure models with direct effects between indicators: local dependence models. Sociological Methods and Research, 16, 379-405.
28. Hanson, R., Stutz, J., and Cheeseman, P. (1991). Bayesian classification with correlation and inheritance. In Proc. 12th. International Joint Conference on A.I. (IJCAI-91), 2, 692-698, Morgan Kaufmann.
29. Kaufman, L. and Rousseeuw, P. J. (1990). Finding groups in data: An introduction to cluster analysis. New York: John Wiley and Sons, Inc.
30. Kishino, H., Miyata, T., and Hasegawa, M. (1990). Maximum likelihood inference of protein phylogeny and the origin of the chloroplasts. J. Mol. Evol. 31, 151-160.
31. Kocha, T. and Zhang, N. L. (2002). Dimension correction for hierarchical latent class models. UAI-02, submitted.
32. Kohlmann, T., and Formann, A. K. (1997). Using latent class models to analyze response patterns in epidemiologic mail surveys. Rost, J. and Langeheine, R. (eds.). Applications of latent trait and latent class models in the social sciences. Muenster: Waxman Verlag.
33. Lanterman, A. D. (2001). Schwarz, Wallace, and Rissanen: Intertwining themes in theories of model order estimation. International Statistical Review, 69(2), 185-212.
34. Lazarsfeld, P. F., and Henry, N.W. (1968). Latent structure analysis. Boston: Houghton Mifflin.
35. Martin, J. and VanLehn, K. (1994). Discrete factor analysis: learning hidden variables in Bayesian networks. Technical Report LRGC_ONR-94-1, Department of Computer Science, University of Pittsburgh.
36. Meila-Predoviciu, M. (1999). Learning with mixtures of trees, Ph.D. Dissertation, Department of Electrical Engineering and Computer Science, MIT.
37. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6(2), 461-464.
38. Swofford, D. L. (1998). PAUP* 4.0 - Phylogenetic Analysis Using Parsimony (*and Other Methods). Sinauer Assoc., Sunderland, MA.
39. Uebersax, J., (2000). A practical guide to local dependence in latent class models. http://ourworld.compuserve.com/homepages/jsuebersax/condep.htm.
40. Vermunt, J.K. and Magidson, J. (2000). Latent GOLD User's Guide. Belmont, Mass.: Statistical Innovations, Inc.
41. Vermunt, J.K. and Magidson, J. (2002). Latent class cluster analysis. in Hagenaars, J. A. and McCutcheon A. L. (eds.), Advances in latent class analysis. Cambridge University Press.
42. Wasmus, A., Kindel, P., Mattussek, S. and Raspe, H. H. (1989). Activity and severity of rheumatoid arthritis in Hannover/FRG and in one regional referral center. Scandinavian Journal of Rheumatology, Suppl. 79, 33-44.
43. Zhang, N. L. (2002). Hierarchical latent class models for cluster analysis. Technical Report HKUST-CS02-02, Department of Computer Science, Hong Kong University of Science & Technology, Hong Kong, China.