Cautious collective classification

Journal of Machine Learning Research

Volumn 10, Issue , 2009, Pages 2777-2836

  McDowell, Luke K ^a   Gupta, Kalyan Moy ^b   Aha, David W ^c  

^a UNITED STATES NAVAL ACADEMY   (United States)

^b KNEXUS RESEARCH CORPORATION   (United States)

^c NAVAL RESEARCH LABORATORY   (United States)

Author keywords

Approximate probabilistic inference; Cautious inference; Collective inference; Networked data; Statistical relational learning

Indexed keywords

COLLECTIVE INFERENCE; DATA CHARACTERISTICS; INFERENCE ALGORITHM; LOCAL CLASSIFIER; PARAMETERIZED; PROBABILISTIC INFERENCE; REAL WORLD DATA; ROBUST PERFORMANCE; STATISTICAL RELATIONAL LEARNING;

LABELS; LEARNING ALGORITHMS;

INFERENCE ENGINES;

EID: 75249087898     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (59)

1. Regina Barzilay and Mirella Lapata. Collective content selection for concept-to-text generation. In Proceedings of the Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP), pages 331-338, 2005.
2. Julian Besag. On the Statistical analysis of dirty pictures. Journal of the Royal Statistical Society, 48(3):259-302, 1986.
3. Julian Besag. Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society, 36(2): 192-236, 1974.
4. Mustafa Bilgic and Lise Getoor. Effective label acquisition for collective classification. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 43-51, 2008.
5. Béla Bollobás, Christian Borgs, Jennifer Chayes, and Oliver Riordan. Directed scale-free graphs. In Proceedings of the 14th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 132-139,2003.
6. Soumen Chakrabarti, Byron Dom, and Piotr Indyk. Enhanced hypertext categorization using hyperlinks. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 307-318, 1998.
7. Mark Craven, Dan DiPasquo, Dayne Freitag, Andrew K. McCallum, Tom M. Mitchell, Kamal Nigam, and Sean Slattery. Learning to extract symbolic knowledge from the World Wide Web. In Proceedings of the 15th Conference of the American Association for Artificial Intelligence (AAAI), pages 509-516, 1998.
8. Stephen Della Pietra, Vincent Della Pietra, and John Lafferty. Inducing features of random fields. IEEE Transactions on Pattern Analysis andMachine Intelligence, 19(4):380-393, 1997.
9. Roland L. Dobrushin. The description of a random field by means of conditional probabilities and conditions of its regularity. Theory of Probability and its Applications, 13(2): 197-224, 1968.
10. Andrew Fast and David Jensen. Why stacked models perform effective collective classification. In Proceedings of the IEEE International Conference on Data Mining (ICDM), 2008.
11. Karen Yuen Fung and Barbara A. Wrobel. The treatment of missing values in logistic regression. Biometrical Journal, 31(1):35-47, 1989.
12. Brian Gallagher and Tina Eliassi-Rad. Leveraging label-independent features for classification in sparsely labeled networks: An empirical study. In Proceedings of the 2nd Workshop on Social Network Mining and Analysis at the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2008.
13. Brian Gallagher, Hanghang Tong, Tina Eliassi-Rad, and Christos Faloutsos. Using ghost edges for classification in sparsely labeled networks. In Proceeding of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 256-264, 2008.
14. Aram Galstyan and Paul R. Cohen. Empirical comparison of "hard" and "soft" label propagation for relational classification. In Proceedings of the 17th International Conference on Inductive Logic Programming (ILP), pages 98-111, 2007.
15. Tayfun Gurel and Kristián Kersting. On the trade-off betweeen iterative classification and collective classification: first experimental results. In Working Notes of the 3rd International ECML/PKDD Workshop on Mining Graphs, Trees, and Sequences, 2005.
16. David Heckerman. A tutorial on learning with bayesian networks. In M. Jordan, editor, Learning in Graphical Models. MIT Press, 1999.
17. Andreas Heß and Nicholas Kushmerick. Iterative ensemble classification for relational data: A case study of semantic web services. In Proceedings of the 15th European Conference on Machine Learning (ECML), pages 156-167, 2004.
18. Cecil Huang and Adnan Darwiche. Inference in belief networks: A procedural guide. International Journal of Approximate Reasoning, 15(3):225-263, 1996.
19. David Jensen and Jennifer Neville. Linkage and autocorrelation cause feature selection bias in relational learning. In Proceedings of the 19th International Conference on Machine Learning (ICML), pages 259-266, 2002.
20. David Jensen, Jennifer Neville, and Michael Hay. Avoiding bias when aggregating relational data with degree disparity. In Proceedings of the 20th International Conference on Machine Learning (ICML), pages 274-281, 2003.
21. David Jensen, Jennifer Neville, and Brian Gallagher. Why collective inference improves relational classification. In Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 593-598, 2004.
22. Ron Kohavi and George H. John. Wrappers for feature subset selection. Artifical Intelligence, 97 (l-2):273-324, 1997. (Pubitemid 127401107)
23. Daphne Koller, Nir Friedman, Lise Getoor, and Benjamin Taskar. Graphical models in a nutshell. In L. Getoor and B. Taskar, editors, An Introduction to Statistical Relational Learning. MIT Press, 2007.
24. Zhenzhen Kou and William W. Cohen. Stacked graphical models for efficient inference in Markov Random Fields. In Proceedings of the 7th SIAM International Conference on Data Mining (SDM), pages 533-538, 2007.
25. Qing Lu and Lise Getoor. Link-based classification. In Proceedings of the 20th International Conference on Machine Learning (ICML), pages 496-503, 2003a.
26. Qing Lu and Lise Getoor. Link-based classification using labeled and unlabeled data. In Proceedings of the Workshop on the Continuum from Labeled to Unlabeled data at the 20th International Conference on Machine Learning (ICML), 2003b.
27. Sofus A. Macskassy. Improving learning in networked data by combining explicit and mined links. In Proceedings of the 22nd AAAI Conference on Artificial Intelligence, pages 590-595, 2007.
28. Sofus A. Macskassy and Foster Provost. Suspicion scoring based on guilt-by-association, collective inference, and focused data access. In Proceedings of the International Conference on Intelligence Analysis, 2005.
29. Sofus A. Macskassy and Foster Provost. Classification in networked data: A toolkit and a univariate case study. Journal of Machine Learning Research, 8:935-983, 2007.
30. Sofus A. Macskassy and Foster Provost. A brief survey of machine learning methods for classification in networked data and an application to suspicion scoring. In Proceedings of the Workshop on Statistical Network Analysis at the 23rd International Conference on Machine Learning (ICML), 2006.
31. Andrew McCallum, Dayne Freitag, and Fernando C. N. Pereira. Maximum entropy markov models for information extraction and segmentation. In Proceedings of the 17th International Conference on Machine Learning, pages 591-598, 2000a.
32. Andrew McCallum, Kamal Nigam, Jason Rennie, and Kristie Seymore. Automating the construction of internet portals with machine learning. Information Retrieval, 3:127-163, 2000b.
33. Luke K. McDowell, Kalyan Moy Gupta, and David W. Aha. Cautious inference in collective classification. In Proceedings of the 22nd AAAI Conference on Artificial Intelligence, pages 596-601, 2007a.
34. Luke K. McDowell, Kalyan Moy Gupta, and David W. Aha. Case-based collective classification. In Proceedings of the 20th International Florida Artificial Intelligence Research Society Conference (FLAIRS), pages 399-404, 2007b.
35. Robert J. McEliece, David J. C. MacKay, and Jung-Fu Cheng. Turbo decoding as an instance of Pearl's "belief propagation" algorithm. IEEE Journal on Selected Areas in Communications, 16 (2): 140-152, 1998.
36. Miller McPherson, Lynn Smith-Lovin, and James M. Cook. Birds of a feather: Homophily in social networks. Annual Review of Sociology, 27:415-444, 2001. (Pubitemid 33342718)
37. Kevin P. Murphy, Yair Weiss, and Michael I. Jordan. Loopy belief propagation for approximate inference: An empirical study. In Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence, pages 467-475, 1999.
38. Jennifer Neville and David Jensen. A bias/variance decomposition for models using collective inference. Machine Learning Journal, 73(1):87-106, 2008.
39. Jennifer Neville and David Jensen. Iterative classification in relational data. In Proceedings of the Workshop on Learning Statistical Models from Relational Data at the 17th National Conference on Artificial Intelligence (AAAI), pages 13-20, 2000.
40. Jennifer Neville and David Jensen. Leveraging relational autocorrelation with latent group models. In Proceedings of the 5th IEEE International Conference on Data Mining (ICDM), pages 170-177,2005.
41. Jennifer Neville and David Jensen. Relational dependency networks. Journal of Machine Learning Research, 8:653-692, 2007.
42. Jennifer Neville, David Jensen, Lisa Friedland, and Michael Hay. Learning relational probability trees. In Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 625-630, 2003a.
43. Jennifer Neville, David Jensen, and Brian Gallagher. Simple estimators for relational bayesian classifiers. In Proceedings of the Third IEEE International Conference on Data Mining (ICDM), pages 609-612, 2003b.
44. Jennifer Neville, Özgür Simsek, David Jensen, John Komoroske, Kelly Palmer, and Henry G. Goldberg. Using relational knowledge discovery to prevent securities fraud. In Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 449-458, 2005.
45. Mark E. Newman. Mixing patterns in networks. Physical Review E, 67(2):026126, 2003.
46. Judea Pearl. Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, 1988.
47. Matthew J. Rattigan, Marc Maier, David Jensen, Bin Wu, Xin Pei, JianBin Tan, and Yi Wang:. Exploiting network structure for active inference in collective classification. In Proceedings of the Workshop on Mining Graphs and Complex Structures at the 7th IEEE International Conference on Data Mining (ICDM), pages 429-434, 2007.
48. Matthew Richardson and Pedro Domingos. Markov logic networks. Machine Learning, 62(1-2): 107-136, 2006.
49. Maytal Saar-Tsechansky and Foster Provost. Handling missing values when applying classification models. Journal of Machine Learning Research, 8(JuI): 1623-1657, 2007.
50. Prithviraj Sen. Personal communication, 2008.
51. Prithviraj Sen and Lise Getoor. Empirical comparison of approximate inference algorithms for networked data. In Proceedings of the Workshop on Open Problems in Statistical Relational Learning at the 23rdInternational Conference on Machine Learning (ICML), 2006.
52. Prithviraj Sen and Lise Getoor. Link-based classification. Technical Report CS-TR-4858, University of Maryland, College Park, MD, February 2007.
53. Prithviraj Sen, Galileo Namata, Mustafa Bilgic, Lise Getoor, Brian Gallagher, and Tina Eliassi-Rad. Collective classification in network data. AI Magazine, Special Issue on AI and Networks, 29(3): 93-106, 2008.
54. Ben Taskar, Pieter Abbeel, and Daphne Koller. Discriminative probalistic models for relational data. In Proceedings of the 18th Conference on Uncertainly in Artificial Intelligence (UAI), pages 485-492, 2002.
55. YongHong Tian, Tiejun Huang, and Wen Gao. Latent linkage semantic kernels for collective classification of link data. Journal of Intelligent Information Systems, 26(3):269-301, 2006.
56. Rudolph Triebel, Richard Schmidt, Oscar Martinez Mozos, and Wolfram Burgard. Instance-based AMN classification for improved object recognition in 2D and 3D laser range data. In Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI), pages 22252230, 2007.
57. Jonathan S. Yedidia, William T. Freeman, and Yair Weiss. Generalized belief propagation. Advances in Neural Information Processing Systems (NIPS), 13:689-695, 2000.
58. Nevin Lianwen Zhang and David Poole. Exploiting causal independence in bayesian network inference. Journal of Artificial Intelligence Research, 5:301-328, 1996.
59. Bin Zhao, Prithviraj Sen, and Lise Getoor. Event classification and relationship labeling in affiliation networks. In Proceedings of the Workshop on Statistical Network Analysis (SNA) at the 23rd International Conference on Machine Learning (ICML), 2006.