Tabu search-enhanced graphical models for classification in high dimensions

INFORMS Journal on Computing

Volumn 20, Issue 3, 2008, Pages 423-437

  Bai, Xue ^a   Padman, Rema ^b   Ramsey, Joseph ^b   Spirtes, Peter ^b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Bayesian networks; Health care decision support; Machine learning; Markov blanket; Online marketing; Tabu search; Text analysis

Indexed keywords

EID: 61349199460     PISSN: 10919856     EISSN: 15265528     Source Type: Journal    
DOI: 10.1287/ijoc.1070.0255     Document Type: Article

References (45)

1. Adam, B. L., Y. Qu, J. W. Davis, M. D. Ward, M. A. Clements, L. H. Cazares, O. J. Semmes, P. F. Schellhammer, Y. Yasui, Z. Feng, G. L. Wright, Jr. 2002. Serum protein fingerprinting coupled with a pattern-matching algorithm distinguishes prostate cancer from benign prostate hyperplasia and healthy men. Cancer Res. 62 3609-3614.
2. Adomavicius, G., A. Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowledge Data Engrg. 17 734-749.
3. Airoldi, E. M., X. Bai, R. Padman. 2006. Markov blankets and metaheuristic search: Sentiment extraction from unstructured texts. Lecture Notes in Computer Science, Vol. 3932. Springer-Verlag, Berlin, 167-187.
4. Aliferis, C., I. Tsamardinos, A. Statnikov. 2003a. Algorithms for large-scale local causal discovery in the presence of small sample or large causal neighborhoods. Technical Report DSL-02-08, Vanderbilt University, Nashville, TN.
5. Aliferis, C., I. Tsamardinos, A. Statnikov. 2003b. HITON, a novel Markov blanket algorithm for optimal variable selection. M. Musen, ed. Proc. Amer. Medical Informatics Assoc. Annual Sympos., AMIA, Washington D.C., 21-25.
6. Bai, X. 2003. Internet enabled arbitrage: Evidence from the international online textbook market. Proc. 8th INFORMS Conf. Inform. Systems Tech., CIST, Atlanta, 23-32.
7. Bai, X. 2005. Tabu search enhanced graphical models for classification of high dimensional data. Technical Report CMU- CALD-05-101, School of Computer Science, Carnegie Mellon University, Pittsburgh.
8. Bai, X., R. Padman. 2005. Tabu search enhanced Markov blanket classifier for high dimensional data sets. B. Golden, S. Raghavan, E. Wasil, eds. The Next Wave in Computing, Optimization, and Decision Technologies. Kluwer Academic Publishers, Norwell, MA, 338-354.
9. Bai, X., R. Padman, E. M. Airoldi. 2005. On learning parsimonious models for extracting consumer opinions. Proc. 38th Hawaii Internat. Conf. System Sci., IEEE Computer Society, Washington, D.C., 75b.
10. Bai, X., C, Glymour, J. Ramsey, R Spirtes, F, Wimberly, R. Padman. 2004. Pcx: Markov blanket classification for large data sets with few cases. Technical Report CMU-CALD-04-103, School of Computer Science, Carnegie Mellon University, Pittsburgh.
11. Berger, D., B. Gendron, J. Y. Potvin, S. Raghavan, P. Soriano. 2000. Tabu search for a network loading problem with multiple facilities. J. Heuristics 6 253-267.
12. Berry, M. J. A., G. S. Linoff. 1997. Data Mining Techniques: For Marketing, Saks, and Customer Support, 1st ed. Wiley Computer Publishing, Hoboken, NJ.
13. Brynjolfsson, E., M. D. Smith. 2000. Frictionless commerce? A comparison of Internet and conventional retailers. Management Sci. 46 563-585.
14. Campos, V., M. Laguna, R. Marti. 2005. Context-independent scatter and Tabu search for permutation problems. INFORMS J. Comput. 17(1) 111-122.
15. Carletta, J. 1996. Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics 22 249-254.
16. Cheng, J., R. Greiner. 1999. Comparing Bayesian network classifiers. Proc. Uncertainty in Artificial Intelligence 1999, Morgan Kaufmann, San Francisco, 101-108.
17. Cheng, J., C. Hatzis, H. Hayashi, M. A. Krogel, S. Morishita, D. Page, J. Sese. 2002. KDD cup 2001 report. SIGKDD Explorations 3 47-64.
18. Chickering, D. M. 2002. Learning equivalence classes of Bayesian-network structures. J. Machine Learn. Res. 3 507-554.
19. Cohen, W. W. 2004. Minorthird: Methods for identifying names and ontological relations in text using heuristics for inducing regularities from data, http://minorthird.sourceforge.net.
20. Cooper, G. F., C. F. Aliferis, J. Aronis, B. G. Buchanan, R. Caruana, M. J. Fine, C. Glymour, G. Gordon, B. H. Hanusa, J. E. Janosky, C. Meek, T. Mitchell, T. Richardson, P. Spirtes. 1992. An evaluation of machine-learning methods for predicting pneumonia mortality. Artificial Intelligence Medicine 9 107-139.
21. Freund, Y., R. E. Schapire. 1999. Large margin classification using the perceptron algorithm. Machine Learn. 37 277-296.
22. Friedman, N., D. Geiger, M. Goldszmidt. 1997. Bayesian network classifiers. Machine Learn. 29 131-163.
23. Fu, Z., B. L. Golden, S. Lele, S. Raghavan, E. A. Wasil. 2003. A genetics algorithm-based approach for building accurate decision trees. INFORMS J. Comput. 15(1) 3-22.
24. Glover, F. 1989. Tabu search-Part I. ORSA J. Comput. 1(3) 190-206.
25. Glover, F., M. Laguna. 1997. Tabu Search. Kluwer Academic Publishers, Norwell, MA.
26. Hanley, J. A., B. J. McNeil. 1983. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148 839-843.
27. Jesus, M. 2001. Web Mining for Profit: E-Business Optimization, 1st ed. Butterworth-Heinemann, Woburn, MA.
28. Joachims, T. 2001. A statistical learning model of text classification with support vector machines. Proc. Conf. Res. Development Inform. Retrieval, ACM, New York, 128-136.
29. Koller, D., M. Sahami. 1996. Towards optimal feature selection. Proc. Thirteenth Internat. Conf. Machine Learn., Morgan Kaufmann, San Francisco, 284-292.
30. Lafferty, J., A. McCallum, F. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proc. Eighteenth Internat. Conf. Machine Learn., Morgan Kaufmann, San Francisco, 282-289.
31. Madden, M. G. 2002. Evaluation of the performance of the Markov blanket Bayesian classifier algorithm. Technical Report NUIG- IT-011002, Department of Information Technology, National University of Ireland, Galway, Ireland.
32. Margaritis, D., S. Thrun. 1999. Bayesian network induction via local neighborhoods. Adv. Neural Inform. Processing System 12 505-511.
33. Montgomery, A., S. Kannan. 2002. Learning about customers without asking. Working paper, Graduate School of Industrial Administration, Carnegie Mellon University, Pittsburgh.
34. Newman, D. J., S. Hettich, C. L. Blake, C. J. Merz. 1998. UCI repository of machine learning databases. http://www.ics.uci.edu/-mlearn/MLRepository.html.
35. Nigam, K., A. McCallum, S. Thrun, T. Mitchell. 2000. Text classification from labeled and unlabeled documents using EM. Machine Learn. 39 103-134.
36. Oppen, J., S. I. Grüner, A. Løkketangen. 2003. A Tabu search based heuristic for the 0/1 multiconstrained knapsack problem. Proc. NIK 2003-Norwegian Informatics Conf., Oslo.
37. Padmanabhan, B., A. Tuzhilin. 2003. On the use of optimization for data mining: Theoretical interactions and eCRM opportunities. Management Sci. 49(10) 1327-1343.
38. Pang, B., L. Lee, S. Vaithyanathan. 2002. Thumbs up? Sentiment classification using machine learning techniques. Proc. 2002 Conf. Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Philadelphia, 79-86.
39. Pearl, J. 2000. Causality: Models, Reasoning, and Inference. Cambridge University Press, Cambridge, UK.
40. Quinlan, J. R. 1990. Induction of decision trees. J. W. Shavlik, T. G. Dietterich, eds. Readings in Machine Learning. Morgan Kaufmann, San Francisco, 57-69. [Originally published in Machine Learn. 1 81-106, 1986.]
41. Ramsey, J. D. 2006. A PC-style Markov blanket search for high dimensional data sets. Technical Report CMU-PHIL-177, Department of Philosophy, Carnegie Mellon University, Pittsburgh.
42. Saar-Tsechansky, M., F. Provost. 2001. Active learning for class probability estimation and ranking. Proc. Internat. Joint Conf. Artificial Intelligence, AAAI Press, Menlo Park, CA, 911-920.
43. Smith, M. D., E. Brynjolfsson. 2001. Customer decision making at an Internet shopbot: Brand still matters. J. Indust. Econom. 49 541-558.
44. Spirtes, P., C. Glymour, R. Scheines. 2000. Causation, Prediction, and Search. MIT Press, Boston.
45. Toth, P., D. Vigo. 2003. The granular Tabu search and its application to the vehicle routing problem. INFORMS J. Comput. 15(4) 334-346.