Parallel graph-based semi-supervised learning

Scaling up Machine Learning: Parallel and Distributed Approaches

Volumn 9780521192248, Issue , 2011, Pages 307-330

  Bilmes, Jeff ^a   Subramanya, Amarnag ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALUMINUM ALLOYS; INFORMATION RETRIEVAL SYSTEMS; SEARCH ENGINES; SPEECH RECOGNITION; STATISTICAL TESTS; SUPERVISED LEARNING;

DECISION FUNCTIONS; DOCUMENT CLASSIFICATION; INTERNET SEARCHES; MACHINE LEARNING APPLICATIONS; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING (SSL); TRANSDUCTIVE LEARNING;

EDUCATION;

EID: 84923427375     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9781139042918.016     Document Type: Chapter

References (66)

1. Alexandrescu, A., and Kirchhoff, K. 2007. Graph-Based Learning for Statistical Machine Translation. In: Proceeding of the Human Language Technologies Conference (HLT-NAACL).
2. Arya, S., and Mount, D. M. 1993. Approximate Nearest Neighbor Queries in Fixed Dimensions. In: ACM-SIAM Symposium on Discrete Algorithms (SODA).
3. Arya, S., Mount, D. M., Netanyahu, N. S., Silverman, R., and Wu, A. 1998. An Optimal Algorithm for Approximate Nearest Neighbor Searching. Journal of the ACM.
4. Balcan, M.-F., and Blum, A. 2005. A PAC-Style Model for Learning from Labeled and Unlabeled Data. Pages 111-126 of: COLT.
5. Baluja, S., Seth, R., Sivakumar, D., Jing, Y., Yagnik, J., Kumar, S., Ravichandran, D., and Aly, M. 2008. Video Suggestion and Discovery for YouTube: Taking Random Walks through the View Graph. Pages 895-904 of: Proceeding of the 17th International conference on World Wide Web. ACM.
6. Belkin, M., Niyogi, P., and Sindhwani, V. 2005. On Manifold Regularization. In: Proceedings of the Conference on Artificial Intelligence and Statistics (AISTATS).
7. Bengio, Y., Delalleau, O., and Roux, N. L. 2007. Label Propagation and Quadratic Criterion. In: Semi-Supervised Learning. Cambridge, MA: MIT Press.
8. Bertsekas, D. 1999. Nonlinear Programming. Athena Scientific.
9. Bie, T. D., and Cristianini, N. 2003. Convex Methods for Transduction. Pages 73-80 of: Advances in Neural Information Processing Systems 16. Cambridge, MA: MIT Press.
10. Bilmes, J. A. 1998. A Gentle Tutorial on the EM Algorithm and Its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models. Technical Report ICSI-TR-97-021. University of Berkeley.
11. Bishop, C. (ed). 1995. Neural Networks for Pattern Recognition. New York: Oxford University Press.
12. Blitzer, J., and Zhu, J. 2008. ACL 2008 Tutorial on Semi-supervised Learning. http://ssl-acl08.wikidot.com/.
13. Blum, A., and Chawla, S. 2001. Learning from Labeled and Unlabeled Data Using Graph Mincuts. Pages 19-26 of: Proceedings of the 18th International Conference on Machine Learning. San Francisco, CA: Morgan Kaufmann.
14. Chapelle, O., Scholkopf, B., and Zien, A. 2007. Semi-Supervised Learning. Cambridge, MA: MIT Press.
15. Collobert, R., Sinz, F., Weston, J., Bottou, L., and Joachims, T. 2006. Large Scale Transductive SVMs. Journal of Machine Learning Research.
16. Corduneanu, A., and Jaakkola, T. 2003. On Information Regularization. In: Uncertainty in Artificial Intelligence.
17. Delalleau, O., Bengio, Y., and Roux, N. L. 2005. Efficient Non-parametric Function Induction in Semi-Supervised Learning. In: Proceedings of the Conference on Artificial Intelligence and Statistics (AISTATS).
18. Dempster, A. P., Laird, N.M., Rubin, D. B., et al. 1977. Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society, Series B (Methodological), 39(1), 1-38.
19. Deshmukh, N., Ganapathiraju, A., Gleeson, A., Hamaker, J., and Picone, J. 1998 (November). Resegmentation of Switchboard. Pages 1543-1546 of: Proceedings of the International Conference on Spoken Language Processing.
20. Evermann, G., Chan, H. Y., Gales, M. J. F., Jia, B., Mrva, D., Woodland, P. C., and Yu, K. 2005. Training LVCSR Systems on Thousands of Hours of Data. In: Proceedings of ICASSP.
21. Frey, B. J., and Dueck, D. 2007. Clustering by Passing Messages between Data Points. Science, 315(5814), 972.
22. Friedman, J. H., Bentley, J. L., and Finkel, R. A. 1977. An Algorithm for Finding Best Matches in Logarithmic Expected Time. ACM Transaction on Mathematical Software, 3.
23. Garcke, J., and Griebel, M. 2005. Semi-supervised Learning with Sparse Grids. In: Proceedings of the 22nd ICML Workshop on Learning with Partially Classified Training Data.
24. Godfrey, J., Holliman, E., and McDaniel, J. 1992 (March). SWITCHBOARD: Telephone Speech Corpus for Research and Development. Pages 517-520 of: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 1.
25. Goldman, S., and Zhou, Y. 2000. Enhancing Supervised Learning with Unlabeled Data. Pages 327-334 of: Proceedings of the 17th International Conference on Machine Learning. San Francisco, CA: Morgan Kaufmann.
26. Greenberg, S. 1995. The Switchboard Transcription Project. Technical Report, The Johns Hopkins University (CLSP) Summer Research Workshop.
27. Greenberg, S., Hollenback, J., and Ellis, D. 1996. Insights into Spoken Language Gleaned from Phonetic Transcription of the Switchboard Corpus. Pages 24-27 of: ICSLP.
28. Haffari, G.R., and Sarkar, A. 2007. Analysis of Semi-supervised Learning with the Yarowsky Algorithm. In: UAI.
29. Hosmer, D. W. 1973. A Comparison of Iterative Maximum Likelihood Estimates of the Parameters of a Mixture of Two Normal Distributions under Three Different Types of Sample. Biometrics.
30. Huang, X., Acero, A., and Hon, H. 2001. Spoken Language Processing. Englewood Cliffs, NJ: Prentice-Hall.
31. Jebara, T., Wang, J., and Chang, S.F. 2009. Graph Construction and b-Matching for Semi-supervised Learning. In: International Conference on Machine Learning.
32. Joachims, T. 2003. Transductive Learning via Spectral Graph Partitioning. In: Proceedings of the International Conference on Machine Learning (ICML).
33. Karlen, M., Weston, J., Erkan, A., and Collobert, R. 2008. Large Scale Manifold Transduction. In: International Conference on Machine Learning, ICML.
34. Lawrence, N. D., and Jordan, M. I. 2005. Semi-supervised Learning via Gaussian Processes. In: Neural Information Processing Systems.
35. Malkin, J., Subramanya, A., and Bilmes, J.A. 2009 (September). On the Semi-Supervised Learning of Multi-Layered Perceptrons. In: Proceedings of the Annual Conference of the International Speech Communication Association (INTERSPEECH).
36. McLachlan, G. J., and Ganesalingam, S. 1982. Updating a Discriminant Function on the Basis of Unclassified Data. Communication in Statistics: Simulation and Computation.
37. Nadler, B., Srebro, N., and Zhou, X. 2010. Statistical Analysis of Semi-supervised Learning: The Limit of Infinite Unlabelled Data. In: Advances in Neural Information Processing Systems (NIPS).
38. Ng, A., and Jordan, M. 2002. On Discriminative vs. Generative Classifiers: A Comparison of Logistic Regression and Naive Bayes. In: Advances in Neural Information Processing Systems (NIPS).
39. Nigam, G. 2001. Using Unlabeled Data to Improve Text Classification. Ph.D. thesis, CMU.
40. Pearl, J. 1988. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco, CA: Morgan Kaufmann.
41. Scudder, H. J. 1965. Probability of Error of Some Adaptive Pattern-Recognition Machines. IEEE Transactions on Information Theory, 11.
42. Seeger, M. 2000. Learning with Labeled and Unlabeled Data. Technical Report, University of Edinburgh, UK.
43. Shi, J., and Malik, J. 2000. Normalized Cuts and Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence.
44. Sindhwani, V., and Selvaraj, S.K. 2006. Large Scale Semi-Supervised Linear SVMs. In: SIGIR ’06: Proceedings of the 29th Annual International ACM SIGIR.
45. Sindhwani, V., Niyogi, P., and Belkin, M. 2005. Beyond the Point Cloud: From Transductive to Semi-supervised learning. In: Proceedings of the International Conference on Machine Learning (ICML).
46. Subramanya, A., and Bilmes, J. 2008. Soft-Supervised Text Classification. In: EMNLP.
47. Subramanya, A., and Bilmes, J. 2009a. Entropic Regularization in Non-parametric Graph-Based Learning. In: NIPS.
48. Subramanya, A., and Bilmes, J. 2009b. The Semi-supervised Switchboard Transcription Project. In: Interspeech.
49. Subramanya, A., and Bilmes, J. 2011. Semi-Supervised Learning with Measure Propagation. Journal of Machine Learning Research.
50. Subramanya, A., Bartels, C., Bilmes, J., and Nguyen, P. 2007. Uncertainty in Training Large Vocabulary Speech Recognizers. In: Proceedings of the IEEE Workshop on Speech Recognition and Understanding.
51. Szummer, M., and Jaakkola, T. 2001. Partially Labeled Classification with Markov Random Walks. In: Advances in Neural Information Processing Systems, vol. 14.
52. Talukdar, P. P., and Crammer, K. 2009. New Regularized Algorithms for Transductive Learning. In: European Conference on Machine Learning (ECML-PKDD).
53. Tomkins, A. 2008. Keynote Speech. CIKM Workshop on Search and Social Media.
54. Tsang, I.W., and Kwok, J. T. 2006. Large-Scale Sparsified Manifold Regularization. In: Advances in Neural Information Processing Systems (NIPS) 19.
55. Tsuda, K. 2005. Propagating Distributions on a Hypergraph by Dual Information Regularization. In: Proceedings of the 22nd International Conference on Machine Learning.
56. Vapnik, V. 1998. Statistical Learning Theory. New York: Wiley.
57. Vazirani, V. V. 2001. Approximation Algorithms. New York: Springer.
58. Wang, F., and Zhang, C. 2006. Label Propagation through Linear Neighborhoods. Pages 985-992 of: Proceedings of the 23rd International Conference on Machine Learning. New York: ACM.
59. White, N. 1986. Theory of Matroids. Cambridge University Press.
60. Woess, W. 2000. Random Walks on Infinite Graphs and Groups. Cambridge Tracts in Mathematics 138. New York: Cambridge University Press.
61. Zhu, X. 2005a. Semi-Supervised Learning Literature Survey. Technical Report 1530. Computer Sciences, University of Wisconsin-Madison.
62. Zhu, X. 2005b. Semi-Supervised Learning with Graphs. Ph.D. thesis, Carnegie Mellon University.
63. Zhu, X., and Ghahramani, Z. 2002a. Learning from Labeled and Unlabeled Data with Label Propagation. Technical Report, Carnegie Mellon University.
64. Zhu, X., and Ghahramani, Z. 2002b. Towards Semi-supervised Classification with Markov Random Fields. Technical Report CMU-CALD-02-106. Carnegie Mellon University.
65. Zhu, X., and Goldberg, A.B. 2009. Introduction to Semi-supervised Learning. Morgan & Claypool.
66. Zhu, X., Ghahramani, Z., and Lafferty, J. 2003. Semi-supervised Learning using Gaussian Fields and Harmonic Functions. In: Proceedings of the International Conference on Machine Learning (ICML).