Co-validation: Using model disagreement on unlabeled data to validate classification algorithms

Advances in Neural Information Processing Systems

Volumn , Issue , 2005, Pages

  Madani, Omid ^a   Pennock, David M ^a   Flake, Gary W ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE LEARNING; AVERAGE ERRORS; BINARY CLASSIFICATION; CLASSIFICATION ALGORITHM; CROSS VALIDATION; MODEL SELECTION; PREDICTION ERRORS; UNBIASED ESTIMATES;

ESTIMATION;

EID: 84898982358     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. [BC03] Y. Bengio and N. Chapados. Extensions to metric-based model selection. Journal of Machine Learning Research, 2003.
2. [BG03] Y. Bengio and Y. Granvalet. No unbiased estimator of the variance of k-fold cross-validation. In NIPS, 2003.
3. [BKM98] C.L. Blake, E. Keogh, and C.J. Merz. UCI repository of machine learning databases, 1998.
4. [CL01] Chih-Chung Chang and Chih-Jen Lin. LIBSVM: A library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/cjlin/ libsvm.
5. [KN02] S. Kutin and P. Niyogi. Almost-everywhere algorithmic stability and generalization error. In UAI, 2002.
6. [Kut02] S. Kutin. Algorithmic stability and ensemble-based learning. PhD thesis, University of Chicago, 2002.
7. [KV95] A. Krogh and J. Vedelsby. Neural network ensembles, cross validation, and active learning. In NIPS, 1995.
8. [LBRB02] T. Lange, M. Braun, V. Roth, and J. Buhmann. Stability-based model selection. In NIPS, 2002.
9. [LRBB04] T. Lange, V. Roth, M. Braun, and J. Buhmann. Stability based validation of clustering algorithms. Neural Computation, 16, 2004.
10. [McC96] A. K. McCallum. Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering. http://www.cs.cmu.edu/mccallum/ bow, 1996.
11. [Sch97] D. Schuurmans. A new metric-based approach to model selection. In AAAI, 1997.
12. [SS02] D. Schuurmans and F. Southey. Metric-based methods for adaptive model selection and regularization. Machine Learning, pages 51-84, 2002.