Migratory logistic regression for learning concept drift between two data sets with application to UXO sensing

IEEE Transactions on Geoscience and Remote Sensing

Volumn 47, Issue 5, 2009, Pages 1454-1466

  Liao, Xuejun ^a   Carin, Lawrence ^a,b  

^a Duke University   (United States)

^b Signal Innovations Group Inc   (United States)

Author keywords

Concept drift; Inverse problems; Logistic regression; Signal processing

Indexed keywords

ACTIVE LEARNING; AUXILIARY VARIABLES; CONCEPT DRIFT; DATA SETS; DIFFERENT DISTRIBUTIONS; LOGISTIC REGRESSION; REAL MEASURED DATUM; SIMULATED DATUM; SOURCE DISTRIBUTIONS; TRAINING AND TESTING; UNEXPLODED ORDNANCES;

DIFFERENTIAL EQUATIONS; EDUCATION; LOGISTICS; REGRESSION ANALYSIS; SIGNAL PROCESSING;

INVERSE PROBLEMS;

ALGORITHM; DATA SET; LEARNING; LOGISTICS; REGRESSION ANALYSIS; REMOTE SENSING; SIGNAL PROCESSING; TRAINING;

EID: 67349229152     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2008.2005268     Document Type: Article

References (32)

1. Y. Zhang, L. Collins, H. Yu, C. E. Baum, and L. Carin, "Sensing of unexploded ordnance with magnetometer and induction data: Theory and signal processing," IEEE Trans. Geosci. Remote Sens., vol. 41, no. 5, pp. 1005-1015, May 2003.
2. G. Widmer and M. Kubat, "Effective learning in dynamic environments by explicit concept tracking," in Proc. Eur. Conf. Mach. Learning, P. B. Brazdil, Ed., 1993, pp. 224-227.
3. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
4. V. N. Vapnik, "An overview of statistical learning theory," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 988-999, Sep. 1999.
5. C. P. Robert and G. Casella, Monte Carlo Statistical Methods. New York: Springer-Verlag, 1999.
6. G. Widmer and M. Kubat, "Learning in the presence of concept drift and hidden contexts," Mach. Learn., vol. 23, no. 1, pp. 69-101, Apr. 1996.
7. J. B. Tenenbaum, "Bayesian modeling of human concept learning," in Advances in Neural Information Processing Systems, vol. 11, M. S. Kearns, S. A. Solla, and D. A. Cohn, Eds. Cambridge, MA: MIT Press, 1999.
8. R. Klinkenberg and T. Joachims, "Detecting concept drift with support vectormachines," in Proc. 17th ICML, P. Langley, Ed., 2000, pp. 487-494.
9. H. Wang, W. Fan, P. S. Yu, and J. Han, "Mining concept-drifting data streams using ensemble classifiers," in Proc. 9th ACM SIGKDD Int. Conf. Knowledge Discovery Data Mining KDD, 2003, pp. 226-235.
10. R. Klinkenberg and S. Ruping, "Concept drift and the importance of examples," in Text Mining Theoretical Aspects and Applications, J. Franke, G. Nakhaeizadeh, and I. Renz, Eds. Heidelberg, Germany: Physica- Verlag, 2003, pp. 55-77.
11. J. Heckman, "Sample selection bias as a specification error," Econometrica, vol. 47, no. 1, pp. 153-161, Jan. 1979.
12. B. Zadrozny, "Learning and evaluating classifiers under sample selection bias," in Proc. 21st ICML, 2004, pp. 903-910.
13. D. P. Bertsekas, Nonlinear Programming, 2nd ed. Belmont,MA: Athena Scientific, 1999.
14. V. V. Fedorov, Theory of Optimal Experiments. New York: Academic, 1972.
15. D. J. C. MacKay, "Information-based objective functions for active data selection," Neural Comput., vol. 4, no. 4, pp. 590-604, Jul. 1992.
16. D. A. Cohn, Z. Ghahramani, and M. I. Jordan, "Active learning with statistical models," in Advances in Neural Information Processing Systems, vol. 7. Cambridge, MA: MIT Press, 1995, pp. 705-712.
17. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," in Advances in Neural Information Processing Systems, vol. 7. Cambridge, MA: MIT Press, 1995, pp. 231-238.
18. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
19. J. Hanley and B. McNeil, "The meaning and use of the area under a receiver operating characteristic (ROC) curve," Radiology, vol. 143, no. 1, pp. 29-36, Apr. 1982.
20. R. Caruana, "Multitask learning," Mach. Learn., vol. 28, no. 1, pp. 41-75, Jul. 1997.
21. J. Baxter, "A model of inductive bias learning," J. Artif. Intell. Res., vol. 12, pp. 149-198, 2000.
22. K. Yu, V. Tresp, and A. Schwaighofer, "Learning Gaussian processes from multiple tasks," in Proc. 22nd ICML, 2005, pp. 1012-1019.
23. W. Fan, "Systematic data selection to mine concept-drifting data streams," in Proc. KDD, 2004, pp. 128-137.
24. R. Klinkenberg, "Learning drifting concepts: Example selection vs. example weighting," Intell. Data Anal. (IDA), vol. 8, no. 3, pp. 281-300, Aug. 2004.
25. M. Scholz and R. Klinkenberg, "Boosting classifiers for drifting concepts," Intell. Data Anal. (IDA), vol. 11, no. 1, pp. 3-28, Jan. 2007.
26. P. Wu and T. G. Dietterich, "Improving SVM accuracy by training on auxiliary data sources," in Proc. 21st ICML, 2004, p. 110.
27. B. Bakker and T. Heskes, "Task clustering and gating for Bayesian multitask learning," J. Mach. Learn. Res., vol. 4, no. 1, pp. 83-99, Dec. 2003.
28. X. Liao and L. Carin, "Radial basis function network for multi-task learning," in Advances in Neural Information Processing Systems, vol. 18. Cambridge, MA: MIT Press, 2006, pp. 795-802.
29. T. Evgeniou, C. A. Micchelli, and M. Pontil, "Learning multiple tasks with kernel methods," J. Mach. Learn. Res., vol. 6, no. 1, pp. 615-637, Apr. 2005.
30. F. Dominici, G. Parmigiani, K. H. Reckhow, and R. L.Wolpert, "Combining information from related regressions," J. Agric., Biol., Environ. Stat., vol. 2, no. 3, pp. 313-332, Sep. 1997.
31. T. Ferguson, "A Bayesian analysis of some nonparametric problems," Ann. Stat., vol. 1, no. 2, pp. 209-230, Mar. 1973.
32. Y. Xue, X. Liao, L. Carin, and B. Krishnapuram, "Multi-task learning for classification with Dirichlet process priors," J. Mach. Learn. Res. (JMLR), vol. 8, pp. 35-63, May 2007.