Learning terrain segmentation with classifier ensembles for autonomous robot navigation in unstructured environments

Journal of Field Robotics

Volumn 26, Issue 2, 2009, Pages 145-175

  Procopio, Michael J ^a   Mulligan, Jane ^b   Grudic, Greg ^b  

^a SANDIA NATIONAL LABORATORIES   (United States)

^b UCB 450   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTONOMOUS NAVIGATION; AUTONOMOUS ROBOT NAVIGATION; AVOIDING OBSTACLE; CLASSIFIER ENSEMBLES; EFFECTIVE TOOL; ENSEMBLE ALGORITHMS; ENSEMBLE METHODS; EXPERIMENTAL EVALUATION; FAR-FIELD; LABELED DATA; LEARNING APPROACH; MACHINE LEARNING METHODS; NAVIGATION TASKS; NEAR FIELDS; NEAR-FIELD; OUTDOOR ENVIRONMENT; PARAMETER SELECTION; PROBLEM DOMAIN; TERRAIN CLASSIFICATION; TERRAIN MODEL; TRAIN MODEL; UNSTRUCTURED ENVIRONMENTS;

CLASSIFIERS; EDUCATION; FAILURE ANALYSIS; LEARNING SYSTEMS; NAVIGATION; NAVIGATION SYSTEMS;

ROBOTS;

EID: 67649209190     PISSN: 15564959     EISSN: 15564967     Source Type: Journal    
DOI: 10.1002/rob.20279     Document Type: Article

References (70)

1. Alpaydin, E. (2004). Introduction to machine learning (adaptive computation and machine learning). Cambridge, MA: The MIT Press.
2. Bajracharya, M., Howard, A., Matthies, L. H., Tang, B., & Turmon, M. (2009). Autonomous off-road navigation with end-to-end learning for the LAGR program. Journal of Field Robotics, 26, 3-25.
3. Bauer, E., & Kohavi, R. (1999). An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning, 36(1-2), 105-139.
4. Bellutta, P., Matthies, L., Owens, K., & Rankin, A. (2000). Terrain perception for DEMO III. In Proceedings of the IEEE Intelligent Vehicles Symposium 2000, Dearborn, MI (pp. 326-331). IEEE.
5. Bishop, C. M. (2006). Pattern recognition and machine learning (information science and statistics). Secaucus, NJ: Springer-Verlag New York.
6. Breiman, L. (1996). Bagging predictors. Machine Learning, 24(2), 123-140.
7. Caruana, R., & Niculescu-Mizil, A. (2004). Data mining in metric space: An empirical analysis of supervised learning performance criteria. In KDD '04: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, WA (pp. 69-78). New York: ACM.
8. Caruana, R., Niculescu-Mizil, A., Crew, G., & Ksikes, A. (2004). Ensemble selection from libraries of models. In ICML '04: Proceedings of the Twenty-First International Conference on Machine Learning, Banff, Alberta, Canada (pp. 137-144). New York: ACM.
9. Chang, C.-C., & Lin, C.-J. (2001). LIBSVM: A library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin /libsvm.
10. Chang, T. S., Qui, K., & Nitao, J. J. (1986). An obstacle avoidance algorithm for an autonomous land vehicle. In Proceedings of the SPIE Conference on Mobile Robots, Boston, MA (pp. 117-123). Boston, MA: SPIE.
11. Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321-357.
12. Cox, D. R., & Snell, E. J. (1989). Analysis of binary data, 2nd ed. London: Chapman & Hall.
13. Crisman, J., & Thorpe, C. (1991). UNSCARF, A color vision system for the detection of unstructured roads. In Proceedings of the 1991 International Conference on Robotics and Automation, Sacramento, CA (pp. 2496-2501). IEEE.
14. Dahlkamp, H., Kaehler, A., Stavens, D., Thrun, S., & Bradski, G. (2006). Self-supervised monocular road detection in desert terrain. In Proceedings of Robotics: Science and Systems, Philadelphia, PA. Cambridge, MA: MIT Press.
15. DeSouza, G. N., & Kak, A. C. (2002). Vision for mobile robot navigation: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(2), 237-267.
16. Devore, J. L. (2004). Probability and statistics for engineering and the sciences, 6th ed. Pacific Grove, CA: Brooks/Cole Publishing Co.
17. Dietterich, T. G. (2000). Ensemble methods in machine learning. In MCS '00: Proceedings of the First International Workshop on Multiple Classifier Systems, Cagliari, Italy (pp. 1-15). London: Springer-Verlag.
18. Dietterich, T. G., & Bakiri, G. (1995). Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2, 263-286.
19. Dzeroski, S., & Zenko, B. (2004). Is combining classifiers with stacking better than selecting the best one? Machine Learning, 54(3), 255-273.
20. Forsyth, D. A., & Ponce, J. (2003). Computer vision: A modern approach. Upper Saddle River, NJ: Prentice Hall.
21. Freund, Y., & Schapire, R. E. (1995). A decision-theoretic generalization of on-line learning and an application to boosting. In EuroCOLT '95: Proceedings of the Second European Conference on Computational Learning Theory, Barcelona, Spain (pp. 23-37). London: Springer-Verlag.
22. Grudic, G., & Mulligan, J. (2006). Outdoor path labeling using polynomial Mahalanobis distance. In Proceedings of Robotics: Science and Systems, Philadelphia, PA. Cambridge, MA: MIT Press.
23. Grudic, G., Mulligan, J., Otte, M., & Bates, A. (2007). Online learning of multiple perceptual models for navigation in unknown terrain. In FSR '07: Proceedings of the International Conference on Field and Service Robotics, Chamonix, France. Paris: INRIA.
24. Hansen, L. K., & Salamon, P. (1990). Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(10), 993-1001.
25. Happold, M., Ollis, M., & Johnson, N. (2006). Enhancing supervised terrain classification with predictive unsupervised learning. In Proceedings of Robotics: Science and Systems, Philadelphia, PA. Cambridge, MA: MIT Press.
26. Hoeting, J., Madigan, D., Raftery, A., & Volinsky, C. T. (1999). Bayesian model averaging: A tutorial (with discussion). Statistical Science, 14(4), 382-417.
27. Howard, A., Turmon, M., Matthies, L., Tang, B., Angelova, A., & Mjolsness, E. (2006). Towards learned traversability for robot navigation: From under foot to the far field. Journal of Field Robotics, 23, 1005-1017.
28. Jackel, L., Krotkov, E., Perschbacher, M., Pippine, J., & Sullivan, C. (2006). The DARPA LAGR program: Goals, challenges, methodology, and phase I results. Journal of Field Robotics, 23, 945-973.
29. Jacobs, R. A. (1995). Methods for combining experts' probability assessments. Neural Computation, 7(5), 867-888.
30. Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991). Adaptive mixtures of local experts. Neural Computation, 3(1), 79-87.
31. Japkowicz, N. (2000). The class imbalance problem: Significance and strategies. In Proceedings of the 2000 International Conference on Artificial Intelligence (ICAI), Las Vegas, NV (pp. 111-117). CSREA Press.
32. Kanade, T., Thorpe, C., & Whittaker, W. (1986). Autonomous land vehicle project at CMU. In CSC '86: Proceedings of the 1986 ACM Fourteenth Annual Conference on Computer Science, Cincinnati, OH (pp. 71-80). New York: ACM.
33. Kelly, A., & Stentz, A. T. (1997). An analysis of requirements for rough terrain autonomous mobility. Autonomous Robots, 4(4).
34. Kelly, A., Stentz, A. T., Amidi, O., Bode, M. W., Bradley, D., Diaz-Calderon, A., Happold, M., Herman, H., Mandelbaum, R., Pilarski, T., Rander, P., Thayer, S., Vallidis, N. M., & Warner, R. (2006). Toward reliable off road autonomous vehicles operating in challenging environments. International Journal of Robotics Research, 25(5-6), 449-483.
35. Kolter, J. Z., & Maloof, M. A. (2003). Dynamic weighted majority: A new ensemble method for tracking concept drift. In ICDM '03: Proceedings of the Third IEEE International Conference on Data Mining, Melbourne, FL (p. 123). Los Alamitos, CA: IEEE.
36. Komarek, P. R., & Moore, A. W. (2003). Fast robust logistic regression for large sparse datasets with binary outputs. In Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics (AISTATS 2003). Society for Artificial Intelligence and Statistics.
37. Krotkov, E., Fish, S., Jackel, L., McBride, B., Perschbacher, M., & Pippine, J. (2007). The DARPA PerceptOR evaluation experiments. Autonomous Robots, 22(1), 19-35.
38. Kuan, D., Phipps, G., & Hsueh, A.-C. (1988). Autonomous robotic vehicle road following. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(5), 648-658.
39. Kuncheva, L. I. (2004). Classifier ensembles for changing environments. In Proceedings of the 5th International Workshop on Multiple Classifier Systems, Cagliari, Italy (pp. 1-15). London: Springer-Verlag.
40. Latombe, J.-C. (1991). Robot motion planning. Boston: Kluwer Academic Publishers.
41. Lieb, D., Lookingbill, A., & Thrun, S. (2005). Adaptive road following using self-supervised learning and reverse optical flow. In Proceedings of Robotics: Science and Systems, Cambridge, MA. Cambridge, MA: MIT Press.
42. Lin, C.-J., Weng, R. C., & Keerthi, S. S. (2008). Trust region Newton method for large-scale logistic regression. Journal of Machine Learning Research, 9, 627-650. Software available at http://www.csie.ntu.edu.tw/ ~cjlin/liblinear.
43. Liu, X.-Y., Wu, J., & Zhou, Z.-H. (2006). Exploratory under-sampling for class-imbalance learning. In ICDM '06: Proceedings of the Sixth International Conference on Data Mining, Hong Kong, China (pp. 965-969). IEEE.
44. Maclin, R., & Opitz, D. (1997). An empirical evaluation of bagging and boosting. In Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI), Providence, RI (pp. 546-551). Cambridge, MA: AAAI Press.
45. Manduchi, R., Castano, A., Talukder, A., & Matthies, L. (2005). Obstacle detection and terrain classification for autonomous off-road navigation. Autonomous Robots, 18(1), 81-102.
46. Matthies, L., Litwin, T., Owens, K., Rankin, A., Murphy, K., Coombs, D., Gilsinn, J., Hong, T., Legowik, S., Nashman, M., & Yoshimi, B. (1998). Performance evaluation of UGV obstacle detection with CCD/FLIR stereo vision and LADAR. In Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC), Gaithersburg, MD (pp. 658-670). IEEE.
47. Minka, T. P. (2001). Algorithms for maximum-likelihood logistic regression (Tech. Rep. 758). Pittsburgh, PA: Department of Statistics, Carnegie Mellon University.
48. Nishida, K., Yamauchi, K., & Omori, T. (2005). ACE: Adaptive classifiers-ensemble system for concept-drifting environments. In Multiple Classifier Systems (MCS '05), Seaside, CA (pp. 176-185). Berlin: Springer.
49. Opitz, D., & Maclin, R. (1999). Popular ensemble methods: An empirical study. Journal of Artificial Intelligence Research, 11, 169-198.
50. Platt, J. (2000). Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In Advances in large margin classifiers (pp. 61-74). Cambridge, MA: MIT Press.
51. Pomerleau, D. (1989). ALVINN: An autonomous land vehicle in a neural network. In Advances in neural information processing systems 1. San Francisco, CA: Morgan Kaufmann.
52. Procopio, M. J. (2007a). An experimental analysis of classifier ensembles for learning drifting concepts over time in autonomous outdoor robot navigation. Ph.D. thesis, Department of Computer Science, University of Colorado at Boulder. Available at http:// ml.cs.colorado.edu/~procopio/phdthesis/.
53. Procopio, M. J. (2007b). Hand-labeled DARPA LAGR data sets. Available at http://ml.cs.colorado.edu/~procopio/labeledlagrdata/.
54. Procopio, M. J., Mulligan, J., & Grudic, G. (2007). Long-term learning using multiple models for outdoor autonomous robot navigation. In IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA (pp. 3158-3165). IEEE.
55. Procopio, M. J., Mulligan, J., & Grudic, G. (2008). Learning in dynamic environments with Ensemble Selection for autonomous outdoor robot navigation. In IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France (pp. 620-627). IEEE.
56. Procopio, M. J., Strohmann, T., Bates, A. R., Grudic, G., & Mulligan, J. (2007). Using binary classifiers to augment stereo vision for enhanced autonomous robot navigation (Tech. Rep. CU-CS-1027-07). Boulder: University of Colorado.
57. Schapire, R. (2002). The boosting approach to machine learning: An overview. In MSRI Workshop on Nonlinear Estimation and Classification, Berkeley, CA.
58. Seo, Y.-W., & Urmson, C. (2008). A perception mechanism for supporting autonomous intersection handling in urban driving. In Proceedings of IEEE International Conference Intelligent Robots and Systems, Nice, France (pp. 1830-1835). IEEE.
59. Singh, S., & Digney, B. (1999). Autonomous cross-country navigation using stereo vision (Tech. Rep. CMU-RITR-99-03). Pittsburgh, PA: Robotics Institute, Carnegie Mellon University.
60. Sofman, B., Lin, E., Bagnell, J., Vandapel, N., & Stentz, A. (2006). Improving robot navigation through self-supervised online learning. In Proceedings of Robotics: Science and Systems, Philadelphia, PA. Cambridge, MA: MIT Press.
61. Stockman, G., & Shapiro, L. G. (2001). Computer vision. Upper Saddle River, NJ: Prentice Hall.
62. Street, W. N., & Kim, Y. (2001). A streaming ensemble algorithm (SEA) for large-scale classification. In KDD '01: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 377-382).
63. Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., Lau, K., Oakley, C., Palatucci, M., Pratt, V., Stang, P., Strohband, S., Dupont, C., Jendrossek, L. E., Koelen, C., Markey, C., Rummel, C., van Niekerk, J., Jensen, E., Alessandrini, P., Bradski, G., Davies, B., Ettinger, S., Kaehler, A., Nefian, A., & Mahoney, P. (2006). Stanley: The robot that won the DARPA Grand Challenge. Journal of Field Robotics, 23, 661-692.
64. Tsymbal, A. (2004). The problem of concept drift: definitions and related work (Tech. Rep. TCD-CS-2004-15). Dublin, Ireland: Computer Science Department, Trinity College.
65. Turk, M., Morgenthaler, D., Gremban, K., & Marra, M. (1988). VITS - A vision system for autonomous land vehicle navigation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(3), 342-361.
66. Vapnik, V. (1995). The nature of statistical learning theory. New York: Springer.
67. Wallace, R., Matsuzaki, K., Crisman, J., Goto, Y., Webb, J., & Kanade, T. (1986). Progress in robot road-following. In Proceedings of 1986 IEEE International Conference on Robotics and Automation, San Francisco, CA (vol. 3, pp. 1615-1621). IEEE.
68. Wang, H., Fan, W., Yu, P. S., & Han, J. (2003). Mining concept-drifting data streams using ensemble classifiers. In KDD '03: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 226-235). New York: ACM Press.
69. Widmer, G., & Kubat, M. (1996). Learning in the presence of concept drift and hidden contexts. Machine Learning, 23(1), 69-101.
70. Wolpert, D. H. (1992). Stacked generalization. Neural Networks, 5(2), 241-259.