Task-specific performance evaluation of UGVs: Case studies at the IVFC

IEEE Transactions on Intelligent Transportation Systems

Volumn 15, Issue 5, 2014, Pages 1969-1979

  Huang, Wuling ^a   Wen, Ding ^b   Geng, Jason ^a   Zheng, Nan Ning ^c  

^a INSTITUTE OF AUTOMATION   (China)

^b NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^c XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Autonomy levels; comprehensive evaluation methods; driving tasks analysis; performance evaluation; Unmanned ground vehicle (UGV)

Indexed keywords

AUTONOMY LEVELS; COMPREHENSIVE EVALUATION; DRIVING TASKS; PERFORMANCE EVALUATION; UNMANNED GROUND VEHICLES;

EID: 84907658012     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2014.2308540     Document Type: Article

References (47)

1. [Online]. Available: http://en.wikipedia.org/wiki/DARPA-Grand-Challenge
2. The European Robot Trial. [Online]. Available: http://www.elrob.org/
3. European research project, Testing and Evaluation Methods for ICTbased Safety Systems (eVALUE). [Online]. Available: http://www.evalue-project.eu/
4. Grand Cooperative Driving Challenge (GCDC). [Online]. Available: http://www.gcdc.net/
5. R. Andrews, R. Mah, and L. Da Silva, "The NASA smart probe project for real-time multiple-microsensor tissue recognition," in Proc. SPIE 5326, Optical Biopsy V, Jul. 13, 2004, p. 92.
6. J. Markoff, Google Cars Drive Themselves, in Traffc, Oct. 9, 2010.
7. H. Huang, Ed., Autonomy Levels for Unmanned Systems Framework, Volume I: Terminology, Version 1.1. Gaithersburg, MD, USA: NIST Special Publication 1011, Nat. Inst. Std. Technol., Sep. 2004.
8. F. Saust, J. Wille, B. Lichte, and M. Maurer, "Autonomous vehicle guidance on Braunschweig's inner ring road within the Stadtpilot project," in Proc. IEEE Intell. Veh. Symp., 2011, pp. 169-174.
9. M. Bertozzi, L. Bombini, A. Broggi,M. Buzzoni, E. Cardarelli, S. Cattani, P. Cerri, A. Coati, S. Debattisti, A. Falzoni, R. I. Fedriga, M. Felisa, L. Gatti, A. Giacomazzo, P. Grisleri, M. C. Laghi, L. Mazzei, P. Medici, M. Panciroli, P. P. Porta, P. Zani, and P. Versari, "VIAC: An out of ordinary experiment," in Proc. IEEE Intell. Veh. Symp., 2011, pp. 175-180.
10. F.-Y. Wang, "Agent-based control strategies for smart and safe vehicles," in Proc. IEEE Int. Conf. Veh. Electron. Safety, Oct. 14-16, 2005, pp. 331-332.
11. F. Qu, F.-Y. Wang, and L. Yang, "Intelligent transportation spaces: Vehicles, traffic, communications, and beyond," IEEE Commun. Mag., vol. 48, no. 11, pp. 136-142, Nov. 2010.
12. F.-Y. Wang, "Parallel control and management for intelligent transportation systems: Concepts, architectures, and applications," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 3, pp. 630-638, Sep. 2010.
13. F.-Y. Wang, X. Wang, L. Li, P. Mirchandani, and Z. Wang, "Digital and construction of a digital vehicle proving ground," in Proc. IEEE Intell. Veh. Symp., Jun. 9-11, 2003, pp. 533-536.
14. F.-Y. Wang, "Parallel system methods for management and control of complex systems," Control Decision, vol. 19, no. 5, pp. 485-489, 2004.
15. M. Montemerlo, J. Becker, S. Bhat, H. Dahlkamp, D. Dolgov, S. Ettinger, D. Haehnel, T. Hilden, G. Hoffmann, B. Huhnke, D. Johnston, S. Klumpp, D. Langer, A. Levandowski, J. Levinson, J. Marcil, D. Orenstein, J. Paefgen, I. Penny, A. Petrovskaya, M. Pflueger, G. Stanek, D. Stavens, A. Vogt, and S. Thrun, "Junior: The Stanford entry in the urban challenge," J. Field Robot., vol. 25, no. 9, pp. 569-597, Sep. 2008.
16. S. Thrun, M. Montemerlo, H. Dahlkamp, D. Stavens, A. Aron, J. Diebel, P. Fong, J. Gale, M. Halpenny, G. Hoffmann, K. Lau, C. Oakley, M. Palatucci, V. Pratt, P. Stang, S. Strohband, C. Dupont, L. E. Jendrossek, C. Koelen, C. Markey, C. Rummel, J. van Nieker, E. Jensen, P. Alessandrini, G. Bradski, B. Davies, S. Ettinger, A. Kaehler, A. Nefian, and P. Mahoney, "Stanley: The robot that won the DARPA grand challenge: Research articles," J. Robot. Syst., vol. 23, no. 9, pp. 661-692, Sep. 2006.
17. J. Levinson, J. Askeland, J. Becker, J. Dolson, D. Held, S. Kammel, J. Z. Kolter, D. Langer, O. Pink, V. Pratt, M. Sokolsky, G. Stanek, D. Stavens, A. Teichman, M. Werling, and S. Thrun, "Towards fully autonomous driving: Systems and algorithms," in Proc. IEEE IV Symp., Jun. 5-9, 2011, pp. 163-168.
18. B. Touchton, T. Galluzzo, D. Kent, and C. Crane, "Perception and planning architecture for autonomous ground vehicles," Computer, vol. 39, no. 12, pp. 40-47, Dec. 2006.
19. G. Stanek, D. Langer, B. Müller-Bessler, and B. Huhnke, "Junior 3: A test platform for advanced driver assistance systems," in Proc. IEEE IV Symp., Jun. 21-24, 2010, pp. 143-149.
20. C. Urmson, J. Anhalt, D. Bagnell, C. Baker, R. Bittner, M. N. Clark, J. Dolan, D. Duggins, T. Galatali, C. Geyer, M. Gittleman, S. Harbaugh, M. Hebert, T. M. Howard, S. Kolski, A. Kelly, M. Likhachev, M. McNaughton, N. Miller, K. Peterson, B. Pilnick, R. Rajkumar, P. Rybski, B. Salesky, Y.-W. Seo, S. Singh, J. Snider, A. Stentz, W. Whittaker, Z.Wolkowicki, and J. Ziglar, "Autonomous driving in urban environments: Boss and the urban challenge," J. Field Robot., vol. 25, no. 8, pp. 425-466, Aug. 2008.
21. T. J. Alberi, "A proposed standardized testing procedure for autonomous ground vehicles," M.S. thesis, Virginia Polytechnic Inst. State Univ., Blacksburg, VA, USA, 2008.
22. C. Schlenoff, R. Madhavan, and S. Balakirsky, "Representing dynamic environments for autonomous ground vehicle navigation," in Proc. IEEE/RSJ Int. Conf. IROS, Oct. 27-31, 2003, vol. 1, pp. 644-649.
23. F. von Hundelshausen, M. Himmelsbach, F. Hecker, A. Mueller, and H.-J. Wuensche, "Driving with tentacles: Integral structures for sensing and motion," J. Field Robot., vol. 25, no. 9, pp. 640-673, Sep. 2008.
24. M. Perrollaz, A. Spalanzani, and D. Aubert, "Probabilistic representation of the uncertainty of stereo-vision and application to obstacle detection," in Proc. IEEE IV Symp., Jun. 21-24, 2010, pp. 313-318.
25. F. Maurelli, D. Droeschel, T. Wisspeintner, S. May, and H. Surmann, "A 3-D laser scanner system for autonomous vehicle navigation," in Proc. ICAR, Jun. 22-26, 2009, pp. 1-6.
26. W. Zhang, "LIDAR-based road and road-edge detection," in Proc. IEEE IV Symp., Jun. 21-24, 2010, pp. 845-848.
27. P. Falcone, F. Borrelli, H. E. Tseng, J. Asgari, and D. Hrovat, "A hierarchical model predictive control framework for autonomous ground vehicles," in Proc. Amer. Control Conf., Jun. 11-13, 2008, pp. 3719-3724.
28. P. Nordin, L. Andersson, and J. Nygards, "Sensor data fusion for terrain exploration by collaborating unmanned ground vehicles," in Proc. 11th Int. Conf. Inf. Fusion, Jun. 30-Jul. 3, 2008, pp. 1-8.
29. M. Felisa and P. Zani, "Robust monocular lane detection in urban environments," in Proc. IEEE IV Symp., Jun. 21-24, 2010, pp. 591-596.
30. M.-Y. Fu and Y.-S. Huang, "A survey of traffic sign recognition," in Proc. ICWAPR, Jul. 11-14, 2010, pp. 119-124.
31. Q. Li, N. Zheng, and H. Cheng, "Springrobot: A prototype autonomous vehicle and its algorithms for lane detection," IEEE Trans. Intell. Transp. Syst., vol. 5, no. 4, pp. 300-308, Dec. 2004.
32. P. Moghadam, W. S. Wijesoma, and M. D. P. Moratuwage, "Towards a fully-autonomous vision-based vehicle navigation system in outdoor environments," in Proc. 11th ICARCV, Dec. 7-10, 2010, pp. 597-602.
33. M. Perrollaz, J. Yoder, and C. Laugier, "Using obstacles and road pixels in the disparity-space computation of stereo-vision based occupancy grids," in Proc. 13th Int. IEEE ITSC, Sep. 19-22, 2010, pp. 1147-1152.
34. F.-Y. Wang, P. B. Mirchandani, and Z. Wang, "The VISTA project and its applications," IEEE Intell. Syst., vol. 17, no. 6, pp. 72-75, Nov./Dec. 2002.
35. M. Joerger and B. Pervan, "Autonomous ground vehicle navigation using integrated GPS and laser-scanner measurements," in Proc. IEEE/ION Position, Location, Navig. Symp., Apr. 25-27, 2006, pp. 988-997.
36. B. Geiger and G. Kubin, "Relative information loss in the PCA," in Proc. IEEE Inf. Theory Workshop, Sep. 2012, pp. 562-566.
37. C. L. Hwang, Y. J. Lai, and T. Y. Liu, "A new approach for multiple objective decision making," Comput. Oper. Res., vol. 20, no. 8, pp. 889-899, Oct. 1993.
38. T. Toledo, H. N. Koutsopoulos, and M. Ben-Akiva, "Integrated driving behavior modeling," Transp. Res. Part C, Emerg. Technol., vol. 15, no. 2, pp. 96-112, Apr. 2007.
39. S. Balakirsky and A. Lacaze, "World modeling and behavior generation for autonomous ground vehicle," in Proc. IEEE ICRA, 2000, vol. 2, pp. 1201-1206.
40. S. Thrun and C. Urmson, "Self-driving cars," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., San Francisco, CA, USA, Sep. 2011, keynote talk.
41. T. L. Saaty, The Analytical Hierarchy Process: Planning, Priority Setting, Resource Allocation. Pittsburgh, PA, USA: RWS Publ., 1990.
42. H. J. Zimmermann, Fuzzy Sets, Decision Making, and Expert Systems. Boston, MA, USA: Kluwer, 1987.
43. L.-F. Shi, "Entropy based fuzzy comprehensive evaluation of university teachers," in Proc. 1st Int. Conf. PCSPA, Sep. 17-19, 2010, pp. 475-478.
44. L. Li, D. Wen, N.-N. Zheng, and L.-C. Shen, "Cognitive cars: A new frontier for ADAS research," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 1, pp. 395-407, Mar. 2012.
45. Q. Li, N. Zheng, and H. Cheng, "Lane boundary detection using an adaptive randomized Hough transform," in Proc. 5th WCICA, Jun. 15-19, 2004, vol. 5, pp. 4084-4088.
46. X. Zhang, N. Zheng, Y. He, and F. Wang, "Vehicle detection using an extended hidden Random field model," in Proc. 14th Int. IEEE ITSC, Oct. 5-7, 2011, pp. 1555-1559.
47. H. Cheng, N. Zheng, X. Zhang, J. Qin, and H. Van de Wetering, "Interactive road situation analysis for driver assistance and safety warning systems: Framework and algorithms," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 1, pp. 157-167, Mar. 2007.