Performance of correspondence algorithms in vision-based driver assistance using an online image sequence database

IEEE Transactions on Vehicular Technology

Volumn 60, Issue 5, 2011, Pages 2012-2026

  Klette, Reinhard ^a   Krüger, Norbert ^b   Vaudrey, Tobi ^a   Pauwels, Karl ^c   Van Hulle, Marc ^c   Morales, Sandino ^a   Kandil, Farid I ^d   Haeusler, Ralf ^a   Pugeault, Nicolas ^e   Rabe, Clemens ^f   Lappe, Markus ^d  

^a UNIVERSITY OF AUCKLAND   (New Zealand)

^b UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^c KU LEUVEN UNIVERSITY OF LEUVEN   (Belgium)

^d UNIVERSITY OF MÜNSTER   (Germany)

^e UNIVERSITY OF SURREY   (United Kingdom)

^f DAIMLER AG   (Germany)

Author keywords

Basic sequences; ground truth; motion analysis; optical flow; performance evaluation; situations; stereo analysis; video data; vision based driver assistance

Indexed keywords

BASIC SEQUENCES; GROUND TRUTH; MOTION ANALYSIS; PERFORMANCE EVALUATION; SITUATIONS; STEREO ANALYSIS; VIDEO DATA; VISION BASED;

ALGORITHMS; AUTOMOBILE DRIVERS; OPTICAL FLOWS; OPTICAL RECORDING; VIDEO RECORDING;

STEREO VISION;

EID: 79959208700     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVT.2011.2148134     Document Type: Article

References (53)

1. A. Briassouli and I. Kompatsiaris, "Change detection for temporal texture in the Fourier domain," in Proc. ACCV, 2010, vol. LNCS, pp. 149-160.
2. S. Baker, S. Scharstein, J. P. Lewis, S. Roth, M. J. Black, and R. Szelisky, "A database and evaluation methodology for optical flow," in Proc. IEEE Int. Conf. Comput. Vis., 2007, pp. 1-8.
3. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, Feb. 1994.
4. Basler Vision Technologies. [Online]. Available: http://www.baslerweb. com/
5. E. Baseski, L. Baunegaard, N. Pugeault, F. Pilz, K. Pauwels, M. M. Van Hulle, F. Wörgötter, and N. Krüger, "Road interpretation for driver assistance based on an early cognitive vision system," in Proc. VISAPP, 2009, vol. 1, pp. 496-505.
6. A. Bellmann, O. Hellwich, V. Rodehorst, and U. Yilmaz, "A benchmarking dataset for performance evaluation of automatic surface reconstruction algorithms," in Proc. BenCOS, 2007, pp. 1-8.
7. S. Birchfield and C. Tomasi, "Depth discontinuities by pixel-to-pixel stereo," Int. J. Comput. Vis., vol. 35, no. 3, pp. 269-293, Dec. 1999. (Pubitemid 32210845)
8. T. Brox, A. Bruhn, N. Papenberg, and J.Weickert, "High-accuracy optical flow estimation based on a theory for warping," in Proc. ECCV, vol. 3024, LNCS, 2004, pp. 25-36.
9. A. Bruhn, J. Weickert, and C. Schnörr, "Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods," Int. J. Comput. Vis., vol. 61, no. 3, pp. 211-231, Feb./Mar. 2005.
10. Carnegie Mellon Univ. Image Data Base. [Online]. Available: http://vasc.ri.cmu.edu/idb/html/stereo/
11. R. M. Dudley, "Probabilities and metrics: Convergence of laws on metric spaces, with a view to statistical testing," Matematisk Inst., Aarhus Univ., Aarhus, Denmark, Lecture notes series, Rep. 45, 1976.
12. .enpeda.. Image Sequence Analysis Test Site (EISATS). [Online]. Available: http://www.mi.auckland.ac.nz/EISATS/
13. J. H. Fecteau and D. P. Munoz, "Salience, relevance, and firing: A priority map for target selection," Trends Cogn. Sci., vol. 10, no. 8, pp. 382-390, Aug. 2006. (Pubitemid 44093330)
14. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient belief propagation for early vision," Int. J. Comput. Vis., vol. 70, no. 1, pp. 41-54, Oct. 2006. (Pubitemid 43855866)
15. D. Gavrilla, Daimler pedestrian benchmark data set, 2009, follow "Looking at people". [Online]. Available: http://www.gavrila.net/ Research/research.html
16. S. Guan, R. Klette, and Y. W. Woo, "Belief propagation for stereo analysis of night-vision sequences," in Proc. PSIVT, vol. 5414, LNCS, 2009, pp. 932-943.
17. P. Handschack and R. Klette, "Quantitative comparisons of differential methods for measuring of image velocity," in Proc. Aspects Visual Form Process., Capri, Italy, 1994, pp. 241-250.
18. R. Hartley and A. Zisserman, Multiple-View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, 2000.
19. R. Haeusler and R. Klette, "Benchmarking stereo data (not the matching algorithms)," in Proc. DAGM, 2010, pp. 383-392.
20. S. Hermann and R. Klette, "The naked truth about cost functions for stereo matching," Univ. Auckland, Auckland, New Zealand, MI-tech-TR 33, 2009.
21. H. Hirschmüller, "Accurate and efficient stereo processing by semiglobal matching and mutual information," in Proc. CVPR, 2005, vol. 2, pp. 807-814.
22. H. Hirschmüller and D. Scharstein, "Evaluation of stereo matching costs on images with radiometric differences," IEEE Trans. Pattern Anal.Mach. Intell., vol. 31, no. 9, pp. 1582-1599, Sep. 2009.
23. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
24. F. I. Kandil, A. Rotter, and M. Lappe, "Driving is smoother and more stable when using the tangent point," J. Vis., vol. 9, no. 1, pp. 11:1-11:11, 2009.
25. F. I. Kandil, A. Rotter, and M. Lappe, "Car drivers attend to different gaze targets when negotiating closed versus open curves," J. Vis., vol. 10, no. 4, pp. 24:1-24:11, 2010.
26. R. Klette and A. Rosenfeld, Digital Geometry-Geometric Algorithms for Digital Picture Analysis. San Francisco, CA: Morgan Kaufmann, 2004.
27. R. Klette, S. Sandino, T. Vaudrey, J. Morris, C. Rabe, and R. Haeusler, "Stereo and motion analysis of long stereo image sequences for vision-based driver assistance," in Proc. DAGM, Jena, Germany, Sep. 9, 2009.
28. V. Kolmogorov and R. Zabih, "What energy functions can be minimized via graph cuts?" IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 2, pp. 147-159, Feb. 2004.
29. M. F. Land and D. N. Lee, "Where we look when we steer," Nature, vol. 369, no. 6483, pp. 742-744, Jun. 1994. (Pubitemid 24225362)
30. Z. Liu and R. Klette, "Dynamic programming stereo on real-world sequences," in Proc. ICONIP, vol. 5506, LNCS, 2008, pp. 527-534.
31. Z. Liu and R. Klette, "Approximated ground truth for stereo and motion analysis on real-world sequences," in Proc. PSIVT, vol. 5414, LNCS, 2009, pp. 874-885.
32. B. McCane, K. Novins, D. Crannitch, and B. Galvin, "On benchmarking optical flow," Comput. Vis. Image Understand., vol. 84, no. 1, pp. 126- 143, Oct. 2001. (Pubitemid 34220912)
33. Middlebury Vision Evaluation. [Online]. Available: http://vision. middlebury.edu/
34. T. Mimuro, Y. Miichi, T. Maemura, and K. Hayafune, "Functions and devices of Mitsubishi active safety ASV," in Proc. IEEE Intell. Vehicles, 1996, pp. 248-253.
35. R. Mohan, G. Medioni, and R. Nevatia, "Stereo error detection, correction, and evaluation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 2, pp. 113-120, Feb. 1989.
36. S. Morales and R. Klette, "A third eye for performance evaluation in stereo sequence analysis," in Proc. CAIP, vol. 5702, LNCS, 2009, pp. 1078- 1086.
37. S. Morales, T. Vaudrey, and R. Klette, "Robustness evaluation of stereo algorithms on long stereo sequences," in Proc. IEEE Intell. Vehicles, 2009, pp. 347-352.
38. S. Morales, Y. W. Woo, R. Klette, and T. Vaudrey, "A study on stereo and motion data accuracy for a moving platform," in Proc. FIRA RoboWorld Congr., vol. 5744, LNCS, 2009, pp. 292-300.
39. Y. Ohta and T. Kanade, "Stereo by two-level dynamic programming," in Proc. IJCAI, 1985, pp. 1120-1126.
40. K. Pauwels, "Computational modeling of visual attention: Neuronal response modulation in the Thalamocortical complex and saliency-based detection of independent motion," Ph.D. dissertation, Katholieke Univ. Leuven, Leuven, Belgium, 2008.
41. Point Grey. [Online]. Available: http://www.ptgrey.com/
42. N. Pugeault, K. Pauwels, F. Pilz, M. M. Van Hulle, and N. Krüger, "A three-level architecture for model-free detection and tracking of independently moving objects," in Proc. Int. Conf. Comput. Vis. Theory Appl., 2010, pp. 237-244.
43. Q. Ji, Z. Zhu, and P. Lan, "Real-time nonintrusive monitoring and prediction of driver fatigue," IEEE Trans. Veh. Technol., vol. 53, no. 4, pp. 1052-1068, Jul. 2004.
44. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense twoframe stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, no. 1-3, pp. 7-42, Apr.-Jun. 2002. (Pubitemid 34428419)
45. R. Szeliski, "Prediction error as a quality metric for motion and stereo," in Proc. ICCV, 1999, vol. 2, pp. 781-788. (Pubitemid 32079945)
46. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007. (Pubitemid 46421678)
47. N. A. Thacker, A. F. Clark, J. L. Barronc, J. R. Beveridged, P. Courtneye, W. R. Crum, V. Ramesh, and C. Clark, "Performance characterization in computer vision: A guide to best practices," Comput. Vis. Image Understand., vol. 109, no. 3, pp. 305-334, Mar. 2008. (Pubitemid 351226622)
48. T. Vaudrey, C. Rabe, R. Klette, and J. Milburn, "Differences between stereo and motion behavior on synthetic and real-world stereo sequences," in Proc. Int. Conf. Image Vis. Comput. New Zealand, 2008, pp. 1-6.
49. T. Vaudrey, A. Wedel, and R. Klette, "A methodology for evaluating illumination artifact removal for corresponding images," in Proc. CAIP, vol. 5702, LNCS, 2009, pp. 1113-1121.
50. 1 optical flow," in Statistical and Geometrical Approaches to Visual Motion Analysis, D. Cremers, B. Rosenhahn, A. L. Yuille, and F. R. Schmidt, Eds. Berlin, Germany: Springer-Verlag, 2009, pp. 23-45.
51. A. Wedel, C. Rabe, T. Vaudrey, T. Brox, U. Franke, and D. Cremers, "Efficient dense scene flow from sparse or dense stereo data," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 739-751.
52. X. Yang and R. Klette, "Approximate ground truth in the real world for testing optical flow algorithms," in Proc. IEEE ICETCE, 2011, pp. 6475- 6478.
53. 1 optical flow," in Proc. Pattern Recogn.-DAGM, 2007, pp. 214-223.