Estimating object proper motion using optical flow, kinematics, and depth information

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 38, Issue 4, 2008, Pages 1139-1151

  Schmüdderich, Jens ^a   Willert, Volker ^b   Eggert, Julian ^b   Rebhan, Sven ^b   Goerick, Christian ^b   Sagerer, Gerhard ^a   Körner, Edgar ^b  

^a BIELEFELD UNIVERSITY   (Germany)

^b HONDA RESEARCH INSTITUTE EUROPE GMBH   (Germany)

Author keywords

Disparity; Egomotion (EM); Kinematics; Motion; Optical flow (OF)

Indexed keywords

CAMERAS; ESTIMATION; IMAGE ENHANCEMENT; KINEMATICS; MATHEMATICAL PROGRAMMING; MECHANICS; OPTICAL FLOWS; REINFORCEMENT; REINFORCEMENT LEARNING; ROBOTICS; SYSTEMS ENGINEERING; UNCERTAINTY ANALYSIS;

CAMERA IMAGES; CAMERA MOVEMENTS; DEPTH INFORMATION; DISPARITY; DYNAMIC ENVIRONMENTS; EGOMOTION (EM); FILTERING METHODS; HUMANOID ROBOT; MEASUREMENT PROCESSES; MOTION; MOVING OBJECTS; OBJECT MOTIONS; OPTICAL FLOW (OF); OPTICAL-FLOW; PRIOR KNOWLEDGE; PROPER MOTIONS; REAL-WORLD SCENARIOS; ROBOT KINEMATICS; STEREO CAMERAS;

ROBOTS;

ALGORITHM; ARTICLE; BIOMECHANICS; COMPUTER SIMULATION; FLOW KINETICS; METHODOLOGY; MOTION; ROBOTICS; THEORETICAL MODEL;

ALGORITHMS; BIOMECHANICS; COMPUTER SIMULATION; MODELS, THEORETICAL; MOTION; RHEOLOGY; ROBOTICS;

EID: 49049094851     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.925657     Document Type: Article

References (34)

1. J. Wolfe and T. Horowitz, "What attributes guide the deployment of visual attention and how do they do it?" Nat. Rev. Neurosci., vol. 5, no. 6, pp. 495-501, Jun. 2004.
2. W. H.Warren, B. A. Kay,W. D. Zosh, A. P. Duchon, and S. Sahuc, "Optic flow is used to control human walking," Nat. Neurosci., vol. 4, no. 2, pp. 213-216, Feb. 2001.
3. T. Albright, "Cortical processing of visual motion," in Visual Motion and its Use in the Stabilization of Gaze, J. Wallman and F. Miles, Eds. New York: Elsevier, 1993, ch. 9, pp. 177-201.
4. T. Tian, C. Tomasi, and D. Heeger, "Comparison of approaches to ego-motion computation," in Proc. IEEE CS Conf. CVPR, Jun. 18-20, 1996, pp. 315-320.
5. T. Zhang and C. Tomasi, "On the consistency of instantaneous rigid motion estimation," Int. J. Comput. Vision, vol. 46, no. 1, pp. 51-79, Jan. 2002.
6. M. A. Lewis, "Detecting surface features during locomotion using optic flow," in Proc. IEEE Int. Conf. Robotics Automation, 2002, vol. 1, pp. 305-310.
7. P. Fidelman, T. Coffman, and R. Miikkulainen, "Detecting motion in the environment with a moving quadruped robot," in RoboCup-2006: Robot Soccer World Cup X, vol. 4434, G. Lakemeyer, E. Sklar, D. Sorenti, and T. Takahashi, Eds. Berlin, Germany: Springer Verlag, 2007, pp. 219-231.
8. D. Comaniciu and B. Xie, "Real-time obstacle detection with a calibrated camera and known ego-motion," U.S. Patent 20 040 183 905, Sep. 23, 2004. to Siemens Corp, Tech. Rep. February, 2004. www.freepatentsonline.com/20040183905.html
9. J. R. del Solar and P. A. Vallejos, "Motion detection and tracking for an AIBO robot using camera motion compensation and Kalman filtering," in RoboCup 2004: Robot Soccer World Cup VIII, vol. 3276, D. Nardi, M. Riedmiller, C. Sammut, and J. Santos-Victor, Eds. Berlin, Germany: Springer-Verlag, Mar. 2005, pp. 619-627.
10. P. Fidelman, T. Coffman, R. Miikkulainen, and P. Stone, "Detecting motion in the world with a moving quadruped robot," Dept. Comput. Sci., Univ. Texas, Austin, TX, Tech. Rep. TR-05-37, 2005.
11. G. Overett and D. Austin, "Stereo vision motion detection from a moving platform," in Proc. Australas. Conf. Robot. Autom., Dec. 2004, pp. 1-11.
12. B. Fardi, I. Seifert, G. Wanielik, and J. Gayko, "Motion-based pedestrian recognition from a moving vehicle," in Proc. IEEE Symp. Intell. Veh., Jun. 2006, pp. 219-224.
13. C. Rabe, U. Franke, and S. Gehrig, "Fast detection of moving objects in complex scenarios," in Proc. IEEE Symp. Intell. Veh., Jun. 2007, pp. 398-403.
14. J. H. Maunsell and D. C. Van Essen, "Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity," J. Neurophysiol., vol. 49, no. 5, pp. 1148-1167, May 1983.
15. K. Tanaka, K. Hikosaka, H. Saito, M. Yukie, Y. Fukada, and E. Iwai, "Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey," J. Neurosci., vol. 6, no. 1, pp. 134-144, Jan. 1986.
16. K. Tanaka, Y. Fukada, and H. A. Saito, "Underlying mechanisms of the response specificity of expansion/contraction and rotation cells in the dorsal part of the medial superior temporal area of the macaque monkey," J. Neurophysiol., vol. 62, no. 3, pp. 642-656, Sep. 1989.
17. C. J. Duffy and R. H. Wurtz, "Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli," J. Neurophysiol., vol. 65, no. 6, pp. 1329-1345, Jun. 1991.
18. C. J. Duffy and R. H. Wurtz, "Response of monkey MST neurons to optic flow stimuli with shifted centers of motion," J. Neurosci., vol. 15, no. 7, pp. 5192-5208, Jul. 1995.
19. J. P. Roy and R. H. Wurtz, "The role of disparity-sensitive cortical neurons in signalling the direction of self-motion," J. Nature, vol. 348, no. 6297, pp. 160-162.
20. L. R. Harris, M. Jenkin, and D. C. Zikovitz, "Visual and non-visual cues in the perception of linear self-motion," Exp. Brain Res., vol. 135, no. 1, pp. 12-21, Nov. 2000.
21. Y. Gu, P. V. Watkins, D. E. Angelaki, and G. C. DeAngelis, "Visual and nonvisual contributions to three-dimensional heading selectivity in the medial superior temporal area," J. Neurosci., vol. 26, no. 1, pp. 73-85, Jan. 2006.
22. C. R. Fetsch, S. Wang, Y. Gu, G. C. Deangelis, and D. E. Angelaki, "Spatial reference frames of visual, vestibular, and multimodal heading signals in the dorsal subdivision of the medial superior temporal area," J. Neurosci., vol. 27, no. 3, pp. 700-712, Jan. 2007.
23. C. J. Duffy, "MST neurons respond to optic flow and translational movement," J. Neurophysiol., vol. 80, no. 4, pp. 1816-1827, Oct. 1998.
24. F. Bremmer, M. Kubischik, M. Pekel, M. Lappe, and K. P. Hoffmann, "Linear vestibular self-motion signals in monkey medial superior temporal area," Ann. N.Y Acad. Sci., vol. 871, pp. 272-281, May 1999.
25. W. K. Page and C. J. Duffy, "MST neuronal responses to heading direction during pursuit eye movements," J. Neurophysiol., vol. 81, no. 2, pp. 596-610, Feb. 1999.
26. H. Komatsu and R. H. Wurtz, "Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons," J. Neurophysiol., vol. 60, no. 2, pp. 580-603, Aug. 1988.
27. F. Bremmer, A. Pouget, and K. P. Hoffmann, "Eye position encoding in the macaque posterior parietal cortex," Eur. J. Neurosci., vol. 10, no. 1, pp. 153-160, Jan. 1998.
28. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint Cambridge, MA: MIT Press, 1999.
29. M. U. Gienger, H. Janssen, and C. Goerick, "Task-oriented whole body motion for humanoid robots," in Proc. 5th IEEE-RAS Int. Conf. Humanoid Robots. Tsukuba, Japan: IEEE Press, 2005, pp. 238-244.
30. J. J. Craig, Introduction to Robotics: Mechanics and Control. Boston, M.A.: Addison-Wesley, 1989.
31. K. Konolige, "Small vision system: Hardware and implementation," in Proc. 8th. Int. Symp. Robot. Res., Oct. 1997, pp. 111-116.
32. B. Jähne, Digital Image Processing, 6th ed. New York: Springer-Verlag, 2005.
33. V. Willert, J. Eggert, J. Adamy, and E. Koerner, "Non-Gaussian velocity distributions integrated over space, time and scales," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 3, pp. 482-493, Jun. 2006.
34. Honda, The Honda Humanoid Robots, 2001. [Online]. Available: http://www.honda-robots.com