Pose estimation through cue integration: A neuroscience-inspired approach

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 42, Issue 2, 2012, Pages 530-538

  Chinellato, Eris ^a   Grzyb, Beata J ^b   Del Pobil, Angel P ^b,c  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITAT JAUME I   (Spain)

^c Sungkyunkwan University   (South Korea)

Author keywords

Biological system modeling; grasping; intelligent robots; robot vision systems; stereo vision

Indexed keywords

BIOLOGICAL SYSTEM MODELING; CUE INTEGRATION; GRASPING; HUMAN STUDY; NEUROPSYCHOLOGICAL; POSE ESTIMATION; ROBOT VISION SYSTEMS; ROBOTIC SYSTEMS; SENSORY SYSTEM; VISUAL ESTIMATION;

COMPUTER SIMULATION; GESTURE RECOGNITION; INTELLIGENT ROBOTS; STEREO VISION;

COMPUTER VISION;

ARTICLE; BIOLOGICAL MODEL; COMPUTER SIMULATION; CYBERNETICS; DEPTH PERCEPTION; HUMAN; IMAGE PROCESSING; METHODOLOGY; PHYSIOLOGY; REPRODUCIBILITY; ROBOTICS; TASK PERFORMANCE;

COMPUTER SIMULATION; CYBERNETICS; DEPTH PERCEPTION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, NEUROLOGICAL; REPRODUCIBILITY OF RESULTS; ROBOTICS; TASK PERFORMANCE AND ANALYSIS;

EID: 84859009717     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2168952     Document Type: Article

References (49)

1. B. T. Backus and M. S. Banks, "Estimator reliability and distance scaling in stereoscopic slant perception," Perception, vol. 28, no. 2, pp. 217-242, 1999.
2. G. J. Brouwer, R. van Ee, and J. Schwarzbach, "Activation in visual cortex correlates with the awareness of stereoscopic depth," J. Neurosci., vol. 25, no. 45, pp. 10 403-10 413, Nov. 2005.
3. U. Castiello and C. Begliomini, "The cortical control of visually guided grasping," Neuroscientist, vol. 14, no. 2, pp. 157-170, Apr. 2008.
4. D. Chetverikov and Z. Szabo, "A simple and efficient algorithm for detection of high curvature points in planar curves," in Proc.Workshop Austrian Pattern Recognit. Group, 1999, pp. 175-184.
5. E. Chinellato, "Visual neuroscience of robotic grasping," Ph.D. dissertation, Universitat Jaume I, Castelló de la Plana, Spain, 2008.
6. E. Chinellato, M. Antonelli, B. J. Grzyb, and A. P. del Pobil, "Implicit sensorimotor mapping of the peripersonal space by gazing and reaching," IEEE Trans. Autonom. Mental Dev., vol. 3, no. 1, pp. 43-53, Mar. 2011.
7. E. Chinellato and A. P. del Pobil, "Distance and orientation estimation of graspable objects in natural and artificial systems," Neurocomputing, vol. 72, no. 4-6, pp. 879-886, Jan. 2009.
8. E. Chinellato, Y. Demiris, and A. P. del Pobil, "Studying the human visual cortex for achieving action-perception coordination with robots," in Artificial Intelligence and Soft Computing, A. P. del Pobil, Ed. Anaheim, CF: Acta Press, 2006, pp. 184-189.
9. J. J. Clark and A. L. Yuille, Data Fusion for Sensory Information Processing Systems. New York: Springer-Verlag, 1990.
10. B. G. Cumming and G. C. DeAngelis, "The physiology of stereopsis," Annu. Rev. Neurosci., vol. 24, pp. 203-238, 2001.
11. S. Ekvall, F. Hoffmann, and D. Kragic, "Object recognition and pose estimation for robotic manipulation using color cooccurrence histograms," in Proc. IEEE Int. Conf. Intell. Robots Syst., Oct. 2003, pp. 1284-1289.
12. N. J. Ferrier, "Determining surface orientation from fixated eye position and angular visual extent," in Proc. IEEE Int. Conf. Robot. Autom., May 1999, pp. 938-943.
13. S. K. Gehrig, H. Badino, and P. Paysan, "Accurate and model-free pose estimation of small objects for crash video analysis," in Proc. Brit. Mach. Vis. Conf., Edinburgh, U.K., Sep. 2006, pp. 1009-1018.
14. A. Genovesio and S. Ferraina, "Integration of retinal disparity and fixation-distance related signals toward an egocentric coding of distance in the posterior parietal cortex of primates," J. Neurophysiol., vol. 91, no. 6, pp. 2670-2684, Jun. 2004.
15. M. Germann, M. D. Breitenstein, I. K. Park, and H. Pfister, "Automatic pose estimation for range images on the GPU," in Proc. Int. Conf. 3-D Digit. Imag. Model., Aug. 2007, pp. 81-90.
16. J. S. Goddard, "Pose and motion estimation using dual quaternion-based extended Kalman filtering," in Proc. SPIE: Three-Dimensional Image Capture Appl., 1998, vol. 3313.
17. H. S. Greenwald, D. C. Knill, and J. A. Saunders, "Integrating visual cues for motor control: A matter of time," Vision Res., vol. 45, no. 15, pp. 1975-1989, Jul. 2005.
18. B. J. Grzyb, E. Chinellato, A.Morales, and A. P. del Pobil, "A 3D grasping system based on multimodal visual and tactile processing," Ind. Robot J., vol. 36, no. 4, pp. 365-369, 2009.
19. M. Hansard and R. Horaud, "Cyclorotation models for eyes and cameras," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 151-161, Feb. 2010.
20. J. M. Hillis, S. J.Watt, M. S. Landy, and M. S. Banks, "Slant from texture and disparity cues: Optimal cue combination," J. Vis., vol. 4, no. 12, pp. 967-992, Dec. 2004.
21. D. G. Jones and J. Malik, "Determining three-dimensional shape from orientation and spatial frequency disparities," in Proc. Eur. Conf. Comput. Vis., 1992, pp. 662-669.
22. B. Julesz, Foundations of Cyclopean Perception. Cambridge, MA: MIT Press, 1971.
23. D. Kragic and H. I. Christensen, "Cue integration for visual servoing," IEEE J. Robot. Autom., vol. 17, no. 1, pp. 18-27, Feb. 2001.
24. M. S. Landy, L. T.Maloney, E. B. Johnston, andM. Young, "Measurement and modeling of depth cue combination: In defense of weak fusion," Vision Res., vol. 35, no. 3, pp. 389-412, Feb. 1995.
25. B. Li, Q. Meng, and H. Holstein, "Articulated pose identification with sparse point features," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 3, pp. 1412-1422, Jun. 2004.
26. V. Lippiello, B. Siciliano, and L. Villani, "Position and orientation estimation based on Kalman filtering of stereo images," in Proc. IEEE Int. Conf. Control Appl., Sep. 2001, pp. 702-707.
27. V. Lippiello, B. Siciliano, and L. Villani, "3D pose estimation for robotic applications based on a multi-camera hybrid visual system," in Proc. IEEE Int. Conf. Robot. Autom., May 2006, pp. 2732-2737.
28. A. Loftus, P. Servos, M. A. Goodale, N. Mendarozqueta, and M. Mon-Williams, "When two eyes are better than one in prehension: Monocular viewing and end-point variance," Exp. Brain Res., vol. 158, no. 3, pp. 317-327, Oct. 2004.
29. D. Marr, Vision: A Computational Investigation Into the Human Representation and Processing of Visual Information. New York:W. H. Freeman, 1982.
30. M. Mon-Williams, J. R. Tresilian, and A. Roberts, "Vergence provides veridical depth perception from horizontal retinal image disparities," Exp. Brain Res., vol. 133, no. 3, pp. 407-413, Aug. 2000.
31. J. F. Norman, J. T. Todd, and F. Phillips, "The perception of surface orientation from multiple sources of optical information," Perceptual Psychophys., vol. 57, no. 5, pp. 629-636, Jul. 1995.
32. G. Peters, "Efficient pose estimation using view-based object representations," Mach. Vis. Appl., vol. 16, no. 1, pp. 59-63, Dec. 2004.
33. G. F. Poggio, F. Gonzalez, and F. Krause, "Stereoscopic mechanisms in monkey visual cortex: Binocular correlation and disparity selectivity," J. Neurosci., vol. 8, no. 12, pp. 4531-4550, Dec. 1988.
34. B. Rosenhahn, C. Perwass, and G. Sommer, "Pose estimation of 3D free-form contours," Int. J. Comput. Vis., vol. 62, no. 3, pp. 267-289, May 2004.
35. B. Rosner, "On the detection of many outliers," Technometrics, vol. 17, no. 2, pp. 221-227, May 1975.
36. P. J. Rousseeuw and A. M. Leroy, Robust Regression and Outlier Detection. New York: Wiley, 1987.
37. S. P. Sabatini, F. Solari, G. Andreani, C. Bartolozzi, and G. M. Bisio, "A hierarchical model of complex cells in visual cortex for the binocular perception of motion-in-depth," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 1271-1278.
38. H. Sakata, M. Taira, M. Kusunoki, A. Murata, K. Tsutsui, Y. Tanaka, W. N. Shein, and Y. Miyashita, "Neural representation of threedimensional features of manipulation objects with stereopsis," Exper. Brain Res., vol. 128, no. 1/2, pp. 160-169, Sep. 1999.
39. A. Saxena, J. Schulte, and A. Y. Ng, "Depth estimation using monocular and stereo cues," in Proc. Int. Joint Conf. Artif. Intell., 2007, pp. 2197-2203.
40. F. Solari, J. Diaz, E. Ros, K. Pauwels, M. Van Hulle, N. Pugeault, S. P. Sabatini, G. Gastaldi, and N. Krueger, "Compact and accurate early vision processing in the harmonic space," in Proc. Int. Conf. Comput. Vis. Theory Appl., 2007, pp. 213-220.
41. G. Taylor and L. Kleeman, "Fusion of multimodal visual cues for model-based object tracking," in Proc. Australasian Conf. Robot. Autom., Brisbane, Australia, Dec. 2003.
42. J. R. Tresilian and M. Mon-Williams, "Getting the measure of vergence weight in nearness perception," Exp. Brain Res., vol. 132, no. 3, pp. 362-368, Jun. 2000.
43. Y. Trotter, S. Celebrini, B. Stricanne, S. Thorpe, and M. Imbert, "Neural processing of stereopsis as a function of viewing distance in primate visual cortical area V1," J. Neurophysiol., vol. 76, no. 5, pp. 2872-2885, Nov. 1996.
44. D. Y. Tsao, W. Vanduffel, Y. Sasaki, D. Fize, T. A. Knutsen, J. B. Mandeville, L. L. Wald, A. M. Dale, B. R. Rosen, D. C. Van Essen, M. S. Livingstone, G. A. Orban, and R. B. H. Tootell, "Stereopsis activates V3A and caudal intraparietal areas in macaques and humans," Neuron, vol. 39, no. 3, pp. 555-568, Jul. 2003.
45. K.-I. Tsutsui, M. Jiang, K. Yara, H. Sakata, and M. Taira, "Integration of perspective and disparity cues in surface-orientation- selective neurons of area CIP," J. Neurophysiol., vol. 86, no. 6, pp. 2856-2867, Dec. 2001.
46. R. van Ee, M. S. Banks, and B. T. Backus, "An analysis of binocular slant contrast," Perception, vol. 28, no. 9, pp. 1121-1145, 1999.
47. A.Weigl, K. Hohm, and M. Seitz, "Processing sensor images for grasping disassembly objects with a parallel-jaw gripper," in Proc. TELEMAN Telerobotics Conf., 1995, pp. 527-532.
48. A. E.Welchman, A. Deubelius, V. Conrad, H. H. Bülthoff, and Z. Kourtzi, "3D shape perception from combined depth cues in human visual cortex," Nat. Neurosci., vol. 8, no. 6, pp. 820-827, Jun. 2005.
49. D. Xu, Y. F. Li, Y. Shen, and M. Tan, "New pose-detection method for self-calibrated cameras based on parallel lines and its application in visual control system," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 36, no. 5, pp. 1104-1117, Oct. 2006.