Extraction of visual features with eye tracking for saliency driven 2D/3D registration

Image and Vision Computing

Volumn 23, Issue 11, 2005, Pages 999-1008

  Chung, Adrian J ^a   Deligianni, Fani ^a   Hu, Xiao Peng ^a   Yang, Guang Zhong ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

2D 3D registration; Eye tracking; Image correlation; Saliency

Indexed keywords

ENDOSCOPY; OPTIMIZATION;

2D/3D REGISTRATION; EYE TRACKING; IMAGE CORRELATION; SALIENCY;

IMAGE ANALYSIS;

EID: 25144452451     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2005.07.003     Document Type: Article

References (36)

1. M.J. Mack Minimally invasive and robotic surgery The Journal of the American Medical Association 285 5 2001 568 572
2. P. Gieles, Image guided surgery: digital imaging as a support to patient treatment, Medica Mundi 40 (2).
3. P.E. Debevec, C.J. Taylor, J. Malik, Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach, in: Computer Graphics Proceedings, Annual Conference Series (Proceedings of the SIGGRAPH'96), 1996, pp. 11-20.
4. D. Wagner, R. Wegenkittl, and E. Gröller Endoview: A phantom study of a tracked virtual bronchoscopy V. Skala Journal of WSCG vol. 10 2002 493 498 URL: http://visinfo.zib.de/EVlib/Show?EVL-2002-66
5. D. Dey, D. Gobbi, P. Slomka, K. Surry, and T. Peters Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: creating stereoscopic panoramas IEEE Transactions on Medical Imaging 21 1 2002 23 30
6. F. Tendick, D. Polly, D. Blezek, J. Burgess, C. Carignan, G. Higgins, C. Lathan, K. Reinig, Final Report of the Technical Requirements for Image-Guided Spine Procedures, Imaging Science and Information Systems (ISIS) Center, Department of Radiology, Georgetown University Medical Center, Georgetown University Medical Center, 2115 Wisconsin Avenue, NW, Suite 603, Washington, DC 20007, 1999, Ch. 3, Operative Planning and Surgical Simulators.
7. D. Dey, P.J. Slomka, D.G. Gobbi, T.M. Peters, Mixed reality merging of endoscopic images and 3-d surfaces. 796-803, in: Medical Image Computing and Computer-Assisted Intervention - MICCAI 2000, Third International Conference, Pittsburgh, Pennsylvania, USA, October 11-14, 2000, Proceedings, Lecture Notes in Computer Science, vol. 1935, Springer, Berlin, 2000, pp. 796-803.
8. A.F. Ayoub, J.P. Siebert, D. Wray, and K.F. Moos A vision-based three dimensional capture system for maxillofacial assessment and surgical planning British Journal of Oral Maxillofacial Surgery 36 1998 353 357
9. L. Joskowicz, Fluoroscopy-based navigation in computer-aided orthopaedic surgery, in: Proceedings of the IFAC Conference on Mechatronic Systems, Darmstadt, Germany, 2000.
10. L. Joskowicz, C. Milgrom, A. Simkin, L. Tockus, Z. Yaniv, Fracas: a system for computer-aided image-guided long bone fracture surgery, Journal of Computer-Aided Surgery 3 (6).
11. J.B.A. Maintz, and M.A. Viergever A survey of medical image registration Medical Image Analysis 2 1 1998 1 36 URL: http://www.cs.uu.nl/people/twan/personal/media97.pdf
12. D.L.G. Hill, P.G. Batchelor, M. Holden, and D.J. Hawkes Medical image registration Physics in Medicine and Biology 46 2001 R1 R45
13. G.P. Penney, J. Weese, J.A. Little, P. Desmedt, D.L.G. Hill, and D.J. Hawkes A comparison of similarity measures for use in 2D-3D medical image registration Lecture Notes in Computer Science 1496 1998 1153 URL: http://link.springer-ny.com/link/service/series/0558/bibs/1496/14961153.htm ; http://link.springer-ny.com/link/service/series/0558/papers/1496/14961153.pdf
14. M.J. Clarkson, D. Rueckert, D.L.G. Hill, and D.J. Hawkes Using photo-consistency to register 2d optical images of the human face to a 3d surface model IEEE Transactions on Pattern Analysis and Machine Intelligence 23 11 2001 1266 1280
15. D.D. Frantz, A.D. Wiles, S.E. Leis, and S.R. Kirsch Accuracy assessment protocols for electromagnetic tracking systems Physics in Medicine and Biology 48 2003 2241 2251
16. K. Mori, Y. Suenaga, J. Toriwaki, J. Hasegawa, K. Kataa, H. Takabatake, H. Natori, A method for tracking camera motion of real endoscope by using virtual endoscopy system, in: Proceedings of SPIE, 3978, 2000-02, pp. 134-145.
17. K. Mori, D. Deguchi, J. Sugiyama, Y. Suenaga, J. Toriwaki Jr., H. Takabatake, and H. Natori Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images Medical Image Analysis 6 2002 321 336
18. J.P. Helferty, W.E. Higgins, Technique for registering 3d virtual ct images to endoscopic video, in: IEEE International Conference on Image Processing, 2001.
19. P. Viola, W.M. Wells III, Alignment by maximization of mutual information, International Journal of Computer Vision.
20. A. Roche, G. Malandain, X. Pennec, and N. Ayache The correlation ratio as a new similarity measure for multimodal image registration Lecture Notes in Computer Science 1496 1998 1115 URL: http://link.springer-ny.com/link/service/series/0558/bibs/1496/14961115.htm ; http://link.springer-ny.com/link/service/series/0558/papers/1496/14961115.pdf
21. M.E. Leventon, and W.E.L. Grimson Multi-modal volume registration using joint intensity distributions Lecture Notes in Computer Science 1496 1998 1057 URL: http://link.springer-ny.com/link/service/series/0558/bibs/1496/14961057. htm ; http://link.springer-ny.com/link/service/series/0558/papers/1496/14961057.pdf
22. T. Whitted, An improved illumination model for shaded display, in: Computer Graphics (Special SIGGRAPH'79 Issue), vol. 13, 1979, pp. 1-14.
23. J. Tsotsos, S. Culhane, W. Wai, Y. Lai, N. Davis, and F. Nuflo Modelling visual attention via selective tuning Artificial Intelligence 78 1/2 1995 507 545
24. L. Itti, C. Koch, and E. Niebur A model of saliency-based visual attention for rapid scene analysis IEEE Transactions on Pattern Analysis and Machine Intelligence 20 11 1998 1254 1259 URL: citeseer.nj.nec.com/itti98model.html
25. X.-P. Hu, L. Dempere-Marco, G.-Z. Yang, Hot spot detection based on feature space representation of visual search, IEEE Transactions on Medical Imaging, in press.
26. G.-Z. Yang, L. Dempere-Marco, X.-P. Hu, and A. Rowe Visual search: psychophysical models and practical applications Image and Vision Computing 20 4 2002 291 305
27. A.A. Faisal, M. Fislage, M. Pomplun, R. Rae, H. Ritter, Observation of human eye movements to simulate visual exploration of complex scenes, Technical Report, University of Bielfeld, 1998
28. R.Y. Tsai A versatile camera calibration technique for high accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses IEEE Journal of Robotics and Automation RA-3 4 1987 323 344
29. Z. Zhang A flexible new technique for camera calibration IEEE Transactions on Pattern Analysis and Machine Intelligence 22 11 2000 1330 1334
30. W. Einhäuser, and P. König Does luminance-contrast contribute to a saliency map for overt visual attention? European Journal of Neuroscience 17 5 2003 1089 1097
31. N. Petkov, and P. Kruizinga Computational models of visual neurons specialised in the detection of periodic and aperiodic oriented visual stimuli: bar and grating cells Biological Cybernetics 76 2 1997 83 96
32. W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery Numerical Recipes in C second ed. 1992 Cambridge University Press Cambridge, MA
33. M. Jägersand Saliency Maps and Attention Selection in Scale and Spatial Coordinates: An Information Theoretic Approach 1993 URL: citeseer.nj.nec.com/12842.html
34. A. Shokoufandeh, I. Marsic, and S.J. Dickinson View-based object recognition using saliency maps Image and Vision Computing 17 5/6 1999 445 460
35. L. Itti, C. Koch, A comparison of feature combination strategies for saliency-based visual attention systems, in: SPIE Human Vision and Electronic Imaging IV (HVEI 1999), San Jose, CA, vol. 3644, 1999, pp. 373-382.
36. D. Deguchi, K. Mori, Y. Suenaga, J. ichi Hasegawa, J. ichiro Toriwaki, H. Natori, and H. Takabatake New calculation method of image similarity for endoscope tracking based on image registration in endoscope navigaton H. Lemke M. Vannier K. Inamura A. Ferman K. Doi J. Reiber Computer Assisted Radiology and Surgery (CARS) 2003 International Congress Series 1256, (London, June 25-28, 2003) 2003 Elsevier Amsterdam 460 466