Assessment of fused videos using scanpaths: A comparison of data analysis methods

Spatial Vision

Volumn 20, Issue 5, 2007, Pages 437-466

  Dixon, Timothy D ^a   Nikolov, Stavri G ^a   Lewis, John J ^a   Li, Jian ^a   Canga, Eduardo Fernandez ^a   Noyes, Jan M ^a   Troscianko, Tom ^a   Bull, Dave R ^a   Canagarajah, C Nishan ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Eye tracking; Image fusion; Psychophysics; Scanpath analysis; Video assessment

Indexed keywords

CAMOUFLAGE; DATA REDUCTION; INFRARED RADIATION; PSYCHOPHYSIOLOGY; TRACKING (POSITION);

COMPUTATIONAL METRIC ANALYSIS; EYE-TRACKING; IMAGE ASSESSMENT; SCANPATHS;

IMAGE FUSION;

ADULT; ARTICLE; COMPARATIVE STUDY; FEMALE; HUMAN; INFORMATION PROCESSING; MALE; PATTERN RECOGNITION; PHYSIOLOGY; PSYCHOPHYSICS; TASK PERFORMANCE;

ADULT; DATA DISPLAY; FEMALE; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; PSYCHOPHYSICS; TASK PERFORMANCE AND ANALYSIS;

EID: 34548062320     PISSN: 01691015     EISSN: 15685683     Source Type: Journal    
DOI: 10.1163/156856807781503659     Document Type: Article

References (49)

1. Bakeman, R. and McArthur, D. (1996). Picturing repeated measures: comments on Luftus, Morrison, and others, Behavior Research Methods, Instruments and Computers 28, 584-589.
2. Burt, P. J. and Kolczynski, R. J. (1993). Enhanced image capture through fusion, in: Proc. 4th Internat. Conf. Computer Vision, Berlin, Germany, pp. 173-182.
3. Carpenter, R. H. S. (1977). Movements of the Eye. Pion, London, UK.
4. Chang, J., Thakur, S., Perera, G., Kowalski, A., Huang, W., Karimi, S., Hunt, M., Koutcher, J., Fuks, Z., Amols, H. and Narayana, A. (2006). Image fusion of MR spectroscopic images for treatment planning of gliomas, Medical Physics 33, 32-40.
5. Chua, H. F., Boland, J. E. and Nesbitt, R. E. (2005). Cultural variation in eye movement during scene perception, Proc. Nat. Acad. Sci. USA 102, 12629-12633.
6. Dixon, T. D., Fernández-Canga, E., Nikolov, S. G. Noyes, J. M., Troscianko, T., Canagarajah, N. and Bull, D. R. (2006a). Methods for the assessment of fused images, ACM Trans. Appl. Perception 3, 309-332.
7. Dixon, T. D., Fernández-Canga, E., Nikolov, S. G., Troscianko, T., Noyes, J. M., Bull, D. R. and Canagarajah, C. N. (2006b). Quality assessment of false colored fused displays, J. Soc. Information Displays 14, 883-894.
8. Dixon, T. D., Nikolov, S. G., Lewis, J. J., Li, J., Fernández- Canga, E., Noyes, J. M., Troscianko, T., Bull, D. R. and Canagarajah, C. N. (2006c). Scanpath analysis of fused multi-sensor images with luminance change: a pilot study, Proc. 9th Internat. Conf. Information Fusion, Florence, Italy.
9. Dixon, T. D., Nikolov, S. G., Lewis, J. J., Li, J., Fernández- Canga, E., Noyes, J. M., Troscianko, T., Bull, D. R. and Canagarajah, C. N. (2006d). Multi-sensor fused video assessment using scanpath analysis, in: Proc. 1st Biolog. Inspired Information Fusion Workshop, Guildford, UK.
10. Eckert, M. P. and Bradley, A. P. (1998). Perceptual quality metrics applied to still image compression, Signal Processing 70, 177-200.
11. Eskiciouglu, A. M. (2000). Quality measurement in for monochrome compressed images in the past 25 years, Proc. IEEE Internat. Conf. Acoustics, Speech Signal Proc. (ICASSP) 4, 1907-1910.
12. Essock, E. A., Sinai, M. J., DeFord, J. K., Hansen, B. C. and Srinivasan, N. (2004). Human perceptual performance with nonliteral imagery: region recognition and texture-based segmentation, J. Exper. Psychol.: Applied 10, 97-100.
13. Girod, B. (1993). What's wrong with the mean-square error, in: Digital Images and Human Vision, Watson, A. B. (Ed.), pp. 207-220. MIT Press, Cambridge, MA, USA.
14. Hemaissia, M., Seghrouchni, A. E. and Mattioli, J. (2006). Enhanced maritime situation awareness with negotiator agents. Defence applications of multi-agent systems, Lecture Notes in Artificial Intelligence 3890, 14-23.
15. Henderson, J. M. and Hollingworth, A. (1999). High-level scene perception, Ann. Rev. Psychol. 50, 243-271.
16. Hutton, S. B. and Tegally, D. (2005). The effects of dividing attention on smooth pursuit eye tracking, Exper. Brain Res. 163, 306-313.
17. Kingsbury, N. G. (1998). The dual-tree complex wavelet transform: a new technique for shift invariance and directional filters, in: Proc. IEEE Digital Signal Proc. Workshop, Bryce Canyon, USA.
18. Kingsbury, N. G. (1999). Image processing with complex wavelets, in: Wavelets: The Key to Intermittent Information, Silverman, B. and Vassilicos, J. (Eds), pp. 165-185. Oxford University Press, New York, USA.
19. Kingsbury, N. G. (2001). Complex wavelets for shift invariant analysis and filtering of signals, J. Appl. Comput. Harmonic Anal. 10, 234-253.
20. Krebs, W. K. and Sinai, M. J. (2002). Psychophysical assessments of image-sensor fused imagery, Human Factors 44, 257-271.
21. Krebs, W. K., Scribner, D. A. and McCarley, J. S. (2001). Comparing behavioral receiver operating characteristic curves to multidimensional matched filters, Optic. Engng 40, 1818-1826.
22. Lewis, J. J., O'Callaghan, R. J., Nikolov, S. G., Bull, D. R. and Canagarajah, C. N. (2004). Region-based image fusion using complex wavelets, in: Proc. 7th Internat. Conf. Information Fusion, Stockholm, Sweden, pp. 55-562.
23. Lewis, J. J., Nikolov, S. G., Loza, A., Fernandez-Canga, E., Cvejic, N., Li, J., Cardinali, A., Canagarajah, C. N., Bull, D. R., Riley, T., Hickman, D. and Smith, M. I. (2006). The Eden Project multi-sensor data set, The Online Resource for Research in Image Fusion (ImageFusion.org).
24. Li, H., Manjunath, B. S. and Mitra, S. K. (1995). Multisensor image fusion using the wavelet transform, Graphical Models and Image Processing 57, 235-245.
25. Łoza, A., Dixon, T. D., Canga, E. F., Nikolov, S. G., Bull, D. R., Canagarajah, C. N., Noyes, J. M. and Troscianko, T. (2005). Methods of fused image analysis and assessment, in: Adv. Study Inst. Conf. (NATO-ASI), Bulgaria.
26. Miyahara, M., Kotani, K. and Algazi, V. R. (1998). Objective picture quality scale (PQS) for image coding, IEEE Trans. Comms 46, 1215-1226.
27. Neider, M. B. and Zelinsky, G. J. (2006). Scene context guides eye movements during visual search, Vision Research 46, 614-621.
28. Nikolov, S. G., Hill, P., Bull, D. R. and Canagarajah, C. N. (2001). Wavelets for image fusion, in: Wavelets in Signal and Image Analysis, Petrosian, A. and Meyer, F. (Eds), pp. 213-244. Computational Imaging and Vision Series, Kluwer Academic Publishers, Dordrecht, Netherlands.
29. Nikolov, S. G., Lewis, J. J., O'Callaghan, R. J., Bull, D. R. and Canagarajah, C. N. (2004). Hybrid fused displays: Between pixel- and region-based image fusion, in: Proc. 7th Internat. Conf. Information Fusion, Stockholm, Sweden, pp. 5-62.
30. Petrović, V. S. and Xydeas, C. S. (2003). Sensor noise effects on signal-level image fusion performance, Information Fusion 4, 167-183.
31. Piella, G. (2003). A general framework for multiresolution image fusion: from pixels to regions, Information Fusion 4, 259-280.
32. Piella, G. (2004). New image quality measures for image fusion, in: Proc. 7th Internat. Conf. Image Fusion, Stockholm, Sweden, pp. 542-546.
33. Piella, G. and Heijmans, H. A. (2003). A new quality metric for image fusion, in: Internat. Conf. Image Proc. ICIP, Barcelona, Spain, pp. 14-17.
34. Pohl, C. and van Genderen, J. L. (1998). Multisensor image fusion in remote sensing: Concepts, methods and applications, Internat. J. Remote Sensing 19, 823-854.
35. Porter, G., Troscianko, T. and Gilchrist, I. (2007). Effort during visual search and counting: insights from pupillometry, Quart. J. Exper. Psychol., in press.
36. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research, Psychol. Bull. 124, 372-422.
37. Rockinger, O. (1997). Image sequence fusion using a shift-invariant wavelet transform, Proc. IEEE Internat. Conf. Image Processing 3, 288-291.
38. Simone, G., Farina, A., Morabito, F., Serpico, A. and Burzzone, L. (2002). Image fusion techniques for remote sensing applications, Information Fusion 3, 3-15.
39. Tobii Technology (2005). http://www.tobii.se/
40. Toet, A. (1990). Hierarchical image fusion, Machine Vision and Applications 3, 1-11.
41. Toet, A. and Franken, E. M. (2003). Perceptual evaluation of different image fusion schemes, Displays 24, 25-37.
42. Toet, A., IJspeert, J., Waxman, A. and Aguilar, M. (1997). Fusion of visible and thermal imagery improves situational awareness, Displays 18, 85-95.
43. Underwood, G. (2005a). Eye fixations on pictures of natural scenes: getting the gist and identifying the components, in: Cognitive Processes in Eye Guidance, Underwood, G. (Ed.), pp. 163-187. Oxford University Press, New York, USA.
44. Underwood, J. (2005b). Novice and expert performance with a dynamic control task: scanpaths during a computer game, in: Cognitive Processes in Eye Guidance, Underwood, G. (Ed.), pp. 317-342. Oxford University Press, New York, USA.
45. Wald, L. (2002). Data Fusion: Definitions and Architectures. Les Presses d'Ecole des Mines des Paris, Paris, France.
46. Wallace, J. M., Stone, L. S. and Masson, G. S. (2005). Object motion computation for the initiation of smooth pursuit eye movements in humans, J. Neurophysiol. 93, 2279-2293.
47. Wang, Z. and Bovik, A. C. (2002). A universal image quality index, IEEE Signal Proc. Lett. 9, 81-84.
48. Wilson, T., Rogers, S. and Meyers, L. R. (1995). Perceptual based hyperspectral image fusion using multispectral analysis, Optic. Engng 34, 3154-3164.
49. Xydeas, C. S. and Petrović, V. S. (2000). Objective image fusion performance measure, Electronics Letts 36, 308-309.