Improving target detection in visual search through the augmenting multi-sensory cues

Ergonomics

Volumn 56, Issue 5, 2013, Pages 729-738

  Hancock, Peter A ^a   Mercado, Joseph E ^b   Merlo, James ^b   Van Erp, Jan B F ^c  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

^b UNITED STATES MILITARY ACADEMY   (United States)

^c TNO   (Netherlands)

Author keywords

auditory cueing; augmented support; tactile cueing; target detection; visual search

Indexed keywords

AUDITORY CUEING; AUDITORY MODALITY; COGNITIVE WORKLOADS; ERRORS OF COMMISSIONS; PERFORMANCE EFFICIENCY; SUCCESSFUL SEARCH; TACTILE CUEING; VISUAL SEARCH;

ERRORS; TARGET TRACKING;

EXPERIMENTS;

ADOLESCENT; ADULT; ASSOCIATION; FEMALE; HEARING; HUMAN; MALE; PATTERN RECOGNITION; REACTION TIME; TASK PERFORMANCE; TOUCH; YOUNG ADULT; ARTICLE;

ADOLESCENT; ADULT; CUES; FEMALE; HEARING; HUMANS; MALE; PATTERN RECOGNITION, VISUAL; REACTION TIME; TASK PERFORMANCE AND ANALYSIS; TOUCH; YOUNG ADULT;

EID: 84878046661     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140139.2013.771219     Document Type: Article

References (55)

1. Allman, B. L. and Meredith, M. A. 2007. Multisensory Processing in 'Unimodal' Neurons: Cross-Modal Subthreshold Auditory Effects in Cat Extrastriate Visual Cortex. Journal of Neurophysiology, 98 (1): 545-549.
2. Calhoun, G. L., Fontejon, J. V., Draper, M. H., Ruff, H. A. and Guilfoos, B. J. 2004. Tactile Versus Aural Redundant Alert Cues for UAV Control Applications. Proceedings of the Human Factorsand ErgonomicsSociety, 48 (1): 137-141.
3. De Vries, S. C., Van Erp, J. B. F. and Kiefer, R. 2009. Direction Coding Using a Tactile Chair. Applied Ergonomics, 40: 477-484.
4. Driver, J. and Spence, C. 1998. Attention and the Cross-Modal Construction of Space. Trends in Cognitive Science, 2: 254-262.
5. Ernst, M. O. and Banks, M. S. 2002. Humans Integrate Visual and Haptic Information in a Statistically Optimal Fashion. Nature, 415: 429-433.
6. Ernst, M. O. and Bülthoff, H. H. 2004. Merging the Senses into a Robust Percept. Trends in Cognitive Science, 8: 162-169.
7. Ferris, T. K. and Sarter, N. B. 2008. Crossmodal Links Between Vision, Audition, and Touch in Complex Environments. Human Factors, 50 (1): 17-26.
8. Fisher, D. L., Coury, B. G., Tengs, T. O. and Duffy, S. A. 1989. Minimizing the Time to Search Visual Displays: The Role of Highlighting. Human Factors, 31 (2): 167-182.
9. Fisher, D. L. and Tan, K. C. 1989. Visual Displays: The Highlighting Paradox. Human Factors, 31: 17-30.
10. Glumm, M. M., Kehring, K. L. and White, T. L. 2009. Effects of Unimodal and Multi-Modal Cues About Threat Locations on Target Acquisition and Workload. Military Psychology, 21 (4): 497-512.
11. Goodale, M. and Milner, A. 1992. Separate Visual Pathways for Perceptionand Action. Trends in Neuroscience, 15 (1): 20-25.
12. Hancock, P. A. 1996. Effect of Control Order, Augmented Feedback, Input Device and Practice on Tracking Performance and Perceived Workload. Ergonomics, 39: 1146-1162.
13. Hancock, P. A. 2005. Time and the Privileged Observer. Kronoscope, 5 (2): 176-191.
14. Hancock, P. A. 2010. " The Battle for Time in the Brain ". In Time, Limits and Constraints: The Study of Time XIII, Edited by: Parker, J. A., Harris, P. A. and Steineck, C. 65-87. Leiden: Brill.
15. Hancock, P. A. 2012. In Search of Vigilance; The Problems of Iatrogenically Created Psychological Phenomenon. American Psychologist, in press
16. Hancock, P. A. and Warm, J. S. 1989. A Dynamic Model of Stress and Sustained Attention. Human Factors, 31: 519-537.
17. Hart, S. G. and Staveland, L. E. 1988. " Development of a Multi-Dimensional Workload Rating Scale: Results of Empirical and Theoretical Research ". In Human Mental Workload, Edited by: Hancock, P. A. and Meshkati, N. 139-183. Amsterdam: Elsevier.
18. Hofer, E. F., Palen, L. A. and Possolo, A. 1993. " Flight Deck Information Management: An Experimental Study of Functional Integration of Approach Data ". In Proceedings of the 7th International Symposium on Aviation Psychology, Columbus, OH: Department of Aviation, Ohio State University.
19. Hogema, J. H., De Vries, S. C., Van Erp, J. B. F. and Kiefer, R. J. 2009. A Tactile Chair for Direction Coding in Car Driving: Field Evaluation. IEEE Transactions on Haptics, 2 (4): 181-188.
20. Jones, L. A. and Sarter, N. 2008. Tactile Displays: Guidance for Their Design and Application. Human Factors, 50 (1): 90-111.
21. Krupinski, E. A. 2000. The Importance of PerceptionResearch in Medical Imaging. Radiation Medicine, 18 (6): 329-334.
22. Mackworth, N. H. 1948. The Breakdown of Vigilance During Prolonged Visual Search. Quarterly Journal of Experimental Psychology, 1: 6-21.
23. Merlo, J. L., Duley, A. R. and Hancock, P. A. 2010. Cross-Modal Congruency Benefits for Combined Tactile and Visual Signaling. American Journal of Psychology, 123 (4): 413-424.
24. Merlo, J. L. and Hancock, P. A. 2011. Quantification of Tactile Cueing for Enhanced Target Search Capacity. Military Psychology, 23 (2): 137-153.
25. Merlo, J., Szalma, M. and Hancock, P. A. 2007. " Stress and Performance: Some Experiences from Iraq ". In Performance Under Stress, Edited by: Hancock, P. A. and Szalma, J. L. Aldershot: Ashgate.
26. Mohebbi, R., Gray, R. and Tan, H. Z. 2009. Driver Reaction Time to Tactile and Auditory Rear-End Collision Warnings While Talking on a Cell Phone. Human Factors, 51 (1): 102-110.
27. Murphy, D. and Bott, J. 1995. On the Lookout: The Air Mobile Ground Security and Surveillance System (AMGSSS) Has Arrived. Unmanned Systems, 13 (4): 22-27.
28. Oron-Gilad, T., Downs, J. L., Gilson, R. D. and Hancock, P. A. 2007. Vibrotactile Guidance Cues for Target Acquisition. IEEE Transactions on Systems, Man, and Cybernetics, 37 (5): 993-1004.
29. Oskarsson, P-A., Eriksson, L. and Carlander, O. 2012. Enhanced Perceptionand Performance by Multimodal Threat Cueing in Simulated Combat Vehicle. Human Factors, 54 (1): 122-137.
30. Philippi, T. G., Van Erp, J. B. F. and Werkhoven, P. J. 2008. Multisensory Temporal Numerosity Judgment. Brain Research, 1242 (C): 116-125.
31. Posner, M. I., Nissen, M. J. and Klein, R. 1976. Visual Dominance: An Information-Processing Account of its Origins and Significance. Psychological Review, 83: 157-170.
32. Posner, M. I., Snyder, C. R. R. and Davidson, B. J. 1980. Attention and the Detection of Signals. Journal of Experimental Psychology: General, 109 (2): 160-174.
33. Poulton, E. C. 1982. Influential Companions: Effects of One Strategy on Another in the Within-Subjects Designs of Cognitive Psychology. Psychological Bulletin, 91 (3): 673
34. Prewett, M. S., Elliott, L. R., Walvoord, A. G. and Coovert, M. D. 2012. A Meta-Analysis of Vibrotactile and Visual Information Displays for Improving Task Performance. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, 42 (1): 123-132.
35. Reason, J. 2008. The Human Contribution, Chichester: Ashgate.
36. Redden, E. S., Carstens, C. B., Turner, D. D., Brill, J. C., Stafford, S. and Terrence, P. I. 2007. " Placement, Fit, and Comparison of Two Types of Tactile Displays ". In Remote Tactile Displays for Future Soldiers, Edited by: Gilson, R. D., Redden, E. S. and Elliott, L. R. Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.
37. Santangelo, V. and Spence, C. 2007. Multisensory Cues Capture Spatial Attention Regardless of Perceptual Load. Journal of Experimental Psychology: Human Perceptionand Performance, 33 (6): 1311-1321.
38. Sarter, N. 2006. Multimodal Information Presentation: Design Guidance and Research Challenges. International Journal of Industrial Ergonomics, 36: 439-445.
39. Sivak, M. 1996. The Information That Drivers Use: Is It Indeed 90% Visual?. Perception, 25 (9): 1081-1089.
40. Sklar, A. E. and Sarter, N. B. 1999. Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains. Human Factors, 41: 543-552.
41. Spence, C. 2011. Cross Modal Correspondences: A Tutorial Review. Attention, Perceptionand Psychophysics, 73: 971-995.
42. Spence, C. and Driver, J. 2004. Crossmodal Space and Crossmodal Attention, USA: Oxford University Press.
43. Stein, B. E. and Meredith, M. A. 1993. The Merging of the Senses, Cambridge, MA: MIT Press.
44. Szalma, J. L. and Hancock, P. A. 2011. Noise and Human Performance: A Meta-Analytic Synthesis. Psychological Bulletin, 137 (4): 682-707.
45. Szalma, J. L. and Hancock, P. A. 2012. What's All the Noise? Differentiating Dimensions of Acoustic Stress and the Limits to Meta-Analysis. Psychological Bulletin, in press.
46. Teder-Sälejärvi, W. A., Russo, F. D., McDonald, J. J. and Hillyard, S. A. 2005. Effects of Spatial Congruity on Audio-Visual Multimodal Integration. Journal of Cognitive Neuroscience, 17 (9): 1396-1409.
47. Tindall-Ford, S., Chandler, P. and Sweller, J. 1997. When Two Sensory Modes are Better Than One. Journal of Experimental Psychology: Applied, 3 (4): 257-287.
48. Van Erp, J. B. F. 2005. Presenting Directions with a Vibro-Tactile Torso Display. Ergonomics, 48: 302-313.
49. Van Erp, J. B. F. and Van Veen, H. A. H. C. 2004. Vibrotactile In-Vehicle Navigation System. Transportation Research Part F: Traffic Psychology and Behaviour, 7 (4-5): 247-256.
50. Van Erp, J. B. F. and Van Veen, H. A. H. C. 2006. Touch Down: The Effect of Artificial Touch Cues on Orientation in Microgravity. NeuroScience Letters, 404: 78-82.
51. Van Erp, J. B. F., Eriksson, L., Levin, B., Carlander, O., Veltmanand, J. E. and Vos, W. K. 2007. Tactile Cueing Effects on Performance in Simulated Aerial Combat with High Acceleration. Aviation, Space and Environmental Medicine, 78: 1128-1134.
52. Vitense, H. S., Jacko, J. A. and Emery, V. K. 2003. Multimodal Feedback: An Assessment of Performance and Mental Workload. Ergonomics, 46 (1-3): 68-87.
53. Warm, J. S., ed. 1984. Sustained Attention in Human Performance, New York: Wiley.
54. Werkhoven, P. J., Van Erp, J. B. F. and Philippi. 2009. Counting Visual and Tactile Events: The Effect of Attention on Multisensory Integration. Attention, Perceptionand Psychophysics, 71 (8): 1854-1861.
55. Wolfe, J. M., Horowitz, T. S. and Kenner, N. 2005. Rare Items Often Missed in Visual Searches. Nature, 435: 439-440.