A meta-analysis of vibrotactile and visual information displays for improving task performance

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 42, Issue 1, 2012, Pages 123-132

  Prewett, Matthew S ^a   Elliott, Linda R ^b   Walvoord, Ashley G ^c   Coovert, Michael D ^d  

^a CENTRAL MICHIGAN UNIVERSITY   (United States)

^b Army Research Laboratory Human Research and Engineering Directorate   (United States)

^c Verizon Wireless   (United States)

^d UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

Load management; multimodal sensors; performance evaluation; tactile sensors

Indexed keywords

INFORMATION COMPLEXITY; META-ANALYSIS; MODERATING EFFECT; MULTIMODAL DISPLAYS; MULTIMODAL SENSOR; PERFORMANCE EVALUATION; TACTILE SENSORS; TASK PERFORMANCE; TASK TYPE; VIBROTACTILE; VISUAL CUES; VISUAL DIRECTIONS; VISUAL INFORMATION;

ELECTRIC LOAD MANAGEMENT; SEMANTICS;

SENSORS;

EID: 84655170076     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2010.2103057     Document Type: Article

References (80)

1. C. D. Wickens, "Multiple resources and mental workload, " Human Factors, vol. 50, no. 3, pp. 449-454, 2008.
2. C. D. Wickens, "Multiple resources and performance prediction, " Theor. Issues Ergon. Sci., vol. 3, no. 2, pp. 159-177, 2002.
3. L. Jones and N. Sarter, "Tactile displays: Guidance for their design and application, " Human Factors, vol. 50, no. 3, pp. 90-111, 2008. (Pubitemid 351346107)
4. J. B. F. van Erp, Tactile Displays for Navigation and Orientation: Perception and Behavior. Leiden, The Netherlands:Mostert and Van Onderen, 2007.
5. C. D. Wickens, J. Goh, J. Helleberg, W. J. Horrey, and D. A. Talleur, "Attentional models of multitask pilot performance using advanced display technology, " Human Factors, vol. 45, no. 3, pp. 360-380, 2003. (Pubitemid 37509590)
6. R. M. Shifren and W. Schneider, "Automatic and controlled processing revisited, " Psychol. Rev., vol. 91, no. 2, pp. 269-276, 1984.
7. J. Rasmussen, "Skills, rules, and knowledge: Signals, signs, and symbols, and other distinctions in human performance models, " IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 3, pp. 257-266, May/Jun. 1983. (Pubitemid 13591183)
8. G. Klein, "Naturalistic decision making, " Human Factors, vol. 50, no. 3, pp. 456-461, 2008.
9. C. Zsambok and G. Klein, Naturalistic DecisionMaking. Mahwah, NJ: Lawrence Erlbaum, 1997.
10. J. J. Scott and R. Gray, "A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving, " Human Factors, vol. 50, no. 2, pp. 264-275, 2008. (Pubitemid 351744371)
11. R. Gilson, E. Redden, and L. Elliott, "Remote tactile displays for future soldiers, " Army Res. Lab., Human Research and Engineering Directorate, Aberdeen Proving Ground, MD, Rep. ARL-SR-0152, 2007.
12. G. L. Calhoun, J. Fontejon, M. Draper, H. A. Ruff, and B. Guilfoos, "Tactile vs. aural redundant alert cues for UAV control applications, " in Proc. HFES 48th Ann. Meeting, Santa Monica, CA, 2004, pp. 137-141.
13. G. L. Calhoun, H. A. Ruff, M. H. Draper, and B. J. Guilfoos, "Tactile and aural alerts in high auditory load UAV control environments, " in Proc. HFES 49th Ann. Meeting, Santa Monica, CA, 2005, pp. 145-149. (Pubitemid 351742243)
14. B. Forster, C. Cavina-Praetesi, S. M. Aglioti, and G. Berlucchi, "Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time, " Exp. Brain Res., vol. 143, no. 4, pp. 480-487, 2002. (Pubitemid 34253297)
15. M. S. Prewett et al., "The benefits of multimodal information: A metaanalysis comparing visual and visual-tactile feedback, " in Proc. 8th Int. Conf. Multimodal Interf. New York, 2006, pp. 333-338. (Pubitemid 47113466)
16. S. Hameed, T. Ferris, S. Jayaraman, and N. Sarter, "Supporting interruption management through informative tactile and peripheral visual cues, " in Proc. HFES 50th Ann. Meeting, Santa Monica, CA, 2006, pp. 376-380. (Pubitemid 351741729)
17. C. Ho, N. Reed, and C. Spence, "Multisensory in-car warning signals for collision avoidance, " Human Factors, vol. 49, pp. 1107-1114, 2007. (Pubitemid 350205846)
18. P. J. Hopp, C. A. P. Smith, B. A. Clegg, and E. D. Heggestad, "Interruption management: The use of attention-directing tactile cues, " Human Factors, vol. 47, no. 1, pp. 1-11, 2005. (Pubitemid 40593933)
19. I. Moorhead, S. Holmes, and A. Furnell, "Understanding multisensory integration for pilot spatial orientation, " QunetiQ Ltd., Farmborough, U. K., Rep. SPC 03-3048, 2004.
20. A. Bloomfield and N. I. Badler, "Collision avoidance using vibrotactile arrays, " in Proc. IEEE Virtual Reality Conf., Charlotte, NC, 2007, pp. 163-170. (Pubitemid 47208201)
21. J. Chen and P. Terrence, "Effects of tactile cueing on concurrent performance of military and robotics tasks in a simulated multitasking environment, " Ergonomics, vol. 51, no. 8, pp. 1137-1152, 2008.
22. B. Davis, "Effects of visual, auditory, and tactile navigation cues on navigation performance, situation awareness, and mental workload, " Army Res. Lab., Aberdeen Proving Ground, MD, Rep. ARL-TR-4022, 2007.
23. M. Dorneich, P. I. Ververs, S. Whitlow, and S. Mathan, "Evaluation of a tactile navigation cueing system and real-time assessment of cognitive state, " in Proc. HFES 50th Ann. Meeting, Santa Monica, CA, 2006, pp. 2600-2604. (Pubitemid 351742188)
24. L. R. Elliott et al., "Tactile guidance for land navigation, " Army Res. Lab., Aberdeen Proving Ground, MD, Rep. ARL-TR-4295, 2006.
25. M. Glumm, K. Kehring, and T. L. White, "Effects of tactile, visual and auditory cues about threat location on target acquisition and attention to visual and auditory communications, " Army Res. Lab., Aberdeen Proving Ground, MD, Rep. ARL-TR-3863, 2006.
26. S. Hameed, S. Jayaraman, M. Ballard, and N. Sarter, "Guiding visual attention by exploiting crossmodal spatial links: An application in air traffic control, " in Proc. HFES 51st Ann. Meeting, Santa Monica, CA, 2007, pp. 220-224.
27. R. W. Lindeman, Y. Yanagida, J. L. Sibert, and R. Lavine, "Effective vibrotactile cueing in a visual search task, " in Proc. Ninth IFIP TC13 Int. Conf. Human-Computer Interact., Zurich, Switzerland, 2003, pp. 89-96.
28. R. W. Lindeman, J. L. Sibert, E. Mendez-Mendez, S. Patil, and D. Phifer, "Effectiveness of directional vibrotactile cuing on a building-clearing task, " in Proc. SIGCHI Conf. Human Factors Comput. Syst., Portland, OR, 2005, pp. 271-280. (Pubitemid 41809064)
29. A. Murray, R. Katzky, and P. Khosla, "Psychophysical characterization and tested validation of a wearable vibrotactile glove for telemanipulation, " Presence, vol. 12, no. 2, pp. 156-182, 2003. (Pubitemid 36573739)
30. H. Tan, R. Gray, J. Young, and R. Traylor. (2003). A haptic back display for attentional and directional cueing. Haptics-e [Online], vol. 3, no. 1, Available: http://www.haptics-e.org.
31. D. T. Aretz, T. S. Andre, B. P. Self, and C. A. Brenaman, "Effect of tactile feedback on unmanned aerial vehicle landings, " in Proc. Interservice/Ind. Training, Simul., Edu. Conf., 2006, paper 2849.
32. J. Chiasson, B. McGrath, and A. H. Rupert, "Enhanced situation awareness in sea, air, and land environment, " in Proc. NATO RTO Human Factors Med. Panel Symp. "Spatial Disorientation in Military Vehicles: Causes, Consequences and Cures, " La Coruna, Spain, 2002, pp. 1-10.
33. D. D. Diamond, S. J. Kass, F. Andrasik, A. K. Raj, and A. H. Rupert, "Vibrotactile cueing as a master caution system for visual monitoring, " Human Factors Aerosp. Safety, vol. 2, no. 4, pp. 339-354, 2002.
34. B. McGrath, A. Estrada, M. Graithwaite, A. K. Raj, and A. H. Rupert, "Tactile situation awareness system flight demonstration final report, " Naval Aerosp. Med. Res. Lab., Pensacola, FL, Rep. USAARL 2004-10, 2004.
35. A. K. Raj, S. J. Kass, and J. F. Perry, "Vibrotactile displays for improving spatial awareness, " in Proc. 44th HFES Ann. Meeting, Santa Monica, CA, 2000, pp. 181-184.
36. R. Small et al., "Multisensory integration for pilot spatial orientation, " Air Force Research Lab. Human Effectiveness Directorate, Wright-Patterson Air Force Base, OH, Rep. AFRL-HE-WP-TR-2006-0166, 2006.
37. L. Tripp, J. Warm, G. Matthews, P. Chiu, and B. Bracken, "Gz Acceleration loss of consciousness: Use of G-suit pressurization and sensory stimulation to enhance recovery, " in Proc. HFES 51st Ann. Meeting, Santa Monica, CA, 2007, pp. 1296-1300.
38. J. B. F. van Erp, R. Meppelink, and H. A. H. C. van Veen, "A touchy car, " TNO Human Factors Res. Inst., Soesterberg, The Netherlands, Rep. TD-2001-0358, 2002.
39. J. B. F. van Erp, J. Veltman, and H. A. H. C. van Veen, "A tactile cockpit instrument to support altitude control, " in Proc. HFES 47th Ann. Meeting, Santa Monica, CA, 2003, pp. 114-118.
40. J. B. F. van Erp, E. Groen, J. Bos, and H. A. H. C. van Veen, "A tactile cockpit instrument supports the control of self-motion during spatial disorientation, " Human Factors, vol. 48, no. 2, pp. 219-228, 2006. (Pubitemid 44061483)
41. G. L. Calhoun, M. Draper, H. Ruff, and J. Fontejon, "Utility of a tactile display for cueing faults, " in Proc. HFES 46th Ann. Meeting, Santa Monica, CA, 2002, pp. 2144-2148.
42. A. Krausman, L. R. Elliott, and R. Pettit, "Effects of visual, auditory, and tactile alerts on platoon leader performance and decision-making, " Army Res. Lab., Aberdeen Proving Ground, MD, Rep. ARL-TR-3999, 2005.
43. A. Sklar and N. Sarter, "Good vibrations: Tactile feedback in support of attention allocation and human-automation coordination in event-driven domains, " Human Factors, vol. 41, no. 4, pp. 543-552, 1999. (Pubitemid 30194419)
44. J. B. F. van Erp, C. Jansen, T. Dobbins, and H. A. H. C. van Veen, "Vibrotactile waypoint navigation at sea and in the air: Two case studies, " in Proc. Eurohaptics, München, Germany, 2004, pp. 166-173.
45. R. Cholewiak and C. McGrath, "Vibrotactile targeting in multisensory systems: Accuracy and interaction, " in Proc. 14th Symp. Haptic Interf. Virtual Environ. Teleoperator Syst., 2006, pp. 413-420. (Pubitemid 44733205)
46. B. Davis, "Effect of tactical navigation display modality on navigation performance, situation awareness, and mental workload, " in Proc. HFES Ann. Meeting, Santa Monica, CA, 2006, pp. 2089-2093. (Pubitemid 351742081)
47. L. R. Elliott, M. Duistermaat, E. Redden, and J. B. F. van Erp, "Multimodal guidance for land navigation, " Army Res. Lab., Aberdeen Proving Grounds, MD, Rep. ARL-TR-3814, 2007.
48. D. Savick, L. R. Elliott, O. Zubal, and C. Stachowiak, "The effect of audio and tactile cues on soldier decision making and navigation in complex simulation scenarios, " Army Res. Lab., Aberdeen Proving Grounds, MD, Rep. ARL-TR-4413, 2008.
49. R. A. McKinley, L. D. Tripp, Jr., C. Goodyear, J. T. Nelson, and R. L. Esken, "Multisensory cueing to improve UAV operator performance during landing, " Aviation Sci. Environ. Med., vol. 78, no. 3, p. 338, 2007.
50. S. Brewster, and A. King. (2005). The design and evaluation of a vibrotactile progress bar. in Proc. First Joint Eurohaptics Conf. Symp. Haptic Interf. Virtual Environ. Teleoperator Syst. [Online]. Available: http://www2.computer.org/portal/web/csdl/doi/10. 1109/WHC. 2005. 127.
51. C. Ho, M. Nikolic, and N. Sarter, "Supporting timesharing and interruption management through multimodal information presentation, " in Proc. HFES 45th Ann. Meeting, Santa Monica, CA, 2001, pp. 341-345.
52. R. Pettit, E. Redden, and C. Carstens, "Comparison of army hand and arm signals to a covert tactile communication system in a dynamic environment, " Army Res. Lab., Aberdeen Proving Grounds, MD, Rep. ARL-TR-3838, 2006.
53. A. Krausman, R. Pettit, and L. R. Elliott, "Effects of redundant alerts on platoon leader performance and decision making, " Army Res. Lab., Aberdeen Proving Ground, MD, Rep. ARL-TR-3999, 2007.
54. C. Lathan and M. Tracy, "The effects of operator spatial perception and sensory feedback on human-robot teleoperation performance, " Presence, vol. 11, no. 4, pp. 368-377, 2002.
55. L. Eriksson et al., "Vibrotactile and visual threat cueing with high G threat intercept in dynamic flight simulation, " in Proc. HFES 50th Ann. Meeting, Santa Monica, CA, 2006, pp. 1547-1551. (Pubitemid 351741967)
56. T. Dobbins and S. Samways, "The use of tactile navigation cues in highspeed craft operations, " in Proc. RINA Conf. High-Speed Craft: Technol. Oper., London, U. K., 2002, pp. 13-20.
57. G. L. Calhoun andM. Draper, "Multisensory interfaces for remotely operated vehicles, " Adv. Human Perform. Cognitive Eng. Res., vol. 7, pp. 149-163, 2006. (Pubitemid 43580854)
58. H. Tang, D. J. Beebe, and A. F. Kramer, "Comparison of tactile and visual feedback for a multi-state input mechanism, " in Proc. 19th Ann. Int. Conf. IEEE Eng. Med. Biol. Soc., Chicago, IL, 1997, pp. 1697-1700.
59. L. Jones, B. Lockyer, and E. Piatski, "Tactile display and vibrotactile pattern recognition on the torso, " Adv. Robot., vol. 20, no. 12, pp. 1359-1374, 2006. (Pubitemid 46102568)
60. O. Carlander and L. Eriksson, "Uni-and bimodal threat cueing with vibrotactile and 3-D audio technologies in a combat vehicle, " in Proc. HFES 50th Ann. Meeting, Santa Monica, CA, 2006, pp. 1552-1556. (Pubitemid 351741968)
61. A. Krausman and T. White, "Detection and localization of vibrotactile signals in moving vehicles, " Army Res. Lab., Aberdeen Proving Ground, MD, Rep. ARL-TR-4463, 2008.
62. A. H. Rupert, "An instrumentation solution for reducing spatial disorientation mishaps, " IEEE Trans. Eng. Med. Biol., vol. 19, no. 2, pp. 71-80, Mar./Apr. 2000.
63. A. H. Rupert, "Tactile situation awareness system: Proprioceptive prostheses for sensory deficiencies, " Aviation Space Environ. Med., vol. 71, no. 9, pp. A92-A99, 2000.
64. A. H. Rupert, M. Graithwaite, B. McGrath, A. Estrada, and A. Raj. (2004). Tactile situation awareness system flight demonstration [Online]. Army Aeromedical Res. Lab., Fort Rucker, AL, Rep. A891224. Available: http://www.stormingmedia. us/89/8912/A891224.html.
65. B. P. Self, J. B. F. van Erp, L. Eriksson, and L. R. Elliott, "Tactile displays for orientation, navigation, and communication in air, sea, and land environments, " NATO RTO, Brussels, Belgium, Rep. RTO-TR-HFM-122, 2007.
66. R. Pettit, E. Redden, and C. Carstens, "Comparison of army hand and arm signals to a covert tactile communication system in a dynamic environment, " Army Res. Lab., Aberdeen Proving Ground, MD, Rep. ARL-TR-3838, 2008.
67. J. B. F. van Erp et al., "Tactile cueing effect on performance in simulated aerial combat with high acceleration, " Aviation Space Environ. Med., vol. 78, no. 12, pp. 1128-1134, 2007. (Pubitemid 350209935)
68. J. C. Brill and R. Gilson, "Tactile technology for covert communications, " in Proc. HFES 50th Ann. Meeting, Santa Monica, CA, 2006, pp. 1692-1695.
69. H. A. H. C. van Veen and J. B. F. van Erp, "Tactile melodies in user interfaces, " in Proc. HFES 47th Ann. Meeting, Santa Monica, CA, 2003, pp. 751-754.
70. C. M. Reed and N. I. Durlach, "Note on information transfer rates in human communication, " Presence, vol. 7, no. 5, pp. 509-518, 1998.
71. G. Cumming, "Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better, " Perspect. Psychol. Sci., vol. 3, pp. 286-300, 2008.
72. M. D. Coovert, A. G. Walvoord, L. R. Elliott, and E. Redden, "A tool for the accumulation and evaluation of multimodal research, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 24, no. 5, pp. 1884-1906, Nov. 2008.
73. P. E. Shrout and J. L. Fleiss, "Intraclass correlations: Uses in assessing rater reliability, " Psychol. Bulletin, vol. 86, no. 2, pp. 420-428, 1979.
74. J. E. Hunter and F. L. Schmidt, Methods of Meta-Analysis: Correcting Error and Bias in Research Findings. Thousand Oaks, CA: Sage, 2004.
75. L. V. Hedges and I. O. Olkin, StatisticalMethods forMeta-Analysis. San Diego, CA: Academic, 1985.
76. M. Borenstein, L. Hedges, L. Higgins, and H. Rothstein, Comprehensive Meta-Analysis, version 2. 0: A Computer Program for Research Synthesis. Englewood, NJ: Biostat, 2005.
77. R. J. Light and D. J. Pillemer, Summing Up: The Science of Reviewing Research. Cambridge: Harvard Univ. Press, 1984.
78. R. Rosenthal, Meta-analytic Procedures for Social Research. Beverly Hills, CA: Sage, 1984.
79. D. Reeves, K. Winter, R. Kane, T. Elmore, and J. Bleiberg, "ANAM 2001 User's Manual: Clinical and Research Modules, " National Cognitive Recovery Foundation, Anaheim, CA, Rep. NCRF-SR-2001-1, 2001.
80. T. F. Elsmore, "SYNWORK1: A PC-based tool for assessment of performance in a simulated work environment, " Behav. Res. Methods, Instrum.comput., vol. 26, pp. 421-426, 1994.