The effect of apparent latency on simulator sickness while using a see-through helmet-mounted display: Reducing apparent latency with predictive compensation

Human Factors

Volumn 54, Issue 2, 2012, Pages 235-249

  Buker, Timothy J ^a   Vincenzi, Dennis A ^b   Deaton, John E ^a  

^a FLORIDA INSTITUTE OF TECHNOLOGY   (United States)

^b Air 4651   (United States)

Author keywords

apparent latency; extrapolated frame correction; helmet mounted display (HMD); neural network; predictive compensation; simulator sickness

Indexed keywords

APPARENT LATENCY; BODY MOVEMENTS; HEAD MOVEMENTS; HEAD POSITION; POTENTIAL APPLICATIONS; PREDICTIVE COMPENSATION; SIMULATOR SICKNESS; VIRTUAL AND AUGMENTED REALITY; VISUAL IMAGERY;

AUGMENTED REALITY; AVIATORS; EQUIPMENT TESTING; EXPERIMENTS; NEURAL NETWORKS; SIMULATORS;

HELMET MOUNTED DISPLAYS;

ADOLESCENT; ADULT; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLINICAL TRIAL; COMPUTER SIMULATION; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; FEMALE; HEAD; HELMET; HUMAN; INFORMATION PROCESSING; MALE; MOTION SICKNESS; MOVEMENT (PHYSIOLOGY); PATHOPHYSIOLOGY; PHYSIOLOGY; RANDOMIZED CONTROLLED TRIAL; TASK PERFORMANCE;

ADOLESCENT; ADULT; COMPUTER SIMULATION; DATA DISPLAY; FEMALE; HEAD; HEAD PROTECTIVE DEVICES; HUMANS; MALE; MOTION SICKNESS; MOVEMENT; NEURAL NETWORKS (COMPUTER); TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 84859345377     PISSN: 00187208     EISSN: 15478181     Source Type: Journal    
DOI: 10.1177/0018720811428734     Document Type: Article

References (49)

1. Adelstein B. D., Lee T. G., Ellis S. R. Head tracking latency in virtual environments: Psychophysics and a model. Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting ; 2003 ; 2003. 2083.
2. Allison R. S., Harris L. R., Jenkin M., Jasiobedzka U., Zacher J. E. Tolerance of temporal delay in virtual environments. Proceedings of IEEE Virtual Reality Conference 2001 ; 2001 ; 2001. 247.
3. Amenós M. C., Knox P. C., Baker C., Burgess K. The effect of a projected virtual reality training environment on vision symptoms in undergraduates. Investigative Ophthalmology & Visual Science. 2010 ; 51: 954
4. Ames S. L., Wolffsohn J. S., McBrien N. A. The development of a symptom questionnaire for assessing virtual reality viewing using a head-mounted display. Optometry and Vision Science. 2005 ; 82: 168-176 (Pubitemid 40381663)
5. Bertin R. J. V., Collet C., Espié S., Graf W. Objective measurement of simulator sickness and the role of visual-vestibular conflict situations. Proceedings of the Driving Simulation Conference North America 2005 ; 2005 ; 2005. 280.
6. Bouyer L. G., Watt D. G. "Torso rotation" experiments: 1. Adaptation to motion sickness does not correlate with changes in VOR gain. Journal of Vestibular Research. 1996 ; 6: 367-375 (Pubitemid 26344369)
7. Braithwaite M. G., Braithwaite B. D. Simulator sickness in an Army simulator. Journal of the Society of Occupational Medicine. 1990 ; 40: 105-110 (Pubitemid 20250952)
8. Cobb S. V. G., Nichols S., Ramsey A., Wilson J. R. Virtual reality-induced symptoms and effects (VRISE). Presence. 1999 ; 8: 169-186
9. DiZio P., Lackner J. R. Advances in human factors/ergonomics: Vol. 21b. Design of computing systems: Social and ergonomic considerations. Salvendy G. Smith M. J. Salvendy G. Koubek R. J., ed. Amsterdam, Netherlands: Elsevier ; 1997: 893-896.
10. Draper M. H., Viirre E. S., Furness T. A., Gawron V. J. Effects of image scale and system time delay on simulator sickness within head-coupled virtual environments. Human Factors. 2001 ; 43: 129-146 (Pubitemid 32656538)
11. Ellis S. R., Bréant F., Menges B. M., Jacoby R. H., Adelstein B. D. Operator interaction with virtual objects: Effects of system latency. Proceedings of the 7th International Conference on Human-Computer Interaction ; 1997 ; 1997. 973.
12. Ellis S. R., Young M. J., Adelstein B. D., Ehrlich S. M. Discriminability of changes in latency during head movement. Proceedings of the 8th International Conference on Human-Computer Interaction ; 1999a ; 1999a. 1129.
13. Ellis S. R., Young M. J., Adelstein B. D., Ehrlich S. M. Discrimination of changes of latency during voluntary hand movement of virtual objects. Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting ; 1999b ; 1999b. 1182.
14. Hein C. M. Driving simulators: Six years of hands-on experience at Hughes Aircraft Company. Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting ; 1993 ; 1993. 607.
15. ISO 9241-3: Ergonomic requirements for office work with visual display terminals (VDTs). Part 3: Visual display requirements. Geneva, Switzerland: Author ; 1992 :
16. Johnson D. M. Introduction to and review of silulator sickness research (Research Rep. 1832). Arlington, VA: U.S. Army Research Institute for the Behavioral and Social Sciences ; 2005 :
17. Jung J. Y., Adelstein B. D., Ellis S. R. Discriminability of predicted artifacts in a time-delayed virtual environment. Proceedings of the International Ergonomics Association/Human Factors and Ergonomics Society Congress ; 2000 ; 2000. 499.
18. Keller K., Colucci D. Proceedings of SPIE Vol. 3362: Helmet- and head-mounted displays III. Bellingham, WA: International Society for Optical Engineering ; 1998: 46-53.
19. Kellog R. S., Kennedy R. S., Graybiel A. Motion sickness symptomatology of labyrinthine defective and normal subjects during zero gravity maneuvers. Aerospace Medicine. 1965 ; 36: 315-318
20. Kennedy R. S., Lane N. E., Berbaum K. S., Lilienthal M. G. A simulator sickness questionnaire (SSQ): A new method for quantifying simulator sickness. International Journal of Aviation Psychology. 1993 ; 3: 203-220
21. Kennedy R. S., Lilienthal M. G., Berbaum K. S., Baltzley D. R., McCauley M. E. Simulator sickness in U.S. Navy flight simulators. Aviation, Space, and Environmental Medicine. 1989 ; 60: 10-16 (Pubitemid 19039478)
22. Kennedy R. S., Tolhurst G. C., Graybiel A. Pensacola, FL: Naval School of Aviation Medicine ; 1965 :
23. Kozulin P., Ames S. L., McBrien N. A. Effects of a head-mounted display on the oculomotor system of children. Optometry and Vision Science. 2009 ; 86: 845-856
24. LaViola J. J. A discussion of cybersickness in virtual environments. SIGCHI Bulletin. 2000 ; 32: 47-56
25. Mania K., Adelstein B., Ellis S. R., Hill M. Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity. Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization ; 2004 New York, NY: Association for Computing Machinery Press ; 2004. 39.
26. Mertler C. A., Vannatta R. A. Advanced and multivariate statistical methods: Practical application and interpretation. 2002 ). Advanced and multivariate statistical methods: Practical application and interpretation (2nd ed.). Los Angeles, CA: Pyrczak. Los Angeles, CA: Pyrczak ; 2002 :
27. Moss J. D., Muth E. R. Characteristics of head-mounted displays and their effects on simulator sickness. Human Factors. 2011 ; 53: 308-319
28. Moss J. D., Muth E. R., Tyrrell R. A., Stephens B. R. Perceptual thresholds for display lag in a real visual environment are not affected by field of view or psychophysical technique. Displays. 2010 ; 31: 143-149
29. Moss J. D., Scisco J. L., Muth E. R. Simulator sickness during head mounted display (HMD) of real world video captured scenes. Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting ; 2008 ; 2008. 1631.
30. Nelson T. W., Roe M. M., Bolia R. S., Morley R. M. Paper presented at the IMAGE 2000 Conference ; 2000 Scottsdale, AZ ; 2000.
31. Pausch R., Crea T., Conway M. A literature survey for virtual environments: Military flight simulator visual systems and simulator sickness. Presence. 1992 ; 1: 344-363
32. Pray R. E., Hyttinen D. H. Paper presented at the Interservice/Industry Training, Simulation, and Education Conference ; 2004 Orlando, FL ; 2004.
33. Rash C. E., Russo M. B., Letowski T. R., Schmeisser E. T. Fort Rucker, AL: U.S. Army Aeromedical Research Laboratory ; 2009 :
34. Reason J. T. Motion sickness: A special case of sensory rearrangement. Advancement of Science. 1970 ; 26: 386-393
35. Reason J. T. Motion sickness adaptation: A neural mismatch model. Journal of the Royal Society of Medicine. 1978 ; 71: 819-829 (Pubitemid 9047761)
36. Reason J. T., Brand J. J. Motion sickness. London, UK: Academic Press ; 1975 :
37. Regan C. An investigation into nausea and other side-effects of head-coupled immersive virtual reality. Virtual Reality. 1995 ; 1 (1). 17-32
38. Regan E. C., Price K. R. The frequency of occurrence and severity of side-effects of immersion virtual reality. Aviation, Space, and Environmental Medicine. 1994 ; 65: 527-530 (Pubitemid 24161834)
39. Regan M., Miller G., Rubin S., Kogelnik C. A real-time low-latency hardware light field renderer. Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) ; 1999 ; 1999. 287.
40. Riccio G. E., Stoffregen T. A. An ecological theory of motion sickness and postural instability. Ecological Psychology. 1991 ; 3: 195-240
41. Sheridan T. B., Ferrell W. R. Remote manipulative control with transmission delay. IEEE Transactions on Human Factors in Electronics. 1963 ; 4: 25-29
42. Smart L. J., Pagulayan R. J., Stoffregen T. A. Self-induced motion sickness in unperturbed stance. Brain Research Bulletin. 1998 ; 47 (5). 449-457 (Pubitemid 29095352)
43. So R. H. Y. Paper presented at the United Kingdom Informal Group Meeting on Human Response to Vibration ; 1994 Alverstoke, UK ; 1994.
44. Stanney K. M., Kennedy R. S. Human factors in simulation and training. Vincenzi D. A. Wise J. A. Mouloua M. Hancock P. A., ed. New York, NY: CRC Press ; 2008: 117-127.
45. Tabachnick B. G., Fidell L. S. 1996 ). Using multivariate statistics (3rd ed.). New York, NY: HarperCollins. New York, NY: HarperCollins ; 1996 :
46. Vincenzi D. A., Deaton J. E., Buker T. J., Blickensderfer E. L., Pray R., Williams B. Mitigation of system latency in next generation helmet mounted display systems (NGHMDS). Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting ; 2011 ; 2011. 2163.
47. Vincenzi D. A., Blickensderfer E. L., Deaton J. E., Buker T. J., Pray R. Paper presented at the Interservice/Industry Training, Simulation, and Education Conference ; 2009 Orlando, FL ; 2009.
48. Wu J. R., Ouhyoung M. On latency compensation and its effects on head-motion trajectories in virtual environments. Visual Computer. 2000 ; 16: 79-90
49. Young S. D., Adelstein B. D., Ellis S. R. Demand characteristics of a questionnaire used to assess motion sickness in a virtual environment. Proceedings of IEEE Virtual Reality Conference 2006 ; 2006 ; 2006. 97.