Training Effectiveness of Whole Body Flight Simulator Motion: A Comprehensive Meta-Analysis

International Journal of Aviation Psychology

Volumn 22, Issue 2, 2012, Pages 164-183

  de Winter, Joost C F ^a   Dodou, Dimitra ^a   Mulder, Max ^b  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84859595974     PISSN: 10508414     EISSN: None     Source Type: Journal    
DOI: 10.1080/10508414.2012.663247     Document Type: Article

References (77)

1. Advani, S. K. and Hosman, R. J. A. W. 2006. "Revising civil simulator standards-An opportunity for technological pull". In Proceedings of the AIAA Modeling and Simulation Technologies Conference and Exhibit (AIAA 2006-6248), Keystone, CO: American Institute of Aeronautics and Astronautics.
2. Advisory Group for Aerospace Research and Development. 1980. Fidelity of simulation for pilot training (Tech. Rep. No. AGARD-AR-159), Neuilly sur Seine, France: North Atlantic Treaty Organization.
3. Berkouwer, W. R., Stroosma, O., Van Paassen, M. M., Mulder, M. and Mulder, J. A. 2005. "Measuring the performance of the SIMONA research simulator's motion system". In Proceedings of the AIAA Modeling and Simulation Technologies Conference and Exhibit (AIAA 2005-6504), San Francisco, CA: American Institute of Aeronautics and Astronautics.
4. Boldovici, J. A. 1992. Simulator motion (Tech. Rep. No. 961), Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
5. Brown, Y. J., Cardullo, F. M. and Sinacori, J. B. 1989. "Need-based evaluation of simulator force and motion cuing devices". In Proceedings of AIAA Flight Simulation Technologies Conference (AIAA 89-3272-CP), Monterey, CA: American Institute of Aeronautics and Astronautics.
6. Buckhout, R., Sherman, H., Goldsmith, C. T. and Vitale, P. A. 1963. The effect of variations in motion fidelity during training on simulated low-altitude flight (Tech. Rep. No. AMRL-TDR-63-108), Wright-Patterson Air Force Base, OH: Aerospace Medical Research Laboratories.
7. Bürki-Cohen, J., Goldsmith, T. H., Chung, W. W., & Schroeder, J. A. (2004). Simulator platform motion requirements for recurrent airline pilot training and evaluation (Final Rep.). www.volpe.dot.gov/coi/hfrsa/docs/spmrrapte.doc
8. Bürki-Cohen, J., Soja, N. N., Go, T. H., Boothe, E. M., DiSario, R., & Jo, Y. J. (2001). Simulator fidelity: The effect of platform motion (Final Rep.). www.volpe.dot.gov/coi/hfrsa/docs/sifi1001.doc
9. Bürki-Cohen, J., Soja, N. N. and Longridge, T. 1998. Simulator platform motion-The need revisited. International Journal of Aviation Psychology, 8: 293-317.
10. Bürki-Cohen, J., Sparko, A. L. and Bellman, M. 2011. "Flight simulator motion literature pertinent to airline-pilot recurrent training and evaluation". In Proceedings of the AIAA Modeling and Simulation Technologies Conference and Exhibit (AIAA 2011-6320), Portland, OR: American Institute of Aeronautics and Astronautics.
11. Caro, P. W. 1976. Some factors influencing transfer of simulator training (Tech. Rep. No. HumRRO-PP-1-76), Alexandria, VA: Human Resources Research Organization.
12. Caro, P. W. 1979. The relationship between flight simulator motion and training requirements. Human Factors, 21: 493-501.
13. Cohen, E. 1970. Is motion needed in flight simulators used for training?. Human Factors, 12: 75-79.
14. Comstock, J. R. Jr. 1984. Oculometric indices of simulator and aircraft motion (NASA Contractor Rep. No. 3801), Washington, DC: National Aeronautics and Space Administration.
15. Crossman, E. R. F. W. 1959. A theory of the acquisition of speed-skill. Ergonomics, 2: 153-166.
16. Cyrus, M. L. 1977. Engineering and geometric constraints of a six degree of freedom synergistic platform motion system (Tech. Rep. No. AFHRL-TR-77-5), Williams Air Force Base, AZ: Air Force Human Resources Laboratory.
17. DeBerg, O. H., McFarland, B. P. and Showalter, T. W. 1976. "The effect of simulator fidelity on engine failure training in the KC-135 aircraft". In Proceedings of the Visual and Motion Simulation Conference, 83-87. Dayton, OH: American Institute of Aeronautics and Astronautics.
18. De Groot, S., De Winter, J. C. F., Mulder, M. and Wieringa, P. A. 2011. Non-vestibular motion cueing in a fixed-base driving simulator: Effects on driver braking and cornering performance. Presence: Teleoperators and Virtual Environments, 20: 117-142.
19. De Winter, J. C. F., Dodou, D., & Mulder, M. (2012). Supplementary material for "Training effectiveness of whole body flight simulator motion: A comprehensive meta-analysis." https://docs.google.com/?tab=oo&authuser=0#folders/0ByG9qtADR1WHY2I0MWRjZTAtMzZmZS00YzM2LTk3ZjAtZDhiOTAxOTYxYzQw
20. Douvillier, J. G. Jr., Turner, H. L., McLean, J. D. and Heinle, D. R. 1960. Effects of flight simulator motion on pilots' performance of tracking tasks (Tech. Rep. No. NASA TN-D-143), Washington, DC: National Aeronautics and Space Administration.
21. Feddersen, W. E. 1962. The role of motion information and its contribution to simulation validity (Tech. Rep. No. D228-429-001), Fort Worth, TX: Bell Helicopter Company.
22. Gebman, J. R., Stanley, W. L., Barbour, A. A., Berg, R. T., Birkler, J. L., Chaloupka, M. G.,., Kirkwood, T. F. and Batten, C. L. 1986. Assessing the benefits and costs of motion for C-I7 flight simulators: Technical appendixes (Tech. Rep. No. N-2301-AF), Santa Monica, CA: RAND Corporation. with
23. Gray, T. H. and Fuller, R. R. 1977. Effects of simulator training and platform motion on air-to-surface weapons delivery training (Tech. Rep. No. AFHRL-TR-77-29). Brooks Air, Force Base, TX: Air Force Human Resource Laboratory.
24. Gundry, A. J. April 1976. Man and motion cues, April, London, UK: Paper presented at the Third Flight Symposium on Theory and Practice in Flight Simulation.
25. Gundry, A. J. 1977. "The effectiveness and sophistication of motion cues provided in flight simulators". In Human operators and simulation, 36-41. London, UK: The Institute of Measurement and Control.
26. Hagin, W. V. 1976. "Platform motion in flight simulators: Critical or nice?". In Proceedings of the Society for Applied Learning Technology, 151-154. Washington, DC: Society for Applied Learning Technology.
27. Hall, J. R. 1989. The need for platform motion in modern piloted flight training simulators (Tech. Memo No. FM 35), Bedford, UK: Royal Aerospace Establishment.
28. Heintzman, R. J. 1996. Determination of force cueing requirements for tactical combat flight training devices (Tech. Rep. No. ASC-TR-97-5001), Wright-Patterson Air Force Base, OH: Training Systems Product Group.
29. Hopkins, C. O. 1975. How much should you pay for that box?. Human Factors, 17: 533-541.
30. Horey, J. D. 1992. "Estimating the impact of restricting simulated motion on transfer of training in rotary wing aircraft". In Proceedings of the 14th Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), San Antonio: TX.
31. Jacobs, J. W., Prince, C., Hays, R. T. and Salas, E. 1990. A meta-analysis of the flight simulator training research (Tech. Rep. No. TR-89-006), Orlando, FL: Naval Training Systems Center.
32. Jacobs, R. S. 1976. Simulator cockpit motion and the transfer of initial flight training (Doctoral dissertation), Urbana, IL: University of Illinois at Urbana-Champaign.
33. Jaeger, B. K. and Mourant, R. R. 2001. "Comparison of simulator sickness using static and dynamic walking simulators". In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, Virtual Environments, 1896-1900. Santa Monica, CA: Human Factors and Ergonomics Society.
34. Jorna, P. G. A. M., Van der Pal, J., Foy, L., Trumm, E., Willems, K., Braun, P.,. and Stott, J. 1998. Training device applications: Airborne systems experiments. Part I: Fixed wing (Euclid 11.1, C3.3.1)
35. Kallus, K. W. 2009. "Psychological fidelity of simulator human performance limitation training". In Proceedings of the 15th International Symposium on Aviation Psychology, Dayton, OH: Wright State University.
36. Koonce, J. M. 1974. Effects of ground-based aircraft simulator motion conditions upon prediction of pilot proficiency (Doctoral dissertation), Urbana, IL: University of Illinois at Urbana-Champaign.
37. Lee, A. T. and Bussolari, S. R. 1989. Flight simulator platform motion and air transport pilot training. Aviation. Space, and Environmental Medicine, 60: 136-140.
38. Levison, W. H., Lancraft, R. E. and Junker, A. M. 1979. "Effects of simulator delays on performance and learning in a roll-axis tracking task". In Proceedings of the 15th Annual Conference on Manual Control, Edited by: George, F. L. 168-186. Dayton, OH: Wright State University.
39. Lintern, G. 1991. An informational perspective on skill transfer in human-machine systems. Human Factors, 33: 251-266.
40. Martin, E. A. 1985. The influence of tactual seat-motion cues on training and performance in a roll-axis compensatory tracking task setting (Doctoral dissertation), Columbus, OH: Ohio State University.
41. Martin, E. L. 1981. Training effectiveness of platform motion: Review of motion research involving the advanced simulator for pilot training and the simulator from air-to-air combat (Tech. Rep. No. AFHRL-TR-79-51), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
42. Martin, E. L. and Waag, W. L. 1978a. Contributions of platform motion to simulator training effectiveness: Study I-Basic contact (Tech. Rep. No. AFHRL-TR-78-15), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
43. Martin, E. L. and Waag, W. L. 1978b. Contributions of platform motion to simulator training effectiveness: Study II-Aerobatics (Tech. Rep. No. AFHRL-TR-78-52), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
44. McCauley, M. E. 2006. Do Army helicopter training simulators need motion bases? (Tech. Rep. No. 1176), Arlington, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.
45. McDaniel, W. C., Scott, P. G. and Browning, R. F. 1983. Contribution of platform motion simulation in SH-3 helicopter pilot training (Tech. Rep. No. 153), Orlando, FL: Training Analysis and Evaluation Group.
46. Nataupsky, M., Waag, W. L., Weyer, D. C., McFadden, R. W. and McDowell, E. 1979. Platform motion contributions to simulator training effectiveness: Study III-Interaction of motion with field-of-view (Tech. Rep. No. AFHRL-TR-79-25), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
47. Noble, C. 2002. The relationship between fidelity and learning in aviation training and assessment. Journal of Air Transportation, 7: 33-54.
48. Nusseck, H.-G., Teufel, H. J., Nieuwenhuizen, F. M. and Bülthoff, H. H. 2008. "Learning system dynamics: Transfer of training in a helicopter hover simulator". In Proceedings of the AIAA Modeling and Simulation Technologies Conference and Exhibit (AIAA 2008-7107), Honolulu, HI: American Institute of Aeronautics and Astronautics.
49. Orlansky, J. and String, J. 1977. Cost-effectiveness of flight simulators for military training: Vol. I. Use and effectiveness of flight simulators (Paper No. P-1275), Arlington, VA: Institute for Defense Analyses.
50. Parris, B. L. and Cook, A. M. 1978. Effects of visual and motion simulation cueing systems on pilot performance during takeoffs with engine failures (NASA Technical Paper No. 1365), Washington, DC: National Aeronautics and Space Administration.
51. Pfeiffer, M. G. and Horey, J. D. 1987. Training effectiveness of aviation motion simulation: A review and analysis of the literature (Special Rep. No. 87-007), Orlando, FL: Naval Training Systems Center.
52. Pfeiffer, M. G. and Scott, P. G. 1985. Experimental and analytic evaluation of the effects of visual and motion simulation in SH-3 helicopter training (Tech. Rep. No. 85-002), Orlando, FL: Naval Training Systems Center.
53. Pohlmann, L. D. and Reed, J. C. 1978. Air-to-air combat skills: Contribution of platform motion to initial training (Tech. Rep. No. AFHRL-TR-78-53), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
54. Pool, D. M., Mulder, M., Van Paassen, M. M. and Van der Vaart, J. C. 2008. Effects of peripheral visual and physical motion cues in roll-axis tracking tasks. Journal of Guidance, Control, and Dynamics, 31: 1608-1622.
55. Reed, L. E. 1977. Visual-proprioceptive cue conflicts in the control of remotely piloted vehicles (Tech. Rep. No. AFHRL-TR-77-57), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
56. Reid, L. D. and Nahon, M. A. 1988. Response of airline pilots to variations in flight simulator motion algorithms. Journal of Aircraft, 25: 639-646.
57. Rolfe, J. M., Hammerton-Fraser, A. M., Poulter, R. F. and Smith, E. M. B. 1970. Pilot response in flight and simulated flight. Ergonomics, 13: 761-768.
58. Ruocco, J. N., Vitale, P. A. and Benfari, R. C. 1965. Kinetic cueing in simulated carrier approaches (Tech. Rep. No. NAVTRADEVCEN 1432-1 & 1432-1-S1), Port Washington, NY: U.S. Naval Training Device Center.
59. Rushton, J. P., Brainerd, C. J. and Pressley, M. 1983. Behavioral development and construct validity: The principle of aggregation. Psychological Bulletin, 94: 18-38.
60. Ryan, L. E., Scott, P. G. and Browning, R. F. 1978. The effects of simulator landing practice and the contribution of motion simulation to P-3 pilot training (TAEG Rep. No. 63), Orlando, FL: Training Analysis and Evaluation Group.
61. Schmidt, F. L. 1992. What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47: 1173-1181.
62. Schmidt, F. L. and Le, H. 2004. Software for the Hunter-Schmidt meta-analysis methods, Iowa City, IA: University of Iowa, Department of Management & Organizations.
63. Schmidt, R. A. and Wulf, G. 1997. Continuous concurrent feedback degrades skill learning: Implications for training and simulation. Human Factors, 39: 509-525.
64. Schroeder, J. A. and Chung, W. W. Y. 2000. Simulator platform motion effects on pilot-induced oscillation prediction. Journal of Guidance, Control, and Dynamics, 23: 438-444.
65. Sharkey, T. J. and McCauley, M. E. 1992. "Does a motion base prevent simulator sickness?". In Proceedings of AIAA/AHS Flight Simulation Technologies Conference (AIAA 92-4133-CP), Hilton Head, SC: American Institute of Aeronautics and Astronautics.
66. Showalter, T. W. and Parris, B. L. 1980. The effects of motion and g-seat cues on pilot simulator performance of three piloting tasks (Tech Rep. No. NASA TP-1601), Washington, DC: National Aeronautics and Space Administration.
67. Taylor, H. L., Lintern, G. and Koonce, J. M. 1993. Quasi-transfer as a predictor of transfer from simulator to airplane. The Journal of General Psychology, 120: 257-276.
68. Vaden, E. A. and Hall, S. 2005. The effect of simulator platform motion on pilot training transfer: A meta-analysis. International Journal of Aviation Psychology, 15: 375-393.
69. Valverde, H. H. 1973. A review of flight simulator transfer of training studies. Human Factors, 15: 510-523.
70. Waag, W. L. 1981. Training effectiveness of visual and motion simulation (Tech. Rep. No. AFHRL-TR-79-72), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
71. Westra, D. P. 1982. Simulator design features for carrier landing: II. In-simulator transfer of training (Tech. Rep. No. NAVTRAEQUIPCEN 81-C-0105-1), Orlando, FL: Naval Training Equipment Center.
72. White, M. D. and Padfield, G. D. 2004. "Flight simulation in academia: Progress with HELIFLIGHT at the University of Liverpool". In Proceedings of Flight Simulation 1929-2029: A centennial perspective (Paper 0421), London, UK: Royal Aeronautical Society.
73. Wilson, D. B. (2002). ES Calculator [Spreadsheet]. http://mason.gmu.edu/~dwilsonb/downloads/ES_Calculator.xls
74. Woodruff, R. R. and Smith, J. F. 1974. T-4G simulator and T-4 ground training devices in USAF undergraduate pilot training (Tech. Rep. No. AFHRL-TR-74-78), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
75. Woodruff, R. R., Smith, J. F., Fuller, J. R. and Weyer, D. C. 1976. Full mission simulation in undergraduate pilot training: An exploratory study (Tech. Rep. No. AFHRL-TR-76-84), Brooks Air Force Base, TX: Air Force Human Resources Laboratory.
76. Young, L. R. 1966. "Some effects of motion cues on manual tracking". In Proceedings of the Second Annual NASA-University Conference on Manual Control, 231-239. Washington, DC: National Aeronautics and Space Administration.
77. Note. References marked with an asterisk indicate studies included in the meta-analysis.