Human-system interface based on speech recognition: application to a virtual nuclear power plant control desk

Progress in Nuclear Energy

Volumn 52, Issue 4, 2010, Pages 379-386

  Jorge, Carlos Alexandre F ^a   Mól, Antônio Carlos A ^a   Pereira, Cláudio Márcio N A ^a   Aghina, Maurício Alves C ^a   Nomiya, Diogo V ^b  

^a INSTITUTO DE PESQUISAS ENERGÉTICAS E NUCLEARES   (Brazil)

^b FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

Human system interface; Nuclear power plant operation training; Speech recognition; Virtual control desk

Indexed keywords

ARTIFICIAL NEURAL NETWORK; AUTOMATIC SPEECH RECOGNITION; AUTOMATIC SPEECH RECOGNITION SYSTEM; CEPSTRAL ANALYSIS; CONTROL DESKS; ERGONOMIC EVALUATION; HUMAN SYSTEM INTERFACE; NUCLEAR POWER; OPERATOR TRAINING; SIGNAL PROCESSING TECHNIQUE; TRAINING SPEECH; VIRTUAL CONTROL; VIRTUAL REALITY TECHNOLOGY;

COMPUTER CONTROL SYSTEMS; COMPUTER KEYBOARDS; NEURAL NETWORKS; NUCLEAR ENERGY; NUCLEAR INDUSTRY; NUCLEAR POWER PLANTS; PERSONNEL TRAINING; PROJECTION SCREENS; SIGNAL PROCESSING; USER INTERFACES; VIRTUAL REALITY;

SPEECH RECOGNITION;

EID: 76749117504     PISSN: 01491970     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.pnucene.2009.08.003     Document Type: Article

References (50)

1. Aghina, M.A.C., Mól, A.C.A., Almeida, A.A.H., Pereira, C.M.N.A., Varela, T.F.B., Cunha, G.G., 2007. Full scope simulator of a nuclear power plant control room using 3D stereo virtual reality techniques for operators training. In: 2007 International Nuclear Atlantic Conference (INAC 2007), Santos, SP, Brazil, Sept. 30 - Oct. 05, DVD-ROM; Available from: http://www.inac2007.com.br/dvd/pdf_dvd/R18_1077.pdf.
2. Aghina M.A.C., Mól A.C.A., Jorge C.A.F., Pereira C.M.N.A., Varela T.F.B., Cunha G.G., and Landau L. Virtual control desks for nuclear power plant simulation: improving operator training. IEEE Computer Graphics and Applications 28 4 (2008) 6-9
3. Aghina, M.A.C., 2009. Abstract (in English) of the M.Sc. Dissertation: Mesa de controle virtual para treinamento de operadores: um estudo de caso para um simulador de usina nuclear (Virtual control desk for operators training: a case study for a nuclear plant simulator), Universidade Federal do Rio de Janeiro (Federal University of Rio de Janeiro); Available from: http://www.coc.ufrj.br/en/index.php?option=com_content&task= view&id=3931&Itemid=150
4. ANSI/ANS-3.1, 1993. Selection, qualification and training of personnel for nuclear power plants.
5. ANSI/ANS-3.5, 1993. Nuclear power plants simulators for use in operators training and examinations.
6. ANSI/ANS-3.2, 1994. Administrative controls and quality assurance to the operational phase of nuclear power plants.
7. Carvalho P.V.R., Santos I.J.A.L., Gomes J.O., Borges M.R.S., and Guerlain S. Human factors approach for evaluation and redesign of human-system interfaces of a nuclear power plant simulator. Displays 29 3 (2008) 273-284
8. Deller Jr. J.R., Proakis J.G., and Hansen J.H. Discrete-time Processing of Speech Signals (1993), MacMillan, New York
9. Diniz, S., Thomé, A.G., Santos, S.C.B., Silva, D.G., 1999a. Automatic speech recognition: a comparative evaluation between neural networks and hidden markov models. In: International Conference on Computation Intelligence for Modelling, Control and Automation (CIMCA 99), Vienna, Austria, February 17-19; Available from: http://www.labic.nce.ufrj.br/downloads/cimca_1999.pdf.
10. Diniz, S., Thomé, A.G., Santos, S.C.B., Silva, D.G., 1999b. Automatic speech recognition: a study and performance evaluation on neural networks and hidden markov models. In: 5th International Conference on Information System, Analysis and Synthesis (ISAS'99), Orlando, FL, USA, July 31-August 4; Available from: http://www.labic.nce.ufrj.br/downloads/isas_1999.pdf.
11. Drøivoldsmo A., and Louka M.N. Virtual reality tools for testing control room concepts. In: Liptak B.G. (Ed). Instrument Engineer's Handbook: Process Software and Digital Networks. third ed. vol. 3 (2002), CRC Press
12. Drøivoldsmo, A., 2003. New tools and technology for the study of human performance in simulator experiments. Dr.Polit. Thesis, Norwegian University of Science and Technology, Norway; Available from: http://ntnu.diva-portal.org/smash/get/diva2:123651/FULLTEXT01.
13. Drøivoldsmo A., Helgar S., Nystad E., Johnsen T., Louka M.N., and Seregi L. Verification of Workplace Design Guidelines for the Control Room: Can Virtual Reality Replace the Physical Mock-up?. Available from: (2000), OECD Halden Reactor Project, Halden, Norway. http://www2.hrp.no/vr/publications/nfe2000.pdf
14. Feher, M.P., 1999. Application of human factors to the Candu 6 Control Room upgrade, In: IAEA Workshop Specialists's Meeting on Approaches for the 171 Integration of Human Factors into the Upgrading and Refurbishment of Control Rooms, Halden, Norway, 23-25 Aug.
15. Foley J.D., Wallace V.L., and Chan P. Human Computer Interaction (1998), Prentice Hall
16. Furui S. Cepstral analysis technique for automatic speaker verification. IEEE Transactions on Acoustics, Speech and Signal Processing ASSP 29 2 (1981) 254-272
17. Hanes L.F., and Naser J. Use of 2.5-D and 3-D technology to evaluate control room upgrades. The American Nuclear Society Winter Meeting & Nuclear Technology Expo (2006), Albuquerque, NM November 12-16
18. Haykin S. Neural Networsks - A Comprehensive Foundation (1999), Prentice-Hall, Upper Saddle River, NJ
19. Hollnagel E. A Survey of Man-machine System Evaluation Methods. Tech. Report (1985), Halden Reactor Project, Organisation for Economic Cooperation and Development
20. Huang B.-H., Rabiner L.R., and Wilpon J.G. On the use of bandpass liftering in speech recognition. IEEE Transactions on Acoustics, Speech and Signal Processing ASSP 35 7 (1987) 947-954
21. IAEA-TECDOC 565, 1990. Control rooms and man-machine interface in nuclear power plants.
22. IAEA-TECDOC 668, 1992. The role of automation and humans in nuclear power plants.
23. IAEA-TECDOC 812, 1995. Control room systems design for nuclear power plants.
24. IAEA-TECDOC 995, 1998. Selection, specification, design and use of various nuclear power plant training simulators.
25. IEC 964, 1989. Design of control rooms for nuclear power plants.
26. IEC 1227, 1993. Nuclear power plants control rooms - operator controls.
27. IEC 1771, 1995. Nuclear power plants - main control room - verification and validation of design.
28. IEC 1772, 1995. Nuclear power plants - main control room - application of visual display units.
29. Jorge, C.A.F., Aghina, M.A.C., Mól, A.C.A., Pereira, C.M.N.A., 2007. Man machine interface based on speech recognition. In: 2007 International Nuclear Atlantic Conference (INAC 2007), Santos, SP, Brazil, Sept. 30-Oct. 05, DVD-ROM; Available from: http://www.inac2007.com.br/dvd/pdf_dvd/R18_953.pdf.
30. Kantowitz B.H., and Sorkin R.D. Human Factors: Understanding People System Relationships (1983), Wiley, New York
31. Kvalen J., Haugset K., and Øwre F. The Simulator-based Halden Man-Machine Laboratory (HAMMLAB) and its Application in Human Factor Studies. Available from: (2005), OECD Halden Reactor Project, Institute for Energy Technology, Norway. http://www.ife.no/laboratories/hammlab/files/hammlabpaper/Attachment/at_ download
32. Lima, A.A., 2000. Abstract (in English) of the M.Sc. dissertation: Análises comparativas em sistemas de reconhecimento de voz (Comparative analysis in speech recognition systems), Universidade Federal do Rio de Janeiro (Federal University of Rio de Janeiro): http://www.pee.ufrj.br/teses/index.php?Abstract=2000094002.
33. Louka, M.N., Gustavsen, M.A., Edvarsen, S.T., 2006. Using virtual reality to support multi-participant human-centered design processes for control room design. Report number IFE/HR/E-2006/017. OECD Halden Reactor Project, Institute for Energy Technology; Available from: http://www.ife.no/publications/2006/mto/publication.2006-09-14.972452443 2/fss_download/Attachmentfile.
34. Malone T.B. Human Factors of Control Room Design and Operator Performance at Three Mile Island (1980) Washington, USA
35. Markidis S., and Rizwan-uddin. A virtual control room with an embedded, interactive nuclear reactor simulator. The American Nuclear Society Winter Meeting & Nuclear Technology Expo (2006), Albuquerque, NM November 12-16
36. Nystad, E., Sebok, A., 2004. A comparison of two presence measures based on experimental results. 7th Annual International Workshop Presence 2004, Valencia, Spain, 13-15 October; Available from: http://www.ife.no/publications/2007/mto/publication.2007-10-08.791180933 2/fss_download/Attachmentfile.
37. Nystad, E., Strand, S., 2006. Using virtual reality technology to include field operators in simulation and training. In: 27th Annual Cannadian Nuclear Society Conference and 30th CNS/CNA Student Conference, Toronto, ON, Canada, June 11 - 14; Available from: http://www.ife.no/publications/2006/mto/publication.2006-11-03.940019276 2/fss_download/Attachmentfile.
38. O'Hara J., Stubler W., and Wachtel J. Methodological Issues in The Validation of Complex Human-Machine Systems (1995) Philadelphia, PA, USA
39. Oliveira, M.V., Santos, I.J.A.L., Carvalho, P.V.R., Mól, A.C.A., Grecco, C.H.S., Moreira, D.M., 2007. Design and evaluation of human-system interfaces for industrial plants. In: 2007 International Nuclear Atlantic Conference (INAC 2007), DVD-ROM, Santos, SP, Brazil, September 30 to October 05; Available from: http://www.inac2007.com.br/dvd/pdf_dvd/R18_865.pdf.
40. Oppenheim A.V., and Schafer R.W. Discrete-Time Signal Processing (1989), Prentice-Hall, Englewood Cliffs, NJ
41. Pikaar R.N. Ergonomics in control room design. Ergonomics 33 5 (1990) 589-600
42. Pinto, R.G., Pinto, H.L., Calôba, L.P., 1995. Using neural networks for automatic speaker recognition. In: Proceedings of the IEEE 38th Midwest Symposium on Circuits and Systems, vol. 2, Rio de Janeiro, RJ, Brazil, pp. 1078-1080.
43. Pinto, H.L., Pinto, R.G., Calôba, L.P., 1996. A speaker verification method using LPC singularity locations. In: Records of the Bi-Annual International Telecommunications Symposium (ITS/ROC&C'96), pp. 39-43.
44. Press W.H., Flannery B.P., Teukolsky S.A., and Vetterling W.T. Numerical Recipes in C: The Art of Scientific Computing. second ed. (1992), Cambridge University Press, New York
45. Rabiner L.R., and Sambur M.R. An algorithm for determining the end-points of isolated utterances. Bell Systems Technical Journal 54 (1975) 297-315
46. Rabiner L.R., and Schafer R.W. Digital Processing of Speech Signals (1978), Prentice-Hall, London
47. Rindahl, G., Johnsen, T., Mark, N.-K., Meyer, G., 2006. Virtual reality in planning and operations from research topic to practical issue. Report number IFE/HR/E-2006/014. OECD Halden Reactor Project, Institute for Energy Technology.
48. Santos I.J.A.L., Teixeira D.V., Ferraz F.T., and Carvalho P.V.R. The use of a simulator to include human factors issues in the interface design of a nuclear power plant control room. Journal of Loss Prevention in the Process Industries 21 3 (2008) 227-238
49. Sebok, A., Nystad, E., Helgar, S., 2004. Navigation in desktop virtual environments: An evaluation and recommendations for supporting usability. Virtual reality 8(1), 26-40; Available from: http://www.ife.no/publications/2007/mto/publication.2007-10-08.368916214 5/fss_download/Attachmentfiles.
50. Skjerve, A.B., Strand, S., 2007. Teamwork in a new operational environment in nuclear power plants. Preliminary results from the extended teamwork study. Report number IFE/HR/E-2007/006. OECD Halden Reactor Project; Available from: http://www.ife.no/publications/2006/mto/publication.2007-04-26.497942993 0/fss_download/Attachmentfile.