NAVIG: Guidance system for the visually impaired using virtual augmented reality

Technology and Disability

Volumn 24, Issue 2, 2012, Pages 163-178

  Katz, Brian F G ^a   Dramas, Florian ^a,b   Parseihian, Gaëtan ^a   Gutierrez, Olivier ^b   Kammoun, Slim ^b   Brilhault, Adrien ^a,b   Brunet, Lucie ^a   Gallay, Mathieu ^a   Oriola, Bernard ^b   Auvray, Malika ^a   Truillet, Philippe ^b   Denis, Michel ^a   Thorpe, Simon ^a   Jouffrais, Christophe ^b  

^a CNRS   (France)

^b IRIT   (France)

Author keywords

Assisted navigation; guidance; need analysis; spatial audio; visually impaired assistive device

Indexed keywords

ACCURACY; ARTICLE; ASSISTIVE TECHNOLOGY; ASSISTIVE TECHNOLOGY DEVICE; AUDIOVISUAL EQUIPMENT; COMPUTER INTERFACE; DATA PROCESSING; DIRECTIONAL VISION; GEOGRAPHIC INFORMATION SYSTEM; HUMAN; IMAGE DISPLAY; IMAGE PROCESSING; NAVIGATION ASSISTED BY ARTIFICIAL VISION AND GLOBAL NAVIGATION SATELLITE SYSTEM; PATIENT AUTONOMY; PATIENT CARE PLANNING; PATIENT MOBILITY; PROCESS DEVELOPMENT; SENSOR; SPATIAL ORIENTATION; SYSTEM ANALYSIS; VIRTUAL REALITY; VISUAL IMPAIRMENT; VISUAL SYSTEM;

EID: 84859156803     PISSN: 10554181     EISSN: 1878643X     Source Type: Journal    
DOI: 10.3233/TAD-2012-0344     Document Type: Article

References (49)

1. Ińegalit́e des chances: Rapport sur les besoins des personnes aveugles ou handicaṕees visuelles vivant au Canada. Canadian Institute for the Blind; 2005. Available from: www. cnib.ca/fr/apropos/ publications/recherche.
2. Roentgen UR, Gelderblom GJ, Soede M, de Witte LP. Inventory of Electronic Mobility Aids for Persons with Visual Impairments: A Literature Review. Journal of Visual Impairment & Blindness. 2008;102(11):702-724.
3. Hub A, Diepstraten J, Ertl T. Design and development of an indoor navigation and object identification system for the blind. ACM SIGACCESS Accessibility and Computing. 2004;77-78:147-152. (Pubitemid 40400965)
4. Auvray M, Myin E. Perception with compensatory devices. From sensory substitution to sensorimotor extension. Cognitive Science. 2009;33:1036-1058.
5. Auvray M, Hanneton S, O'Regan JK. Learning to perceive with a visuo-auditory substitution system: Localization and object recognition with The Voice. Perception. 2007;36(3): 416-430.
6. Project NAVIG. Available from: navig.irit.fr.
7. Dramas F, Oriola B, Katz BFG, Thorpe S, Jouffrais C. Designing an assistive device for the blind based on object localization and augmented auditory reality. In: ACM Conf. Computers and Accessibility (ASSETS). Halifax, Canada; 2008. p. 263-264.
8. Gallay M, Denis M, Auvray M. Navigation assistance for blind pedestrians: Guidelines for the design of devices and implications for spatial cognition. In: Representing space in cognition: Interrelations of behaviour, language, and formal models. Tenbrink T, Wiener J, Claramunt C, (Eds.). Oxford University Press (UK); (accepted).
9. Katz BFG, Truillet P, Thorpe S, Jouffrais C. NAVIG: Navigation assisted by artificial vision and GNSS. In: Workshop on Multimodal Location Based Techniques for Extreme Navigation (Pervasive 2010). Helsinki, Finland; 2010. p. 1-4.
10. Parseihian G, Brilhault A, Dramas F. NAVIG: An object localization system for the blind. In: Workshop onMultimodal Location Based Techniques for Extreme Navigation (Pervasive 2010). Helsinki, Finland; 2010.
11. Noordzij ML, Zuidhoek S, Postma A. The influence of visual experience on the ability to form spatial mental models based on route and survey descriptions. Cognition. 2006;100:321-342. (Pubitemid 43902756)
12. Brock A, Vinot JL, Oriola B, Kammoun S, Truillet P, Jouffrais C.Ḿethodes et outils de conception participative avec des utilisateurs non-voyants. In: 22nd French-speaking conference on HCI. Luxembourg; 2010. p. 65-72.
13. Brunet L. ́Etude des besoins et des strat́egies des personnes non-voyantes lors de la navigation pour la conception d'un dispositif d'aide performant et accept́e (Needs and strategy study of blind people during navigation for the design of a functional and accepted aid device). Department of Ergonomics, Universit́e Paris-Sud, Orsay, France; 2010.
14. Bisseret A, Sebillote S, Falzon P. Techniques pratiques pour l'́etude des activit́es expertes. Toulouse: Octar̀es Editions, 1999.
15. Buisson M, Bustico A, Chatty S, Colin FR, Jestin Y, Maury S, et al. Ivy: un bus logiciel au service du d́eveloppement de prototypes de syst̀emes interactifs. In: 14th French-speaking conference on Human-computer interaction (IHM '02); 2002. p. 223-226.
16. Kammoun S, Oriola B, Truillet P, Jouffrais C. Conception et Evaluation d'un Syst̀eme de Dialogue pour un dispositif de Suppĺeance pour D́eficients Visuels. In : Ubiquit́e etMobilit́e. Toulouse; 2011. p. 34-37.
17. Kammoun S, Maće M, Oriola B, Jouffrais J. Designing a Virtual Environment Framework for Improving Guidance for the Visually Impaired. In: Designing Inclusive Systems (CWUAAT). Langdon, Clarkson, Robinson, Lazar, Heylighen (Eds.), Springer-Verlag, 2012 (In press).
18. Thorpe S, Fize D, Marlot C. Speed of processing in the human visual system. Nature. 1996;381(6582):520-522. (Pubitemid 26170929)
19. SpikeNet Technology;. Available from: www.spikenettechnology. com.
20. Dramas F, Thorpe S, Jouffrais C. Artificial Vision for the Blind: A Bio-Inspired Algorithm for Objects and Obstacles Detection. International Journal of Image and Graphics. 2010;10(4):531-544.
21. Brilhault A, Kammoun S, Gutierrez O, Truillet P, Jouffrais C. Fusion of Artificial Vision and GPS to Improve Blind Pedestrian Positioning. In: Intl. Conf. on New Technologies, Mobility and Security, IEEE. France; 2011.
22. Google Street View;. Available from: Maps.google.com/help/maps/ streetview/.
23. Durrant-Whyte HF. Sensor models and multisensory integration. International Journal of Robotics Research. 1988;7(6):97-113.
24. Berger JO. Statistical Decision Theory and Bayesian Analysis. Second edition. Springer; 1985.
25. Bar-Shalom Y. Tracking and Data Association. Academic Press Professional; 1987.
26. Mitchell HB. Multi-Sensor Data Fusion: An introduction. Springer; 2007.
27. Cappelle C, El Najjar ME, Pomorski D, Charpillet F. Multisensors data fusion using dynamic bayesian network for robotised vehicle geo-localisation. In: Intl. Conf. on Information Fusion. Cologne; 2010. p. 1-8.
28. Park SK, Young Soo Suh TND. The pedestrian navigation system using inertial sensors. In: ICROS-SICE International Joint Conference. Fukuoka, Japan; 2009. p. 3970-3974.
29. Bentzen B, Mitchell P. Audible signage as a wayfinding aid: Comparison of Verbal Landmarks and Talking Signs . J of Visual Impairment and Blindness. 1995;89. p. 494-505.
30. Angeo Technology;. Available from: www.angeo.fr.
31. Loomis JM, Golledge R, Klatzlty RL, Speigle J, Tietz J. Personal guidance system for visually impaired. In: First annual ACM conf. on Assistive technologies (Assets '94); 1994. p. 85-90.
32. Mayerhofer B, Pressl B,Wieser M. ODILIA-AMobility Concept for the Visually Impaired. In: Computers Helping People with Special Needs. Miesenberger K, Klaus J, Zagler W, Karshmer A (Eds.) Springer; LNCS 2008;5105(2008). p. 1109-1116.
33. Fletcher JF. Spatial representation in blind children. Development compared to sighted children. J of Visual Impairment and Blindness. 1980;74(10):318-385.
34. Golledge R, Klatzky RL, Loomis JM, Speigle J, Tietz J. A geographical information system for a GPS-based personal guidance system. Intl J of Geographical Information Science. 1998;p. 727-749. (Pubitemid 29038805)
35. V̈olkel T, K̈uhn R, Weber G. Mobility Impaired Pedestrians Are Not Cars: Requirements for the Annotation of Geographical Data In: Computers Helping People with Special Needs, LNCS 2008;5105(2008), p. 1085-1092.
36. Zheng J, Winstanley A, Pan Z, Coveney S. Spatial Characteristics of Walking Areas for Pedestrian Navigation. In: Third Intl. Conf. on Multimedia and Ubiquitous Engineering, IEEE. China; 2009. p. 452-458.
37. V̈olkel T, Weber G. A New Approach for Pedestrian Navigation for Mobility Impaired Users Based on Multimodal Annotation of Geographical Data In: Universal Access in Human-Computer Interaction. Ambient Interaction, LNCS 2007; 4555(2007), p. 575-584.
38. Begault DR. 3-D Sound for Virtual Reality and Multimedia. New York: Academic Press; 1994.
39. Max Visual Programming Language for Music and Multimedia Available from: cycling74 com/products/maxmspjitter/Max visual programming language for music and multimedia; Available from: cycling74.com/products/maxmspjitter/.
40. Katz BFG, Picinali L. Spatial Audio Applied to Research with the Blind. In: Strumillo P, editor. Advances in Sound Localization. InTech; 2011. p. 225-250.
41. Walker BN, Lindsay J. Navigation Performance in a Virtual Environment with Bonephones. In: Intl. Conf. on Auditory Display. Limerick, Ireland; 2005. p. 260-263.
42. F́erey N, Nelson J, Martin C, Picinali L, Bouyer G, Tek A, et al. Multisensory VR interaction for protein-docking in the CoRSAIRe project. Virtual Reality. 2009;13:273-293.
43. V́ezien JM, Ḿeńelas B, Nelson J, Picinali L, Bourdot P, Ammi M, et al. Multisensory VR exploration for computer fluid dynamics in the CoRSAIRe project. Virtual Reality. 2009;13:257-271.
44. Katz BFG, Rio E, Picinali L, Warusfel O. The Effect of Spatialization in a Data Sonification Exploration Task. In: 14th Meeting of the Intl. Conf. on Auditory Display (ICAD). Paris; 2008. p. 1-7.
45. Ḿeńelas B, Picinali L, Katz BFG, Bourdot P. Audio haptic feedbacks in a task of targets acquisition. In: IEEE Symposium on 3D User Interfaces (3DUI 2010). Waltham, USA; 2010. p. 51-54.
46. Kammoun S, Dramas F, Oriola B, Jouffrais C. Route Selection Algorithm for Blind Pedestrian. In: Intl. Conf. on Control, Automation and Systems, IEEE, KINTEX. Gyeonggi-do, Korea; 2010. p. 2223-2228.
47. Blattner MM, Sumikawa DA, Greenberg RM. Earcons and icons: Their structure and common design principles. In: Journal of Human Computer Interaction. 1989;4(1), 11-44.
48. Parlouar R, Dramas F, Maće M, Jouffrais C. Assistive device for the blind based on object recognition: An application to identify currency bills. In: ACM Conference on Computers and Accessibility (ASSETS 2009). Pittsburgh, PA, USA; 2009. p. 227-228.
49. Liu X. A camera phone based currency reader for the visually impaired. In: 10th international ACM SIGACCESS conference on Computers and accessibility. Halifax, Nova Scotia, Canada; 2008. p. 305-306.