Mobility and low contrast trip hazard avoidance using augmented depth

Journal of Neural Engineering

Volumn 12, Issue 1, 2015, Pages

  McCarthy, Chris ^a,b   Walker, Janine G ^a,b   Lieby, Paulette ^a   Scott, Adele ^a,b   Barnes, Nick ^a,b  

^a CSIRO   (Australia)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Computer vision; Mobility; Navigation; Obstacle avoidance; Prosthetic vision

Indexed keywords

CARRIER MOBILITY; COLLISION AVOIDANCE; NAVIGATION; PROSTHETICS;

EXTRACTION ALGORITHMS; GROUND PLANES; GROUND SURFACES; HUMAN MOBILITY; PROSTHETIC VISION; SAFE MOBILITY; VISUAL REPRESENTATIONS; WALL BOUNDARIES;

COMPUTER VISION;

ADULT; ALGORITHM; ARTICLE; AUGMENTED DEPTH; BRIGHTNESS; CONTRAST; EXTRACTION; EYE MOVEMENT; FEMALE; HAZARD; HUMAN; LOW CONTRAST TRIP HAZARD AVOIDANCE; MALE; OPTICAL DEPTH; OUTCOME ASSESSMENT; PRIORITY JOURNAL; RETINAL IMPLANT; SIMULATED PROSTHETIC VISION; VISION; VISUAL SYSTEM PARAMETERS; CONTROLLED STUDY; DEPTH PERCEPTION; DEVICES; FALLING; GAIT; IMAGE ENHANCEMENT; MIDDLE AGED; PHYSIOLOGY; PREVENTION AND CONTROL; PROCEDURES; PSYCHOMOTOR PERFORMANCE; RANDOMIZED CONTROLLED TRIAL; VISUAL PROSTHESIS;

ACCIDENTAL FALLS; ADULT; DEPTH PERCEPTION; GAIT; HUMANS; IMAGE ENHANCEMENT; MALE; MIDDLE AGED; PHOSPHENES; PSYCHOMOTOR PERFORMANCE; VISUAL PROSTHESIS;

EID: 84921796335     PISSN: 17412560     EISSN: 17412552     Source Type: Journal    
DOI: 10.1088/1741-2560/12/1/016003     Document Type: Article

References (62)

1. Zrenner E 2002 Will retinal implants restore vision? Science 295 1022-5
2. Kim S, Sadda S, Humayun M, deJuan E Jr., Melia B and Green W 2002 Morphometric analysis of the macula in eyes with geographic atrophy due to age-related macular degeneration Retina 46 4-10
3. Stone J, Barlow W, Humayun M, deJuan E Jr. and Milam A 1992 Morphometric analysis of macular photoreceptors and ganglion cells in retinas with retinitis pigmentosa Arch. Ophthal. 110 1634-9
4. Rizzo J F, Wyatt J, Loewenstein J, Kelly S and Shire D 2003 Perceptual efficacy of electrical stimulation of human retina with a microelectrode array during short-term surgical trials Invest. Opthalmol. Vis. Sci. 44 5362-9
5. Rizzo J F 2011 Update on retinal prosthetic research: the Boston retinal implant project J. Neuro-Ophthalmol. 31 160
6. Humayun M S et al 2012 Interim results from the international trial of second sight's visual prosthesis Ophthalmology 119 779-88
7. Zrenner E et al 2011 Subretinal electronic chips allow blind patients to read letters and combine them to words Proc. Royal Soc. B 278 1489-97
8. Stingl K et al 2013 Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS Proc. Royal Soc. B 280 20130077
9. Ayton L N et al 2014 First-in-human trial of a novel suprachoroidal retinal prosthesis PLoS One submitted
10. Brindley G S and Lewin W S 1968 The sensations produced by electrical stimulation of the visual cortex J. Physiol. 196 479-93
11. Elfar S D, Cottaris N P, Iezzi R and Abrams G W 2009 A cortical (v1) neurophysiological recording model for assessing the efficacy of retinal visual prostheses J. Neurosci. Methods 180 195-207
12. Chen S C, Suaning G J, Morley J W and Lovell N H 2009 Simulating prosthetic vision: I. Visual models of phosphenes Vis. Res. 49 1493-506
13. Wilke R et al 2011 Spatial resolution and perception of patterns mediated by a subretinal 16-electrode array in patients blinded by hereditary retinal dystrophies Invest. Opthalmol. Vis. Sci. 52 5995-6003
14. Nanduri D, Humayun M S, Greenberg R J, McMahon M J and Weiland J D 2008 Retinal prosthesis phosphene shape analysis Conf. Proc. IEEE Eng. Med. Bio. Soc. (EMBS) pp 1785-8
15. Fornos A P, Sommerhalder J, Da Cruz L, Sahel J A, Mohand-Said S, Hafezi F and Pelizzone M 2012 Temporal properties of visual perception on electrical stimulation of the retina Invest. Opthalmol. Vis. Sci. 53 2720-31
16. Humayun M S et al 2003 Visual perception in a blind subject with a chronic microelectronic retinal prosthesis Vis. Res. 43 2573-81
17. Chen S C, Hallum L E, Lovell N H and Suaning G J 2005 Visual acuity measurement of prosthetic vision: a virtual-reality simulation study J. Neural Eng. 2 S135
18. Lieby P, Barnes N, Walker J G, Scott A and Ayton L 2013 Evaluating lanczos2 image filtering for visual acuity in simulated prosthetic vision Proc. of Association of Research in Vision and Ophthalmology (ARVO) abstract 1049/C0026
19. Thompson R W, Barnett G D, Humayun M S and Dagnelie G 2003 Facial recognition using simulated prosthetic pixelized vision Invest. Opthalmol. Vis. Sci. 44 5035-42
20. Chang M H, Kim H S, Shin J H and Park K S 2012 Facial identification in very low-resolution images simulating prosthetic vision J. Neural Eng. 9 046012
21. Zhao Y, Lu Y, Zhou C, Chen Y, Ren Q and Chai X 2011 Chinese character recognition using simulated phosphene maps Invest. Opthalmol. Vis. Sci. 52 3404-12
22. Barnes N, Scott A F, Stacey A, McCarthy C, Lieby P, Ayton L N, Peteo M, Sinclair N, Shivdasani M and Walker J G 2014 Lanczos2 image filtering improves performance on low vision tests in implanted visual prosthetic patients Proc. of Association of Research in Vision and Ophthalmology (ARVO) abstract 1802
23. Chen L-M, Friedman R M and Roe A W 2005 Optical imaging of si topography in anesthetized and awake squirrel monkeys J. Neurosci. 25 7648-59
24. Sousa L, Tomás P, Pelayo F, Martinez A, Morillas C A and Romero S 2005 Bioinspired stimulus encoder for cortical visual neuroprostheses New Algorithms, Architectures and Applications for Reconfigurable Computing ed P Lysaght and W Rosenstiel (Dordrecht: Springer) pp 279-90
25. Delbrück T and Liu S-C 2004 A silicon early visual system as a model animal Vis. Res. 44 2083-9
26. Keeffe J E, Francis K L, Luu C D, Barnes N, Lamoureaux E L and Guymer R H 2010 Expectations of a visual prosthesis: perspectives from people with impaired vision Proc. Association of Research in Vision and Ophthalmology (ARVO) abstract 6020/A297
27. Cha K, Horch K W and Normann R A 1992 Mobility performance with a pixelized vision system Vis. Res. 32 1367-72
28. Dagnelie G, Keane P, Narla V, Yang L, Weiland J and Humayun M 2007 Real and virtual mobility performance in simulated prosthetic vision J. Neural Eng. 4 92-101
29. Dowling J A and Maeder A J 2004 Mobility enhancement and assessment for a visual prosthesis Proc. SPIE 5369 1-2
30. Dowling J A and Maeder A J 2004 Mobility enhancement and assessment for a visual prosthesis Int. Soc. Opt. Eng. 32 1-2
31. Dowling J, Boles W and Maeder A 2005 Mobility assessment using simulated arti ficial human vision Proc. 2005 Workshop on Computer Vision Applications for the Visually Impaired (CVAVI)
32. Parikh N, Itti L, Humayun M and Weiland J 2013 Performance of visually guided tasks using simulated prosthetic vision and saliency-based cues J. Neural Eng. 10 026017
33. Humayun M S, da Cruz L, Dagnelie G, Mohand-Said S, Stanga P, Agrawal R N and Greenberg R J 2010 Interim performance results from the second sight Argus II retinal prosthesis study Proc. Association of Research in Vision and Ophthalmology (ARVO) abstract 2022
34. Parikh N, Itti L and Weiland J 2010 Saliency-based image processing for retinal prostheses J. Neural Eng. 7 016006
35. Pradeep V, Medioni G and Weiland J 2010 A wearable system for the visually impaired Conf. Proc. IEEE Eng. Med. Bio. Soc. (EMBS) (August 31-september 4 2010) pp 6233-6
36. Barnes N, Lieby P, Walker J G, McCarthy C, Botea V and Scott A F 2012 Evaluating depth-based visual representations for mobility in simulated prosthetic vision Proc. Association of Research in Vision and Ophthalmology (ARVO) abstract 5550
37. Lieby P, Walker J G, Scott A F, McCarthy C and Botea V 2012 Mobility experiments using simulated prosthetic vision with 98 phosphenes of limited dynamic range Proc. Association of Research in Vision and Ophthalmology (ARVO) abstract 5539/D1144
38. Li Yi, McCarthy C and Barnes N 2012 On just noticeable difference for bionic eye Conf. Proc. IEEE Eng. Med. Bio. Soc. (EMBS)
39. Watson N and Wooden M 2002 The household, income and labour dynamics in Australia (HILDA) survey: wave 1 survey methodology Technical Report Melbourne Institute of Applied Economics and Social Research, Melbourne No. 1/102
40. Morris L J, Prior S L, Anstey K J, Butterworth P, Jacomb P and Tait and ACT Government Health Directorate R J 2011 Mental health and wellbeing in the ACT Health Series No. 54. (Canberra: ACT Government Health Directorate)
41. Haymes S A, Johnston A W and Heyes A D 2002 Relationship between vision impairment and ability to perform activities of daily living Ophthalmic Physiol. Opt. 22 79-91
42. Lord S R and Dayhew J 2001 Visual risk factors for falls in older people J. Am. Geriatric Soc. 49 508-15
43. Lieby P, Barnes N, McCarthy C, Liu N, Dennett H, Walker J G, Botea V and Scott A F 2011 Substituting depth for intensity and real-time phosphene rendering: visual navigation under low vision conditions Conf. Proc. IEEE Eng. Med. Bio. Soc. (EMBS) pp 8017-20
44. Broman A, West S, Munoz B, Bandeen-Roche K, Rubin G and Turano K 2004 Divided visual attention as a predictor of bumping while walking: the salisbury eye evaluation Invest. Opthalmol. Vis. Sci. 45 2955-60
45. Clark-Carter D D, Heyes A D and Howarth C I 1986 The efficiency and walking speed of visually impaired people Ergonomics 29 779-89
46. McCarthy C, Lieby P, Walker J G, Scott A F, Botea V and Barnes N 2012 Low contrast trip hazard avoidance with simulated prosthetic vision Proc. Association of Research in Vision and Ophthalmology (ARVO) abstract 6950
47. Ohnishi N and Imiya A 2008 Visual navigation of mobile robot using optical flow and visual potential field In Robot Vision (Berlin: Springer) pp 412-26
48. Lin C H, Jiang S Y, Pu Y J and Song K T 2010 Robust ground plane detection for obstacle avoidance of mobile robots using a monocular camera In Intelligent Robots and Systems (IROS) IEEE/RSJ Int. Conf. pp 3706-11
49. Pears N and Liang B 2001 Ground plane segmentation for mobile robot visual navigation In Intelligent Robots and Systems Proc. IEEE/RSJ Int. Conf. vol 3 pp 1513-8
50. Ohnishi N and Imiya A 2006 Dominant plane detection from optical flow for robot navigation Pattern Recognit. Lett. 27 1009-21
51. Ulrich I and Nourbakhsh I 2000 Appearance-based obstacle detection with monocular color vision Proc. National Conf. on Artificial Intelligence pp 866-71
52. Fischler M A and Bolles R C 1981 Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography Commun. ACM 24 381-95
53. Se S and Brady M 2002 Ground plane estimation, error analysis and applications Robot. Auton. Syst. 39 59-71
54. Mufti F, Mahony R and Heinzmann J 2008 Spatio-temporal ransac for robust estimation of ground plane in video range images for automotive applications In Intelligent Transportation Systems Int. IEEE Conf. pp 1142-8
55. Gallo O, Manduchi R and Rafii A 2010 CC-RANSAC: fitting planes in the presence of multiple surfaces in range data Pattern Recognit. Lett. 403-10
56. Pradeep V, Medioni G and Weiland J 2008 Piecewise planar modeling for step detection using stereo vision Proc. 2008 Workshop on Computer Vision Applications of the Visually Impaired (CVAVI)
57. McCarthy C and Barnes N 2010 Surface extraction from isodisparity contours Proc. Asian Conf. Computer Vision (ACCV)
58. Pollefeys M and Sinha S N 2004 Iso-disparity surfaces for general stereo configurations Proc. European Conf. Computer Vision (ECCV) pp 509-20
59. McCarthy C, Barnes N and Lieby P 2011 Ground surface segmentation for navigation with a low resolution visual prosthesis Conf. Proc. IEEE Eng. Med. Bio. Soc. (EMBS) pp 4457-60
60. Canny J 1986 A computational approach to edge detection IEEE Trans. Pattern Anal. Mach. Intell 8 679-714
61. Kovesi P D MATLAB and Octave Functions for Computer Vision and Image Processing Centre for Exploration Targeting, School of Earth and Environment (University of Western Australia) www.csse.uwa.edu.au/~pk/research/matlabfns/〉.
62. Cormen T H, Leiserson C E, Rivest R L, Ronald L and Stein C 2001 Introduction to Algorithms 2nd edn (Cambridge, MA: MIT)