Use of a time-of-flight camera with an Omek Beckon™ framework to analyze, evaluate and correct in real time the verticality of multiple sclerosis patients during exercise

International Journal of Environmental Research and Public Health

Volumn 10, Issue 11, 2013, Pages 5807-5829

  Eguíluz, Gonzalo ^a   García, María Begoña ^a  

^a UNIVERSITY OF DEUSTO   (Spain)

Author keywords

Multiple sclerosis; Time of flight; Verticality improvement

Indexed keywords

DISABILITY; PHYSICAL ACTIVITY; PUBLIC HEALTH;

ADULT; ANALYTIC METHOD; ARTICLE; BODY POSTURE; CAMERA; CLINICAL ARTICLE; EXERCISE; HUMAN; MALE; MULTIPLE SCLEROSIS; OCCUPATIONAL THERAPY; OMEK BECKON FRAMEWORK; PATIENT POSITIONING; PHYSIOTHERAPY; QUESTIONNAIRE; REHABILITATION CARE; SPEECH THERAPY; TIME OF FLIGHT CAMERA; YOGA;

ADULT; EXERCISE THERAPY; FEMALE; HUMANS; MALE; MULTIPLE SCLEROSIS; SPAIN; VIDEO RECORDING;

EID: 84887362049     PISSN: 16617827     EISSN: 16604601     Source Type: Journal    
DOI: 10.3390/ijerph10115807     Document Type: Article

References (93)

1. Hu, W.; Lucchinetti, C.F. The pathological spectrum of CNS inflammatory demyelinating diseases. Semin. Immunopathol. 2009, 31, 439-453.
2. Poser, C.M.; Paty, D.W.; Scheinberg, L.; McDonald, W.I.; Davis, F.A.; Ebers, G.C.; Johnson, K.P.; Sibley, W.A.; Silberberg, D.H.; Tourtellotte, W.W. New diagnostic criteria for multiple sclerosis: Guidelines for research protocols. Ann. Neurol. 1983, 13, 227-231.
3. Amato, M.P.; Ponziani, G.; Rossi, F.; Liedl, C.L.; Stefanile, C.; Rossi, L. Quality of life in multiple sclerosis: The impact of depression, fatigue and disability. Mult. Scler. J. 2001, 7, 340-344.
4. Ghezzi, A.; Deplano, V.; Faroni, J.; Grasso, M.G.; Liguori, M.; Marrosu, G.; Pozzlilli, C.; Simone, L.I.; Zaffaroni, M. Multiple sclerosis in childhood: clinical features of 149 cases. Mult. Scler. J. 1997, 3, 43-46.
5. Bakshi, R. Fatigue associated with multiple sclerosis: Diagnosis, impact and management. Mult. Scler. J. 2003, 9, 219-227.
6. Weinshenker, B.G.; Bass, B.; Rice, G.P.A.; Noseworthy, J.; Carriere, W.; Baskerville, J.; Ebers, G.C. The natural history of multiple sclerosis: A geographically based study I. Clinical course and disability. Brain 1989, 112, 133-146.
7. Columbus, F.H. Treatment and Management of Multiple Sclerosis; An Imprint of Nova Science Publishers, Inc.: Hauppauge, NY, USA, 2005.
8. Fiske, J.; Griffiths, J.; Thompson, S. Multiple sclerosis and oral care. Dent. Update 2002, 29, 273-283.
9. Stroud, N.; Minahan, C.; Sabapathy, S. The perceived benefits and barriers to exercise participation in persons with multiple sclerosis. Disabil. Rehabil. 2009, 31, 2216-2222.
10. Bakshi, R.; Shaikh, Z.A.; Miletich, R.S.; Czarnecki, D.; Dmochowski, J.; Henschel, K.; Janardhan, V.; Dubey, N.; Kinkel, P.R. Fatigue in multiple sclerosis and its relationship to depression and neurologic disability. Mult. Scler. J. 2000, 6, 181-185.
11. Schapiro, R.T. Symptom management in multiple sclerosis. Ann. Neurol. 1994, 36, S123-S129.
12. Polman, C.H.; Reingold, S.C.; Banwell, B.; Clanet, M.; Cohen, J.A.; Filippi, M.; Fujihara, K.; Havrdova, E.; Hutchinson, M.; Kappos, L.; et al. Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Ann. Neurol. 2011, 69, 292-302.
13. Brodkey, M.B.; Ben-Zacharia, A.B.; Reardon, J.D. Living Well with Multiple Sclerosis. Am. J. Nurs. 2011, 111, 40-48.
14. Grandisson, M.; Hébert, M.; Thibeault, R. A systematic review on how to conduct evaluations in community-based rehabilitation. Disabil. Rehabil. 2013, 2013, 1-11, doi:10.3109/09638288.2013.785602.
15. Olaogun, M.O.B.; Nyante, G.G.G.; Ajediran, A.I. Overcoming the Barriers for Participation by the Disabled: An appraisal and global view of community-based rehabilitation in community development. Afr. J. Physiother. Rehabil. Sci. 2009, 1, 24-29.
16. Chan, W.M.; Hjelm, N.M. The role of telenursing in the provision of geriatric outreach services to residential homes in Hong Kong. J. Telemed. Telecare 2001, 7, 38-46.
17. th Annual International Conference of the Engineering in Medicine and Biology Society, Shanghai, China, 1-4 September 2005.
18. Camurri, A.; Mazzarino, B.; Volpe, G.; Morasso, P.; Priano, F.; Re, C. Application of multimedia techniques in the physical rehabilitation of Parkinson's patients. J. Vis. Comput. Animat. 2003, 14, 269-278.
19. Weiss, S.M.; Indurkhya, N.; Zhang, T.; Damerau, F.J. Text Mining: Predictive Methods for Analyzing Unstructured Information Springer: Berlin, Germany, 2005.
20. Yellowlees, P.M.; Holloway, K.M.; Parish, M.B. Therapy in virtual environments-clinical and ethical issues. Telemed. e-Health 2012, 18, 558-564.
21. Bart, O.; Agam, T.; Weiss, P.L.; Kizony, R. Using video-capture virtual reality for children with acquired brain injury. Disabil. Rehabil. 2011, 33, 1579-1586.
22. Betker, A.L.; Szturm, T.; Moussavi, Z.K.; Nett, C. Video game-based exercises for balance rehabilitation: A single-subject design. Arch. Phys. Med. rehabil. 2006, 87, 1141-1149.
23. Hailey, D.; Roine, R.; Ohinmaa, A.; Dennett, L. Evidence of benefit from telerehabilitation in routine care: A systematic review. J. Telemed. Telecare 2011, 17, 281-287.
24. Hailey, D.; Ohinmaa, A.; Roine, R. Study quality and evidence of benefit in recent assessments of telemedicine. J. Telemed. Telecare 2004, 10, 318-324.
25. Whitworth, E.; Lewis, J.A.; Boian, R.; Tremaine, M.; Burdea, G.; Deutsch, J.E. Formative Evaluation of a Virtual Reality Telerehabilitation System for the Lower Extremity. In Proceedings of the 2nd International Workshop on Virtual Rehabilitation (IWVR2003), Piscataway, NJ, USA, 21-22 September 2003.
26. Zampolini, M.; Baratta, S.; Schifini, F.; Spitali, C.; Todeschini, E.; Bernabeu, M.; Tormos, J.M.; Opisso, E.; Magni, R.; Magnino, F.; et al. Upper Limb Telerehabilitation with Home Care and Activity Desk (HCAD) System. In Proceedings of the Virtual Rehabilitation, Venice, Italy, 27-29 September 2007.
27. Epelde, G.; Carrasco, E.; Gomez-Fraga, I.; Vivanco, K.; Jimenez, J.M.; Rueda, O.; Bizkarguenaga, A.; Sevilla, D.; Sanchez, P. ERehab: Ubiquitous Multidevice Personalised Telerehabilitation Platform. In Proceedings of the AAL Forum 2012, Eindhoven, Netherlands, 24-27 September 2012.
28. Bueno, A.; Marzo, J.L.; Vallejo, X. AXARM: An Extensible Remote Assistance and Monitoring Tool for ND Telerehabilitation. In Electronic Healthcare; Springer: Berlin, Germany, 2009; Volume 1, pp. 106-113.
29. Mikołajewska, E.; Mikołajewski, D. Neurological telerehabilitation-current and potential future applications. J. Health Sci. 2011, 1, 7-14.
30. Rogante, M.; Bernabeau, M.; Giacomozzi, C.; Hermens, H.; Huijgen, B.; Ilsbroukx, S.; Macellari, V. ICT for Home-Based Service to Maintain the Upper Limb Function in Ageing. In Proceedings of the 6th International Conference of the International Society for Gerontechnology (ISG'08), Pisa, Italy, 4-6 June 2008.
31. Kolb, A.; Barth, E.; Koch, R.; Larsen, R. Time-of-flight sensors in computer graphics. Proc. Eurographics (State Art Re.) 2009, 2009, 119-134.
32. Gokturk, S.B.; Yalcin, H.; Bamji, C. A Time-of-Flight Depth Sensor-System Description, Issues and Solutions. In Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop, CVPRW'04. Washington, DC, USA, 27 May-02 June 2004.
33. Omek Interactive. Available online: http://www.linkedin.com/company/omek-interactive (accessed on 28 October 2013).
34. SoftKinetic, Inc. Available online: http://www.linkedin.com/company/softkinetic-inc (accessed on 28 October 2013).
35. 3D Time of Flight Analog Output DepthSense® Image Sensors (OPT8130 and OPT8140). Available online: http://www.planar.ru/project//documents/44001_45000/44005/slab063.pdf (accessed on 29 October 2013).
36. Intel Buys Israeli Startup Omek Interactive for Close to $50 Million. Available online: http://www.haaretz.com/business/.premium-1.536056 (accessed on 28 October 2013).
37. Tracking Modes (Seated and Default). Available online: http://msdn.microsoft.com/enus/ library/hh973077.aspx, 2013 (accessed on 28 October 2013).
38. Does OpenNI2/NiTE2 Support "Upper Body Only" Skeleton Tracking? Available online: http://community.openni.org/openni/topics/does_openni2_nite2_support_upper_body_only_skelet on_tracking (accessed on 28 October 2013).
39. Brooke, J. SUS-A quick and dirty usability scale. Usability Eval. Ind. 1996, 189, 194.
40. Uçan, O.N.; Öǧüşlü, C.E. A non-linear technique for the enhancement of extremely non-uniform lighting images. J. Aeronaut. Sp. Technol. 2007, 3, 37-47.
41. Danielsson, P.-E. Euclidean distance mapping. Comput. Gr. Image Process. 1980, 14, 227-248.
42. A summary of image segmentation techniques. Available online: http://citeseerx.ist.psu.edu/ viewdoc/download?doi=10.1.1.138.6560&rep=rep1&type=pdf (accessed on 28 October 2013).
43. Joshi, S.V.; Shire, A.N. A review of enhanced algorithm for color image segmentation. Int. J. Advanced Res. Comput. Sci. Softw. Eng. 2013, 3, 435-441.
44. Plagemann, C.; Ganapathi, V.; Koller, D.; Thrun, S. Real-time Identification and Localization of Body Parts from Depth Images. In Proceedings of the 2010 IEEE International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA, 3-7 May 2010.
45. Schwarz, L.A.; Mkhitaryan, A.; Mateus, D.; Navab, N. Estimating Human 3D Pose from Time-of-Flight Images Based on Geodesic Distances and Optical Flow. In Proceedings of the IEEE International Conference on Automatic Face & Gesture Recognition and Workshops. (FG 2011), Santa Barbara, CA, USA, 21-25 March 2011.
46. Zhang, J.; Siddiqi, K.; Macrini, D.; Shokoufandeh, A.; Dickinson, S. Retrieving Articulated 3-D Models Using Medial Surfaces and Their Graph Spectra. In Energy Minimization Methods in Computer Vision and Pattern Recognition.; Springer: Berlin, Germany, 2005.
47. Thome, N.; Merad, D.; Miguet, S. Human Body Part Labeling and Tracking Using Graph Matching Theory. In Proceedings of the IEEE International Conference on Video and Signal Based Surveillance, AVSS'06, Sydney, Australia, 22-24 November 2006.
48. Witkin, A. Interpolation between Model Poses Using Inverse Kinematics. U.S. Patent 8,358,311, 22 January 2013.
49. Schwarz, L.A.; Mkhitaryan, A.; Mateus, D.; Navab, N. Human skeleton tracking from depth data using geodesic distances and optical flow. Image Vis. Comput. 2012, 30, 217-226.
50. El Gamal, A.; Eltoukhy, H. CMOS image sensors. Circuits Devices Mag., IEEE 2005, 21, 6-20.
51. Carlson, B.S. Comparison of Modern CCD and CMOS Image Sensor Technologies and Systems for Low Resolution Imaging. In Proceedings of the 1st International Conference on Sensors; IEEE, Orlando, Florida, USA, 12-14 June 2002.
52. Lee, S.B.; Choi, O.; Ioraud, R. Time of Flight Cameras: Principles, methods, and applications; Springer: Berlin, Germany, 2013.
53. Omek Beckon™ Development Suite. Available online: http://www.omekinteractive.com/content/ Datasheet-Omek-BeckonDevelopmentSuite.pdf (accessed on 28 October 2013).
54. Crabb, R.; Tracey, C.; Puranik, A.; Davis, J. Real-Time Foreground Segmentation via Range and Color Imaging. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW'08, Anchorage, AK, USA, 23-28 June 2008.
55. Schiller, I.; Koch, R. Improved Video Segmentation by Adaptive Combination of Depth Keying and Mixture-of-Gaussians. In Image Analysis; Springer: Berlin/Heidelberg, Germany, 2011.
56. Teichman, A.; Thrun, S. Learning to Segment and Track in RGBD. In Algorithmic Foundations of Robotics X; Springer: Berlin/Heidelberg, Germany, 2013.
57. Salas, J.; Tomasi, C. People Detection Using Color and Depth Images. In Pattern Recognition; Springer: Berlin, Germany, 2011.
58. Moeslund, T.B.; Hilton, A.; Krüger, V. A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 2006, 104, 90-126.
59. Wren, C.R.; Azarbayejani, A.; Darrell, T.; Pentland, A.P. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 1997, 19, 780-785.
60. Brand, M. Shadow Puppetry. In Proceedings of the 7th IEEE International Conference on Computer Vision, Kerkyra, Greece, 20-27 September 1999.
61. Grauman, K.; Shakhnarovich, G.; Darrell, T. Inferring 3D Structure with a Statistical Image-Based Shape Model. In Proceedings of the 9th IEEE International Conference on Computer Vision, Nice, France, 13-16 October 2003.
62. Sminchisescu, C.; Kanaujia, A.; Li, Z; Metaxas, D. Discriminative Density Propagation for 3D Human Motion Estimation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR, San Diego, CA, USA, 20-26 June 2005.
63. Sigal, L.; Isard, M.; Haussecker, H.; Black, M. J. Loose-limbed people: Estimating 3D human pose and motion using non-parametric belief propagation. Int. J. Comput. Vis. 2012, 98, 15-48.
64. Merad, D.; Aziz, K.E.; Thome, N. Fast People Counting Using Head Detection from Skeleton Graph. In Proceedings of the 7th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Boston, MA, USA, 29 August-1 September 2010.
65. th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Ouro Preto, Brazil, 22-25 August 2012.
66. Boulic, R.; Varona, J.; Unzueta, L.; Peinado, M.; Suescun, A.; Perales, F. Evaluation of on-line analytic and numeric inverse kinematics approaches driven by partial vision input. Virtual Real. 2006, 10, 48-61.
67. Mitra, S.; Acharya, T. Gesture recognition: A survey. IEEE Trans. Syst. Man Cybern. C Appl. Rev. 2007, 37, 311-324.
68. Bodack, M.P.; Tunkel, R.S.; Marini, S.G.; Nagler, W. Spinal accessory nerve palsy as a cause of pain after whiplash injury: Case report. J. Pain Symptom Manag. 1998, 15, 321-328.
69. Talvitie, U.; Reunanen, M. Interaction between physiotherapists and patients in stroke treatment. Physiother. 2002, 88, 77-88.
70. Kauppi, M.; Leppänen, L.; Heikkilä, S.; Lahtinen, T.; Kautiainen, H. Active conservative treatment of atlantoaxial subluxation in rheumatoid arthritis. Rheumatol. 1998, 37, 417-420.
71. Nilsson, B.-M.; Söderlund, A. Head posture in patients with whiplash-associated disorders and the measurement method's reliability-A comparison to healthy subjects. Adv. Physiother. 2005, 7, 13-19.
72. de Haart, M.; Geurts, A.C.; Huidekoper, S.C.; Fasotti, L.; van Limbeek, J. Recovery of standing balance in postacute stroke patients: a rehabilitation cohort study. Arch. Phys. Med. Rehabil. 2004, 85, 886-895.
73. Zhang, L.; Hsieh, J.-C.; Wang, J. A Kinect-Based Golf Swing Classification System Using HMM and Neuro-Fuzzy. In Proceedings of the 2012 International Conference on Computer Science and Information Processing (CSIP), Xi'an, China, 24-26 August 2012.
74. French, B.J.; Ferguson, K.R. Testing and Training System for Assessing Movement and Agility Skills without a Confining Field. U.S. Patent 6,098,458, 8 August 2000.
75. Tsuji, T.; Sumida, Y.; Kaneko, M.; Kawamura, S. A virtual sports system for skill training. J. Robotics Mechatron. 2000, 13, 168-175.
76. Roston, G.P.; Peurach, T. A Whole Body Kinesthetic Display Device for Virtual Reality Applications. In Proceedings of the 1997 IEEE International Conference on Robotics and Automation, Albuquerque, NM, USA, 20-25 Apirl 1997.
77. Barra, J.; Marquer, A.; Joassin, R.; Reymond, C.; Metge, L.; Chauvineau, V.; Pérennou, D. Humans use internal models to construct and update a sense of verticality. Brain 2010, 133, 3552-3563.
78. Verheyden, G.; Nieuwboer, A.; van de Winckel, A.; De Weerdt, W. Clinical tools to measure trunk performance after stroke: A systematic review of the literature. Clin. Rehabil. 2007, 21, 387-394.
79. Mouchnino, L.; Aurenty, R.; Massion, J.; Pedotti, A. Coordination between equilibrium and head-trunk orientation during leg movement: A new strategy build up by training. J. Neurophysiol. 1992, 67, 1587-1598.
80. Fortin, C.; Feldman, D.E.; Cheriet, F.; Labelle, H. Clinical methods for quantifying body segment posture: A literature review. Disabil. Rehabil. 2011, 33, 367-383.
81. Hall, S.J. Basic Biomechanics, 5th ed.; Lavoisier: Cachan, France, 2007.
82. Bangor, A.; Kortum, P.; Miller, J. Determining what individual SUS scores mean: Adding an adjective rating scale. J. Usability Stud. 2009, 4, 114-123.
83. Fragoso, Y.D.; Santana, D.L.B.; Pinto, R.C. The positive effects of a physical activity program for multiple sclerosis patients with fatigue. NeuroRehabilitation 2008, 23, 153-157.
84. Beckerman, H.; de Groot, V.; Scholten, M.A.; Kempen, J.C.E.; Lankhorst, G.J. Physical activity behavior of people with multiple sclerosis: Understanding how they can become more physically active. Phys. Ther. 2010, 90, 1001-1013.
85. Gulick, E.E. Symptom and activities of daily living trajectory in multiple sclerosis: A 10-year study. Nurs. Res. 1998, 47, 137-146.
86. Terré-Boliart, R.; Orient-López, F. Tratamiento rehabilitador en la esclerosis múltiple. Rev. Neurol. 2007, 44, 426-431.
87. LaRocca, N.G.; Kalb, R.C. Efficacy of rehabilitation in multiple sclerosis. Neurorehabilitation Neural Repair 1992, 6, 147-155.
88. Occupational therapy: Performance, participation, and well-being. Available online: http://media.matthewsbooks.com.s3.amazonaws.com/documents/tocwork/155/9781556425301.pdf (accessed on 28 October 2013).
89. Lacorte, S.; Fernandez-Alba, A.R. Time of flight mass spectrometry applied to the liquid chromatographic analysis of pesticides in water and food. Mass Spectrum. Rev. 2006, 25, 866-880.
90. th International MATADOR Conference; Springer: Manchester, UK, 14-16 July 2010.
91. Rodríguez, A.; Rey, B.; Alcañiz, M.; Bañosb, R.; Guixeresa, J.; Wrzesiena, M.; Gomeza, M.; Pereza, D.; Rasalb, P.; Parraa, E. Annual Review of Cybertherapy and Telemedicine 2012: Advanced Technologies in the Behavioral, Social and Neurosciences; ISO Press Bv: Amsterdam, Netherlands, 2012.
92. Santos, C.; Paterson, R.R.M.; Venâncio, A.; Lima, N. Filamentous fungal characterizations by matrix-assisted laser desorption/ionization time-of-flight mass spectrometry. J. Appl. Microbiol. 2010, 108, 375-385.
93. Stevenson, L.G.; Drake, S.K.; Murray, P.R. Rapid identification of bacteria in positive blood culture broths by matrix-assisted laser desorption ionization-time of flight mass spectrometry. J. Clin. Microbial. 2010, 48, 444-447.