A Kinect-based system for cognitive rehabilitation exercises monitoring

Computer Methods and Programs in Biomedicine

Volumn 113, Issue 2, 2014, Pages 620-631

  Gonzalez Ortega D ^a   Diaz Pernas F J ^a   Martinez Zarzuela M ^a   Anton Rodriguez M ^a  

^a UNIVERSITY OF VALLADOLID   (Spain)

Author keywords

3D computer vision; Cognitive rehabilitation; Human body parts detection and tracking; Human computer interaction; Kinect device

Indexed keywords

3D COMPUTER VISION; COGNITIVE ASSESSMENTS; COGNITIVE REHABILITATION; FACIAL FEATURE DETECTION; HUMAN BODIES; ILLUMINATION CHANGES; KINECT DEVICE; VISION-BASED SYSTEM;

COMPUTER VISION; HUMAN COMPUTER INTERACTION; THREE DIMENSIONAL;

PATIENT REHABILITATION;

ARTICLE; AUTOMATION; BODY MOVEMENT; BODY POSITION; BODY REGIONS; BODY SURFACE; COGNITION; COGNITIVE DEFECT; COGNITIVE REHABILITATION; COMPARATIVE STUDY; EXERCISE; EYE TRACKING; FACIES; FINGER; GAIT; GEOMETRY; HAND JOINT; HAND MOVEMENT; HEALTH PRACTITIONER; HUMAN; HUMAN COMPUTER INTERACTION; IMAGE PROCESSING; PHYSICAL DISABILITY; THREE DIMENSIONAL IMAGING; VIRTUAL REALITY; WRIST;

3D COMPUTER VISION; COGNITIVE REHABILITATION; HUMAN BODY PARTS DETECTION AND TRACKING; HUMAN-COMPUTER INTERACTION; KINECT DEVICE;

ARTIFICIAL INTELLIGENCE; COGNITION DISORDERS; EAR; EYE; HUMANS; MONITORING, PHYSIOLOGIC; NOSE; PSYCHOMOTOR PERFORMANCE;

EID: 84892780040     PISSN: 01692607     EISSN: 18727565     Source Type: Journal    
DOI: 10.1016/j.cmpb.2013.10.014     Document Type: Article

References (52)

1. Domingo M.C. An overview of the Internet of things for people with disabilities. Journal of Networks and Computer Applications 2012, 35(2):584-596.
2. Betke M., Gips J. The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2002, 10(1):1-10.
3. Varona J., Manresa-Yee C., Perales F.J. Hands-free vision-based interface for computer accessibility. Journal of Network and Computer Applications 2008, 31(4):357-374.
4. Musen M.A., Shahar Y., Shortliffe E.H. Clinical decision-support systems. Medical Informatics: Computer Applications in Health Care and Biomedicine 2001, 573-609. Springer, New York, NY. E.H. Shortliffe, L.E. Perreault, G. Wiederhold, L.M. Fagan (Eds.).
5. Zhou H., Hu H. Human motion tracking for rehabilitation - a survey. Biomedical Signal Processing and Control 2008, 3(1):1-18.
6. Wang P., Kreutzer I.A., Bjärnemo R., Davies R.C. A web-based cost-effective training tool with possible application to brain injury rehabilitation. Computer Methods and Programs in Biomedicine 2004, 74(3):235-243.
7. Lin C., Huan C., Chan C., Yeh M., Chiu C.-C. Design of a computer game using an eye-tracking device for eye's activity rehabilitation. Optics and Lasers in Engineering 2004, 42(1):91-108.
8. da Costa R.M.E.M., de Carvalho L.A.V. The acceptance of virtual reality devices for cognitive rehabilitation: a report of positive results with schizophrenia. Computer Methods and Programs in Biomedicine 2004, 73(3):173-182.
9. Edmans J.A., Gladman J.R.F., Cobb S., Sunderland A., Pridmore T., Hilton D., et al. Validity of a virtual environment for stroke rehabilitation. Stroke 2006, 37(11):2770-2775.
10. Rand D., Kizony R., Weiss P.L. Virtual reality rehabilitation for all: Vivid GX versus Sony PlayStation II EyeToy. Proceedings of the Fifth International Conference on Disability, Virtual Reality and Associated Technologies 2004, 87-94.
11. Lin C.-S., Wei T.-C., Lu A.-T., Hung S.-S., Chen W.-L., Chang C.-C. A rehabilitation training system with double-CCD camera and automatic spatial positioning technique. Optics and Lasers in Engineering 2011, 49(3):457-464.
12. Vousdoukas M.I., Perakakis P., Idrissi S., Vila J. SVMT: a MATLAB toolbox for stereo-vision motion tracking of motor reactivity. Computer Methods and Programs in Biomedicine 2012, 108(1):318-329.
13. Broeren J., Bjorkdahl A., Claesson L., Goude D., Lundgren-Nilsson Å, Samuelsson H., Blomstrand C., Sunnerhagen K.S., Rydmark M. Virtual rehabilitation after stroke. Proceedings of the Medical Informatics Europe 2008, 77-82.
14. Pyk P., Wille D., Chevrier E., Hauser Y., Holper L., Fatton I., Greipl R., Schlegel S., Ottiger L., Ruckriem B., Pescatore A., Meyer-Heim A., Kiper D., Eng K. A paediatric interactive therapy system for arm and hand rehabilitation. Proceedings of the Virtual Rehabilitation Conference 2008, 127-132.
15. Cho S., Ku J., Cho Y.K., Kim I.-Y., Kang Y.J., Jang D.P., Kim S.I. Development of virtual reality proprioceptive rehabilitation system for stroke patients. Computer Methods and Programs in Biomedicine 2013, (in press).
16. Avola D., Spezialetti M., Placidi G. Design of an efficient framework for fast prototyping of customized human-computer interfaces and virtual environments for rehabilitation. Computer Methods and Programs in Biomedicine 2013, 110(3):490-502.
17. Badesa F.J., Morales R., Garcia-Aracil N., Sabater J.M., Casals A., Zollo L. Auto-adaptive robot-aided therapy using machine learning techniques. Computer Methods and Programs in Biomedicine 2013, (in press).
18. Pediaditis M., Tsiknakis M., Leitgeb N. Vision-based motion detection, analysis and recognition of epileptic seizures-a systematic review. Computer Methods and Programs in Biomedicine 2012, 108(3):1133-1148.
19. Chang Y.-J., Chen S.-F., Huang J.-D. A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. Research in Developmental Disabilities 2011, 32(6):2566-2570.
20. Lange B., Chang C.-Y., Suma E., Newman B., Rizzo A.S., Bolas M., Development Evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. Proceedings of the Annual International Conference of the IEEE EMBS 2011, 1831-1834.
21. González-Ortega D., Díaz-Pernas F.J., Martínez-Zarzuela M., Antón-Rodríguez M., Díez-Higuera J.F., Boto-Giralda D. Real-time hands, face and facial features detection and tracking: application to cognitive rehabilitation tests monitoring. Journal of Networks and Computer Applications 2010, 33(4):447-466.
22. M.A. Franco-Martín, T. Orihuela-Villameriel, Y. Buanco-Aguado, Programa GRADIOR. Programa de evaluación y rehabilitación cognitiva por ordenador (Editrans, Valladolid, Spain, 2000).
23. INTRAS Foundation, 2013, http://www.intras.es/.
24. Plagemann C., Ganapathi V., Koller D., Thrun S. Real-time identification and localization of body parts from depth images. Proceedings of the International Conference on Robotics and Automation 2010, 3108-3113.
25. Hrabar S., Corke P., Bosse M. High dynamic range stereo vision for outdoor mobile robotics. Proceedings of the IEEE International Conference on Robotics and Automation 2009, 430-435.
26. Elmezain M., Al-Hamadi A., Michaelis B. Real-time capable system for hand gesture recognition using hidden markov models in stereo color image sequence. Journal of WSCG 2008, 16(1):1213-6972.
27. Schwarz L.A., Mkhitaryan A., Mateus D., Navab N. Human skeleton tracking from depth data using geodesic distances and optical flow. Image and Vision Computing 2012, 30(3):217-226.
28. Dutta T. Evaluation of the Kinect sensor for 3-D kinematic measurement in the workplace. Applied Ergonomics 2012, 43(4):645-649.
29. Hu R.Z.-L., Hartfield A., Tung J., Fakih A., Hoey J., Poupart P. 3D pose tracking of walker users' lower limb with a structured-light camera on a moving platform. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2011, 29-36.
30. Chang Y.-J., Chou L.-D., Wang F.T.-Y., Chen S.-F. A kinect-based vocational task prompting system for individuals with cognitive impairments. Personal and Ubiquitous Computing 2011, 10.1007/s00779-011-0498-6.
31. Haggard P., Wolpert D.M. Disorders of body scheme. Higher-Order Motor Disorders: From Neuroanatomy and Neurobiology to Clinical Neurology 2005, Oxford University Press, Oxford, UK. H.J. Freund, M. Jeannerod, M. Hallett, R. Leiguarda (Eds.).
32. Sirigu A., Grafman J., Bressler K., Sunderland T. Multiple representations contribute to body knowledge processing, evidence from a case of autotopagnosia. Brain 2011, 114:629-642.
33. Coslett H.B. Evidence for a disturbance of body schema in neglect. Brain and Cognition 1998, 37(3):527-544.
34. Denes G., Cappelletti J.Y., Zilli T., Porta F.D., Gallana A. A category-specific deficit of spatial representation: the case of autotopagnosia. Neuropsychologia 2000, 38(4):345-350.
35. Poeck K., Orgass B. The concept of the body schema: a critical review and some experimental results. Cortex 1971, 7(3):254-277.
36. Lebrun Y. Gerstmann's syndrome. Journal of Neurolinguistics 2005, 18(4):317-326.
37. Fischer P., Marterer A., Danielczyk W. Right-left disorientation in dementia of the Alzheimer type. Neurology 1990, 40(10):1619-1620.
38. Strub R., Geschwind N. Localization in Gerstmann syndrome. Localization in Neuropsychology 1983, Academic Press, New York NY. A. Kertesz (Ed.).
39. OpenNI, 2013, http://openni.org/.
40. OpenCV, 2013, http://sourceforge.net/projects/opencvlibrary.
41. Lienhart R., Kuranov A., Pisarevsky V. Empirical analysis of detection cascades of boosted classifiers for rapid object detection. Proceedings of the DAGM-Symposium 2003, 297-304.
42. do Carmo M.P. Differential Geometry of Curves and Surfaces 1976, Prentice-Hall, Englewood Cliffs NJ.
43. Besl P.J., Jain R.C. Invariant surface characteristics for 3-D object recognition in range images. Computer Vision, Graphics, and Image Processing 1986, 33(1):33-80.
44. Malassiotis S., Strintzis M.G. Robust real-time 3D head pose estimation from range data. Pattern Recognition 2005, 38(8):1153-1165.
45. Mirelman A., Patritti B.L., Bonato P., Deutsch J.E. Effects of virtual reality training on gait biomechanics of individuals post-stroke. Gait Posture 2010, 31(4):433-437.
46. Saposnik G., Teasell R., Mamdani M., Hall J., McIlroy W., Cheung D., Thorpe K.E., Cohen L.G., Bayley M.E. Effectiveness of virtual reality using Wii gaming technology in stroke rehabilitation: a pilot randomized clinical trial and proof of principle. Stroke 2010, 41(7):1477-1484.
47. Chang C.-Y., Lange B., Zhang M., Koenig S., Requejo P., Somboon N., Sawchuk A.A., Rizzo A. Towards pervasive physical rehabilitation using Microsoft Kinect. Proceedings of the International Conference on Pervasive Computing Technologies for Healthcare 2012, 159-162.
48. Ibarra Zannatha J.M., Malo Tamayo A.J., Gómez Sánchez Á.D., Lavín Delgado J.E., Rodríguez Cheu L.E., Sierra Arévalo W.A. Development of a system based on 3D vision, interactive virtual environments, ergonometric signals and a humanoid for stroke rehabilitation. Computer Methods and Programs in Biomedicine 2013, 112(2):239-249.
49. SeeMe Rehabilitation, 2013, http://www.virtual-reality-rehabilitation.com/products/seeme/what-is-seeme.
50. Esoma Exercise System, 2013, http://newmed.media.mit.edu/blog/jom/2011/03/17/esoma-exercise-system-cardiac-rehab-using-kinect.
51. Lozano-Quilis J.-A., Albiol-Pérez S., Gil-Gómez H., Palacios-Navarro G., Fardoun H., Gil-Gómez J.-A., Mashat A. Virtual reality system for multiple sclerosis rehabilitation using Kinect. Proceedings of the International Conference on Pervasive Computing Technologies for Healthcare (ICTs for improving Patients Rehabilitation Research Techniques Workshop) 2013.
52. Simmons S., McCrindle R., Sperrin M., Smith A. Prescription software for recovery and rehabilitation using Microsoft Kinect. Proceedings of the International Conference on Pervasive Computing Technologies for Healthcare (ICTs for improving Patients Rehabilitation Research Techniques Workshop) 2013.