Matching incomplete time series with dynamic time warping: an algorithm and an application to post-stroke rehabilitation

Artificial Intelligence in Medicine

Volumn 45, Issue 1, 2009, Pages 11-34

  Tormene, Paolo ^a   Giorgino, Toni ^a   Quaglini, Silvana ^a   Stefanelli, Mario ^a  

^a UNIVERSITY OF PAVIA   (Italy)

Author keywords

Dynamic programming; Dynamic time warping; Motor rehabilitation; Nearest neighbour; Post stroke; Real time feedback; Subsequence matching; Timeseries classification; Wearable sensors

Indexed keywords

DYNAMIC TIME WARPING; MOTOR REHABILITATION; NEAREST NEIGHBOUR; POST-STROKE; REAL-TIME FEEDBACK; SUBSEQUENCE MATCHING; TIMESERIES CLASSIFICATION; WEARABLE SENSORS;

ALGORITHMS; BIOFEEDBACK; CLASSIFIERS; DYNAMIC PROGRAMMING; INDEXING (OF INFORMATION); LEARNING SYSTEMS; MOTORS; PATIENT REHABILITATION; PROGRAMMING THEORY; REAL TIME SYSTEMS; SENSORS; SYSTEMS ENGINEERING; WEAVING;

TIME SERIES;

ACCURACY; ARTICLE; CLASSIFICATION ALGORITHM; ELECTRONIC SENSOR; EXERCISE; FEEDBACK SYSTEM; HUMAN; MOTOR PERFORMANCE; PREDICTION; PRIORITY JOURNAL; REHABILITATION; STROKE; TIME SERIES ANALYSIS; VELOCITY;

ALGORITHMS; BIOFEEDBACK (PSYCHOLOGY); HUMANS; MULTIVARIATE ANALYSIS; STROKE;

EID: 60449118655     PISSN: 09333657     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artmed.2008.11.007     Document Type: Article

References (69)

1. Paolucci S., Antonucci G., Grasso M.G., Morelli D., Troisi E., Coiro P., et al. Early versus delayed inpatient stroke rehabilitation: a matched comparison conducted in Italy. Archives of Physical Medicine and Rehabilitation 81 6 (2000) 695-700
2. Kwakkel G., van Peppen R., Wagenaar R.C., Dauphinee S.W., Richards C., Ashburn A., et al. Effects of augmented exercise therapy time after stroke: a meta-analysis. Stroke; A Journal of Cerebral Circulation 35 11 (2004) 2529-2539
3. Forster A., and Young J. The clinical and cost effectiveness of physiotherapy in the management of elderly people following a stroke, vol. EB02 (2002), The Chartered Society Of Physiotherapy, London, UK
4. Quaglini S., Cavallini A., Gerzeli S., and Micieli G. Economic benefit from clinical practice guideline compliance in stroke patient management. Health Policy 69 3 (2004) 305-315
5. Inzitari D. The Italian Guidelines for stroke prevention. The Stroke Prevention and Educational Awareness Diffusion (SPREAD) Collaboration. Neurological Sciences: Official Journal of the Italian Neurological Society and of the Italian Society of Clinical Neurophysiology 21 1 (2000) 5-12
6. Giorgino T., Tormene P., Cattani B., Pistarini C., and Quaglini S. Remote support for stroke rehabilitation: MyHeart's Neurological Rehabilitation concept, Medinfo 2007. In: Kuhn K.A., Warren J.R., and Leong T.-Y. (Eds). Proceedings of the 12th world congress on health (medical) informatics, vol. 12 (Part 1) (2007), IOS Press, Amsterdam 92-96
7. Giorgino T., Tormene P., and Quaglini S. A multivariate time-warping based classifier for gesture recognition with wearable strain sensors. In: Dittmar A., Clark J., McAdams E., and Lovell N. (Eds). Engineering in medicine and biology society, 2007. EMBS 2007. 29th annual international conference of the IEEE (2007), IEEE Computer Society, Los Alamitos, CA, USA 4903-4906
8. Carpi F., and De Rossi D. Electroactive polymer-based devices for e-textiles in biomedicine. IEEE Transactions on Information Technology in Biomedicine 9 3 (2005) 295-318
9. De Rossi D., and Lymberis A. New generation of smart wearable health systems and applications. IEEE Transactions on Information Technology in Biomedicine 9 3 (2005) 293-294
10. Giorgino T., Lorussi F., De Rossi D., and Quaglini S. Posture classification via wearable strain sensors for neurological rehabilitation. In: Dhawan A., Akay M., Laine A.F., and Chon K. (Eds). Engineering in medicine and biology society, 2006. EMBS'06. 28th annual international conference of the IEEE (2006), IEEE Computer Society, Los Alamitos, CA, USA 6273-6276
11. Mattmann C., Amft O., Harms H., Troster G., and Clemens F. Recognizing upper body postures using textile strain sensors. In: Starner T., Schiele B., and Ryhänen T. (Eds). Proceedings of 11th IEEE international symposium on wearable computers (2007), IEEE Computer Society, Los Alamitos, CA, USA 29-36
12. Lorussi F., Scilingo E.P., Tesconi M., Tognetti A., and De Rossi D. Strain sensing fabric for hand posture and gesture monitoring. IEEE Transactions on Information Technology in Biomedicine 9 3 (2005) 372-381
13. P. Tormene, T. Giorgino, Upper-limb rehabilitation exercises acquired through 29 elastomer strain sensors placed on fabric. release 1.0. Accessed: October 30; 2008. http://www.labmedinfo.org/research/myheart/myheart.htm (July 2008).
14. Duchêne F., Garbay C., and Rialle V. Learning recurrent behaviors from heterogeneous multivariate time-series. Artificial intelligence in Medicine 39 1 (2007) 25-47
15. Antunes C., and Oliveira A. Temporal data mining: an overview. In: Unnikrishnan K.P., and Uthurusamy R. (Eds). Proceedings of the workshop on temporal data mining at the 7th international conference on knowledge discovery and data mining (KDD'01) (2001), Association for Computing Machinery, San Francisco, CA 1-13
16. Sakoe H., and Chiba S. Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing [see also IEEE Transactions on Signal Processing] 26 1 (1978) 43-49
17. Rabiner L., and Juang B.-H. Fundamentals of speech recognition (1993), Prentice-Hall, Inc., Upper Saddle River, NJ, USA
18. Kaufman L., and Rousseeuw P. Finding Groups in Data: an introduction to cluster analysis (1990), Wiley-Interscience, New York
19. Faundez-Zanuy M. On-line signature recognition based on VQ-DTW. Pattern Recognition 40 3 (2007) 981-992
20. Rath T., and Manmatha R. Word image matching using dynamic time warping. In: Manmatha R. (Ed). Proceedings of the IEEE computer society conference on computer vision and pattern recognition, vol. 2 (2003), IEEE Computer Society, Los Alamitos, CA, USA II-521-II-527
21. Gollmer K., and Posten C. Supervision of bioprocesses using a dynamic time warping algorithm. Control Engineering Practice 4 9 (1996) 1287-1295
22. Huang B., and Kinsner W. ECG frame classification using dynamic time warping. In: Kinsner W., Sebak A., and Ferens K. (Eds). Proceedings of the Canadian conference on electrical and computer engineering IEEE CCECE 2002, vol. 2 (2002), IEEE Computer Society, Los Alamitos, CA, USA 1105-1110
23. Syeda-Mahmood T., Beymer D., and Wang F. Shape-based matching of ECG recordings. In: Dittmar A., Clark J., McAdams E., and Lovell N. (Eds). Engineering in medicine and biology society, 2007. EMBS 2007. 29th annual international conference of the IEEE (2007), IEEE Computer Society, Los Alamitos, CA, USA 2012-2018
24. Tuzcu V., and Nas S. Dynamic time warping as a novel tool in pattern recognition of ECG changes in heart rhythm disturbances. In: Jamshidi M., Johnson M., and Chen P. (Eds). Proceedings of the IEEE international conference on systems, man and cybernetics, vol. 1 (2005), IEEE Computer Society, Los Alamitos, CA, USA 182-186
25. Casarotto S., Bianchi A., Cerutti S., Vanello N., Ricciardi E., Gentili C., et al. Combination of event-related potentials and functional magnetic resonance imaging during single-letter reading. In: Dhawan A., Akay M., Laine A.F., and Chon K. (Eds). Proceedings of the 28th annual international conference of the IEEE engineering in medicine and biology society EMBS'06 (2006), IEEE Computer Society, Los Alamitos, CA, USA 984-987
26. Brina C.D., Niels R., Overvelde A., Levi G., and Hulstijn W. Dynamic time warping: a new method in the study of poor handwriting. Human Movement Science 27 2 (2008) 242-255
27. Aach J., and Church G.M. Aligning gene expression time series with time warping algorithms. Bioinformatics 17 6 (2001) 495-508
28. Hermans F., and Tsiporkova E. Merging microarray cell synchronization experiments through curve alignment. Bioinformatics 23 2 (2007) 64-70
29. Kartikeyan B., and Sarkar A. Shape description by time series. IEEE Transactions on Pattern Analysis and Machine Intelligence 11 9 (1989) 977-984
30. Wei L., Keogh E., and Xi X. SAXually explicit images: finding unusual shapes. In: Clifton C.W., Zhong N., Liu J., Wah B.W., and Wu X. (Eds). Proceedings of the sixth international conference on data mining, 2006, ICDM'06 (2006), IEEE Computer Society, Los Alamitos, CA, USA 711-720
31. Tak Y.-S. A leaf image retrieval scheme based on partial dynamic time warping and two-level filtering. In: Wei D., Miyazaki T., and Paik I. (Eds). Proceedings of the 7th IEEE international conference on computer and information technology CIT 2007 (2007), IEEE Computer Society, Los Alamitos, CA, USA 633-638
32. Mori A., Uchida S., Kurazume R., Taniguchi R., Hasegawa T., and Sakoe H. Early recognition and prediction of gestures. In: Werner B. (Ed). Proceedings of the 18th international conference on pattern recognition ICPR 2006, vol. 3 (2006), IEEE Computer Society, Los Alamitos, CA, USA 560-563
33. Sakoe H. Two-level DP-matching - A dynamic programming-based pattern matching algorithm for connected word recognition. IEEE Transactions on Acoustics, Speech and Signal Processing [see also IEEE Transactions on Signal Processing] 27 6 (1979) 588-595
34. Myers C., Rabiner L., and Rosenberg A. Performance tradeoffs in dynamic time warping algorithms for isolated word recognition. IEEE Transactions on Acoustics Speech and Signal Processing 28 6 (1980) 623-635
35. Wu H., Kido R., and Shioyama T. Improvement of continuous dynamic programming for human gesture recognition. In: Sanfeliu A., Villanueva J., Vanrell M., Alquezar R., Jain A., and Kittler J. (Eds). Proceedings of the 15th international conference on pattern recognition, vol. 2 (2000), IEEE Computer Society, Los Alamitos, CA, USA 945-948
36. Keogh E, Xi X, Wei L, Ratanamahatana CA. The UCR time series classification/clustering homepage. Accessed: May 15; 2007. http://www.cs.ucr.edu/eamonn/time_series_data/.
37. Martin JK, Hirschberg DS. Small sample statistics for classification error rates II: confidence intervals and significance tests. Tech. Re ICS-TR-96-22. University of California, Irvine. Technical Report No. 96-22; 1996.
38. Scilingo E.P., Lorussi F., Mazzoldi A., and De Rossi D. Strain-sensing fabrics for wearable kinaesthetic-like systems. IEEE Sensors Journal 3 4 (2003) 460-467
39. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20 1 (1960) 37-46
40. Kvalseth T. Measurement of interobserver agreement using a "standard": measure formulation and statistical inferences. In: Tien J.M. (Ed). Proceedings of the IEEE international conference on systems, man, and cybernetics 'computational cybernetics and simulation', vol. 2 (1997), IEEE Computer Society, Los Alamitos, CA, USA 1787-1790
41. Lorussi F., Rocchia W., Scilingo E.P., Tognetti A., and De Rossi D. Wearable redundant fabric-based sensors arrays for reconstruction of body segment posture. IEEE Sensors Journal 4 6 (2004) 807-818
42. R Development Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2007, ISBN 3-900051-07-0.
43. Demšar J. Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research 7 (2006) 1-30
44. Salzberg S.L. On comparing classifiers: pitfalls to avoid and a recommended approach. Data Mining and Knowledge Discovery 1 3 (1997) 317-328
45. Itakura F. Minimum prediction residual principle applied to speech recognition. IEEE Transactions on Acoustics Speech and Signal Processing [see also IEEE Transactions on Signal Processing] 23 1 (1975) 67-72
46. Myers CS. A comparative study of several dynamic time warping algorithms for speech recognition. Master's Thesis, MIT Jun 20; 1980.
47. Keogh E., and Pazzani M. Derivative dynamic time warping. In: Kumar V., and Grossman R. (Eds). First SIAM international conference on data mining (2001), Society for Industrial and Applied Mathematics, Philadelphia, PA
48. Muscillo R., Conforto S., Schmid M., Caselli P., and D'Alessio T. Classification of motor activities through derivative dynamic time warping applied on accelerometer data. In: Dittmar A., Clark J., McAdams E., and Lovell N. (Eds). Engineering in medicine and biology society, 2007. EMBS 2007. 29th annual international conference of the IEEE (2007), IEEE Computer Society, Los Alamitos, CA, USA 4930-4933
49. Oka R. Spotting method for classification of real world data. The Computer Journal 41 8 (1998) 559-565
50. Rabiner L., Rosenberg A., and Levinson S. Considerations in dynamic time warping algorithms for discrete word recognition. IEEE Transactions on Acoustics Speech and Signal Processing 26 6 (1978) 575-582
51. Keogh E., and Ratanamahatana C.A. Exact indexing of dynamic time warping. Knowledge and Information Systems 7 3 (2005) 358-386
52. Salvador S., and Chan P. Fastdtw: Toward accurate dynamic time warping in linear time and space. In: Unnikrishnan K.P., Uthurusamy R., and Han J. (Eds). KDD workshop on mining temporal and sequential data (2004), ACM, New York, NY, USA 70-80
53. Sakurai Y., Faloutsos C., and Yamamuro M. Stream monitoring under the time warping distance. In: Liu L., Yazici A., Chirkova R., and Oria V. (Eds). Proceedings of the IEEE 23rd international conference on data engineering ICDE 2007 (2007), IEEE Computer Society, Los Alamitos, CA, USA 1046-1055
54. Rabiner L. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of IEEE 77 2 (1989) 257-286
55. Oates T., Firoiu L., and Cohen P.R. Using dynamic time warping to bootstrap hmm-based clustering of time series. Sequence Learning - Paradigms, Algorithms, and Applications (2001), Springer-Verlag, London, UK p. 35-52
56. Yaniv R., and Burshtein D. An enhanced dynamic time warping model for improved estimation of dtw parameters. IEEE Transactions on Speech and Audio Processing 11 3 (2003) 216-228
57. Navarro G. A guided tour to approximate string matching. ACM Computing Surveys 33 1 (2001) 31-88
58. P. Reiners, Dynamic programming and sequence alignment. Accessed: October 30; 2008. http://www.ibm.com/developerworks/java/library/j-seqalign/index.html (March 2008).
59. Henikoff S., and Henikoff J.G. Amino acid substitution matrices from protein blocks. Proceedings of the National Academy of Sciences of the United States of America 89 22 (1992) 10915-10919
60. Latecki L.J., Megalooikonomou V., Wang Q., and Yu D. An elastic partial shape matching technique. Pattern Recognition 40 11 (2007) 3069-3080
61. Warren Liao T. Clustering of time series data-a survey. Pattern Recognition 38 11 (2005) 1857-1874
62. Dixon S. An on-line time warping algorithm for tracking musical performances. In: Kaelbling L.P., and Saffiotti A. (Eds). Proceedings of the nineteenth international joint conference on artificial intelligence, vol. IJCAI-05 (2005), Professional Book Center, Denver, CO 1727-1728
63. Nishimura T., and Oka R. Spotting recognition of human gestures from time-varying images. In: Kavanaugh M.E. (Ed). Proceedings of the second international conference on automatic face and gesture recognition (1996), IEEE Computer Society, Los Alamitos, CA, USA 318-322
64. Kameya H., Mori S., and Oka R. A segmentation-free biometric writer verification method based on continuous dynamic programming. Pattern Recognition Letters 27 6 (2006) 567-577
65. Stacey M., and McGregor C. Temporal abstraction in intelligent clinical data analysis: a survey. Artificial Intelligence in Medicine 39 1 (2007) 1-24
66. Augusto J.C. Temporal reasoning for decision support in medicine. Artificial Intelligence in Medicine 33 1 (2005) 1-24
67. Haimowitz IJ. Knowledge-based trend detection and diagnosis. Ph.D. Thesis, Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, Cambridge, MA, USA; 1994.
68. Haimowitz I.J., and Kohane I.S. Managing temporal worlds for medical trend diagnosis. Artificial Intelligence in Medicine 8 3 (1996) 299-321
69. Giorgino T, Tormene P. dtw: dynamic time warping algorithms. Accessed: October 30; 2008. http://cran.r-project.org/web/packages/dtw/index.html (July 2008).