Relative hidden Markov models for video-based evaluation of motion skills in surgical training

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 37, Issue 6, 2015, Pages 1206-1218

  Zhang, Qiang ^a   Li, Baoxin ^a  

^a Arizona State University   (United States)

Author keywords

emotion recognition; Relative hidden markov model; relative learning; surgical skill; temporal model

Indexed keywords

MARKOV PROCESSES; MOTION ANALYSIS; PERSONNEL TRAINING; SPEECH RECOGNITION; SURGERY; TRELLIS CODES;

EMOTION RECOGNITION; RELATIVE LEARNING; RELATIVE RANKINGS; SURGICAL SKILL; TARGET APPLICATION; TEMPORAL ANALYSIS; TEMPORAL MODELING; VIDEO-BASED EVALUATIONS;

HIDDEN MARKOV MODELS;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; CLINICAL COMPETENCE; EDUCATION; GENERAL SURGERY; HUMAN; IMAGE PROCESSING; MACHINE LEARNING; MARKOV CHAIN; MOTOR PERFORMANCE; PHYSIOLOGY; PROCEDURES; VIDEORECORDING;

ALGORITHMS; CLINICAL COMPETENCE; GENERAL SURGERY; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MACHINE LEARNING; MARKOV CHAINS; MOTOR SKILLS; PATTERN RECOGNITION, AUTOMATED; VIDEO RECORDING;

EID: 84929192781     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2014.2361121     Document Type: Article

References (42)

1. F. Duan, Y. Zhang, N. Pongthanya, K. Watanabe, H. Yokoi, and T. Arai, "Analyzing human skill through control trajectories and motion capture data," in Proc. IEEE Int. Conf. Autom. Sci. Eng., Aug. 2008, pp. 454-459.
2. K. Watanabe and M. Hokari, "Kinematical analysis and measurement of sports form," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 36, no. 3, pp. 549-557, May 2006.
3. S. Suzuki, N. Tomomatsu, F. Harashima, and K. Furuta, "Skill evaluation based on state-transition model for human adaptive mechatronics (HAM)," in Proc. 30th Annu. Conf. IEEE Ind. Electron. Soc., 2004, vol. 1, pp. 641-646.
4. S. Satoshi and H. Fumio, "Skill evaluation from observation of discrete hand movements during console operation," J. Robot., vol. 2010, 2010.
5. J. Rosen, M. Solazzo, B. Hannaford, and M. Sinanan, "Task decomposition of laparoscopic surgery for objective evaluation of surgical residents' learning curve using hidden Markov model," Comput. Aided Surgery, vol. 7, pp. 49-61, 2002.
6. K. Kahol, N. C. Krishnan, V. N. Balasubramanian, S. Panchanathan, M. Smith, and J. Ferrara, "Measuring movement expertise in surgical tasks," in Proc. 14th Annu. ACM Int. Conf. Multimedia, 2006, pp. 719-722.
7. Q. Zhang and B. Li, "Video-based motion expertise analysis in simulation-based surgical training using hierarchical Dirichlet process hidden markov model," in Proc. Int. ACM Workshop Med. Multimedia Anal. Retrieval, 2011, pp. 19-24.
8. E. Fox, "Bayesian nonparametric learning of complex dynamical phenomena," Ph.D. thesis, MIT, Cambridge, MA, USA, 2009.
9. D. Parikh, and K. Grauman, "Relative attributes," in Proc. Int. Conf. Comput. Vis., Nov. 2011, pp. 503-510.
10. M. Schultz, and T. Joachims, "Learning a distance metric from relative comparisons," in Proc. Advances Neural Inf. Process. Syst., 2004, p. 41.
11. N. Kumar, A. Berg, P. Belhumeur, and S. Nayar, "Attribute and simile classifiers for face verification," in Proc. IEEE Int. Conf. Comput. Vis., Sep. 29, 2009-Oct. 2, 2009, pp. 365-372.
12. D. Parikh, A. Kovashka, A. Parkash, and K. Grauman, "Relative attributes for enhanced human-machine communication," in Proc. AAAI Conf. Artif. Intell., 2012.
13. Q. Zhang and B. Li, "Relative hidden Markov models for evaluating motion skill," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 548-555.
14. M. Collins, "Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms," in Proc. ACL-02 Conf. Empirical Methods Natural Language Process., 2002, pp. 1-8.
15. Y. Altun, I. Tsochantaridis, and T. Hofmann, "Hidden Markov support vector machines," in Proc. 20th Int. Conf. Mach. Learning, 2003, vol. 20, no. 1, p. 3.
16. A. Sloin and D. Burshtein, "Support vector machine training for improved hidden Markov modeling," IEEE Trans. Signal Process., vol. 56, no. 1, pp. 172-188, Jan. 2008.
17. G. Wang, D. Forsyth, and D. Hoiem, "Comparative object similarity for improved recognition with few or no examples," in Proc. 23rd IEEE Conf. Comput. Vis. Pattern Recog., 2010, pp. 3525-3532.
18. A. Kovashka, D. Parikh, and K. Grauman, "Whittlesearch: Image search with relative attribute feedback," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2973-2980.
19. I. Kadar and O. Ben-Shahar, "Small sample scene categorization from perceptual relations," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2012, pp. 2711-2718.
20. S. Guo, S. Sanner, T. Graepel, and W. Buntine, "Score-based Bayesian skill learning," in Proc. Eur. Conf. Mach. Learn. Knowl. Discovery Databases, 2012, pp. 106-121.
21. P. Dangauthier, R. Herbrich, T. Minka, and T. Graepel, "Trueskill through time: Revisiting the history of chess," in Proc. Adv. Neural Inf. Process. Syst., 2007, pp. 337-344.
22. N. R. Howells, M. D. Brinsden, R. S. Gill, A. J. Carr, and J. L. Rees, "Motion analysis: A validated method for showing skill levels in arthroscopy," Arthroscopy: J. Arthroscopic Related Surgery, vol. 24, no. 3, pp. 335-342, 2008.
23. H. Lin, I. Shafran, D. Yuh, and G. Hager, "Towards automatic skill evaluation: Detection and segmentation of robot-assisted surgical motions," Comput. Aided Surgery, vol. 11, no. 5, pp. 220-230, 2006.
24. A. G. Gallagher, E. M. Ritter, H. Champion, G. Higgins, M. P. Fried, G. Moses, C. D. Smith, and R. M. Satava, "Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training," Ann. Surgery, vol. 241, no. 2, p. 364, 2005.
25. J. Rosen, J. Brown, L. Chang, M. Sinanan, and B. Hannaford, "Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete Markov model," IEEE Trans. Biomed. Eng., vol. 53, no. 3, pp. 399-413, Mar. 2006.
26. K. Kahol, N. C. Krishnan, V. N. Balasubramanian, S. Panchanathan, M. Smith, and J. Ferrara, "Measuring movement expertise in surgical tasks," in Proc. 14th Annu. ACM Int. Conf. Multimedia, 2006, pp. 719-722.
27. S.-k. Jun, P. Singhal, M. Sathianarayanan, S. Garimella, A. Eddib, and V. Krovi, "Evaluation of robotic minimally invasive surgical skills using motion studies," in Proc. Workshop Performance Metrics Intell. Syst., 2012, pp. 198-205.
28. L. E. Baum, T. Petrie, G. Soules, and N. Weiss. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Statist. [Online]. 41(1), pp. 164-171. Available: http://www.jstor.org/stable/2239727
29. B. Juang and L. Rabiner, "The segmental k-means algorithm for estimating parameters of hidden Markov models," IEEE Trans. Acoustics, Speech Signal Process., vol. 38, no. 9, pp. 1639-1641, Sep. 1990.
30. N. Merhav and Y. Ephraim, "Maximum likelihood hidden Markov modeling using a dominant sequence of states," IEEE Trans. Signal Process., vol. 39, no. 9, pp. 2111-2115, Sep. 1991.
31. D. P. Bertsekas, "Constrained optimization and Lagrange multiplier methods," in Computer Science and Applied Mathematics, Boston, MA, USA: Academic, vol. 1, 1982.
32. C.-C. Chang and C.-J. Lin. (2011). LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. [Online]. 2, pp. 27:1-27:27, Software available at http://www.csie.ntu.edu. tw/ cjlin/libsvm.
33. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
34. I. Laptev, "On space-time interest points," Int. J. Comput. Vis., vol. 64, no. 2, pp. 107-123, 2005.
35. Q. Zhang, L. Chen, Q. Tian, and B. Li, "Video-based analysis of motion skills in simulation-based surgical training," in Proc. Int. IS&T/SPIE Electron. Imaging, 2013, p. 86670A.
36. T. L. Nwe, S. W. Foo, and L. C. De Silva, "Speech emotion recognition using hidden Markov models," Speech Commun., vol. 41, no. 4, pp. 603-623, 2003.
37. B. Schuller, G. Rigoll, and M. Lang, "Hidden Markov model-based speech emotion recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., 2003, vol. 2, pp. II-1.
38. M. El Ayadi, M. S. Kamel, and F. Karray, "Survey on speech emotion recognition: Features, classification schemes, and databases," Pattern Recognit., vol. 44, no. 3, pp. 572-587, 2011.
39. A. Tarasov and S. J. Delany, "Benchmarking classification models for emotion recognition in natural speech: A multi-corporal study," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. Workshops, 2011, pp. 841-846.
40. K. H. Kim, S. Bang, and S. Kim, "Emotion recognition system using short-term monitoring of physiological signals," Med. Biol. Eng. Comput., vol. 42, no. 3, pp. 419-427, 2004.
41. H. Mori, T. Satake, M. Nakamura, and H. Kasuya. (2008). UU database: A spoken dialogue corpus for studies on paralinguistic information in expressive conversation. Proc. Int. Conf. Text, Speech Dialogue, pp. 427-434 [Online]. Available: http://uudb.speechlab. org/
42. P. C. Woodland, J. J. Odell, V. Valtchev, and S. J. Young. (1994). Large vocabulary continuous speech recognition using htk. Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., vol. 2, pp. II/125-II/128 [Online]. Available: http://htk.eng.cam.ac.uk/