Sketch recognition by fusion of temporal and image-based features

Pattern Recognition

Volumn 44, Issue 6, 2011, Pages 1225-1234

  Arandjelović, Relja ^a   Sezgin, Tevfik Metin ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b KOÇ UNIVERSITY   (Turkey)

Author keywords

Graphics recognition; Sketch recognition; User interfaces

Indexed keywords

ALTERNATIVE SOURCE; COMBINATION METHOD; DIAGRAM RECOGNITION; EXPRESSIVE POWER; FREEHAND SKETCHING; FUSION METHODS; GRAPHICS RECOGNITION; IMAGE DATA; IMAGE-BASED; IMAGE-BASED FEATURES; IMAGE-BASED METHODS; PARALLEL GROWTH; PEN-BASED; PROCESSING CAPABILITY; PROCESSING POWER; RECOGNITION METHODS; RECOGNITION RATES; SKETCH RECOGNITION; SKETCH-BASED USER INTERFACE; SPATIAL CONSTRAINTS; STAND-ALONE ALGORITHM; TEMPORAL DATA; TEMPORAL FEATURES; TEMPORAL INFORMATION;

ALGORITHMS; IMAGE FUSION; USER INTERFACES;

FEATURE EXTRACTION;

EID: 79551557204     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.11.006     Document Type: Article

References (54)

1. D. Willems, R. Niels, M. van Gerven, and L. Vuurpijl Iconic and multi-stroke gesture recognition Pattern Recognition 42 12 2009 3303 3312
2. D. Rubine Specifying gestures by example SIGGRAPH Computer Graphics 25 4 1991 329 337
3. T. Hammond, and R. Davis LADDER, a sketching language for user interface developers Computers and Graphics 28 2005 518 532
4. C. Alvarado, and R. Davis SketchREAD: a multi-domain sketch recognition engine UIST '04 2004 ACM New York, NY, USA 23 32
5. J.-P. Valois, M. Cote, M. Cheriet, Online recognition of sketched electrical diagrams, in: ICDAR '01, September 1013, 2001, pp. 460464.
6. S. Mac, and E. Anquetil Eager interpretation of on-line hand-drawn structured documents: the DALI methodology Pattern Recognition 42 12 2009 3202 3214
7. A. Hall, C. Pomm, P. Widmayer, A combinatorial approach to multi-domain sketch recognition, in: Eurographics Workshop on Sketch-based Interfaces and Modeling, 2007, pp. 714.
8. L. Kara, T. Stahovich, An image-based trainable symbol recognizer for sketch-based interfaces, in: AAAI Fall Symposium Series 2004: Making Pen-Based Interaction Intelligent and Natural, 2004, pp. 501517.
9. H. Hse, A.R. Newton, Sketched symbol recognition using Zernike moments, in: Proceedings of International Conference on Pattern Recognition, vol. 1, 2004, pp. 367370.
10. M. Oltmans, Envisioning sketch recognition: a local feature based approach to recognizing informal sketches, Ph.D. Thesis, MIT, Cambridge, MA, May 2007.
11. S. Simhon, G. Dudek, Sketch interpretation and refinement using statistical models, in: Eurographics Symposium on Rendering, 2004, pp. 2332.
12. W. Jiang, Z.-X. Sun, HMM-based on-line multi-stroke sketch recognition, in: Proceedings of 2005 International Conference on Machine Learning and Cybernetics, vol. 7, August 2005, pp. 45644570.
13. D. Anderson, C. Bailey, M. Skubic, Hidden Markov model symbol recognition for sketch-based interfaces, in: AAAI Fall Symposium Series Making Pen-Based Interaction Intelligent and Natural, 2004, pp. 1521.
14. T.M. Sezgin, and R. Davis HMM-based efficient sketch recognition Proceedings of the 10th International Conference on Intelligent User Interfaces 2005 ACM New York, NY, USA 281 283
15. L. Rabiner A tutorial on hidden Markov models and selected applications in speech recognition Proceedings of the IEEE 77 2 1989 257 286
16. L. Rabiner, and B.-H. Juang Fundamentals of Speech Recognition 1993 Prentice-Hall, Inc. Upper Saddle River, NJ, USA
17. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combining classifiers IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 1998 226 239
18. L. Xu, A. Krzyzak, and C. Suen Methods of combining multiple classifiers and their applications to handwriting recognition IEEE Transactions on Systems, Man and Cybernetics 22 3 1992 418 435
19. A. Jaimes, and N. Sebe Multimodal humancomputer interaction: a survey Computer Vision and Image Understanding 108 12 2007 116 134
20. A. Rahman, and M. Fairhurst Multiple classifier decision combination strategies for character recognition: a review International Journal on Document Analysis and Recognition 5 July 2003 166 194
21. C.-C. Chang, C.-J. Lin, LIBSVM: A Library for Support Vector Machines, 2001. Software available at 〈 http://www.csie.ntu.edu.tw/~cjlin/libsvm 〉.
22. V. Vapnik Statistical Learning Theory 1998 John Wiley & Sons New York
23. H. Lin, C. Lin, and R. Weng A note on Platt's probabilistic outputs for support vector machines Machine Learning 68 3 2007 267 276
24. B. Scholkopf, J. Platt, J. Shawe-Taylor, A. Smola, and R. Williamson Estimating the support of a high-dimensional distribution Neural Computation 13 7 2001 1443 1471
25. L. Vuurpijl, The NicIcon database 〈 http://unipen.nici.ru.nl/ NicIcon/ 〉.
26. F. Manual, 101-5-1, Operational Terms and Graphics, Washington, DC, Department of the Army, vol. 30, 1997.
27. O.E. The Marine Corps Gazette, Tactical decision games symbols 〈 http://www.mca-marines.org/gazette/tdgsym.asp 〉.
28. C. Alvarado, M. Lazzareschi, Properties of real-world digital logic diagrams, in: Proceedings of the First International Workshop on Pen-Based Learning Technologies, 2007, pp. 1224.
29. J. Chen, C. Wang, and R. Wang Adaptive binary tree for fast SVM multiclass classification Neurocomputing 72 1315 2009 3370 3375
30. M. Shilman, H. Pasula, S. Russel, R. Newton, Statistical visual language models for ink parsing, in: Proceedings of the AAAI Spring Symposium on Sketch Understanding, 2002, pp. 12632.
31. T.A. Hammond, R. Davis, Recognizing interspersed sketches quickly, in: Proceedings of Graphics Interface, Toronto, Ontario, Canada, Canadian Information Processing Society, 2009, pp. 157166.
32. J. Mas, G. Sanchez, J. Llados, B. Lamiroy, An incremental on-line parsing algorithm for recognizing sketching diagrams, in: International Conference on Document Analysis and Recognition, 2007, pp. 452456.
33. D. Sharon, M. Van de Panne, Constellation models for sketch recognition, in: Eurographics Workshop on Sketch Based Interfaces and Modeling, 2006, pp. 1926.
34. M. Shilman, P. Viola, Spatial recognition and grouping of text and graphics, in: Eurographics Workshop on Sketch-Based Interfaces and Modeling, 2004, pp. 9195.
35. T. Sezgin, and R. Davis Sketch recognition in interspersed drawings using time-based graphical models Computers and Graphics 32 5 2008 500 510
36. S. Cates, Combining representations for improved sketch recognition, Ph.D. Thesis, Massachusetts Institute of Technology, September 2009.
37. L. Gennari, L.B. Kara, T.F. Stahovich, and K. Shimada Combining geometry and domain knowledge to interpret hand-drawn diagrams Computers and Graphics 29 4 2005 547 562
38. P.J. Cowans, M. Szummer, A graphical model for simultaneous partitioning and labeling, in: International Workshop on Artificial Intelligence and Statistics, 2005, pp. 7380.
39. Y. Qi, M. Szummer, T.P. Minka, Diagram structure recognition by Bayesian Conditional Random Fields, in: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2005, pp. 191196.
40. T.M. Sezgin, Generic and HMM based approaches to freehand sketch recognition, in: Proceedings of the MIT Student Oxygen Workshop, 2003.
41. G. Feng, C. Viard-Gaudin, and Z. Sun On-line hand-drawn electric circuit diagram recognition using 2D dynamic programming Pattern Recognition 42 12 2009 3215 3223
42. D. Arrivault, N. Richard, C. Fernandez-Maloigne, P. Bouyer, Collaboration between statistical and structural approaches for old handwritten characters recognition, in: 5th IAPR Workshop, vol. 3434, Mars 2005, pp. 291300.
43. P. Foggia, C. Sansone, F. Tortorella, and M. Vento Combining statistical and structural approaches for handwritten character description Image and Vision Computing 17 9 1999 701 711
44. T. Steinherz, E. Rivlin, N. Intrator, and P. Neskovic An integration of online and pseudo-online information for cursive word recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 27 5 2005 669 683
45. H. Oda, B. Zhu, J. Tokuno, M. Onuma, A. Kitadai, M. Nakagawa, A compact on-line and off-line combined recognizer, in: 10th International Workshop on Frontiers in Handwriting Recognition, vol. 1, 2006, pp. 133138.
46. H. Tanaka, K. Nakajima, K. Ishigaki, K. Akiyama, M. Nakagawa, Hybrid pen-input character recognition system based on integration of onlineoffline recognition, in: International Conference on Document Analysis and Recognition, September 1999, pp. 209212.
47. M. Liwicki, H. Bunke, HMM-based on-line recognition of handwritten whiteboard notes, in: International Workshop on Frontiers in Handwriting Recognition, 2006, pp. 595599.
48. M. Liwicki, A. Graves, H. Bunke, J. Schmidhuber, A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks, in: International Conference on Document Analysis and Recognition, 2007, pp. 367371.
49. M. Liwicki, and H. Bunke Combining diverse on-line and off-line systems for handwritten text line recognition Pattern Recognition 42 12 2009 3254 3263
50. M. Liwicki, H. Bunke, J. Pittman, and S. Knerr Combining diverse systems for handwritten text line recognition Machine Vision and Applications 2009 1 13
51. S. Belongie, J. Malik, and J. Puzicha Shape matching and object recognition using shape contexts IEEE Transactions on Pattern Analysis and Machine Intelligence 24 4 2002 509 522
52. E.G. Learned-Miller Data driven image models through continuous joint alignment IEEE Transactions on Pattern Analysis and Machine Intelligence 28 2 2006 236 250
53. L. Bahl, P. Brown, P. de Souza, R. Mercer, Maximum mutual information estimation of hidden Markov model parameters for speech recognition, in: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 11, 1986. pp. 4952.
54. M. Collins, Discriminative training methods for hidden markov models: theory and experiments with perceptron algorithms, in: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, Morristown, NJ, USA, Association for Computational Linguistics, 2002, pp. 18.