A model-based recognition engine for sketched diagrams

Journal of Visual Languages and Computing

Volumn 21, Issue 2, 2010, Pages 81-97

  Brieler, Florian ^a   Minas, Mark ^a  

^a BUNDESWEHR UNIVERSITY MUNICH   (Germany)

Author keywords

Geometry based recognition; Sketch recognition; Sketching

Indexed keywords

EID: 77949305392     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2009.12.002     Document Type: Article

References (38)

1. A. Apte, V. Vo, T.D. Kimura, Recognizing multistroke geometric shapes: an experimental evaluation, in: Proceedings of the Sixth Annual ACM Symposium on User Interface Software and Technology (UIST '93), ACM Press, New York, NY, USA, 1993, pp. 121-128.
2. Mankoff J., Abowd G.D., and Hudson S.E. OOPS: a toolkit supporting mediation techniques for resolving ambiguity in recognition-based interfaces. Computers & Graphics 24 6 (2000) 819-834
3. H. Hse, A.R. Newton, Sketched symbol recognition using zernike moments, in: Proceedings of the 17th International Conference on Pattern Recognition (ICPR '04), IEEE Computer Society, Washington, DC, USA, 2004, pp. 367-370.
4. C. Alvarado, R. Davis, Dynamically constructed bayes nets for multi-domain sketch understanding, in: Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI '05), 2005, pp. 1407-1412.
5. H. Dibeklioglu, T.M. Sezgin, E. Ozcan, A recognizer for free-hand graph drawings, in: Proceedings of the First International Workshop on Pen-Based Learning Technologies (PLT '07), IEEE Computer Society, Washington, DC, USA, 2007, p. 17.
6. T. Igarashi, S. Matsuoka, H. Tanaka, Teddy: a sketching interface for 3d freeform design, in: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99), ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 1999, pp. 409-416.
7. S.-H. Bae, R. Balakrishnan, K. Singh, ILoveSketch: as-natural-as-possible sketching system for creating 3D curve models, in: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08), ACM Press, New York, NY, USA, 2008, pp. 151-160.
8. G. Costagliola, V. Deufemia, M. Risi, Sketch grammars: a formalism for describing and recognizing diagrammatic sketch languages, in: Proceedings of the Eighth International Conference on Document Analysis and Recognition (ICDAR '05), IEEE Computer Society, Washington, DC, USA, 2005, pp. 1226-1231.
9. Zanibbi R., Blostein D., and Cordy J.R. Recognizing mathematical expressions using tree transformation. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 11 (2002) 1455-1467
10. Minas M. Concepts and realization of a diagram editor generator based on hypergraph transformation. Journal of Science of Computer Programming, Special Issue on Applications of Graph Transformations 44 2 (2002) 157-180
11. M. Minas, Generating meta-model-based freehand editors, in: A. Zündorf, D. Varró (Eds.), Proceedings of the Third International Workshop on Graph Based Tools (GraBaTs'06), Natal (Brazil), vol. 1 of Electronic Communications of the EASST, European Association of Software Science and Technology, 2006.
12. 3: a tool for multi-formalism and meta-modelling, in: Proceedings of the Fifth International Conference on Fundamental Approaches to Software Engineering (FASE '02), Springer, London, UK, 2002, pp. 174-188.
13. T. Fischer, J. Niere, L. Torunski, A. Zündorf, Story diagrams: a new graph rewrite language based on the Unified Modeling Language and Java, in: Selected Papers from the Sixth International Workshop on Theory and Application of Graph Transformations (TAGT '98), Springer, London, UK, 2000, pp. 296-309.
14. L.B. Kara, T.F. Stahovich, Hierarchical parsing and recognition of hand-sketched diagrams, in: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04), ACM Press, New York, NY, USA, 2004, pp. 13-22.
15. D. Rubine, Specifying gestures by example, in: Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '91), vol. 25(4), 1991, pp. 329-337.
16. M.J. Fonseca, C. Pimentel, J.A. Jorge, CALI: an online scribble recognizer for calligraphic interfaces, in: Papers from the 2002 AAAI Spring Symposium on Sketch Understanding, AAAI Press, Menlo Park, CA, USA, 2002, pp. 51-58.
17. Q. Chen, J. Grundy, J. Hosking, An e-whiteboard application to support early design-stage sketching of UML diagrams, in: Proceedings of the 2003 IEEE Symposium on Human Centric Computing Languages and Environments (HCC '03), IEEE Computer Society, Washington, DC, USA, 2003, pp. 219-226.
18. B. Paulson, P. Rajan, P. Davalos, R. Gutierrez-Osuna, T. Hammond, What!?! no Rubine features?: using geometric-based features to produce normalized confidence values for sketch recognition, in: Workshop on Sketch Tools for Diagramming (VL/HCC '08), 2008, pp. 57-63.
19. B. Plimmer, I. Freeman, A toolkit approach to sketched diagram recognition, in: Proceedings of the 21st British HCI Group Annual Conference (HCI '07), 2007, pp. 205-213.
20. J.I. Hong, J.A. Landay, SATIN: a toolkit for informal ink-based applications, in: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST '00), ACM Press, New York, NY, USA, 2000, pp. 63-72.
21. F. Brieler, M. Minas, A new approach to flexible, trainingless sketching, in: Workshop on Visual Modeling for Software Intensive Systems (VL/HCC '05), 2005, pp. 43-50.
22. F. Brieler, M. Minas, Recognition and processing of hand drawn diagrams using syntactic and semantic analysis, in: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI '08), ACM Press, New York, NY, USA, 2008, pp. 181-188.
23. F. Brieler, M. Minas, Ambiguity resolution for sketched diagrams by syntax analysis based on graph grammars, in: C. Ermel, J. de Lara, R. Heckel (Eds.), Proceedings of the Graph Transformation and Visual Modeling Techniques (GT-VMT '08), vol. 10 of Electronic Communications of the EASST, European Association of Software Science and Technology, 2008.
24. {ring operator} Encontro Portugues de Computacao Grafica, 2005.
25. T. Hammond, R. Davis, Tahuti: a geometrical sketch recognition system for UML class diagrams, in: Papers from 2002 AAAI Spring Symposium on Sketch Understanding, 2002, pp. 59-66.
26. T. Hammond, R. Davis, Automatically transforming symbolic shape descriptions for use in sketch recognition, in: Proceedings of the 19th National Conference on Artificial Intelligence (AAAI '04), AAAI Press, Menlo Park, CA, USA, 2004.
27. Hammond T., and Davis R. LADDER, a sketching language for user interface developers. Computers & Graphics 29 4 (2005) 518-532
28. P. Taele, T. Hammond, Hashigo: a next-generation sketch interactive system for Japanese Kanji, in: Proceedings of the 21st Innovative Applications Artificial Intelligence Conference (IAAI '09), 2009.
29. T.A. Hammond, LADDER: a perceptually-based language to simplify sketch recognition user interface development, Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA (2007).
30. G. Costagliola, V. Deufemia, M. Risi, A multi-layer parsing strategy for on-line recognition of hand-drawn diagrams, in: Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC '06), IEEE Computer Society, Washington, DC, USA, 2006, pp. 103-110.
31. R. Chung, P. Mirica, B. Plimmer, Inkkit: a generic design tool for the tablet pc, in: Proceedings of the Sixth ACM SIGCHI New Zealand Chapter's International Conference on Computer-human Interaction (CHINZ '05), ACM, New York, NY, USA, 2005, pp. 29-30.
32. L. Yeung, B. Plimmer, B. Lobb, D. Elliffe, Effect of fidelity in diagram presentation, in: Proceedings of the 22nd British HCI Group Annual Conference on HCI 2008 (BCS-HCI '08), British Computer Society, Swinton, UK, 2008, pp. 35-44.
33. C. Alvarado, R. Davis, SketchREAD: a multi-domain sketch recognition engine, in: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04), ACM, New York, NY, USA, 2004, pp. 23-32.
34. A. Caetano, N. Goulart, M. Fonseca, J. Jorge, JavaSketchIt: issues in sketching the look of user interfaces, in: Papers from the 2002 AAAI Spring Symposium on Sketch Understanding, AAAI Press, Menlo Park, CA, USA, 2002, pp. 9-14.
35. T.M. Sezgin, R. Davis, HMM-based efficient sketch recognition, in: Proceedings of the International Conference on Intelligent User Interfaces (IUI '05), ACM Press, New York, NY, USA, 2005.
36. B. Paulson, T. Hammond, PaleoSketch: accurate primitive sketch recognition and beautification, in: Proceedings of the 13th International Conference on Intelligent User Interfaces (IUI '08), ACM, New York, NY, USA, 2008, pp. 1-10.
37. T. Hammond, R. Davis, LADDER: a language to describe drawing, display, and editing in sketch recognition, in: Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI '03), 2003, pp. 461-467.
38. R. Patel, B. Plimmer, J. Grundy, R. Ihaka, Ink features for diagram recognition, in: Proceedings of the Fourth Eurographics Workshop on Sketch-based Interfaces and Modeling (SBIM '07), ACM Press, New York, NY, USA, 2007, pp. 131-138.