Local context-based recognition of sketched diagrams

Journal of Visual Languages and Computing

Volumn 25, Issue 6, 2014, Pages 955-962

  Costagliola, Gennaro ^a   De Rosa, Mattia ^a   Fuccella, Vittorio ^a  

^a UNIVERSITY OF SALERNO   (Italy)

Author keywords

Framework; Local context; Methodology; Multi domain; Sketch recognition; Visual languages

Indexed keywords

EID: 84928650474     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2014.10.021     Document Type: Article

References (44)

1. C. Alvarado, R. Davis, Sketchread: a multi-domain sketch recognition engine, in: Proceedings of the UIST'04, 2004, pp. 23-32.
2. D. Avola, A. Buono, P. Nostro, R. Wang, A novel online textual/graphical domain separation approach for sketch-based interfaces, in: E. Damiani, J. Jeong, R. Howlett, L. Jain (Eds.), New Directions in Intelligent Interactive Multimedia Systems and Services. 2, vol. 226, Springer, Berlin, Germany, 2009, pp. 167-176.
3. R. Bardohl, GenGEd: Visual Definition of Visual Languages based on Algebraic Graph Transformation (Ph. D. thesis), Verlag Dr. Kovac, 2000, Technical University of Berlin, Department of Computer Science, 1999.
4. R. Bardohl, M. Minas, G. Taentzer, A. Schürr, Handbook of graph grammars and computing by graph transformation, Application of Graph Transformation to Visual Languages, World Scientific Publishing Co., Inc., River Edge, NJ, USA, 1999, pp. 105-180.
5. G. Casella, V. Deufemia, V. Mascardi, G. Costagliola, M. Martelli, An agent-based framework for sketched symbol interpretation, J. Vis. Lang. Comput. 19 (2) (2008) 225-257.
6. S.S. Chok, K. Marriott, Automatic construction of intelligent diagram editors, in: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, UIST'98, ACM, New York, NY, USA, 1998, pp. 185-194.
7. R. Chung, P. Mirica, B. Plimmer, Inkkit: A generic design tool for the tablet pc, in: Proceedings of the CHINZ'05, 2005, pp. 29-30.
8. G. Costagliola, M. De Rosa, V. Fuccella, Identifying attachment areas on sketched symbols, in: Proceedings of the of VL/HCC'11, 2011, pp. 83-86.
9. G. Costagliola, M. De Rosa, V. Fuccella, Improving shape context matching for the recognition of sketched symbols, in: Proceedings of the of DMS, 2011, pp. 289-294.
10. G. Costagliola, M. De Rosa, V. Fuccella, Investigating human performance in hand-drawn symbol autocompletion, in: Proceedings of the SMC'13, 2013, pp. 279-284.
11. G. Costagliola, V. Deufemia, G. Polese, A framework for modeling and implementing visual notations with applications to software engineering, ACM Trans. Softw. Eng. Methodol. 13 (October (4)) (2004) 431-487.
12. G. Costagliola, V. Deufemia, G. Polese, Visual language implementation through standard compiler-compiler techniques, J. Vis. Lang. Comput. 18 (2) (2007) 165-226. (selected papers from Visual Languages and Computing 2005 (VLC'05)).
13. G. Costagliola, V. Deufemia, M. Risi, Sketch grammars: a formalism for describing and recognizing diagrammatic sketch languages, in: Proceedings of the ICDAR'05, 2005, pp. 1226-1230.
14. G. Costagliola, V. Fuccella, M. Di Capua, Interpretation of strokes in radial menus: the case of the keyscretch text entry method, J. Vis. Lang. Comput. 24 (4) (2013) 234-247.
15. G. Costagliola, G. Polese, Extended positional grammars, in: Proceedings of the VL'00, 2000, pp. 103-110.
16. G. Costagliola, M. De Rosa, V. Fuccella, Recognition and autocompletion of partially drawn symbols by using polar histograms as spatial relation descriptors, Comput. Graph. 39 (0) (2014) 101-116.
17. J. de Lara, H. Vangheluwe, Atom3: a tool for multi-formalism and meta-modelling, in: R.-D. Kutsche, H. Weber (Eds.), Fundamental Approaches to Software Engineering, Lecture Notes in Computer Science, vol. 2306, Springer, Berlin, Heidelberg, 2002, pp. 174-188.
18. G. Feng, C. Viard-Gaudin, Z. Sun, On-line hand-drawn electric circuit diagram recognition using 2d dynamic programming, Pattern Recognit. 42 (12) (2009) 3215-3223.
19. M. Fonseca, J. Jorge, Using fuzzy logic to recognize geometric shapes interactively, in: Proceedings of the FUZZ IEEE, vol. 1, 2000, pp. 291-296.
20. V. Fuccella, M. De Rosa, G. Costagliola, Novice and expert performance of keyscretch: a gesture-based text entry method for touchscreens, IEEE Trans. Hum.-Mach. Syst. 44 (4) (2014) 511-523.
21. L. Gennari, L.B. Kara, T.F. Stahovich, K. Shimada, Combining geometry and domain knowledge to interpret hand-drawn diagrams, Comput. Graph. 29 (4) (2005) 547-562.
22. E.J. Golin, Parsing visual languages with picture layout grammars, J. Vis. Lang. Comput. 2 (December (4)) (1991) 371-393.
23. E.J. Golin, S.P. Reiss, The specification of visual language syntax, J. Vis. Lang. Comput. 1 (June 2) (1990) 141-157.
24. T. Hammond, R. Davis, Tahuti: a geometrical sketch recognition system for uml class diagrams, in: ACM SIGGRAPH 2006 Courses, 2006.
25. T. Hammond, R. Davis, Ladder, a sketching language for user interface developers, in: ACM SIGGRAPH 2007 Courses, 2007.
26. J. Herold, T.F. Stahovich, A machine learning approach to automatic stroke segmentation, Comput. Graph. 38 (0) (2014) 357-364.
27. U. Kastens, C. Schmidt, Vl-eli: a generator for visual languages- system demonstration, Electr. Notes Theor. Comput. Sci. 65 (3) (2002) 139-143.
28. B.M. Kim Marriott, editor, Visual Language Theory, Springer-Verlag, New York, 1998.
29. A. Kleppe, Software Language Engineering: Creating Domain-Specific Languages Using Metamodels, 1st edition, Addison-Wesley Professional, Courier in Stoughton, MA, USA, 2008.
30. W. Lee, L. Burak Kara, T.F. Stahovich, An efficient graph-based recognizer for hand-drawn symbols, Comput. Graph. 31 (August) (2007) 554-567.
31. K. Marriott, Parsing visual languages with constraint multiset grammars, in: M. Hermenegildo, S. Swierstra (Eds.), Programming, Languages: Implementations, Logics and Programs, Lecture Notes in Computer Science, vol. 982, Springer, Berlin, Heidelberg, 1995, pp. 24-25.
32. M. Minas, G. Viehstaedt, Diagen: a generator for diagram editors providing direct manipulation and execution of diagrams, in: Proceedings of the 11th International IEEE Symposium on Visual Languages, VL'95, IEEE Computer Society, Washington, DC, USA, 1995, pp. 203.
33. T.Y. Ouyang, R. Davis, A visual approach to sketched symbol recognition, in: Proceedings of the IJCAI'09, 2009, pp. 1463-1468.
34. T.Y. Ouyang, R. Davis, Chemink: a natural real-time recognition system for chemical drawings, in: Proceedings of the IUI'11, 2011, pp. 267-276.
35. B. Paulson, T. Hammond, Paleosketch: accurate primitive sketch recognition and beautification, in: Proceedings of the IUI'08, 2008, pp. 1-10.
36. J. Rekers, A. Schurr, A graph based framework for the implementation of visual environments, in: Proceedings of the IEEE Symposium on Visual Languages, September 1996, pp. 148-155.
37. D. Rubine, Specifying gestures by example, SIGGRAPH Comput. Graph. 25 (July) (1991) 329-337.
38. T.F. Stahovich, E.J. Peterson, H. Lin, An efficient, classification-based approach for grouping pen strokes into objects, Comput. Graph. 0 (2014).
39. D.G. Ullman, S. Wood, D. Craig, The importance of drawing in the mechanical design process, Comput. Graph. 14 (2) (1990) 263-274.
40. L. Weitzman, K. Wittenburg, Relational grammars for interactive design, in: Proceedings of the IEEE Symposium on Visual Languages, August 1993, pp. 4-11.
41. J.O. Wobbrock, A.D. Wilson, Y. Li, Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes, in: Proceedings of the UIST'07, 2007, pp. 159-168.
42. Y. Xiong, J.J.J. LaViola, A shortstraw-based algorithm for corner finding in sketch-based interfaces, Comput. Graph. 34 (5) (2010) 513-527.
43. S. Zhai, P.O. Kristensson, The word-gesture keyboard: reimagining keyboard interaction, Commun. ACM 55 (September (9)) (2012) 91-101.
44. W. Zhang, L. Wenyin, K. Zhang, Symbol recognition with kernel density matching, IEEE Trans. Pattern Anal. Mach. Intell. 28 (December (12)) (2006) 2020-2024.