An agent-based framework for sketched symbol interpretation

Journal of Visual Languages and Computing

Volumn 19, Issue 2, 2008, Pages 225-257

  Casella, Giovanni ^a,b   Deufemia, Vincenzo ^b   Mascardi, Viviana ^a   Costagliola, Gennaro ^b   Martelli, Maurizio ^a  

^a UNIVERSITY OF GENOA   (Italy)

^b UNIVERSITY OF SALERNO   (Italy)

Author keywords

Agent based systems; Diagram recognition; Sketch understanding; Visual language parsing

Indexed keywords

EID: 40649091100     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2007.04.002     Document Type: Article

References (51)

1. D. Blostein, L. Haken, Using diagram generation software to improve diagram recognition: a case study of music notation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(11) (1999) 1121-1136.
2. Gross M.D. The electronic cocktail napkin-A computational environment for working with design diagrams. Design Studies 17 1 (1996) 53-69
3. Haddawy P., Dailey M.N., Kaewruen P., Sarakhette N., and Hai L.H. Anatomical sketch understanding: recognizing explicit and implicit structure. Artificial Intelligence in Medicine 39 2 (2007) 165-177
4. T. Hammond, R. Davis, Tahuti: a geometrical sketch recognition system for UML class diagrams, in: Proceedings of the AAAI Symposium on Sketch Understanding, AAAI Press, 2002, pp. 59-66.
5. Landay J.A., and Myers B.A. Sketching interfaces: toward more human interface design. IEEE Computer 34 3 (2001) 56-64
6. Newman M.W., Lin J., Hong J.I., and Landay J.A. DENIM: an informal web site design tool inspired by observations of practice. Human-Computer Interaction 18 3 (2003) 259-324
7. Stahovich T.F., Davis R., and Shrobe H. Generating multiple new designs from a sketch. Artificial Intelligence 104 1-2 (1998) 211-264
8. C. Alvarado, R. Davis, SketchREAD: a multi-domain sketch recognition engine, in: Proceedings of User Interface and Software Technology (UIST'04), Santa Fe, NM, USA, ACM Press, New York, October 24-27, 2004, pp. 23-32.
9. Igarashi T., and Zeleznik B. Sketch-based Interaction. IEEE Computer Graphics and Applications 27 1 (2007) 26-27
10. C. Alvarado, R. Davis, Dynamically constructed Bayes nets for multi-domain sketch understanding, in: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI'05), Edinburgh, Scotland, UK, July 30-August 5, 2005, pp. 1407-1412.
11. G. Casella, G. Costagliola, V. Deufemia, M. Martelli, V. Mascardi, An agent-based framework for context-driven interpretation of symbols in diagrammatic sketches, in: Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'06), Brighton, UK, IEEE CS Press, 2006, pp. 73-80.
12. Object Management Group. UML Specification version 2.0. 〈http://www.omg.org/technology/documents/formal/uml.htm〉, 2005.
13. L.B. Kara, T.F. Stahovich, Hierarchical parsing and recognition of hand-sketched diagrams, in: Proceedings of User Interface and Software Technology (UIST'04), 2004, ACM Press, 2004, pp. 13-22.
14. D. Arrivault, N. Richard, P. Bouyer, Fuzzy hierarchical attributed graph approach for handwritten hieroglyphs description, in: Proceedings of 11th International Conference on Computer Analysis of Images and Patterns (CAIP'05), Lecture Notes in Computer Science, vol. 3691, Springer, Berlin, 2005, pp. 748-755.
15. M. Luck, P. McBurney, O. Shehory, S. Willmott, The AgentLink Community, Agent technology: computing as interaction-a roadmap for agent-based computing, AgentLink III, 2005.
16. Wooldridge M., and Jennings N.R. Intelligent agents: theory and practice. The Knowledge Engineering Review 10 2 (1995) 115-152
17. Jennings N.R., Sycara K.P., and Wooldridge M. A roadmap of agent research and development. Journal of Autonomous Agents and Multi-Agent Systems 1 1 (1998) 7-36
18. M. Amer, A. Karmouch, T. Gray, S. Mankovski, An agent model for resolution of feature conflicts in telephony, Journal of Network and Systems Management, 8(3) (2000).
19. J. Chu-Carroll, S. Carberry, Communication for conflict resolution in multi-agent collaborative planning, in: Proceedings of the International Conference on Multi-Agent Systems (ICMAS'95), 1995, pp. 49-56.
20. J.L.T. da Silva, V.L. Strube de Lima, Lexical categorical disambiguation using a multi-agent systems architecture, in: Proceedings of the International Conference on Multi-Agent Systems (ICMAS'98), 1998, pp. 417-418.
21. Juchmes R., Leclercq P., and Azar S. A freehand-sketch environment for architectural design supported by a multi-agent system. Computers & Graphics 29 6 (2005) 905-915
22. Luck M., McBurney P., and Preist C. A manifesto for agent technology: towards next generation computing. Journal of Autonomous Agents and Multi-Agent Systems 9 3 (2004) 203-252
23. Zambonelli F., and Omicini A. Challenges research directions in agent-oriented software engineering. Journal of Autonomous Agents and Multi-Agent Systems 9 3 (2004) 253-283
24. J.I. Hong, J.A. Landay, SATIN: a toolkit for informal ink-based applications, in: Proceedings of User Interface and Software Technology (UIST'00), November 5-8, San Diego, California, ACM Press, New York, 2000, pp. 63-72.
25. Hammond T., and Davis R. LADDER: A sketching language for user interface developers. Computers & Graphics 29 4 (2005) 518-532
26. A. Apte, V. Vo, T.D. Kimura, Recognizing multistroke geometric shapes: an experimental evaluation, in: Proceedings of User Interface and Software Technology (UIST'93), 1993, ACM Press, New York, pp. 121-128.
27. G. Costagliola, V. Deufemia, M. Risi, Sketch grammars: a formalism for describing and recognizing diagrammatic sketch languages, in: Proceedings of the Eighth International Conference on Document Analysis and Recognition (ICDAR'05), Seoul, South Korea, IEEE CS Press, 2005, pp. 1226-1230.
28. M.J. Fonseca, C. Pimentel, J.A. Jorge, CALI-An online scribble recognizer for calligraphic interfaces, in: Proceedings of the AAAI Symposium on Sketch Understanding, AAAI Press, 2002, pp. 51-58.
29. Kara L.B., and Stahovich T.F. An image-based trainable symbol recognizer for hand-drawn sketches. Computers & Graphics 29 4 (2005) 501-517
30. Rubine D. Specifying gestures by example. Computer Graphics 25 4 (1991) 329-337
31. E. Friedman-Hill, Jess, The Java Expert System Shell, Technical Report, Sandia National Laboratories, 2000, 〈http://herzberg.ca.sandia.gov/jess〉.
32. G. Costagliola, V. Deufemia, G. Polese, A framework for modeling and implementing visual notations with applications to software engineering, ACM Transactions on Software Engineering and Methodology, 13(4) (2004) 431-487.
33. A. Ferreira, M. Vala, J.A. Madeiras Pereira, J.A. Jorge, A. Paiva, A calligraphic interface for managing agents, in: Proceedings of the 14th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG'06), 2006, pp. 25-31.
34. F. Bellifemine, A. Poggi, G. Rimassa. Developing multi-agent systems with JADE, in: Seventh International Workshop Agent Theories Architectures and Languages (ATAL2000), Lecture Notes in Computer Science, vol. 1986, Springer, Berlin, 2000, pp. 89-103.
35. FIPA ORG, FIPA ACL Message Structure Specification, Document no. SC00061G, 2002.
36. InkML, 〈http://www.w3.org/TR/InkML/〉, October 2006.
37. Y. Liu, Y. Yu, W. Liu, Online segmentation of freehand stroke by dynamic programming, in: Proceedings of International Conference on Document Analysis and Recognition (ICDAR'05), Seoul, South Korea, IEEE CS Press, 2005, pp. 197-201.
38. H. Hse, A.R. Newton, Sketched symbol recognition using zernike moments, in: Proceedings of International Conference on Pattern Recognition (ICPR'04), Cambridge, UK, August, IEEE CS Press, 2004, pp. 367-370.
39. JUNG-the Java Universal Network/Graph Framework, ver. 1.7.5, 〈http://jung.sourceforge.net/〉, 2006.
40. P.R. Cohen, M. Johnston, D. McGee, I. Smith, J. Pittman, L. Chen, J. Clow, Multimodal interaction for distributed interactive simulation, in: Proceedings of Innovative Applications of Artificial Intelligence Conference (IAAI'97), 1997, AAAI Press, pp. 978-985.
41. E. Kaiser, D. Demirdjian, A. Gruenstein, X. Li, J. Niekrasz, M. Wesson, S. Kumar, Demo: a multimodal learning interface for sketch, speak and point creation of a schedule chart, in: Proceedings of the Sixth International Conference on Multimodal Interfaces (ICMI'04), State College, Pennsylvania, USA, October 14-15, 2004, pp. 329-330.
42. H.H. Achten, A.J. Jessurun, An agent framework for recognition of graphic units in drawings, in: Proceedings of 20th International Conference on Education and Research in Computer Aided Architectural Design in Europe (eCAADe'02), Warsaw, 2002, pp. 246-253.
43. G. Mackenzie, N. Alechina, Classifying sketches of animals using an agent-based system, in: Proceedings of 10th International Conference on Computer Analysis of Images and Patterns (CAIP'03), Lecture Notes in Computer Science, vol. 2756, Springer, Berlin, 2003, pp. 521-529.
44. S. Azar, L. Couvreury, V. Delfosse, B. Jaspartz, C. Boulanger, An agent-based multimodal interface for sketch interpretation, in: Proceedings of International Workshop on Multimedia Signal Processing (MMSP-06), British Columbia, Canada, 2006.
45. Gennari L., Kara L.B., and Stahovich T.F. Combining geometry and domain knowledge to interpret hand-drawn diagrams. Computers & Graphics 29 4 (2005) 547-562
46. B. Krishnapuram, C. Bishop, M. Szummer, Generative Bayesian models for shape recognition, in: Proceedings of 10th International Workshop on Frontiers in Handwriting Recognition (IWFHR-9), Japan, IEEE CS Press, 2004, pp. 20-25.
47. J.V. Mahoney, M.P.J. Fromherz, Three main concerns in sketch recognition and an approach to addressing them, in: Proceedings of AAAI Spring Symposium on Sketch Understanding, AAAI Press, 2002, pp. 105-112.
48. Sezgin T.M., and Davis R. Sketch interpretation using multiscale models of temporal patterns. IEEE Computer Graphics and Applications 27 1 (2007) 28-37
49. G. Costagliola, V. Deufemia, M. Risi, A multi-layer parsing strategy for on-line recognition of hand-drawn diagrams, in: Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'06), Brighton, UK, IEEE CS Press, 2006, pp. 103-110.
50. S. Bergamaschi, Extraction of informations from highly heterogeneous sources of textual data, in: Proceedings of First International Workshop on Cooperative Information Agents (CIA'97), Lecture Notes in Computer Science, vol. 1997, Springer, Berlin, pp. 42-63.
51. V.S. Subrahmanian, S-S. Chen, J.A. Hendler, R. Hull, V. Tannen, Smart mediators and intelligent agents (panel), in: Proceedings of the Fifth International Conference on Information and Knowledge Management (CIKM'96), 1996, p. 343.