ChemInk: A natural real-time recognition system for chemical drawings

International Conference on Intelligent User Interfaces, Proceedings IUI

Volumn , Issue , 2011, Pages 267-276

  Ouyang, Tom Y ^a   Davis, Randall ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Chemical diagram recognition; Graphical models; Pen based interfaces; Sketch recognition

Indexed keywords

ACCURACY RATE; CHEMICAL DIAGRAM; CHEMICAL DRAWING; CHEMICAL STRUCTURE; CONDITIONAL RANDOM FIELD; CORNER DETECTION; DATA SETS; DRAWING STYLES; FREEHAND SKETCH; GRAPHICAL MODEL; JOINT MODELS; LEARNING-BASED APPROACH; LEVELS OF DETAIL; MULTIPLE LEVELS; PEN-BASED INTERFACES; REAL TIME; REAL-TIME RECOGNITION SYSTEM; SKETCH RECOGNITION; TABLET PCS; USER STUDY; VISUAL FEATURE; VISUAL FEEDBACK;

COMPUTER AIDED DESIGN; GRAPHIC METHODS; GRAPHICAL USER INTERFACES; PERSONAL COMPUTERS; VISUAL COMMUNICATION;

FEATURE EXTRACTION;

EID: 79952772276     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1943403.1943444     Document Type: Conference Paper

References (25)

1. C. Alvarado and R. Davis. Sketchread: A multi-domain sketch recognition engine. In Proc. UIST, 2004.
2. R. Casey, S. Boyer, P. Healey, A. Miller, B. Oudot, and K. Zilles. Optical recognition of chemical graphics. Document Analysis and Recognition, pages 627-631, 1993.
3. L. Fei-Fei, R. Fergus, and P. Perona. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. Computer Vision and Image Understanding, 106(1):59-70, 2007. (Pubitemid 46528761)
4. L. Gennari, L. Kara, T. Stahovich, and K. Shimada. Combining geometry and domain knowledge to interpret hand-drawn diagrams. Computers & Graphics, 29(4):547-562, 2005. (Pubitemid 41240654)
5. M. Gross. The electronic cocktail napkin - a computational environment for working with design diagrams. Design Studies, 17(1):53-69, 1996. (Pubitemid 126384998)
6. T. Hammond and R. Davis. Ladder: a language to describe drawing, display, and editing in sketch recognition. In International Conference on Computer Graphics and Interactive Techniques, 2006.
7. L. Kara and T. Stahovich. An image-based trainable symbol recognizer for sketch-based interfaces. AAAI Fall Symposium: Making Pen-Based Interaction Intelligent and Natural, 2004.
8. J. Lafferty, A. McCallum, and F. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. ICML, pages 282-289, 2001.
9. J. LaViola Jr and R. Zeleznik. Mathpad 2: a system for the creation and exploration of mathematical sketches. ACM Transactions on Graphics, 23(3):432-440, 2004.
10. D. Lowe. Object recognition from local scale-invariant features. In International Conference on Computer Vision, volume 2, pages 1150-1157, 1999. (Pubitemid 32079997)
11. K. Murphy, Y. Weiss, and M. Jordan. Loopy belief propagation for approximate inference: An empirical study. In Proc. of UAI, pages 467-475, 1999.
12. J. Nocedal and S. Wright. Numerical optimization. Springer, 2000.
13. M. Oltmans. Envisioning Sketch Recognition: A Local Feature Based Approach to Recognizing Informal Sketches. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, 2007.
14. T. Ouyang and R. Davis. Recognition of hand drawn chemical diagrams. In Proc. AAAI, 2007.
15. T. Ouyang and R. Davis. Learning from neighboring strokes: Combining appearance and context for multi-domain sketch recognition. In NIPS, pages 1401-1409, 2009.
16. T. Y. Ouyang and R. Davis. A visual approach to sketched symbol recognition. In Proc. IJCAI, 2009.
17. B. Paulson and T. Hammond. Paleosketch: accurate primitive sketch recognition and beautification. In Proc. IUI, pages 1-10, 2008.
18. T. Sezgin and R. Davis. Sketch based interfaces: Early processing for sketch understanding. In International Conference on Computer Graphics and Interactive Techniques, 2006.
19. T. Sezgin and R. Davis. Sketch recognition in interspersed drawings using time-based graphical models. Computers & Graphics, 32(5):500-510, 2008.
20. F. Sha and F. Pereira. Shallow parsing with conditional random fields. In Proc. ACL, pages 134-141, 2003.
21. M. Shilman, H. Pasula, S. Russell, and R. Newton. Statistical visual language models for ink parsing. AAAI Spring Symposium on Sketch Understanding, 2002.
22. M. Shilman, P. Viola, and K. Chellapilla. Recognition and grouping of handwritten text in diagrams and equations. In Frontiers in Handwriting Recognition, 2004.
23. M. Szummer. Learning diagram parts with hidden random fields. In International Conference on Document Analysis and Recognition, pages 1188-1193, 2005. (Pubitemid 46442511)
24. D. Tenneson and S. Becker. Interpretation of Molecule Conformations from Drawn Diagrams. PhD thesis, Brown University, 2008.
25. Y. Xiong and J. LaViola Jr. Revisiting shortstraw: improving corner finding in sketch-based interfaces. In Proc. Eurographics Symposium on Sketch-Based Interfaces and Modeling, pages 101-108, 2009.