Recognizing network-like hand-drawn sketches- A Convolutional Neural Network approach

Proceedings of the ASME International Design Engineering Technical Conferences and Computers and Information in Engineering Conference 2009, DETC2009

Volumn 5, Issue PART A, 2010, Pages 671-681

  Fu, Luoting ^a   Kara, Levent Burak ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CAD/CAE; CONVOLUTIONAL NEURAL NETWORK; ENGINEERING DESIGN; ENGINEERING DOMAINS; ENGINEERING MODELS; FREEHAND SKETCH; HAND-DRAWN SKETCHES; NON-TRIVIAL TASKS; SLIDING WINDOW; TRAINING SAMPLE; VISUAL OBJECTS;

CONVOLUTION; DESIGN; DRAWING (GRAPHICS); MODELS; VISUALIZATION;

NEURAL NETWORKS;

EID: 77953721837     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. Shpitalni, M., and Lipson, H., 1995. "Classification of sketch strokes and corner detection using conic sections and adaptive clustering". ASME Journal of Mechanical Design, 119, pp. 131-135.
2. Landay, J. A., and Myers, B. A., 2001. "Sketching interfaces: Toward more human interface design". IEEE Computer, 34(3), pp. 56-64.
3. Yang, M. C., 2003. "Concept generation and sketching: Correlations with design outcome". In ASME Design Engineering Technical Conferences and Design Theory and Methodology Conference.
4. Schutze, M., Sachse, P., and Romer, A., 2003. "Support value of sketching in the design process". Research in Engineering Design, 14, pp. 89-97.
5. Song, S., and Agogino, A. M., 2004. "Insights on designers' sketching activities in new product design teams". In ASME Design Engineering Technical Conferences and Computers and Information in Engineering Conference.
6. Chusilp, P., and Jin, Y., 2006. "Impact of mental iteration on concept generation". Journal of Mechanical De-sign, 128(1), pp. 14-25.
7. Yang, M. C., and Cham, J. G., 2007. "An analysis of sketching skill and its role in early stage engineering design. "Journal of Mechanical Design, 129(5), pp. 476-482.
8. Ullman, D. G., Wood, S., and Craig, D., 1990. "The importance of drawing in the mechanical design process". Computer and Graphics, 14(2), pp. 263-274.
9. Kara, L. B., Gennari, L., and Stahovich, T. F., 2008. "A sketch-based tool for analyzing vibratory mechanical sys-tems". Journal of Mechanical Design, 130(10).
10. LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P., 1998. "Gradient-based learning applied to document recog-nition". Proceedings of the IEEE, 86(11), November, pp. 2278-2324.
11. Garcia, C., and Delakis, M., 2004. "Convolutional face finder: A neural architecture for fast and robust face detec-tion". IEEE Transactions On Pattern Analysis and Machine intelligence, 26(11), pp. 1408-1423.
12. Osadchy, M., LeCun, Y., and Miller, M., 2007. "Synergistic face detection and pose estimation with energy-based models". Journal of Machine Learning Research, 8, May, pp. 1197-1215.
13. Ozer, O. F., Ozun, O., Tuzel, C. O., Atalay, V., and Cetin, A. E., 2001. "Vision-based single-stroke character recog-nition for wearable computing". IEEE Intelligent Systems and Applications, 16(3), pp. 33-37.
14. Rubine, D., 1991. "Specifying gestures by example". Computer Graphics, 25, pp. 329-337.
15. Yasuda, H., Takahashi, K., and Matsumoto, T., 2000. "A discrete hmm for online handwriting recognition". International Journal of Pattern Recognition and Articial Intelligence, 14(5), pp. 675-688.
16. LaViola, J., and Zeleznik, R., 2004. "Mathpad2: A system for the creation and exploration of mathematical sketches". In Proceedings of SIGGRAPH, Vol. 23, pp. 432-440.
17. Alvarado, C., and Davis, R., 2005. "Dynamically constructed bayes nets for multi-domain sketch understand-ing". In International Joint Conference on Artificial Intelligence.
18. Sezgin, T. M., and Davis, R., 2008. "Sketch recognition in interspersed drawings using time-based graphical models". Computers and Graphics Journal, 32(5), pp. 500-510.
19. Rabiner, L. R., 1989. "A tutorial on hidden markov models and selected applications in speech recognition". In Proceedings of the IEEE, pp. 257-286.
20. Cowans, P. J., and Szummer, M., 2005. "A graphical model for simultaneous partitioning and labeling". In AI and Statistics.
21. Kara, L. B., and Stahovich, T. F., 2004. "Hierarchical parsing and recognition of hand-sketched diagrams". In User Interface Software Technology.
22. Saund, E., 2003. "Finding perceptually closed paths in sketches and drawings". IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, pp. 475-491.
23. Kara, L. B., and Stahovich, T. F., 2005. "An image-based, trainable symbol recognizer for hand-drawn sketches". Computers and Graphics, 29(4), pp. 501-517.
24. Notowidigdo, M., and Miller, R. C., 2004. "Off-line sketch interpretation". In AAAI Fall Symposium Series 2004: Making Pen-Based Interaction Intelligent and Natural.
25. Rumelhart, D. E., Hinton, G. E., and Williams, R. J., 1986. "Learning representations by back-propagating er-rors". Nature, 323(6088), pp. 533-536.
26. Bishop, C. M., 1995. Neural Networks for Pattern Recognition. Oxford University Press, November.
27. Simard, P. Y., Steinkraus, D., and Platt, J. C., 2003. "Best practice for convolutional neural networks applied to visual document analysis". In International Conference on Document Analysis and Recogntion, pp. 958-962.
28. Viola, P., and Jones, M., 2001. "Rapid object detection using a boosted cascade of simple features". In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 905-910.
29. Rowley, H. A., Member, S., Baluja, S., and Kanade, T., 1998. "Neural network-based face detection". IEEE Transactions on Pattern Analysis and Machine intelligence, 20, pp. 23-38.
30. Bouvrie, J., 2006. "Notes on convolutional neural networks". In MIT CBCL Tech Report, pp. 38-44.
31. Vapnik, V. N., 1998. Statistical Learning Theory. Wiley, New York.
32. Haralick, R. M., and Shapiro, L. G., 1992. Computer and Robot Vision. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
33. Quattoni, A., Collins, M., and Darrell, T., 2004. "Conditional random fields for object recognition". In Neural Information Processing Systems, MIT Press, pp. 1097-1104.
34. Silva, R. d., Bischel, D. T., Lee, W., Peterson, E. J., Calfee, R. C., and Stahovich, T. F., 2007. "Kirchhoff's pen: A pen-based circuit analysis tutor". In Eurographics Workshop on Sketch-Based Interfaces and Modeling.
35. Gennari, L., Kara, L. B., and Stahovich, T. F., 2005. "Combining geometry and domain knowledge to interpret hand-drawn diagrams". Computers and Graphics, 29(4), pp. 547-562.