From engineering diagrams to engineering models: Visual recognition and applications

CAD Computer Aided Design

Volumn 43, Issue 3, 2011, Pages 278-292

  Fu, Luoting ^a   Kara, Levent Burak ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Convolutional Neural Network; Engineering document image analysis; Engineering information retrieval; Network like engineering diagram; Sketch based modeling; Visual recognition

Indexed keywords

CONVOLUTIONAL NEURAL NETWORK; ENGINEERING DOCUMENT IMAGE ANALYSIS; ENGINEERING INFORMATION RETRIEVAL; NETWORK-LIKE ENGINEERING DIAGRAM; SKETCH-BASED MODELING; VISUAL RECOGNITION;

BENCHMARKING; COMPUTER AIDED DESIGN; COMPUTER SIMULATION; CONVOLUTION; DATA PROCESSING; GRAPHIC METHODS; IMAGE ANALYSIS; INFORMATION RETRIEVAL; MODELS; NEURAL NETWORKS; RESONANT CIRCUITS; SEMANTICS;

SEARCH ENGINES;

EID: 78651588036     PISSN: 00104485     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cad.2010.12.011     Document Type: Article

References (70)

1. D.G. Ullman, S. Wood, and D. Craig The importance of drawing in the mechanical design process Computers and Graphics 14 2 1990 263 274
2. M. Shpitalni, and H. Lipson Classification of sketch strokes and corner detection using conic sections and adaptive clustering ASME Journal of Mechanical Design 119 1995 131 135 (Pubitemid 127709716)
3. J.A. Landay, and B.A. Myers Sketching interfaces: toward more human interface design IEEE Computer 34 3 2001 56 64 (Pubitemid 32255197)
4. Yang MC. Concept generation and sketching: correlations with design outcome. In: ASME design engineering technical conferences and design theory and methodology conference. 2003.
5. M. Schutze, P. Sachse, and A. Romer Support value of sketching in the design process Research in Engineering Design 14 2003 89 97
6. Song S, Agogino AM. Insights on designers' sketching activities in new product design teams. In: ASME design engineering technical conferences and computers and information in engineering conference. 2004.
7. P. Chusilp, and Y. Jin Impact of mental iteration on concept generation Journal of Mechanical Design 128 1 2006 14 25
8. M.C. Yang, and J.G. Cham An analysis of sketching skill and its role in early stage engineering design Journal of Mechanical Design 129 5 2007 476 482 (Pubitemid 46876295)
9. Silva Rd, Bischel DT, Lee W, Peterson EJ, Calfee RC, Stahovich TF. Kirchhoff's pen: a pen-based circuit analysis tutor. In: Eurographics workshop on sketch-based interfaces and modeling. 2007.
10. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proceedings of the IEEE 86 11 1998 2278 2324
11. R.M. Haralick, and L.G. Shapiro Computer and robot vision vol. I 1992 Addison-Wesley
12. L.B. Kara, L. Gennari, and T.F. Stahovich A sketch-based tool for analyzing vibratory mechanical systems Journal of Mechanical Design 130 10 2008 101101
13. C.S. Fahn, J.F. Wang, and J.Y. Lee A topology-based component extractor for understanding electronic circuit diagrams Computer Vision, Graphics, and Image Processing 44 1988 119 138
14. A. Okazaki, T. Knodo, K. Mori, S. Tsunekawa, and E. Kawamoto An automatic circuit diagram reader with loop-structure-based symbol recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 10 3 1988 331 341 (Pubitemid 18639671)
15. X. Lin, S. Shimotsuji, and M. Minoh Efficient diagram understanding with characteristic pattern detection Computer Vision, Graphics, and Image Processing 30 1985 84 106 (Pubitemid 15490084)
16. Y. Yu, A. Samal, and S.C. Seth A system for recognizing a large class of engineering drawings IEEE Transactions on Pattern Analysis and Machine Intelligence 19 8 1997 868 890 (Pubitemid 127762278)
17. R.P. Futrelle, I.A. Kakadiaris, J. Alexander, C.M. Carriero, N. Nikolakis, and J.M. Futrelle Understanding diagrams in technical documents IEEE Computer 25 7 1992 75 78
18. Futrelle RP, Nikolakis N. Efficient analysis of complex diagrams using constraint-based parsing. In: International conference on document analysis and recognition (ICDAR). 1995. p. 78290.
19. B.T. Messmer, and H. Bunke Automatic learning and recognition of graphical symbols in engineering drawings G. Goos, J. Hartmanis, J. van Leeuwen, Graphics recognition methods and applications vol. 1072 1996 Springer 123 134 (Pubitemid 126074578)
20. W. Liu Example-driven graphics recognition Proceedings of the SSPR2002 (structural, syntactic, and statistical pattern recognition LNCS vol. 2396 2002
21. Yan L, Liu W. Engineering drawings recognition using a case-based approach. In: International conference on document analysis and recognition. 2003. p. 1904.
22. S. Yang Symbol recognition via statistical integration of pixel-level constraint histograms: a new descriptor IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2 2005 278 281 (Pubitemid 40377321)
23. W. Zhang, L. Wenyin, and K. Zhang Symbol recognition with kernel density matching IEEE Transactions on Pattern Analysis and Machine Intelligence 28 12 2006 2020 2024 (Pubitemid 46405711)
24. Barrat S, Tabbone S, Nourrissier P. A Bayesian classifier for symbol recognition. In: Seventh IAPR international workshop on graphics recognition. 2007.
25. Luqman MM, Brouard T, Ramel J-Y. Graphic symbol recognition using graph based signature and Bayesian network classifier. In: International conference on document analysis and recognition (ICDAR). 2009.
26. S. Escalera, A. Forns, O. Pujol, P. Radeva, G. Snchez, and J. Llads Blurred shape model for binary and grey-level symbol recognition Pattern Recognition Letters 30 15 2009 1424 1433
27. S. Barrat, and S. Tabbone A Bayesian network for combining descriptors: application to symbol recognition International Journal on Document Analysis and Recognition 13 1 2010 65 75
28. G. Nagy Twenty years of document image analysis in PAMI IEEE Transactions on Pattern Analysis and Machine Intelligence 22 1 2000 38 62 (Pubitemid 32132954)
29. L. Cordella, and M. Vento Symbol recognition in documents: a collection of techniques? International Journal on Document Analysis and Recognition 3 2 2000 73 88
30. O.F. Ozer, O. Ozun, C.O. Tuzel, V. Atalay, and A.E. Cetin Vision-based single-stroke character recognition for wearable computing IEEE Intelligent Systems and Applications 16 3 2001 33 37 (Pubitemid 32732715)
31. D. Rubine Specifying gestures by example Computer Graphics 25 1991 329 337
32. H. Yasuda, K. Takahashi, and T. Matsumoto A discrete hmm for online handwriting recognition International Journal of Pattern Recognition and Artificial Intelligence 14 5 2000 675 688
33. A. Hall, C. Pomm, and P. Widmayer A combinatorial approach to multi-domain sketch recognition SBIM '07: proceedings of the 4th eurographics workshop on sketch-based interfaces and modeling 2007 ACM New York (NY, USA) 7 14
34. LaViola J, Zeleznik R. Mathpad2: A system for the creation and exploration of mathematical sketches. In: Proceedings of SIGGRAPH, vol. 23. 2004. p. 43240.
35. Murugappan S, Ramani K. FEAsy: A sketch-based interface integrating structural analysis in early design. In: Proceedings of the ASME international design engineering technical conferences and computers and information in engineering conference 2009, vol. 2. 2009. p. 74352.
36. T. Hammond, and R. Davis LADDER, a sketching language for user interface developers Computer and Graphics 29 4 2005 518 532 (Pubitemid 41240652)
37. Alvarado C, Davis R. Dynamically constructed Bayes nets for multi-domain sketch understanding. International joint conference on artificial intelligence. 2005.
38. C. Alvarado, and R. Davis SketchREAD: a multi-domain sketch recognition engine UIST '04: proceedings of the 17th annual ACM symposium on user interface software and technology 2004 ACM New York (NY, USA) 23 32 (Pubitemid 40787660)
39. T.M. Sezgin, and R. Davis Sketch recognition in interspersed drawings using time-based graphical models Computers and Graphics 32 5 2008 500 510
40. P.J. Cowans, and M. Szummer A graphical model for simultaneous partitioning and labeling AI and statistics 2005
41. Kara LB, Stahovich TF. Hierarchical parsing and recognition of hand-sketched diagrams. User interface software technology. 2004.
42. E. Saund Finding perceptually closed paths in sketches and drawings IEEE Transactions on Pattern Analysis and Machine Intelligence 25 2003 475 491
43. Notowidigdo M, Miller RC. Off-line sketch interpretation. In: AAAI fall symposium series 2004: making pen-based interaction intelligent and natural. 2004.
44. L.B. Kara, and T.F. Stahovich An image-based, trainable symbol recognizer for hand-drawn sketches Computers and Graphics 29 4 2005 501 517 (Pubitemid 41240651)
45. J. Pu, and D. Gur Automated freehand sketch segmentation using radial basis functions Computer-Aided Design 41 12 2009 857 864
46. Ouyang TY, Davis R. A visual approach to sketched symbol recognition. In: Proceedings of the 21st international joint conferences on artificial intelligence (IJCAI-2009). 2009.
47. C. Garcia, and M. Delakis Convolutional face finder: a neural architecture for fast and robust face detection IEEE Transactions on Pattern Analysis and Machine Intelligence 26 11 2004 1408 1423 (Pubitemid 40168019)
48. C.M. Bishop Neural networks for pattern recognition 1996 Oxford University Press USA
49. Bouvrie J. Notes on convolutional neural networks. MIT CBCL tech report. 2006. p. 3844.
50. F.-J. Huang, and Y. LeCun Large-scale learning with svm and convolutional nets for generic object categorization Proceedings of the IEEE conference on computer vision and pattern recognition 2006 IEEE Press
51. M. Osadchy, Y. LeCun, and M. Miller Synergistic face detection and pose estimation with energy-based models Journal of Machine Learning Research 8 2007 1197 1215 (Pubitemid 46827844)
52. Simard PY, Steinkraus D, Platt JC. Best practice for convolutional neural networks applied to visual document analysis. In: International conference on document analysis and recogntion. 2003. p. 958962.
53. D.H. Hubel, and T.N. Wiesel Receptive fields, binocular interaction and functional architecture in the cat's visual cortex Journal of Physiology 160 1962 106 154
54. L. Shapiro, and G. Stockman Computer vision 2002 Prentice Hall
55. R.M. Haralick, and L.G. Shapiro Computer and robot vision 1992 Addison-Wesley Longman Publishing Co., Inc Boston (MA, USA)
56. K. Suzuki, I. Horiba, and N. Sugie Linear-time connected-component labeling based on sequential local operations Computer Vision and Image Understanding 89 1 2003 1 23
57. C.H. Lampert, M.B. Blaschko, and T. Hofmann Efficient subwindow search: a branch and bound framework for object localization IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2009 2129 2142
58. Lehmann A, Leibe B, Gool LV. Fast prism: Branch and bound hough transform for object class detection. International Journal of Computer Vision. http://dx.doi.org/10.1007/s11263-010-0342-x.
59. S.T. Roweis, and L.K. Saul Nonlinear dimensionality reduction by locally linear embedding Science 290 5500 2000 2323 2326 (Pubitemid 32041578)
60. L.B. Kara, and K. Shimada Sketch-based 3D shape creation for industrial styling design IEEE Computer Graphics and Applications 27 1 2007 60 71 (Pubitemid 46223772)
61. C.M. Bishop Pattern recognition and machine learning 2006 Springer Berlin
62. Hse H, Newton AR. Sketched symbol recognition using zernike moments. In: Proceedings of the 17th international conference on pattern recognition, vol. 1. 2004. p. 367370.
63. L. Gennari, L.B. Kara, and T.F. Stahovich Combining geometry and domain knowledge to interpret hand-drawn diagrams Computers and Graphics 29 4 2005 547 562 (Pubitemid 41240654)
64. H. Tong, B. Gallagher, C. Faloutsos, and T. Eliassi-Rad Fast best-effort pattern match in large attributed graphs Knowledge discovery and data mining 2007
65. J. Pu, and K. Ramani On visual similarity based 2d drawing retrieval Computer-Aided Design 38 3 2006 249 259 (Pubitemid 43144806)
66. E. Saund, and J. Mahoney Scanscribe: perceptually supported diagram image editing Diagrammatic representation and inference 2004 Springer 428 432
67. A. Quattoni, M. Collins, and T. Darrell Conditional random fields for object recognition Neural information processing systems 2004 MIT Press 1097 1104
68. D. Dori, L. Wenyin, and M. Peleg How to win a dashed line detection contest G. Goos, J. Hartmanis, J. van Leeuwen, Graphics recognition methods and applications vol. 1072 1996 Springer 286 300 (Pubitemid 126074590)
69. G. Agam, H. Luo, and I. Dinstein Morphological approach for dashed lines detection G. Goos, J. Hartmanis, J. van Leeuwen, Graphics recognition methods and applications vol. 1072 1996 Springer 92 105 (Pubitemid 126074576)
70. E. Learned-Miller Data driven image models through continuous joint alignment IEEE Transactions on Pattern Analysis and Machine Intelligence 28 2 2006 236 250 (Pubitemid 46395291)