Neural network-based symbol recognition using a few labeled samples

Computers and Graphics (Pergamon)

Volumn 35, Issue 5, 2011, Pages 955-966

  Fu, Luoting ^a   Kara, Levent Burak ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Deep Belief Network; Neural nets; Sketch recognition; Symbol recognition; Synthetic training samples; Unsupervised training

Indexed keywords

DEEP NEURAL NETWORKS; NEURAL NETWORKS; PATTERN RECOGNITION; SAMPLING; SUPERVISED LEARNING;

DEEP BELIEF NETWORKS; SKETCH RECOGNITION; SYMBOL RECOGNITION; TRAINING SAMPLE; UNSUPERVISED TRAINING;

INTERNET PROTOCOLS;

EID: 80051596307     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2011.07.001     Document Type: Article

References (49)

1. R. Davis Magic paper: sketch-understanding research Computer 40 9 2007 34 41
2. L. Olsen, F.F. Samavati, M.C. Sousa, and J.A. Jorge Sketch-based modeling: a survey Computers & Graphics 33 1 2009 85 103
3. Fu L, Kara LB. Recognizing network-like hand-drawn sketches: a convolutional neural network approach. In: Proceedings of ASME 2009 international design engineering technical conferences (IDETC) & computers and information in engineering conference (CIE), no. DETC2009-87402, San Diego, CA, 2009. p. 18.
4. T.Y. Ouyang, and R. Davis Learning from neighboring strokes: combining appearance and context for multi-domain sketch recognition Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta, Advances in neural information processing systems 2009 MIT Press Cambridge, MA 1401 1409
5. L.B. Kara, L. Gennari, and T.F. Stahovich A sketch-based tool for analyzing vibratory mechanical systems Journal of Mechanical Design 130 10 2008 101101
6. L. Gennari, L.B. Kara, and T.F. Stahovich Combining geometry and domain knowledge to interpret hand-drawn diagrams Computers & Graphics 29 4 2005 547 562 (Pubitemid 41240654)
7. Cowans PJ, Szummer M. A graphical model for simultaneous partitioning and labeling. In: Cowell RG, Ghahramani Z, editors. Proceedings of the 10th international workshop on artificial intelligence and statistics, Society for Artificial Intelligence and Statistics, Barbados, 2005. p. 7380.
8. L.B. Kara, and T.F. Stahovich An image-based, trainable symbol recognizer for hand-drawn sketches Computers & Graphics 29 4 2005 501 517 (Pubitemid 41240651)
9. D.E. Rumelhart, G.E. Hinton, and R.J. Williams Learning representations by back-propagating errors Nature 323 6088 1986 533 536 (Pubitemid 16025374)
10. C.M. Bishop Neural networks for pattern recognition 1995 Oxford University Press Oxford, UK
11. T.Y. Ouyang, and R. Davis A visual approach to sketched symbol recognition Proceedings of the 21st international joint conferences on artificial intelligence 2009 Morgan Kaufmann Pasadena, CA 1463 1468
12. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proceedings of the IEEE 86 11 1998 2278 2324
13. C. Garcia, and M. Delakis Convolutional face finder: a neural architecture for fast and robust face detection IEEE Transactions on Pattern Analysis and Machine Intelligence 26 11 2004 1408 1423 (Pubitemid 40168019)
14. T.K. Ho, and H.S. Baird Large-scale simulation studies in image pattern recognition IEEE Transactions on Pattern Analysis and Machine Intelligence 19 10 1997 1067 1079 (Pubitemid 127762298)
15. M. Banko, and E. Brill Mitigating the paucity-of-data problem: exploring the effect of training corpus size on classifier performance for natural language processing Proceedings of the first international conference on human language technology research 2001 Association for Computational Linguistics Morristown, NJ, USA 1 5
16. T. Varga, and H. Bunke Comparing natural and synthetic training data for off-line cursive handwriting recognition Proceedings of the ninth international workshop on frontiers in handwriting recognition 2004 IEEE Computer Society Washington, DC, USA 221 225 (Pubitemid 40601225)
17. V.N. Vapnik Statistical learning theory 1998 Wiley New York
18. J. Wang, K.N. Plataniotis, J. Lu, and A.N. Venetsanopoulos On solving the face recognition problem with one training sample per subject Pattern Recognition 39 9 2006 1746 1762 (Pubitemid 43867573)
19. G.E. Hinton, S. Osindero, and Y. Teh A fast learning algorithm for deep belief nets Neural Computation 18 7 2006 1527 1554 (Pubitemid 44024729)
20. R. Raina, A. Battle, H. Lee, B. Packer, and A.Y. Ng Self-taught learning: transfer learning from unlabeled data Proceedings of the 24th international conference on machine learning 2007 ACM New York, NY, USA 759 766
21. M. Ranzato, F.J. Huang, Y.-L. Boureau, and Y. LeCun Unsupervised learning of invariant feature hierarchies with applications to object recognition Proceedings of computer vision and pattern recognition conference 2007 IEEE Press Minneapolis, MN 1 8
22. G.E. Hinton, and R.R. Salakhutdinov Reducing the dimensionality of data with neural networks Science 313 5786 2006 504 507 (Pubitemid 44148451)
23. R. Salakhutdinov, and G. Hinton Using deep belief nets to learn covariance kernels for Gaussian processes J. Platt, D. Koller, Y. Singer, S. Roweis, Advances in neural information processing systems 2008 MIT Press Cambridge, MA 1249 1256
24. Salakhutdinov R, Hinton GE. Deep Boltzmann machines. In: Proceedings of the international conference on artificial intelligence and statistics, vol. 5, 2009. p. 44855.
25. V. Nair, and G. Hinton 3D object recognition with deep belief nets Y. Bengio, D. Schuurmans, J. Lafferty, C.K.I. Williams, A. Culotta, Advances in neural information processing systems 2009 MIT Press Cambridge, MA 1339 1347
26. T.M. Sezgin, and R. Davis Sketch recognition in interspersed drawings using time-based graphical models Computers & Graphics 32 5 2008 500 510
27. L. Yaeger, R. Lyon, and B. Webb Effective training of a neural network character classifier for word recognition M.C. Mozer, M.I. Jordan, T. Petsche, Advances in neural information processing systems 1997 MIT Press Cambridge, MA 807 813
28. P.Y. Simard, D. Steinkraus, and J.C. Platt Best practices for convolutional neural networks applied to visual document analysis Proceedings of the seventh international conference on document analysis and recognition 2003 IEEE Computer Society Washington, DC, USA 958 963
29. Thomas A. Govindaraju V. Generation and performance evaluation of synthetic handwritten CAPTCHAs. In: Proceedings of the 11th international conference on frontiers in handwriting recognition, no. 1071, Montréal, Québec, Canada, 2008.
30. C.E. Brodley, and M.A. Friedl Identifying mislabeled training data Journal of Artificial Intelligence Research 11 1999 131 167 (Pubitemid 129628762)
31. C. Bouveyron, and S. Girard Robust supervised classification with mixture models: learning from data with uncertain labels Pattern Recognition 42 11 2009 2649 2658
32. J. Nonnemaker, and H.S. Baird Using synthetic data safely in classification K. Berkner, L. Likforman-Sulem, Document recognition and retrieval XVI, vol. 7247 2009 SPIE San Jose, CA, USA 72470G
33. A. Blum, and T. Mitchell Combining labeled and unlabeled data with co-training Proceedings of the 11th annual conference on computational learning theory 1998 ACM New York, NY, USA 92 100
34. J. Weston, R. Collobert, F. Sinz, L. Bottou, and V. Vapnik Inference with the universum Proceedings of the 23rd international conference on machine learning 2006 ACM New York, NY, USA 1009 1016
35. R.K. Ando, and T. Zhang A framework for learning predictive structures from multiple tasks and unlabeled data Journal of Machine Learning Research 6 2005 1817 1853
36. L. Fei-Fei, R. Fergus, and P. Perona One-shot learning of object categories IEEE Transactions on Pattern Analysis and Machine Intelligence 28 4 2006 594 611 (Pubitemid 43264657)
37. R. Memisevic, and G.E. Hinton Unsupervised learning of image transformations IEEE computer society conference on computer vision and pattern recognition 2007 IEEE Computer Society Los Alamitos, CA, USA 1 8
38. E. Learned-Miller Data driven image models through continuous joint alignment IEEE Transactions on Pattern Analysis and Machine Intelligence 28 2 2006 236 250 (Pubitemid 46395291)
39. J. Chen, X. Chen, J. Yang, S. Shan, R. Wang, and W. Gao Optimization of a training set for more robust face detection Pattern Recognition 42 11 2009 2828 2840
40. Ciresan DC, Meier U, Gambardella LM, Schmidhuber J. Deep big simple neural nets excel on handwritten digit recognition. Technical Report 〈 arXiv:1003.0358 〉; 2010.
41. Y. Bengio Learning deep architectures for AI Foundations and Trends in Machine Learning 2 1 2009 1 127
42. G.E. Hinton Training products of experts by minimizing contrastive divergence Neural Computation 14 8 2002 1771 1800
43. G.E. Hinton To recognize shapes P. Cisek, T. Drew, J. Kalaska, Computational neuroscience: theoretical insights into brain function 2007 Elsevier
44. Hinton GE. A practical guide to training restricted Boltzmann machines. Technical Report, UTML TR 2010-003, Department of Computer Science, University of Toronto; 2010.
45. Hse H, Newton AR. Sketched symbol recognition using Zernike moments. In: Proceedings of the 17th international conference on pattern recognition, vol. 1, Cambridge, UK, 2004. p. 36770.
46. M. Field, S. Gordon, E. Peterson, R. Robinson, T. Stahovich, and C. Alvarado Technical section: the effect of task on classification accuracy: using gesture recognition techniques in free-sketch recognition Computers & Graphics 34 2010 499 512
47. Y. Amit, and A. Trouve POP: patchwork of parts models for object recognition International Journal of Computer Vision 75 2 2007 267 282 (Pubitemid 47293422)
48. Niels R, Willems D, Vuurpijl L. The NicIcon database of handwritten icons. In: 11th International conference on the frontiers of handwriting recognition (ICFHR 2008), Montreal, Canada, 2008.
49. M. Osadchy, Y. LeCun, and M. Miller Synergistic face detection and pose estimation with energy-based models Journal of Machine Learning Research 8 2007 1197 1215 (Pubitemid 46827844)