Dreaming more data: Class-dependent distributions over diffeomorphisms for learned data augmentation

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016

Volumn , Issue , 2016, Pages 342-350

  Hauberg, Søren ^a   Freifeld, Oren ^b   Lindbo Larsen, Anders Boesen ^a   Fisher, John W ^b   Hansen, Lars Kai ^b  

^a TECHNICAL UNIVERSITY OF DENMARK   (Denmark)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP NEURAL NETWORKS;

'CURRENT; DATA AUGMENTATION; DATA CLASS; DIFFEOMORPHISMS; END TO END; FEATURE ENGINEERINGS; HIGH-DIMENSIONAL MODELS; IMPLICIT FORM; KEY ELEMENTS; TRAINING DATA;

LIE GROUPS;

EID: 85067571143     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (50)

1. B. Allen, B. Curless, and Z. Popović. Articulated body deformation from range scan data. In ACM Transactions on Graphics (TOG), volume 21, pages 612–619. ACM, 2002.
2. Y. Amit and A. Trouvé. Pop: Patchwork of parts models for object recognition. International Journal of Computer Vision (IJCV), 75(2):267–282, Nov. 2007.
3. D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, and J. Davis. Scape: shape completion and animation of people. In ACM Transactions on Graphics (TOG), volume 24, pages 408–416. ACM, 2005.
4. V. Arnold. Mathematical methods of classical mechanics. Springer Science & Business Media, 1989.
5. V. Arsigny, O. Commowick, X. Pennec, and N. Ayache. A log-euclidean polyaffine framework for locally rigid or affine registration. In BIR. Springer, 2006.
6. H. S. Baird. Document image defect models. In SDIA, pages 546–556. Springer, 1992.
7. M. Beg, M. Miller, A. Trouv, and L. Younes. Computing large deformation metric mappings via geodesic flows of diffeomorphisms. International Journal of Computer Vision, 61(2):139–157, 2005.
8. R. Bellman and R. Kalaba. On adaptive control processes. Automatic Control, IRE Transactions on, 4(2):1–9, Nov 1959.
9. F. Bogo, J. Romero, M. Loper, and M. J. Black. Faust: Dataset and evaluation for 3d mesh registration. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 3794–3801. IEEE, 2014.
10. O. Chapelle et al. Semi-supervised learning. 2006.
11. O. Chapelle and B. Schölkopf. Incorporating invariances in non-linear support vector machines. In NIPS, pages 609–616, 2001.
12. X. Cui, V. Goel, and B. Kingsbury. Data augmentation for deep neural network acoustic modeling. In ICASSP, pages 5582–5586, May 2014.
13. S. Darkner and J. Sporring. Locally orderless registration. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(6):1437–1450, June 2013.
14. A. Dosovitskiy, J. T. Springenberg, and T. Brox. Unsupervised feature learning by augmenting single images. arXiv preprint arXiv:1312.5242, 2013.
15. O. Duchenne, A. Joulin, and J. Ponce. A graph-matching kernel for object categorization. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 1792–1799. IEEE, 2011.
16. D. Eigen, C. Puhrsch, and R. Fergus. Depth map prediction from a single image using a multi-scale deep network. In Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 2366–2374. Curran Associates, Inc., 2014.
17. C. Farabet, C. Couprie, L. Najman, and Y. LeCun. Learning hierarchical features for scene labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8):1915–1929, 2013.
18. O. Freifeld, S. Hauberg, K. Batmanghelich, and J. W. F. III. Highly-expressive spaces of well-behaved transformations: Keeping it simple. In International Conference on Computer Vision (ICCV), Santiago, Chile, Dec. 2015.
19. I. Goodfellow, H. Lee, Q. V. Le, A. Saxe, and A. Y. Ng. Measuring invariances in deep networks. In NIPS, pages 646–654, 2009.
20. T. Graepel and R. Herbrich. Invariant pattern recognition by semi-definite programming machines. In S. Thrun, L. Saul, and B. Schölkopf, editors, NIPS, pages 33–40. MIT Press, 2004.
21. U. Grenander. General pattern theory: A mathematical study of regular structures. Clarendon Press, 1993.
22. B. Hariharan, C. L. Zitnick, and P. Dollár. Detecting objects using deformation dictionaries. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1995–2002. IEEE, 2014.
23. G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine, 29(6):82–97, 2012.
24. J. H. Hipwell, C. Tanner, W. R. Crum, J. Schnabel, D. J. Hawkes, et al. A new validation method for x-ray mammogram registration algorithms using a projection model of breast x-ray compression. Medical Imaging, IEEE Transactions on, 26(9):1190–1200, 2007.
25. D. A. Hirshberg, M. Loper, E. Rachlin, and M. J. Black. Coregistration: Simultaneous alignment and modeling of articulated 3d shape. In Computer Vision–ECCV 2012, pages 242–255. Springer, 2012.
26. B. Hoyle, M. M. Rau, C. Bonnett, S. Seitz, and J. Weller. Data augmentation for machine learning redshifts applied to SDSS galaxies. Monthly Notices of the Royal Astronomical Society, 450:305, 2015.
27. N. Jaitly and G. E. Hinton. Vocal tract length perturbation (VTLP) improves speech recognition. In Proc. ICML Workshop on Deep Learning for Audio, Speech and Language, 2013.
28. A. Kanazawa, A. Sharma, and D. Jacobs. Locally scale-invariant convolutional neural networks. arXiv preprint arXiv:1412.5104, 2014.
29. J. J. Kivinen and C. K. Williams. Transformation equivariant boltzmann machines. In ICANN, pages 1–9. Springer, 2011.
30. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In F. Pereira, C. Burges, L. Bottou, and K. Weinberger, editors, NIPS, pages 1097–1105. Curran Associates, Inc., 2012.
31. Q. Liao, J. Z. Leibo, and T. Poggio. Learning invariant representations and applications to face verification. In NIPS, 2013.
32. G. Loosli, S. Canu, and L. Bottou. Training invariant support vector machines using selective sampling. Large scale kernel machines, pages 301–320, 2007.
33. X. Lu, B. Zheng, A. Velivelli, and C. Zhai. Enhancing text categorization with semantic-enriched representation and training data augmentation. Journal of the American Medical Informatics Association, 13(5):526–535, 2006.
34. D. Mattes, D. R. Haynor, H. Vesselle, T. K. Lewellen, and W. Eubank. Pet-ct image registration in the chest using free-form deformations. Medical Imaging, IEEE Transactions on, 22(1):120–128, 2003.
35. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller. Equation of state calculations by fast computing machines. The journal of chemical physics, 21(6):1087–1092, 1953.
36. E. G. Miller and C. Chefd’Hotel. Practical nonparametric density estimation on a transformation group for vision. In CVPR, volume 2, pages II–114, 2003.
37. M. I. Miller. Computational anatomy: shape, growth, and atrophy comparison via diffeomorphisms. NeuroImage, 23:S19–S33, 2004.
38. M. Nielsen, P. Johansen, A. Jackson, B. Lautrup, and S. Hauberg. Brownian warps for non-rigid registration. Journal of Mathematical Imaging and Vision, 31:221–231, 2008.
39. X. Pennec. Intrinsic statistics on Riemannian manifolds: Basic tools for geometric measurements. Journal of Mathematical Imaging and Vision, 25(1):127–154, 2006.
40. C. P. Robert and G. Casella. Monte Carlo statistical methods. Citeseer, 2004.
41. D. Rueckert and J. Schnabel. Medical image registration. In T. M. Deserno, editor, Biomedical Image Processing, Biological and Medical Physics, Biomedical Engineering, pages 131–154. Springer Berlin Heidelberg, 2011.
42. P. Simard, B. Victorri, Y. LeCun, and J. S. Denker. Tangent prop – a formalism for specifying selected invariances in an adaptive network. In NIPS, pages 895–903, 1992.
43. P. Y. Simard, D. Steinkraus, and J. C. Platt. Best practices for convolutional neural networks applied to visual document analysis. In 2013 12th International Conference on Document Analysis and Recognition, volume 2, pages 958–958. IEEE Computer Society, 2003.
44. K. Sohn and H. Lee. Learning invariant representations with local transformations. In ICML, pages 1311–1318, 2012.
45. C. Studholme, D. Hill, and D. Hawkes. Automated 3d registration of mr and pet brain images by multi-resolution optimisation of voxel similarity measures. Med. Phys, 24(1):25–35, 1997.
46. C. Studholme, D. L. Hill, and D. J. Hawkes. Multiresolution voxel similarity measures for mr-pet registration. In Information processing in medical imaging, volume 3, pages 287–298. Dordrecht, The Netherlands: Kluwer, 1995.
47. P. Viola and W. M. Wells III. Alignment by maximization of mutual information. International journal of computer vision, 24(2):137–154, 1997.
48. J. Winn and N. Jojic. Locus: Learning object classes with unsupervised segmentation. In Computer Vision, 2005. ICCV 2005. Tenth IEEE International Conference on, volume 1, pages 756–763. IEEE, 2005.
49. Z. Wu, S. Song, A. Khosla, F. Yu, L. Zhang, X. Tang, and J. Xiao. 3D shapenets: A deep representation for volumetric shape modeling. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
50. M. Zhang and P. T. Fletcher. Finite-dimensional Lie algebras for fast diffeomorphic image registration. In IPMI, 2015.