Bayesian Optimization with an empirical hardness model for approximate nearest neighbour search

2014 IEEE Winter Conference on Applications of Computer Vision, WACV 2014

Volumn , Issue , 2014, Pages 588-595

  Martinez, Julieta ^a   Little, James J ^a   De Freitas, Nando ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS;

APPROXIMATE ALGORITHMS; BAYESIAN OPTIMIZATION; DESCRIPTORS; EMPIRICAL OPTIMIZATION; HIGH DIMENSIONAL SPACES; LINEAR SEARCH; NEAREST NEIGHBOUR SEARCH; PARAMETER-TUNING;

HARDNESS;

EID: 84904632376     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WACV.2014.6836049     Document Type: Conference Paper

References (25)

1. J. Bergstra and Y. Bengio. Random search for hyperparameter optimization. The Journal of Machine Learning Research, 13:281-305, 2012
2. J. Bergstra, D. Yamins, and D. Cox. Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures. In Proceedings of the 30th International Conference on Machine Learning (ICML-13), pages 115-123, 2013
3. O. Boiman, E. Shechtman, and M. Irani. In Defense of nearest-neighbor based image classification. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8. IEEE, 2008
4. E. Brochu, V. M. Cora, and N. de Freitas. A tutorial on bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv preprint arXiv:1012.2599, 2010
5. D. Cox and N. Pinto. Beyond simple features: A largescale feature search approach to unconstrained face recognition. In Automatic Face &Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on, pages 8-15. IEEE, 2011
6. F. Hutter, Y. Hamadi, H. H. Hoos, and K. Leyton-Brown. Performance prediction and automated tuning of randomized and parametric algorithms. In Principles and Practice of Constraint Programming-CP 2006, pages 213-228. Springer, 2006
7. F. Hutter, H. H. Hoos, and K. Leyton-Brown. Sequential model-based optimization for general algorithm configuration. In Proc. of LION-5, page 507523, 2011
8. F. Hutter, L. Xu, H. H. Hoos, and K. Leyton-Brown. Algorithm runtime prediction: Methods &evaluation. Artificial Intelligence, 2013
9. H. Jégou, M. Douze, and C. Schmid. Product Quantization for Nearest Neighbor Search. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(1):117-128, Jan. 2011. QUAERO. 1
10. A. Krizhevsky. Learning multiple layers of features from tiny images. Technical Report, Department of Computer Science, University of Toronto, 2009
11. K. Leyton-Brown, E. Nudelman, and Y. Shoham. Learning the empirical hardness of optimization problems: The case of combinatorial auctions. In Principles and Practice of Constraint Programming-CP 2002, pages 556-572. Springer, 2002
12. D. G. Lowe. Distinctive image features from scaleinvariant keypoints. International journal of computer vision, 60(2):91-110, 2004
13. M. Muja and D. G. Lowe. Fast approximate nearest neighbors with automatic algorithm configuration. In VISAPP (1), pages 331-340, 2009
14. K. P. Murphy. Machine learning: A probabilistic perspective. The MIT Press, 2012
15. A. Oliva and A. Torralba. Building the gist of a scene: The role of global image features in recognition. Progress in brain research, 155:23-36, 2006
16. M. A. Osborne, R. Garnett, and S. J. Roberts. Gaussian processes for global optimization. In 3rd international conference on learning and intelligent optimization (LION3), pages 1-15, 2009
17. M. Quigley, K. Conley, B. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, and A. Y. Ng. ROS: An opensource robot operating system. In ICRA workshop on open source software, volume 3, 2009
18. C. Silpa-Anan and R. Hartley. Optimised kd-Trees for fast image descriptor matching. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8. IEEE, 2008
19. J. Sivic and A. Zisserman. Video google: A text retrieval approach to object matching in videos. In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, pages 1470-1477. IEEE, 2003
20. J. Snoek, H. Larochelle, and R. P. Adams. Practical bayesian optimization of machine learning algorithms. In Neural Information Processing Systems, 2012
21. N. Srinivas, A. Krause, S. M. Kakade, and M. Seeger. Gaussian process optimization in the bandit setting: No regret and experimental design. arXiv preprint arXiv:0912.3995, 2009
22. A. Torralba, R. Fergus, and W. T. Freeman. 80 million tiny images: A large data set for nonparametric object and scene recognition. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 30(11):1958-1970, 2008
23. A. Torralba, R. Fergus, and Y.Weiss. Small codes and large image databases for recognition. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8. IEEE, 2008
24. J. Wang, N. Wang, Y. Jia, J. Li, G. Zeng, H. Zha, and X. Hua. Trinary-projection trees for approximate nearest neighbor search. 2013
25. Z. Wang, M. Zoghi, F. Hutter, D. Matheson, and N. De Freitas. Bayesian optimization in high dimensions via random embeddings. In Proceedings of the Twenty-Third international joint conference on Artificial Intelligence, pages 1778-1784. AAAI Press, 2013. 1, 2, 5.