Predicting and understanding Urban perception with convolutional neural networks

MM 2015 - Proceedings of the 2015 ACM Multimedia Conference

Volumn , Issue , 2015, Pages 139-148

  Porzi, Lorenzo ^a,b   Buló, Samuel Rota ^a   Lepri, Bruno ^a   Ricci, Elisa ^a,b  

^a FONDAZIONE BRUNO KESSLER   (Italy)

^b UNIVERSITY OF PERUGIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

CONVOLUTION; NEURAL NETWORKS; URBAN PLANNING;

CONVOLUTIONAL NEURAL NETWORK; EXPERIMENTAL EVALUATION; HUMAN PERCEPTION; PSYCHOLOGICAL STATE; SOCIAL OUTCOMES; STATE-OF-THE-ART METHODS; VISUAL APPEARANCE; VISUAL QUALITIES;

FORECASTING;

EID: 84962852741     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2733373.2806273     Document Type: Conference Paper

References (40)

1. Y. Arase, X. Xie, T. Hara, and S. Nishio. Mining peoples trips from large scale geo-Tagged photos. In ACM Multimedia, 2010.
2. S. M. Arietta, A. A. Efros, R. Ramamoorthi, and M. Agrawala. City forensics: Using visual elements to predict non-visual city attributes. IEEE Trans. on Visualization and Computer Graphics, 2014.
3. B. Berger and P. W. Shor. Approximation alogorithms for the maximum acyclic subgraph problem. In ACM-SIAM symposium on Discrete algorithms, 1990.
4. Y.-L. Boureau, J. Ponce, and Y. LeCun. A theoretical analysis of feature pooling in visual recognition. In International Conference on Machine Learning, 2010.
5. O. Chapelle and S. S. Keerthi. Efficient algorithm for ranking with svms. Information Retrieval, 13(3):201-215, 2010.
6. Y.-Y. Chen, A.-J. Cheng, and W. H. Hsu. Travel recommendation by mining people attributes and travel group types from community-contributed photos. IEEE Trans. on Multimedia, 15(6):1283-1295, 2013.
7. H. David. The method of paired comparisons. Hodder Arnold, 1988.
8. C. Doersch, S. Singh, A. Gupta, J. Sivic, and A. Efros. What makes Paris look like Paris? ACM Transactions on Graphics, 31(4), 2012.
9. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. Liblinear: A library for large linear classification. The Journal of Machine Learning Research, 2008.
10. H. Grabner, F. Nater, M. Druey, and L. Van Gool. Visual interestingness in image sequences. In ACM Multimedia, 2013.
11. T. Graepel, T. Minka, and R. T. Herbrich. A Bayesian skill rating system. Neural Information Processing Systems, 2007.
12. J. Hays and A. A. Efros. Im2gps: estimating geographic information from a single image. In Computer Vision and Pattern Recognition, 2008.
13. R. Herbrich, T. Graepel, and K. Obermayer. Large margin rank boundaries for ordinal regression. Advances in Large Margin Classifiers, pages 115-132, 2000.
14. J. Jacobs. The death and the life of great American cities. Random House, 1961.
15. Y. Jia. Caffe: An open source convolutional architecture for fast feature embedding. http://caffe.berkeleyvision.org, 2013.
16. R. Karp. Reducibility among combinatorial problems. In Complexity of Computer Computations, The IBM Research Symposia Series, pages 85-103. 1972.
17. G. Kelling and C. Coles. Fixing broken windows: Restoring order and reducing crime in our community. Free Press, 1998.
18. A. Khosla, B. An, J. J. Lim, and A. Torralba. Looking beyond the visible scene. In Computer Vision and Pattern Recognition, 2014.
19. P. Koniusz, F. Yan, and K. Mikolajczyk. Comparison of mid-level feature coding approaches and pooling strategies in visual concept detection. Computer Vision and Image Understanding, 117(5):479-492, 2013.
20. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Neural Information Processing Systems, 2012.
21. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Computer Vision and Pattern Recognition, 2006.
22. P. Lindal and T. Hartig. Architectural variation, building height, and the restorative quality of urban residential streetscapes. Journal of Environmental Psychology, 2012.
23. K. Lynch. The image of the city, volume 11. MIT press, 1960.
24. L. Marchesotti, F. Perronnin, D. Larlus, and G. Csurka. Assessing the aesthetic quality of photographs using generic image descriptors. In International Conference on Computer Vision, 2011.
25. N. Naik, J. Philipoom, R. Raskar, and C. Hidalgo. Streetscore-predicting the perceived safety of one million streetscapes. In Computer Vision and Pattern Recognition Workshops, 2014.
26. J. Nasar. The evaluative image of the city. Sage Publications, 1997.
27. V. Ordonez and T. L. Berg. Learning high-level judgments of urban perception. In European Conference on Computer Vision. 2014.
28. G. Patterson, C. Xu, H. Su, and J. Hays. The sun attribute database: Beyond categories for deeper scene understanding. International Journal of Computer Vision, 108(1-2):59-81, 2014.
29. L. Porzi, S. R. Buĺo, P. Valigi, O. Lanz, and E. Ricci. Learning contours for automatic annotations of mountains pictures on a smartphone. In International Conference on Distributed Smart Cameras, 2014.
30. L. Porzi, E. Ricci, T. Ciarfuglia, and M. Zanin. Visual-inertial tracking on android for augmented reality applications. In IEEE Workshop on Environmental, Energy and Structural Monitoring Systems, 2012.
31. D. Quercia, N. K. OHare, and H. Cramer. Aesthetic capital: what makes london look beautiful, quiet, and happy? In ACM Computer supported cooperative work & social computing, pages 945-955, 2014.
32. P. Salesses, K. Schechtner, and C. A. Hidalgo. The collaborative image of the city: mapping the inequality of urban perception. PloS one, 8(7):e68400, 2013.
33. R. J. Sampson, J. Morenoff, and T. Gannon-Rowley. Assessing neighborhood effects: Social processs and new directions in research. Annual Review of Sociology, 2002.
34. R. J. Sampson and S. W. Raudenbush. Systematic social observation of public spaces: A new look at disorder in urban neighborhoods. American Journal of Sociology, 105(3):603-651, 1999.
35. H. Schroeder and L. Anderson. Perception of personal safety in urban recreation sites. Journal of Leisure Research, 16:177-194, 1983.
36. W. Skogan. Disorder and decline: Crime and the spiral of decay in American neighborhoods. University of California Press, 1990.
37. R. Urlich. Visual landscapes and psychological well-being. Landscape Research, 4:17-23.
38. R. Weber, J. Schnier, and T. Jacobsen. Aesthetics of streetscapes: Influence of fundamental properties on aesthetic judgments of urban space. Perceptual and Motor Skills, 106:128-146, 2008.
39. J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba. Sun database: Large-scale scene recognition from abbey to zoo. In Computer Vision and Pattern Recognition, 2010.
40. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva. Learning deep features for scene recognition using places database. In Neural Information Processing Systems, 2014.