Using deep learning and google street view to estimate the demographic makeup of neighborhoods across the United States

Proceedings of the National Academy of Sciences of the United States of America

Volumn 114, Issue 50, 2017, Pages 13108-13113

  Gebru, Timnit ^a   Krause, Jonathan ^a   Wang, Yilun ^a   Chen, Duyun ^a   Deng, Jia ^b   Aiden, Erez Lieberman ^c,d   Fei Fei, Li ^a  

^a Stanford University   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

^c BAYLOR COLLEGE OF MEDICINE   (United States)

^d Rice University   (United States)

Author keywords

Computer vision; Deep learning; Demography; Social analysis

Indexed keywords

ARTICLE; AUTOMATION; CAR; COMPUTER VISION; DATA ANALYSIS; DEEP LEARNING; DEMOGRAPHY; EDUCATION; ELECTION; GOOGLE STREET VIEW; HUMAN; INCOME; NEIGHBORHOOD; POLITICS; PRIORITY JOURNAL; RACE; SEARCH ENGINE; SOCIAL BEHAVIOR; SUPERVISED MACHINE LEARNING; UNITED STATES; MACHINE LEARNING; POPULATION; PROCEDURES; SATELLITE IMAGERY; SOCIOECONOMICS; STATISTICS AND NUMERICAL DATA;

AUTOMOBILES; DEMOGRAPHY; HUMANS; MACHINE LEARNING; POPULATION; SATELLITE IMAGERY; SOCIOECONOMIC FACTORS; UNITED STATES;

EID: 85038582257     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1700035114     Document Type: Article

References (27)

1. Department of Commerce, US Census Bureau (2013) US census bureau’s budget estimates. Available at www.osec.doc.gov/bmi/budget/fy13cbj/Census FY2013 CongressionalJustification-FINAL.pdf. Accessed September 13, 2014.
2. Department of Commerce, US Census Bureau (2012) American community survey 5 year data (2008-2012). Available at https://factfinder.census.gov/faces/tableservices/jsf/pages/productview.xhtml?src=bkmk. Accessed September 13, 2014.
3. Department of Commerce, US Census Bureau (2010) Decennial census. Available at https://www.census.gov/data/developers/data-sets/decennial-census.html. Accessed September 13, 2014.
4. Antenucci D, Cafarella M, Levenstein M, Ré C, Shapiro MD (2014) Using Social Media to Measure Labor Market Flows (National Bureau of Economic Research, Cambridge, MA), Technical Report 20010.
5. Michel JB, et al. (2011) Quantitative analysis of culture using millions of digitized books. Science 331:176–182.
6. Blumenstock J, Cadamuro G, On R (2015) Predicting poverty and wealth from mobile phone metadata. Science 350:1073–1076.
7. Naik N, Philipoom J, Raskar R, Hidalgo C (2014) Streetscore–Predicting the perceived safety of one million streetscapes. 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops (IEEE, New York), pp 793–799.
8. Naik N, Kominers SD, Raskar R, Glaeser EL, Hidalgo CA (2017) Computer vision uncovers predictors of physical urban change. Proc Natl Acad Sci USA 114:7571–7576.
9. American Association of State Highway and Transportation Officials (2013) Vehicle and Transit Availability. Commuting in America 2013 (American Association of State Highway and Transportation Officials, Washington, DC), Report 7.
10. Choo S, Mokhtarian PL (2004) What type of vehicle do people drive? The role of attitude and lifestyle in influencing vehicle type choice. Transport Res Pol Pract 38: 201–222.
11. Felzenszwalb P, Girshick R, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part based models. IEEE Trans Pattern Anal Mach Intell 32: 1627–1645.
12. Gebru T, et al. (2017) Fine-grained car detection for visual census estimation in AAAI, in press.
13. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278–2324.
14. Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convo-lutional neural networks. Advances in Neural Information Processing Systems. Available at papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf. Accessed November 9, 2017.
15. Bland M (2012) Asian consumers and the automotive market. Available at app. compendium.com/uploads/user/a33eed35-8a44-4da7-84c4-16f3751fe303/9855ee60-f764-43b4-84c4-40950ff36307/File/3e1e2e5d8d20fad49eaac919e38abc8e/polk 3af 05 17 2012 presentation.pdf. Accessed November 6, 2017.
16. Auto Remarketing Staff (2011) Which brands most attract African-American buyers? Available at www.autoremarketing.com/content/trends/which-brands-most-attractafrican-american-buyers. Accessed October 24, 2016.
17. Simo-Serra E, Fidler S, Moreno-Noguer F, Urtasun R (2015) Neuroaesthetics in fashion: Modeling the perception of beauty. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE, New York), pp 869–877.
18. Matzen K, Bala K, Snavely N (2017) Streetstyle: Exploring world-wide clothing styles from millions of photos. arXiv:1706.01869.
19. Ordonez V, Berg TL (2014) Learning high-level judgments of urban perception. European Conference on Computer Vision (Springer, Boston), pp 494–510.
20. Khosla A, An B, Lim JJ, Torralba A (2014) Looking beyond the visible scene. 2014 IEEE Conference on Computer Vision and Pattern Recognition (IEEE, New York), pp 3710–3717.
21. Zhou B, Liu L, Oliva A, Torralba A (2014) Recognizing city identity via attribute analysis of geo-tagged images. European Conference on Computer Vision (Springer, Boston), pp 519–534.
22. Jean N, et al. (2016) Combining satellite imagery and machine learning to predict poverty. Science 353:790–794.
23. Ren S, He K, Girshick R, Sun J (2017) Faster r-CNN: Towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39:1137–1149.
24. Barlow RE, Bartholomew DJ, Bremner J, Brunk HD (1972) Statistical Inference under Order Restrictions: The Theory and Application of Isotonic Regression (Wiley, New York).
25. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278–2324.
26. Daumé H III (2007) Frustratingly easy domain adaptation. Conference of the Association for Computational Linguistics (ACL, Prague, Czech Republic).
27. Ansolabehere S, Palmer M, Lee A (2014) Precinct-Level Election Data. Available at hdl.handle.net/1903.1/21919. Accessed January 13, 2015.