Estimating user location in social media with stacked denoising auto-encoders

1st Workshop on Vector Space Modeling for Natural Language Processing, VS 2015 at the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2015

Volumn , Issue , 2015, Pages 201-210

  Liu, Ji ^a   Inkpen, Diana ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DEEP LEARNING; LOCATION; SIGNAL ENCODING;

AUTO ENCODERS; DE-NOISING; ERROR RATE; LEARN+; LEARNING TECHNIQUES; PHYSICAL LOCATIONS; SECURITY MONITORING; SOCIAL MEDIA; TEXTUAL DATA; USER LOCATION;

SOCIAL NETWORKING (ONLINE);

EID: 84956477039     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. S Abrol, L Khan, and B Thuraisingham. 2012. Tweecalization: Efficient and intelligent location mining in twitter using semi-supervised learning. In Proceedings of the 8th International Conference on Collaborative Computing: Networking, Applications and Work-sharing (CollaborateCom 2012), pages 514–523.
2. Saima Aman and Stan Szpakowicz. 2008. Using roget’s thesaurus for fine-grained emotion recognition. In Proceedings of IJCNLP, pages 312–318.
3. Lars Backstrom, Eric Sun, and Cameron Marlow. 2010. Find me if you can: Improving geographical prediction with social and spatial proximity. In Proceedings of the 19th International Conference on World Wide Web, WWW’10, pages 61–70, New York, NY, USA. ACM.
4. Yoshua Bengio and Pascal Lamblin. 2007. Greedy layer-wise training of deep networks. Advances in Neural Information Processing Systems, 19(153).
5. Yoshua Bengio, Aaron Courville, and Pascal Vincent. 2013. Representation learning: A review and new perspectives. Pattern Analysis and Machine Intelligence, 35(8):1798 – 1828.
6. Yoshua Bengio. 2012. Practical recommendations for gradient-based training of deep architectures. Neural Networks: Tricks of the Trade, 7700:437–478.
7. James Bergstra, Olivier Breuleux, Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, Guillaume Desjardins, Joseph Turian, David Warde-Farley, and Yoshua Bengio. 2010. Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy), volume 4, page 3.
8. John Kenneth Chambers. 1998. Dialectology. Cambridge University Press.
9. Zhiyuan Cheng, James Caverlee, and Kyumin Lee. 2010. You are where you tweet: a content-based approach to geo-locating Twitter users. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management (CIKM’10), volume October 26, pages 759–768, Toronto.
10. Pedro Domingos. 2012. A few useful things to know about machine learning. Communications of the ACM, 55(10):78–87.
11. Mark Dredze, Michael J Paul, Shane Bergsma, and Hieu Tran. 2013. Carmen: A twitter geolocation system with applications to public health. In Proceedings of the AAAI Workshop on Expanding the Boundaries of Health Informatics Using AI (HIAI).
12. Jacob Eisenstein, Brendan O’Connor, Noah A Smith, and Eric P Xing. 2010. A latent variable model for geographic lexical variation. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP’10, pages 1277–1287, Stroudsburg, PA, USA. Association for Computational Linguistics.
13. Jacob Eisenstein, Amr Ahmed, and Eric P Xing. 2011. Sparse additive generative models of text. In Proceedings of the 28th International Conference on Machine Learning (ICML’11), pages 1041–1048.
14. Diman Ghazi, Diana Inkpen, and Stan Szpakowicz. 2014. Prior and contextual emotion of words in sentential context. Computer Speech & Language, 28(1):76–92, January.
15. Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach. In Proceedings of the 28th International Conference on Machine Learning (ICML’11), pages 513–520.
16. Bo Han, Paul Cook, and Timothy Baldwin. 2014. Text-based twitter user geolocation prediction. Journal of Artifficial Intelligence Research (JAIR), 49:451–500.
17. Geoffrey E Hinton, Simon Osindero, and Yee-Whye Teh. 2006. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527–54, July.
18. Fei Huang and Alexander Yates. 2010. Exploring representation-learning approaches to domain adaptation. In Proceedings of the 2010 Workshop on Domain Adaptation for Natural Language Processing, pages 23–30.
19. David Jurgens. 2013. That’s what friends are for: Inferring location in online social media platforms based on social relationships. In Proceedings of the Seventh International Conference on Weblogs and Social Media, ICWSM 2013, Cambridge, Massachusetts, USA, July 8-11, 2013.
20. Tao Li, Yi Zhang, and Vikas Sindhwani. 2009. A non-negative matrix tri-factorization approach to sentiment classification with lexical prior knowledge. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 244–252. Association for Computational Linguistics, August.
21. Prem Melville, Wojciech Gryc, and Richard D. Lawrence. 2009. Sentiment analysis of blogs by combining lexical knowledge with text classification. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’09), page 1275, New York, New York, USA, June. ACM Press.
22. Olutobi Owoputi, Brendan OConnor, Chris Dyer, Kevin Gimpel, Nathan Schneider, and Noah A Smith. 2013. Improved part-of-speech tagging for online conversational text with word clusters. In Proceedings of NAACL-HLT, pages 380–390.
23. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825–2830.
24. K Malcolm Petyt. 1980. The study of dialect: An introduction to dialectology. Andre Deutsch.
25. Reid Priedhorsky, Aron Culotta, and Sara Y. Del Valle. 2014. Inferring the origin locations of tweets with quantitative confidence. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW’14), pages 1523–1536, New York, USA, February. ACM Press.
26. Stephen Roller, Michael Speriosu, Sarat Rallapalli, Benjamin Wing, and Jason Baldridge. 2012. Supervised text-based geolocation using language models on an adaptive grid. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 1500–1510. Association for Computational Linguistics, July.
27. Dominic Paul Rout, Kalina Bontcheva, Daniel Preotiuc-Pietro, and Trevor Cohn. 2013. Where’s @wally?: a classification approach to geolocating users based on their social ties. In 24th ACM Conference on Hypertext and Social Media (part of ECRC), HT’13, Paris, France - May 02 - 04, 2013, pages 11–20.
28. David E Rumelhart, Geoffrey E Hinton, and Ronald J Williams. 1985. Learning internal representations by error propagation. Technical report, DTIC Document.
29. Roger W Sinnott. 1984. Virtues of the haversine. Sky and Telescope, 68:158.
30. Duyu Tang, Bing Qin, Ting Liu, and Zhenghua Li. 2013. Learning Sentence Representation for Emotion Classification on Microblogs. Natural Language Processing and Chinese Computing, 400:212–223.
31. Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. Proceedings of the 25th International Conference on Machine Learning (ICML’08), pages 1096–1103.
32. Benjamin P. Wing and Jason Baldridge. 2011. Simple supervised document geolocation with geodesic grids. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL HLT’11), pages 955–964. Association for Computational Linguistics, June.
33. Yuan Yao, Lorenzo Rosasco, and Andrea Caponnetto. 2007. On early stopping in gradient descent learning. Constructive Approximation, 26(2):289–315.