Big Data Driven Natural Language Processing Research and Applications

Handbook of Statistics

Volumn 33, Issue , 2015, Pages 203-238

  Gudivada, Venkat N ^a   Rao, Dhana ^b   Raghavan, Vijay V ^c  

^a EAST CAROLINA UNIVERSITY   (United States)

^b MARSHALL UNIVERSITY   (United States)

^c UNIVERSITY OF LOUISIANA AT LAFAYETTE   (United States)

Author keywords

Big data; Natural language processing; Statistical models

Indexed keywords

EID: 84944593291     PISSN: 01697161     EISSN: None     Source Type: Book Series    
DOI: 10.1016/B978-0-444-63492-4.00009-5     Document Type: Chapter

References (96)

1. ACL ACL anthology: a digital archive of research papers in computational linguistics 2015, http://www.aclweb.org/anthology/.
2. Agarwal B., Mittal N. Text classification using machine learning methods-a survey. Advances in Intelligent Systems and Computing 2014, vol. 236:701-709. Springer India. B.V. Babu, A. Nagar, K. Deep, M. Pant, J.C. Bansal, K. Ray, U. Gupta (Eds.).
3. Agarwal S., Godbole S., Punjani D., Roy S. How much noise is too much: a study in automatic text classification. Seventh IEEE International Conference on Data Mining, 2007 (ICDM 2007) 2007, 3-12.
4. Anderson A., Huttenlocher D., Kleinberg J., Leskovec J. Discovering value from community activity on focused question answering sites: a case study of stack overflow. Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2012, 850-858. ACM, New York, NY.
5. Biadsy F., Hall K., Moreno P., Roark B. Backoff inspired features for maximum entropy language models. Proceedings of Interspeech 2014.
6. Bird S., Klein E., Loper E. Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit 2009, O'Reilly Media, Sebastopol, California.
7. Blei D.M. Probabilistic topic models. Commun. ACM 2012, 55(4):77-84.
8. Blei D., Ng A., Jordan M. Latent dirichlet allocation. J. Mach. Learn. Res. 2003, 3:993-1022.
9. Brants T., Franz A. Web 1T 5-gram version 1 2012, Linguistic Data Consortium. http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2006T13.
10. Brill E. Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging. Comput. Linguist. 1995, 21(4):543-565.
11. British National Corpus 2014, http://www.natcorp.ox.ac.uk/.
12. Broder A., Gabrilovich E., Josifovski V. Information retrieval challenges in computational advertising. Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval 2010, ACM, New York, NY, pp. 908-908.
13. Chang A.X., Savva M., Manning C.D. Learning spatial knowledge for text to 3D scene generation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014 2014.
14. Chelba C., Mikolov T., Schuster M., Ge Q., Brants T., Koehn P. One billion word benchmark for measuring progress in statistical language modeling. CoRR 2013, abs/1312.3005. http://arxiv.org/abs/1312.3005.
15. Chomsky N. Syntactic Structures 2002, De Gruyter Mouton, Boston, Massachusetts. second ed.
16. Collobert R., Weston J., Bottou L., Karlen M., Kavukcuoglu K., Kuksa P. Natural language processing (almost) from scratch. J. Mach. Learn. Res. 2011, 12:2493-2537.
17. th Annual Meeting of the Association for Computational Linguistics 2002, 168-175.
18. Deschacht K., De Belder J., Moens M.-F. The Latent words language model. Comput. Speech Lang. 2012, 26(5):384-409.
19. Dhar V. Data science and prediction. Commun. ACM 2013, 56(12):64-73.
20. Doan A., Ramakrishnan R., Vaithyanathan S. Managing information extraction: state of the art and research directions 2006, 799-800. ACM, Chicago, IL.
21. Doan A., Naughton J.F., Ramakrishnan R., Baid A., Chai X., Chen F., Chen T., Chu E., DeRose P., Gao B., Gokhale C., Huang J., Shen W., Vuong B.-Q. Information extraction challenges in managing unstructured data. SIGMOD Rec. 2009, 37(4):14-20.
22. Dryer M.S., Haspelmath M. WALS Online 2013, Max Planck Institute for Evolutionary Anthropology, Leipzig.
23. Feinerer I., Hornik K., Meyer D. Text mining infrastructure in R. J. Stat. Softw. 2008, 25(5):1-54. http://www.jstatsoft.org/v25/i05.
24. Foster J., Çetinoglu Ö., Wagner J., Le Roux J., Hogan S., Nivre J., Hogan D., Van Genabith J. #hardtoparse: POS tagging and parsing the Twitterverse. AAAI 2011 Workshop On Analyzing Microtext 2011, 20-25. United States. https://hal.archives-ouvertes.fr/hal-00702445.
25. Francis N., Kucera H. The brown corpus 1964, http://www.essex.ac.uk/linguistics/external/clmt/w3c/corpus_ling/content/corpora/list/private/brown/brown.html.
26. Gimpel K., Schneider N., O'Connor B., Das D., Mills D., Eisenstein J., Heilman M., Yogatama D., Flanigan J., Smith N.A. Part-of-speech tagging for Twitter: annotation, features, and experiments. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: Short Papers 2011, vol. 2:42-47. Association for Computational Linguistics.
27. Goldberg Y., Orwant J. A dataset of syntactic-Ngrams over time from a very large corpus of english books. Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 1: Proceedings of the Main Conference and the Shared Task: Semantic Textual Similarity, Atlanta, Georgia, USA 2013, 241-247. ACL.
28. Gonzalez-Dominguez J., Lopez-Moreno I., Moreno P.J., Gonzalez-Rodriguez J. Frame by frame language identification in short utterances using deep neural networks. Neural Netw. 2015, 64:49-58.
29. Google 1-Billion-word language modeling benchmark 2014, https://code.google.com/p/1-billion-word-language-modeling-benchmark/.
30. Google Syntactic N-grams 2014, http://storage.googleapis.com/books/syntactic-ngrams/index.html.
31. Halevy A., Norvig P., Pereira F. The unreasonable effectiveness of data. IEEE Intell. Syst. 2009, 24(2):8-12.
32. Han S., Philipose M., Ju Y.-C. NLify: lightweight spoken natural language interfaces via exhaustive paraphrasing. Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Zurich, Switzerland 2013, 429-438. ACM, New York, NY.
33. Hey T., Tansley S., Toll K. The Fourth Paradigm: Data-Intensive Scientific Discovery 2009, Microsoft Press, Redmond, Washington. first ed.
34. Hodjat B., Hodjat S., Treadgold N., Jonsson I.-M. CRUSE: a context reactive natural language mobile interface. Proceedings of the 2nd Annual International Workshop on Wireless Internet, Boston, Massachusetts, USA 2006, ACM, New York, NY.
35. Hofmann M., Klinkenberg R. RapidMiner: Data Mining Use Cases and Business Analytics Applications 2013, Chapman & Hall/CRC, Boca Raton, Florida, ISBN 1482205491, 9781482205497.
36. Huang F., Ahuja A., Downey D., Yang Y., Guo Y., Yates A. Learning representations for weakly supervised natural language processing tasks. Comput. Linguist. 2014, 40(1):85-120.
37. Indurkhya N., Damerau F.J. Handbook of Natural Language Processing 2010, Chapman & Hall/CRC, Boca Raton, Florida.
38. Ingersoll G.S., Morton T.S., Farris A.L. Taming Text: How to Find, Organize, and Manipulate It 2012, Manning Publications Co., Greenwich, Connecticut.
39. Johnson M. How the statistical revolution changes (computational) linguistics. Proceedings of the EACL 2009 Workshop on the Interaction Between Linguistics and Computational Linguistics: Virtuous, Vicious or Vacuous? Athens, Greece 2009, 3-11. ACL, Stroudsburg, PA.
40. Jones R. Learning to extract entities from labeled and unlabeled text 2005, http://www.cs.cmu.edu/rosie/thesis.html.
41. Jung K., Kim K.I., Jain A.K. Text information extraction in images and video: a survey. Pattern Recogn. 2004, 37(5):977-997.
42. Jurafsky D., Martin J.H. Speech and Language Processing 2009, Prentice Hall, Upper Saddle River, New Jersey. second ed.
43. Jyothi P., Johnson L., Chelba C., Strope B. Large-scale discriminative language model reranking for voice-search. Proceedings of the NAACL-HLT 2012 Workshop: Will We Ever Really Replace the N-gram Model? On the Future of Language Modeling for HLT 2012, 41-49. Montreal, Canada.
44. Keretna S., Lim C.P., Creighton D. A hybrid model for named entity recognition using unstructured medical text. 9th International Conference on System of Systems Engineering (SOSE), 2014 2014, 85-90.
45. Klein D. The unsupervised learning of natural language structure 2005, Stanford University, Ph.D. thesis.
46. Koehn P. Europarl: a parallel corpus for statistical machine translation 2015, http://www.statmt.org/europarl/.
47. Leech G., Garside R., Bryant M. CLAWS4: the tagging of the british national corpus. Proceedings of the 15th Conference on Computational Linguistics-Volume 1, Kyoto, Japan 1994, 622-628. ACL, Stroudsburg, PA.
48. Lewis D.D. Reuters-21578 text categorization collection data set 2015, https://archive.ics.uci.edu/ml/datasets/Reuters-21578+Text+Categorization+Collection.
49. Li F., Jagadish H.V. NaLIR: an interactive natural language interface for querying relational databases. Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, Snowbird, Utah, USA 2014, 709-712. ACM, New York, NY.
50. Li Y., Yang H., Jagadish H.V. NaLIX: an interactive natural language interface for querying XML. Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, Baltimore, Maryland 2005, 900-902. ACM, New York, NY.
51. Li Y., Chaudhuri I., Yang H., Singh S., Jagadish H.V. DaNaLIX: a domain-adaptive natural language interface for querying XML. Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data, Beijing, China 2007, 1165-1168. ACM, New York, NY.
52. Linguistic Data Consortium Language resources 2015, https://www.ldc.upenn.edu/language-resources.
53. Low Y., Bickson D., Gonzalez J., Guestrin C., Kyrola A., Hellerstein J.M. GraphLab: a new framework for parallel machine learning 2013, http://www.select.cs.cmu.edu/publications/paperdir/uai2010-low-gonzalez-kyrola-bickson-guestrin-hellerstein.pdf.
54. Manning C., Schutze H. Foundations of Statistical Natural Language Processing 1999, MIT Press, Cambridge, Massachusetts.
55. Marcus M.P., Marcinkiewicz M.A., Santorini B. Building a large annotated corpus of english: the penn treebank. Comput. Linguist. 1993, 19(2):313-330. Cambridge, MA, USA.
56. Mihalcea R., Radev D. Graph-based Natural Language Processing and Information Retrieval 2011, Cambridge University Press, New York, NY.
57. Nadeau D., Sekine S. A survey of named entity recognition and classification. Lingvist. Investig. 2007, 30(1):3-26.
58. Navigli R. Word sense disambiguation: a survey. ACM Comput. Surv. 2009, 41(2). 10:1-10:69.
59. NCBI PubMed, national center for biotechnology information 2015, http://www.ncbi.nlm.nih.gov/pubmed.
60. Nenkova A., McKeown K. Automatic summarization. Found. Trends Inform. Retr. 2011, 5(2-3):103-233.
61. Nenkova A., McKeown K. A survey of text summarization techniques. Mining Text Data 2012, 43-76. Springer, Heidelberg. C. Aggarwal, C. Zhai (Eds.).
62. Norvig P. Natural language corpus data. Beautiful Data: The Stories Behind Elegant Data Solutions 2009, 219-242. O'Reilly Media. T. Segaran, J. Hammerbacher (Eds.).
63. OASIS Technical Committee Apache UIMA project 2015, http://uima.apache.org/.
64. Palmer D.D. A trainable rule-based algorithm for word segmentation. Proceedings of the 35th Annual Meeting of the ACL, Madrid, Spain 1997, 321-328. Association for Computational Linguistics, Stroudsburg, PA.
65. Palmer M., Gildea D., Kingsbury P. The proposition bank: an annotated corpus of semantic roles. Comput. Linguist. 2005, 31(1):71-106.
66. Papineni K., Roukos S., Ward T., Zhu W.J. BLEU: a method for automatic evaluation of machine translation 2002, 311-318. ACL, Stroudsburg, PA.
67. Perkins J. Python Text Processing with NLTK 2.0 Cookbook 2010, Packt Publishing, Birmingham, United Kingdom.
68. Popel M., žabokrtský Z. TectoMT: modular NLP framework 2010, 293-304. Springer-Verlag, Berlin.
69. Princeton University WordNet: a large lexical database for English 2015, http://wordnet.princeton.edu/wordnet/.
70. Gutenberg Project 2015, https://www.gutenberg.org/.
71. Ratnaparkhi A. A maximum entropy model for part-of-speech tagging. Proceedings of the Empirical Methods in Natural Language Processing 1996, 133-142. Philadelphia, PA, USA. E. Brill, K. Church (Eds.).
72. Read the Web Project NELL: never-ending language learning 2015, http://rtw.ml.cmu.edu/rtw/.
73. Riezler S., Liu Y., Vasserman A. Translating queries into snippets for improved query expansion 2008, 737-744. ACL, Stroudsburg, PA.
74. Rotem N. Open text summarizer 2014, http://libots.sourceforge.net/.
75. Rüger S. Multimedia information retrieval. Synth. Lect. Inf. Concepts Retr. Serv. 2009, 1(1):1-171.
76. Russell M.A. Mining the Social Web: Analyzing Data from Facebook, Twitter, LinkedIn, and Other Social Media Sites 2011, O'Reilly Media, Sebastopol, California.
77. Sarawagi S. Information extraction. Found. Trends Databases 2008, 1(3):261-377.
78. Schmidt L., Sharifi M., Moreno I.L. Large-scale speaker identification. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2014, 1650-1654. Florence.
79. Severyn A., Moschitti A., Uryupina O., Plank B., Filippova K. Opinion mining on YouTube. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2014, 1252-1261. Association for Computational Linguistics, Baltimore, MD.
80. Sproat R., Shih C., Gale W., Chang N. A stochastic finite-state word-segmentation algorithm for Chinese. Proceedings of the 32nd Annual Meeting of ACL, Las Cruces, New Mexico 1994, 66-73. Association for Computational Linguistics, Stroudsburg, PA.
81. Stanford NLP Group Stanford NLP tools 2014, http://nlp.stanford.edu/software/index.shtml.
82. Subramaniam L.V., Roy S., Faruquie T.A., Negi S. A survey of types of text noise and techniques to handle noisy text 2009, 115-122. ACM, New York, NY.
83. Sutton C., McCallum A. An introduction to conditional random fields. Found. Trends Mach. Learn. 2012, 4(4):267-373. 1935-8237.
84. Talukdar P.P., Jacob M., Mehmood M.S., Crammer K., Ives Z.G., Pereira F., Guha S. Learning to create data-integrating queries. Proc. VLDB Endow. 2008, 1(1):785-796.
85. The Apache Software Foundation openNLP 2012, http://opennlp.apache.org/.
86. The Apache Software Foundation Apache lucene core 2014, http://lucene.apache.org/core/.
87. The University of Sheffield GATE 2015, http://gate.ac.uk/.
88. The University of Waikato Weka 3: data mining software in java 2014, http://www.cs.waikato.ac.nz/ml/weka/.
89. University of Massachusetts at Amherst Machine learning for language toolkit 2014, http://mallet.cs.umass.edu/.
90. Wang K., Thrasher C., Hsu B.-J.P. Web scale NLP: a case study on URL word breaking 2011, 357-366. ACM, New York, NY.
91. Wang Y., Zhao X., Sun Z., Yan H., Wang L., Jin Z., Wang L., Gao Y., Law C., Zeng J. Peacock: learning long-tail topic features for industrial applications. ACM Trans. Intell. Syst. Technol. 2014, 9(4). 39.1-39.23.
92. Wigner E. The unreasonable effectiveness of mathematics in the natural sciences. Commun. Pure Appl. Math. 1960, 13(1):1-14.
93. ϕ digital library. 2014 IEEE 30th International Conference on Data Engineering Workshops (ICDEW) 2014, 68-73.
94. Yogatama D., Wang C., Routledge B., Smith N., Xing E. Dynamic language models for streaming text. Trans. ACL 2014, 2:181-192.
95. YouTube Viewership statistics 2015, http://www.youtube.com/yt/press/statistics.html.
96. Zhang Y., Clark S. Syntactic processing using the generalized perceptron and beam search. Comput. Linguist. 2011, 37(1):105-151.