Towards building a scholarly big data platform: Challenges, lessons and opportunities

Proceedings of the ACM/IEEE Joint Conference on Digital Libraries

Volumn , Issue , 2014, Pages 117-126

  Wu, Zhaohui ^a   Wu, Jian ^a   Khabsa, Madian ^a   Williams, Kyle ^a   Chen, Hung Hsuan ^a   Huang, Wenyi ^a   Tuarob, Suppawong ^a   Choudhury, Sagnik Ray ^a   Ororbia, Alexander ^a   Mitra, Prasenjit ^a   Giles, C Lee ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Big Data; Information Extraction; Scholarly Big Data

Indexed keywords

BIG DATA; COMPUTER ARCHITECTURE; DATA ANALYTICS; DIGITAL LIBRARIES; DISTRIBUTED DATABASE SYSTEMS; INFORMATION RETRIEVAL;

DATA HARVESTING; DATA PLATFORM; DISTRIBUTED REPOSITORIES; DYNAMIC SCHEDULERS; FOCUSED CRAWLER; PRIVATE CLOUDS; RESTFUL API; USER INFORMATION;

DATA MINING;

EID: 84919397810     PISSN: 15525996     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/JCDL.2014.6970157     Document Type: Conference Paper

References (39)

1. C. Caragea, J. Wu, A. Ciobanu, K., Williams, J. Fernández-Ramrez, H.-H. Chen, Z. Wu, and C. L. Giles. "Citeseerx: A scholarly big dataset," in Proceedings of ECIR, 2014, pp. 311-322.
2. H. Chao and J. Fan. "Layout and content extraction for pdf documents," in Document Analysis Systems VI. Springer, 2004, pp. 213-224.
3. H.-H. Chen and C. L. Giles. "Ascos: An asymmetric network structure context similarity measure," in Proceedings of ASONAM, 2013, pp. 442-449.
4. H.-H. Chen, L. Gou, X. Zhang, and C. L. Giles. "Collabseer: A search engine for collaboration discovery," in Proceedings of JCDL, 2011, pp. 231-240.
5. H.-H. Chen, P. Treeratpituk, P. Mitra, and C. L. Giles. "Csseer: An expert recommendation system based on citeseerx," in Proceedings of JCDL, 2013, pp. 381-382.
6. S. R. Choudhury, P. Mitra, A. Kirk, S. Szep, D. Pellegrino, S. Jones, and C. L. Giles. "Figure metadata extraction from digital documents," in Proceedings of ICDAR, 2013, pp. 135-139.
7. S. R. Choudhury, S. Tuarob, P. Mitra, L. Rokach, A. Kirk, S. Szep, D. Pellegrino, S. Jones, and C. L. Giles. "A -gure search engine architecture for a chemistry digital library," in Proceedings of JCDL, 2013, pp. 369-370.
8. K. W. S. D. G. M. K. P. T. Cornelia Caragea, Jian Wu and C. L. Giles. "Automatic identification of research articles from crawled documents. " in Proceedings of WSDM-WSCBD, 2014.
9. I. G. Councill, C. L. Giles, and M. yen Kan. "Parscit: An open-source crf reference string parsing package," in Proceedings of the LREF, 2008, pp. 661-667.
10. N. Craswell, O. Zoeter, M. Taylor, and B. Ramsey. "An experimental comparison of click position-bias models," in WSDM, 2008, pp. 87-94.
11. S. Das, P. Mitra, and C. L. Giles. "Ranking experts using author-document-topic graphs," pp. 87-96, 2013.
12. G. Dupret and B. Piwowarski. "A user browsing model to predict search engine click data from past observations. " in SIGIR, 2008, pp. 331-338.
13. C. L. Giles, K. D. Bollacker, and S. Lawrence. "Citeseer: An automatic citation indexing system," in Proceedings of DL, 1998, pp. 89-98.
14. S. D. Gollapalli, C. L. Giles, P. Mitra, and C. Caragea. "On identifying academic homepages for digital libraries," in Proceedings of JCDL, 2011, pp. 123-132.
15. H. Han, C. L. Giles, E. Manavoglu, H. Zha, Z. Zhang, and E. A. Fox. "Automatic document metadata extraction using support vector machines," in JCDL, 2003, pp. 37-48.
16. J. Huang, Z. Zhuang, J. Li, and C. L. Giles. "Collaboration over time: characterizing and modeling network evolution," in Proceedings of WSDM, 2008, pp. 107-116.
17. W. Huang, S. Kataria, C. Caragea, P. Mitra, C. L. Giles, and L. Rokach. "Recommending citations: translating papers into references. " in Proceedings of CIKM, 2012, pp. 1910-1914.
18. J. B. B. J. Jansen and T. Saracevic. "Real life information retrieval: A study of user queries on the web," SIGIR Forum, vol. 32, no. 1, pp. 5-17, 1998.
19. S. Kataria, P. Mitra, and S. Bhatia. "Utilizing context in generative bayesian models for linked corpus. " in Proceedings of AAAI, 2010, pp. 1340-1345.
20. H.-R. Ke, R. Kwakkelaar, Y.-M. Tai, and L.-C. Chen. "Exploring behavior of e-journal users in science and technology: Transaction log analysis of elsevier's sciencedirect onsite in taiwan," Library and Information Science Research, vol. 24, no. 3, pp. 265-291, 2002.
21. M. Khabsa and C. L. Giles. "The number of scholarly documents on the public web," PLOS one, 2014.
22. M. Khabsa, P. Treeratpituk, and C. L. Giles. "Ackseer: A repository and search engine for automatically extracted acknowledgments from digital libraries," in Proceedings of JCDL, 2012, pp. 185-194.
23. Y. Liu, K. Bai, P. Mitra, and C. L. Giles. "Tableseer: Automatic table metadata extraction and searching in digital libraries. " in JCDL, 2007, pp. 91-100.
24. X. Lu, S. Kataria, W. J. Brouwer, J. Z. Wang, P. Mitra, and C. L. Giles. "Automated analysis of images in documents for intelligent document search," IJDAR, vol. 12, no. 2, pp. 65-81, 2009.
25. M. Savva, N. Kong, A. Chhajta, L. Fei-Fei, M. Agrawala, and J. Heer. "Revision: Automated classification, analysis and redesign of chart images," in Proceedings of UIST, 2011, pp. 393-402.
26. C. Silverstein, M. Henzinger, H. Marais, and M. Moricz. "Analysis of a very large AltaVista query log," Digital Systems Research Center, Tech. Rep. 1998-014, 1998.
27. M. Taghavi, A. Patel, N. Schmidt, C. Wills, and Y. Tew. "An analysis of web proxy logs with query distribution pattern approach for search engines. " Computer Standards and Interfaces, vol. 34, no. 1, pp. 162-170, 2012.
28. P. Treeratpituk and C. L. Giles. "Disambiguating authors in academic publications using random forests," in Proceedings JCDL, 2009, pp. 39-48.
29. S. Tuarob, S. Bhatia, P. Mitra, and C. Giles. "Automatic detection of pseudocodes in scholarly documents using machine learning," in Proceedings of ICDAR, 2013, pp. 738-742.
30. S. Tuarob, P. Mitra, and C. Giles. "A classification scheme for algorithm citation function in scholarly works," in Proceedings of JCDL, 2013, pp. 367-368.
31. S. Tuarob, P. Mitra, and C. L. Giles. "Improving algorithm search using the algorithm co-citation network," in Proceedings of JCDL, 2012, pp. 277-280.
32. J. Wu, P. Teregowda, J. P. F. Ramrez, P. Mitra, S. Zheng, and C. L. Giles. "The evolution of a crawling strategy for an academic document search engine: whitelists and blacklists," in Proceedings of WebSci, 2012, pp. 340-343.
33. J. Wu, P. Teregowda, K. Williams, M. Khabsa, D. Jordan, E. Treece, Z. Wu, and C. Giles. "Migrating a digital library to a private cloud," in Proceedings of the IC2E, 2014.
34. Z. Wu, S. Das, Z. Li, P. Mitra, and C. L. Giles. "Searching online book documents and analyzing book citations," in Proceedings of DocEng, 2013, pp. 81-90.
35. Z. Wu and C. L. Giles. "Measuring term informativeness in context," in Proceedings of NAACL-HLT 2013, 2013, pp. 259-269.
36. Z. Wu, W. Huang, C. Liang, and C. L. Giles. "Crowd-sourcing web knowledge for metadata extraction," in Proceedings of JCDL, 2014.
37. Z. Wu, Z. Li, P. Mitra, and C. L. Giles. "Can back-of-the-book indexes be automatically created" in Proceedings of CIKM, 2013, pp. 1745-1750.
38. Z. Wu, P. Mitra, and C. L. Giles. "Table of contents recognition and extraction for heterogeneous book documents," in Proceedings of ICDAR, 2013, pp. 1205-1209.
39. Y. Zhang, B. J. Jansen, and A. Spink. "Time series analysis of a web search engine transaction log. " Inf. Process. Manage., vol. 45, no. 2, pp. 230-245, 2009.