Big data solution for Sri Lankan development: A case study from travel and tourism

International Conference on Advances in ICT for Emerging Regions, ICTer 2013 - Conference Proceedings

Volumn , Issue , 2013, Pages 207-216

  Irudeen, Rinusha ^a   Samaraweera, Sanjeeva ^a  

^a Virtusa Pvt Ltd   (Sri Lanka)

Author keywords

Apache Mahout; Apache Sqoop; Big Data; Dashboard; Hadoop; Hbase; MapReduce

Indexed keywords

COMMERCE; COMPUTER ARCHITECTURE; MARKETING; ONLINE SYSTEMS;

APACHE MAHOUT; APACHE SQOOP; BIG DATUM; DASHBOARD; HADOOP; HBASE; MAP-REDUCE;

DIGITAL STORAGE;

EID: 84898409978     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICTer.2013.6761180     Document Type: Conference Paper

References (46)

1. T. Lock (2012) The Register: The Big Data revolution. [Online]. Available:http://www. theregister. co. uk/2012/10/0 8/big-data-revolution/
2. R. Henschke. (2009) Asia Calling: Sri Lanka Calls for Tourism DevelopmentBoom. [Online]. Available: http://www. asiacalling. org/en/special-reports/after-the-war-the-hardwork-begins-in-sri-lanka/ 1441-sri-lanka-calls-for-tourismdevelopment-boom
3. J. Manyika, M. Chui, B. Brown, J. Bughin, R. Dobbs, C. Roxburgh, and A. H Byers, (2011) Big data: The next frontier for innovation, competition, and productivity. California: McKinsey Global Institute. Available:http://www. mckinsey. com/insights/business-techn ology/big-data-the-next-frontier-for- innovation
4. J. Kelly, D. Vellante, and D. Floyer, (2013) Wikibon: Big Data Market Size and Vendor Revenues. [Online]. Available: http://wikibon. org/wiki/v/big-data-market-size-and-vendor-revenues
5. M. Feuz, M. Fuller and F. Stalder (2011) Personal Web searching in the age of semantic capitalism: Diagnosing the mechanisms of personalisation [Online]. Available: http://firstmonday. org/article/view/3344/2766
6. Research and Internationalrelations Division. Sri lanka tourism development authority: annual statistical report (2011) [online]. Available:http://www. sltda. lk/sites/default/files/Annual-Statistical-Re port-2011. pdf
7. P. Russom, Big Data Analytics, TDWI Best Practices Report, Fourth Quarter, 2011
8. P. Zikopoulos and C. Eaton, "Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data" McGraw-Hill, 2011
9. Google/OTX(2011)Traveler's Road to Decision 2011:Google/IPSOS OTXMediaCT,USA. [Online]. Available: http://www. thinkwithgoogle. com/insights/emea/library/studies/traveler s-road-to-decision-2011/
10. T. H. Davenport, (2013) At the Big Data Crossroads:turning towards a smarter travel experience: Amadeus IT Group. [Online]. Available: http://2013. amadeusblog. com/wp-content/uploads/2013/06/Amadeus-Big-Data-Report. pdf
11. S. Mitra, (2007) Web 3. 0 and Travel Search Engines. [Online]. Available: http://www. sramanamitra. com/2007/06/01/web-30-travelsearch-engines/
12. Ventana research (2012) The Challenge of Big Data: Benchmarking Large-Scale Data Management, California: USA. [Online]. Available: http://www. ventanaresearch. com/uploadedFiles/Content/Landing-Pag es/ Ventana%20Research%20Benchmark%20Research%20Big%20Dat a%20White%20Paper%202012. pdf
13. D. J. Abadi, D. S. Myers, D. J. DeWitt,and S. Madden, Materialization Strategies in a Column-oriented DBMS. In: Proc. of ICDE (2007) pp. 466-475
14. H. Chen, R. H. L. Chiang and V. C. Storey, Business intelligence and analytics:from big data to big impact: Business Intelligence Research,MIS Quarterly Vol. 36 No. 4, 2012, pp. 1174-1175
15. T. White, Hadoop: The Definitive Guide: Storage and Analysis at internet scale, CA, USA: O'Reilly Media, 2012
16. K. Ting, and J. J Cecho, Apache Sqoop Cookbook: Unlocking Hadoop for your relational Databases, CA, USA: O'Reilly Media, 2013
17. I. Drost, Scaling Data Analysis with Apache Mahout, CA, USA: O'Reilly Media, 2011
18. J. Lin, Exploring Large-Data Issues in the Curriculum: A Case Study with MapReduce (Proceedings of the Third Workshop on Issues in Teaching Computational Linguistics), Ohio: USA, Association for Computational Linguistic, 2008, pp 54-61
19. R. Baraglia, G. D. F. Morales, and C. Lucchese. Document similarity self joins with MapReduce. In ICDM, 2010
20. Y. Kim and K. Shim. Parallel top-k similarity joins algorithms using MapReduce. In ICDE, 2012
21. Gigaspaces (2012) "Big Data Survey: Real-Time Stream Processing and Cloud-Based, Big Data Increasing in Today's Enterprises": USA. Available:http://www. gigaspaces. com/sites/default/files/prod uct/BigDataSurvey-Report. pdf
22. Explore Srilanka, Laya: Comfort, Peace And Serenity (2012) [Online]. Available: http://exploresrilanka. lk/2012/12/laya-comfort-peace-andserenity/
23. S. Few and P. Edge (2007) Why most Dashboards Fails [Online]. Available:http://www. perceptualedge. com/articles/misc/WhyMostDas hboardsFail. pdf
24. S. Rosenbush, and M. Totty (2013) U. S. edition of The Wall Street Journal, with the headline: How Big Data Is Changing the Whole Equation for Business [Online]. Available: http://online. wsj. com/article/ SB1000142412788732417890457834007 1261396666. html
25. Research and International relations Division. Sri lanka tourism development authority: annual statistical report (2011) [online]. available:http://www. sltda. lk/sites/default/files/Annual-Statistical-Re port-2011. pdf
26. Data Protection Acts 1988 and 2003: A Guide for Data Controllers. Available:http://www. dataprotection. ie/documents/forms/Ne wAGuideForDataControllers. pdf
27. L. Wijesiri (2012) DAILY NEWS: Developing tourism in Sri Lanka and challenges [Online]. Available: http://www. dailynews. lk/2010/02/27/fea03. asp
28. NewVantage Partners: Big Data Executive Survey (2013) [Online]. Available: http://newvantage. com/wp-content/uploads/2013/02/NVPBig-Data-Survey- 2013-Summary-Report. pdf
29. R. E. Bryant, R. H. Katz and E. D. Lazowsk, "Big-Data Computing: Creating revolutionary breakthroughs in commerce, science, and society" Version B, 2008, pp 2-3
30. The Authority on World Travel & Tourism: Travel & Tourism Economic Impact 2012 WORLD (2012) [Online]. Available: http://www. wttc. org/site-media/uploads/downloads/world2012. pdf
31. An Oracle White Paper in Enterprise Architecture-Information Architecture: An Architect's Guide to Big Data (2012) [Online]. Available:http://www. oracle. com/technetwork/topics/entarch/articles/o ea-big-data-guide-1522052. pdf
32. jsoup: Java HTML Parser [Online]. Available: http://jsoup. org/
33. P. Houston, "Instant Jsoup How-To: Effectively extract and manipulate HTML content with the JSoup Library", Packt Publishing. Birmingham: UK, 2013
34. Integrating Hadoop with Enterprise RDBMS Using Apache SQOOP and Other Tools (2011) [Online]. Available: http://www. hadoopworld. com/session/ integrating-hadoop-withenterprise-rdbms-using-apache-sqoop-and-other-tools/
35. H. Liao, J. Han and J. Fang (2010) Fifth IEEE International Conference on Networking, Architecture, and Storage: Multi-dimensional Index on Hadoop Distributed File System (2010) [Online]. Available: http://www. cs. odu. edu/~mukka/cs775s11/Presentations/papers/liao. pd f
36. G. Satell (2013) Why Facebook's Graph Search Really Does Matter: Big Data + NLP [Online]. Available: http://www. forbes. com/sites/gregsatell/2013/02/04/ why-facebooksgraph-search-really-does-matter-big-data-nlp/
37. The Blog of the International Computer Science Institute:Big Data or Expert Annotation-What's Best for Natural Language Processing? (2013). [Online]. Available: http://www. icsi. berkeley. edu/icsi/blog/data-versus-experts
38. The Apache Software Foundation. Apache HBase. [Online]. Available: http://hbase. apache. org/
39. K. Shvachko, H. Kuang, S. Radia, and R. Chansler (2010) The Hadoop Distributed File System. O'Reilly Media, Yahoo! Press
40. J. Dean and S. Ghemawat (2004) MapReduce: Simplified Data Processing on Large Clusters. Vol 06
41. Avinash, Lakshman. Cassandra-A Decentralized Structured Storage system. In LADIS, 2009
42. M. StoneBreaker. SQL databases V. NOSQL databases, Communications of the ACM, Vol. 53 No. 4, pp. 10-11, 2010
43. J. Hurwitz, A. Nugent, F. Halper,and M. Kaufman,"Big Data For Dummies: Big Data management ", NJ, USA: John Wiley & Sons,2013
44. C. Lam," Hadoop in action: Programming with Pig" Manning Publications, 2010
45. D. Borthakur. (2008) Hadoop 1. 2. 1 Documentation: HDFS Architecture Guide [Online]. Available: http://hadoop. apache. org/docs/stable/hdfs-design. html
46. Big data and analytics in travel and transportation: Beyond the hype: Solutions that deliver big value, IBM Corporation, 2013. [Online]. Available: http://public. dhe. ibm. com/common/ssi/ecm/en/gbw03215usen/GBW0 3215USEN. PDF