Embedding AI and crowdsourcing in the big data lake

IEEE Intelligent Systems

Volumn 29, Issue 5, 2014, Pages 70-73

  O'Leary, Daniel E ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

artificial intelligence; Big Data Lake; crowdsourcing; data governance; data warehouses; intelligent systems; master data management

Indexed keywords

ARTIFICIAL INTELLIGENCE; DATA WAREHOUSES; DECISION SUPPORT SYSTEMS; INFORMATION MANAGEMENT; INTELLIGENT SYSTEMS; LAKES;

CRITICAL COMPONENT; CROWDSOURCING; DATA GOVERNANCES; DATA-SOURCES; DECISION SUPPORTS; HUMAN INTELLIGENCE; MASTER DATA MANAGEMENT; TECHNOLOGY ISSUES;

BIG DATA;

EID: 84910111297     PISSN: 15411672     EISSN: None     Source Type: Journal    
DOI: 10.1109/MIS.2014.82     Document Type: Article

References (19)

1. J. Dixon, Pentaho, Hadoop, and Data Lakes, blog, 2010; http://jamesdixon. wordpress.com/2010/10/14/pentahohadoop-and-data-lakes.
2. D.E. O?Leary, "Building and Evolving Data Warehousing and Business Intelligence: The Case of Sysco," Intelligent Systems in Accounting, Finance and Management, vol. 18, no. 4, 2011, pp. 195-213.
3. D.E. O?Leary, "REAL-D: A Schema for Data Warehouses," J. Information Systems, vol. 13, no. 1, 1999, pp. 49-62.
4. B. Devlin, "Data Lake Muddies the Waters on Big Data Management," http://searchbusinessanalytics.techtarget.com/feature/Data-lake-muddies-the-waterson-big-data-management.
5. W. Eckerson, "Beware of Alligators in the Data Lake," Wayne?s World, blog, 12 Mar. 2014; www.b-eye-network. com/blogs/eckerson/archives/2014/03/beware-of-the-a.php.
6. L. Weber, "Don?t Drown in the Big Data Lake," blog, 24 Apr. 2014; www.ibmbigdatahub.com/blog/don?t-drownbig-data-lake.
7. D.E. O?Leary, "Artificial Intelligence and Big Data," IEEE Intelligent Systems, vol. 28, no. 2, 2013, pp. 96-99.
8. D. McLeod and D. Heimbigner, "A Federated Architecture for Information Management," ACM Trans. Information Systems, vol. 3, no. 3, 1985, pp. 253-278.
9. E. Lin and L. Haas, IBM Federated Database Technology, tech. report, IBM, www.ibm.com/developerworks/data/library/techarticle/0203haas/0203haas. html.
10. S, Handschuh, S. Staab, and F. Ciravengna, "Semi-Automatic Creation of Metadata," Knowledge Eng. and Knowledge Management: Ontologies and the Semantic Web, Springer Berlin Heidelberg, 2002, pp. 358-372.
11. T. Finin et al., "Annotating Named Entities in Twitter Data with Crowdsourcing," Proc. NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon?s Mechanical Turk, 2010, pp. 80-88.
12. J. Banerjee et al., "Semantics and Implementation of Schema Evolution in Object-Oriented Databases," Proc. ACM Sigmod Ann. Conf. Management of Data, 1987, pp. 311-322.
13. N. Pudota et al., "Automatic Key Phrase Extraction and Ontology Mining for Content-Based Tag Recommendation," Int?l J. Intelligent Systems, vol. 25, no. 12, 2010, pp. 1158-1186.
14. C. Bettini et al., "Discovering Frequent Event Patterns with Multiple Granularities in Time Sequneces," IEEE Trans. Knowledge and Data Eng., vol. 10, no. 2, 1998, pp. 222-237.
15. Capgemini and Pivotal, The Technology of the Business Data Lake, tech. report, 2013; www.capgemini.com/resources/the-technology-of-the-business-data-lake.
16. E. Coiera et al., "Architecture for Knowledge Based and Federated Search of Clinical Evidence," J. Medical Internet Research, vol. 7, no. 5, 2005; doi:10.2196/jmir.7.5.e52.
17. J. Dinerstein, "Learning Based Fusion for Data Deduplication," Proc. 7th Int?l. Conf. Machine Learning and Applications, 2008, pp. 66-71.
18. P.Y. Hsuch, P. Melville, and V. Sindhwani, "Data Quality from Crowdsourcing," Proc. NAACL HLT Workshop on Active Learning for Natural Language Processing, 2009, pp. 27-35.
19. D. Geer, "Can Data Lakes Solve Cloud Security Problems," CSO, 18 Mar. 2014; www.csoonline.com/article/2134475/network-security/can-data-lakes-solve-cloud-securitychallenges-. html.