Entity reconciliation in big data sources: A systematic mapping study

Expert Systems with Applications

Volumn 80, Issue , 2017, Pages 14-27

  Enriquez J G ^a   Dominguez Mayo F J ^a   Escalona, M J ^a   Ross, M ^b,c   Staples, G ^c  

^a UNIVERSITY OF SEVILLE   (Spain)

^b SOUTHAMPTON SOLENT UNIVERSITY   (United Kingdom)

^c BCS Quality Specialist Group   (United Kingdom)

Author keywords

Big data; Entity reconciliation; Heterogeneous databases; Systematic mapping study

Indexed keywords

DIGITAL LIBRARIES; MAPPING; PROBLEM SOLVING;

ENTITY RECONCILIATION; HETEROGENEOUS DATA SOURCES; HETEROGENEOUS DATABASE; JOURNAL ARTICLES; LEVEL OF AUTOMATIONS; OPERATIONAL PHASE; REAL-WORLD ENTITIES; SYSTEMATIC MAPPING STUDIES;

BIG DATA;

EID: 85015660559     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2017.03.010     Document Type: Article

References (89)

1. Ali, O., Cristianini, N., Information fusion for entity matching in unstructured data. IFIP Advances in Information and Communication Technology, 339 AICT, 2010, 162–169 http://doi.org/10.1007/978-3-642-16239-8_23.
2. Ayat, N., Akbarinia, R., Afsarmanesh, H., Valduriez, P., Entity resolution for distributed probabilistic data. Distributed and Parallel Databases 31:4 (2013), 509–542.
3. Ayat, N., Akbarinia, R., Afsarmanesh, H., Valduriez, P., Entity resolution for probabilistic data. Information Sciences 277 (2014), 492–511 http://doi.org/10.1016/j.ins.2014.02.135.
4. Balaji, J., Javed, F., Kejriwal, M., Min, C., Sander, S., & Ozturk, O. (2016). An ensemble blocking scheme for entity resolution of large and sparse datasets.
5. Beheshti, S.-M.-R., Benatallah, B., Venugopal, S., Ryu, S.H., Motahari-Nezhad, H.R., Wang, W., A systematic review and comparative analysis of cross-document coreference resolution methods and tools. Computing 1 (2016), 1–37 http://doi.org/10.1007/s00607-016-0490-0.
6. Bortoli, S., Bouquet, P., Bazzanella, B., An identification ontology for entity matching. On the Move to Meaningful Internet Systems: Otm 2014 Workshops 8842 (2014), 587–596.
7. Brando, C., Frontini, F.b, Ganascia, J.-G., Disambiguation of named entities in cultural heritage texts using linked data sets. Communications in Computer and Information Science 539 (2015), 505–514 http://doi.org/10.1007/978-3-319-23201-0_51.
8. Bratus, S., Rumshisky, A., Khrabrov, A., Magar, R., Thompson, P., Domain-specific entity extraction from noisy, unstructured data using ontology-guided search. International Journal on Document Analysis and Recognition 14:2 (2011), 201–211 http://doi.org/10.1007/s10032-011-0149-5.
9. Brizan, D.G., Tansel, A.U., A survey of entity resolution and record linkage methodologies. Communications of the IIMA 6:3 (2006), 41–50.
10. Calvanese, D., Keet, C.M., Nutt, W., Rodríguez-Muro, M., Stefanoni, G., Web-based graphical querying of databases through an ontology: The Wonder system. Proceedings of the 2010 ACM symposium on applied computing, 2010, 1388–1395 http://doi.org/10.1145/1774088.1774384.
11. Carvalho, L.F.M., Laender, A.H.F., Meira, W. Jr, Entity matching: A case study in the medical domain. Alberto Mendelzon International Workshop on Foundations of Data Management, 2015, 57.
12. Chen, M., Mao, S., Liu, Y., Big data: A survey. Mobile networks and applications, Vol. 19, 2014, Springer Berlin Heidelberg, 171–209 http://doi.org/10.1007/s11036-013-0489-0.
13. Costa, G., Cuzzocrea, A., Manco, G., Ortale, R., Data de-duplication: A review. Studies in Computational Intelligence 375 (2011), 385–412 http://doi.org/10.1007/978-3-642-22913-8_18.
14. Costa, G. D. A. (2016). Large-scale entity resolution for semantic web data integration LARGE-SCALE ENTITY RESOLUTION FOR SEMANTIC, (October 2014).
15. Da Silva, F.Q.B., Santos, A.L.M., Soares, S., Frana, A.C.C., Monteiro, C.V.F., MacIel, F.F., Six years of systematic literature reviews in software engineering: An updated tertiary study. Information and Software Technology 53:9 (2011), 899–913 http://doi.org/10.1016/j.infsof.2011.04.004.
16. de Assis Costa, G., de Oliveira, J.M.P., A blocking scheme for entity resolution in the semantic web. Advanced Information networking and applications (AINA), 2016 IEEE 30th international conference on, 2016, 1138–1145.
17. Dharavath, R., Kumar, C., The journal of systems and software entity resolution based EM for integrating heterogeneous distributed probabilistic data. The Journal of Systems & Software 107 (2015), 93–109 http://doi.org/10.1016/j.jss.2015.05.035.
18. Dharavath, R., Singh, A.K., Entity resolution-based jaccard similarity coefficient for heterogeneous distributed databases. Proceedings of the second international conference on computer and communication technologies, 2016, 497–507.
19. Dorneles, C.F., Gonçalves, R., dos Santos Mello, R., Approximate data instance matching: A survey. Knowledge and Information Systems 27:1 (2011), 1–21 http://doi.org/10.1007/s10115-010-0285-0.
20. Efthymiou, V., Efthymiou, V., Papadakis, G., Papastefanatos, G., Stefanidis, K., Palpanas, T., Parallel meta-blocking for scaling entity resolution over big heterogeneous data. Information Systems 65:December 2016 (2016), 137–157 http://doi.org/10.1016/j.is.2016.12.001.
21. Efthymiou, V., Stefanidis, K., Vassilis, C., Minoan ER : Progressive entity resolution in the web of data. 19th international conference on extending database tech- nology, EDBT 2016, 2016, 670–671 http://doi.org/10.5441/002/edbt.2016.79.
22. Fan, W., Geerts, F., Tang, N., Yu, W., Conflict resolution with data currency and consistency. Journal of Data Information Quality 5:1–2 (2014), 6:1–6:37 http://doi.org/10.1145/2631923.
23. Fan, W., Li, J., Ma, S., Tang, N., Yu, W., Interaction between record matching and data repairing. Proceedings of the 2011 international conference on management of data - SIGMOD ’11, Vol. 1, 2011 http://doi.org/10.1145/1989323.1989373.
24. Firmani, D., Saha, B., Srivastava, D., Online entity resolution using an oracle. Proceedings of the VLDB endowment, 9, 2016, 384–395.
25. Fisher, J., Christen, P., Wang, Q., Rahm, E., A clustering-based framework to control block sizes for entity resolution. Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining - KDD ’15, 2015, 279–288 http://doi.org/10.1145/2783258.2783396.
26. Fosso Wamba, S., Akter, S., Edwards, A., Chopin, G., Gnanzou, D., How “big data” can make big impact: Findings from a systematic review and a longitudinal case study. International Journal of Production Economics 165 (2015), 234–246 http://doi.org/10.1016/j.ijpe.2014.12.031.
27. Frontini, F., Brando, C., Ganascia, J.-G., Domain-adapted named-entity linker using Linked Data. Workshop on NLP Applications: Completing the Puzzle co-located with the 20th International Conference on Applications of Natural Language to Information Systems (NLDB 2015), Jun 2015, Passau, Germany. Proceedings of the Workshop on NLP Applications: Completing the Puzzle co-located with the 20th International Conference on Applications of Natural Language to Information Systems (NLDB 2015), 2015, http://ceur-ws.org/Vol-1386/.hal-01203356.
28. Gaikwad, S., & Bogiri, N. (2015, January). A survey analysis on duplicate detection in hierarchical data. In Pervasive Computing (ICPC), 2015 International Conference on (pp. 1–6). IEEE.
29. Genero, M., Cruz-Lemus, J. A., & Piattini, M. (2014). Métodos de Investigación en Ingeniería del Software. RA-MA Editorial.
30. Getoor, L., Machanavajjhala, A., Entity resolution for big data. KDD ’13: Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining, 4503, 2013 http://doi.org/10.1145/2487575.2506179.
31. Group, O.M., OMG unified modeling language TM ( OMG UML ), version 2.5. InformatikSpektrum 21:May (2017), 1–758 http://doi.org/10.1007/s002870050092.
32. Gu, Q., Zhang, Y., Cao, J., Xu, G., Cuzzocrea, A., A confidence-based entity resolution approach with incomplete information. Data science and advanced analytics (DSAA), 2014 international conference on, 2014, 97–103 http://doi.org/10.1109/DSAA.2014.7058058.
33. Hermansson, L., Kerola, T., Johansson, F., Jethava, V., Dubhashi, D., Entity disambiguation in anonymized graphs using graph kernels. Proceedings of the 22nd ACM international conference on conference on information & knowledge management - CIKM ’13, 2013, 1037–1046 http://doi.org/10.1145/2505515.2505565.
34. Hernández, M., Koutrika, G., HIL: A high-level scripting language for entity integration. Proceedings of the 16th international conference on extending database technology, 2013, 549–560 http://doi.org/10.1145/2452376.2452440.
35. Hsueh, S.C., Lin, M.Y., Chiu, Y.C., A load-balanced mapreduce algorithm for blocking-based entity-resolution with multiple keys., 152, 2014, 3–9.
36. Irmak, U., Kraft, R., A scalable machine-learning approach for semi-structured named entity recognition. Proceedings of the 19th international conference on world wide web WWW 10, 2010, 461 http://doi.org/10.1145/1772690.1772738.
37. Kejriwal, M., Populating entity name systems for big data. Proceedings of the 13th international semantic web conference, 2014, 521–528.
38. Kitchenham, B., Brereton, P., A systematic review of systematic review process research in software engineering. Information and Software Technology 55:12 (2013), 2049–2075 http://doi.org/10.1016/j.infsof.2013.07.010.
39. Kitchenham, B., Charters, S., Guidelines for performing systematic literature reviews in software engineering. Engineering 2 (2007), 1–65 http://doi.org/10.1145/1134285.1134500.
40. Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., Systematic literature reviews in software engineering – A tertiary study. Information and Software Technology 52:8 (2010), 792–805 http://doi.org/10.1016/j.infsof.2010.03.006.
41. Kolb, L., Köpcke, H., Thor, A., Databases, H.S.D., Systems, H., Learning-based entity resolution with MapReduce. Cikm 1 (2011), 1–6 http://doi.org/http://doi.acm.org/10.1145/2064085.2064087.
42. Kong, C., Gao, M., Xu, C., Quian, W., Zhou, A., Entity matching across multiple heterogeneous data sources. Proceedings of the 21st International conference on database systems for advanced applications (DASFAA 2016), Vol. 9642, 2016, 133–146 http://doi.org/10.1007/978-3-319-32025-0.
43. Leitão, L., Calado, P., Herschel, M., Efficient and effective duplicate detection in hierarchical data. IEEE Transactions on Knowledge and Data Engineering 25:5 (2013), 1028–1041 http://doi.org/10.1109/TKDE.2012.60.
44. Li, L., Li, J., Gao, H., Rule-based method for entity resolution. IEEE Transactions on Knowledge and Data Engineering 27:1 (2015), 250–263 http://doi.org/10.1109/TKDE.2014.2320713.
45. Li, L., Li, J., Wang, H., Gao, H., Context-based entity description rule for entity resolution. Cikm 1 (2011), 1725–1730 http://doi.org/10.1145/2063576.2063825.
46. Lin, Y., Wang, H., Li, J., & Gao, H. (2016). Efficient entity resolution on heterogeneous records. http://doi.org/1610.09500.
47. Liu, H., Kumar, T.K.A., Thomas, J.P., Cleaning framework for big data – object identification and linkage. 2015 IEEE international congress on big data, 2015, 215–221 http://doi.org/10.1109/BigDataCongress.2015.38.
48. Liu, Y., Wang, H., Gao, H., A fast entity resolution method based on wave of records. 2011 international conference on consumer electronics, communications and networks, CECNet 2011 – proceedings, 60933001, 2011, 4642–4645 http://doi.org/10.1109/CECNET.2011.5768200.
49. Maddodi, S., Attigeri, G.V., Karunakar, A.K., Data Deduplication techniques and analysis. Proceedings - 3rd international conference on emerging trends in engineering and technology, ICETET 2010, 2010, 664–668 http://doi.org/10.1109/ICETET.2010.42.
50. McKinsey & Company. Big data: the next frontier for innovation, competition, and productivity. 2011, McKinsey Global Institute, 156 (June) http://doi.org/10.1080/01443610903114527.
51. Mendeley Support Team. Mendeley guide. Mendeley Desktop, 2011, 1–16 http://doi.org/10.1063/1.476396.
52. Ngai, E.W.T., Gunasekaran, A., A review for mobile commerce research and applications. Decision Support Systems 43:1 (2007), 3–15 http://doi.org/10.1016/j.dss.2005.05.003.
53. Ngai, E.W.T., Hu, Y., Wong, Y.H., Chen, Y., Sun, X., The application of data mining techniques in financial fraud detection: A classification framework and an academic review of literature. Decision Support Systems 50:3 (2011), 559–569 http://doi.org/10.1016/j.dss.2010.08.006.
54. Ngai, E.W.T., Hu, Y., Wong, Y.H., Chen, Y., Sun, X., The application of data mining techniques in financial fraud detection: A classification framework and an academic review of literature. Decision Support Systems 50:3 (2011), 559–569 http://doi.org/10.1016/j.dss.2010.08.006.
55. Ngai, E.W.T., Moon, K.K.L., Riggins, F.J., Yi, C.Y., RFID research: An academic literature review (1995–2005) and future research directions. International Journal of Production Economics 112:2 (2008), 510–520 http://doi.org/10.1016/j.ijpe.2007.05.004.
56. Nguyen, K., Ichise, R., Linked data entity resolution system enhanced by configuration learning algorithm. IEICE TRANSACTIONS on Information and Systems 99:6 (2016), 1521–1530.
57. Nuray-turan, R., Kalashnikov, D.V., Mehrotra, S., Adaptive connection strength models for relationship-based entity resolution. Jdiq 4:2 (2013), 1–22 http://doi.org/10.1145/2435221.2435224.
58. Otero-Cerdeira, L., Rodríguez-Martínez, F.J., Gómez-Rodríguez, A., Ontology matching: A literature review. Expert Systems with Applications 42:2 (2015), 949–971 http://doi.org/10.1016/j.eswa.2014.08.032.
59. Papadakis, G., Ioannou, E., Niederée, C., Fankhauser, P., Efficient entity resolution for large heterogeneous information spaces. Proceedings of the fourth ACM international conference on web search and data mining - WSDM ’11, 535, 2011 http://doi.org/10.1145/1935826.1935903.
60. Papadakis, G., Ioannou, E., Niederée, C., Palpanas, T., Nejdl, W., To compare or not to compare: Making entity resolution more efficient. Proceedings of the international workshop on semantic web information management, 2011, 3:1–3:7 http://doi.org/10.1145/1999299.1999302.
61. Papadakis, G., Ioannou, E., Niederée, C., Palpanas, T., Nejdl, W., Beyond 100 million entities: Large-scale blocking-based resolution for heterogeneous data. Proceedings of the fifth ACM international conference on web search and data mining, 2012, 53–62 http://doi.org/10.1145/2124295.2124305.
62. Papadakis, G., Svirsky, J., Gal, A., Palpanas, T., Comparative analysis of approximate blocking techniques for entity resolution. Pvldb 9:9 (2016), 684–695 http://doi.org/10.14778/2947618.2947624.
63. Ponce, J., Escalona, M. J., Gómez, A., Luque, M., & Molina, A. (2010). Definición de una política de pruebas en la gestión cultural : Aplicación al desarrollo del proyecto Mosaico, 6, 25–43.
64. Priya, P.A., Prabhakar, S., Vasavi, S., Entity resolution for high velocity streams using semantic measures. Advance computing conference (IACC), 2015 IEEE international, 2015, 35–40.
65. Rahmani, H., Ranjbar-Sahraei, B., Weiss, G., Tuyls, K., Entity resolution in disjoint graphs: An application on genealogical data. Intelligent Data Analysis 20:2 (2016), 455–475.
66. Ramadan, B., Christen, P., Liang, H., Dynamic sorted neighborhood indexing for real-time entity resolution. Databases Theory and Applications, Adc 2014 8506 (2014), 1–12 http://doi.org/10.1145/2816821.
67. Selenium. (2017). Selenium website documentation, last access February. RA-MA Editorial.
68. Shen, W., Han, J., Wang, J., A probabilistic model for linking named entities in web text with heterogeneous information networks. Proceedings of the 2014 ACM SIGMOD international conference on management of data, 2014, 1199–1210 http://doi.org/10.1145/2588555.2593676.
69. Shin, K., Jung, J., Lee, S., Kang, U., BEAR: Block elimination approach for random walk with restart on large graphs. Proceedings of the 2015 ACM SIGMOD international conference on management of data, New York, NY, USA, 2015, ACM, 1571–1585 http://doi.org/10.1145/2723372.2723716.
70. Shu, L., Chen, A., Xiong, M., Meng, W., Efficient Spectral neighborhood blocking for entity resolution. Proceedings - International conference on data engineering, 2011, 1067–1078 http://doi.org/10.1109/ICDE.2011.5767835.
71. Shu, L., Lin, C., Meng, W., Han, Y., Yu, C.T., Smalheiser, N.R., A framework for entity resolution with efficient blocking. Information reuse and integration (IRI), 2012 IEEE 13th international conference on, 2012, 431–440 http://doi.org/10.1109/IRI.2012.6303041.
72. Shull, F., Singer, J., & Sj??berg, D. I. K. (2008). Guide to advanced empirical software engineering. Guide to advanced empirical software engineering. http://doi.org/10.1007/978-1-84800-044-5.
73. Sleeman, J., Finin, T., Entity type recognition for heterogeneous semantic graphs. 2013 AAAI fall symposium series, 2013, 63–67 http://doi.org/10.1109/ICSC.2013.22.
74. Song, D., Luo, Y., Heflin, J., Linking heterogeneous data in the semantic web using scalable and domain-independent candidate selection. IEEE Transactions on Knowledge and Data Engineering, 2016, 143–156 PP(99) http://doi.org/10.1109/TKDE.2016.2606399.
75. Sun, C., Shen, D., Kou, Y., Nie, T., Yu, G., ERGP: A combined entity resolution approach with genetic programming. 2014 11th web information system and application conference, 2014, 215–220 http://doi.org/10.1109/WISA.2014.46.
76. Sun, Z., Xiao, N., Liu, F., Fu, Y., DS-Dedupe: A scalable, low network overhead data routing algorithm for inline cluster deduplication system. 2014 International conference on computing, networking and communications, ICNC 2014, 2014, 895–899 http://doi.org/10.1109/ICCNC.2014.6785456.
77. Wang, H., Li, J., Gao, H., Efficient entity resolution based on subgraph cohesion. Knowledge and Information Systems 46:2 (2015), 285–314 http://doi.org/10.1007/s10115-015-0818-7.
78. Wang, J., Oyama, S., Kurihara, M., Kashima, H., Learning an accurate entity resolution model from crowdsourced labels. Proceedings of the 8th international conference on ubiquitous information management and communication – ICUIMC ’14, 2014, 1–8 http://doi.org/10.1145/2557977.2558060.
79. Wang, Q., Cui, M., Liang, H., Semantic-aware blocking for entity resolution. IEEE Transactions on Knowledge and Data Engineering 28:1 (2016), 166–180.
80. Whang, S.E., Garcia-Molina, H., Incremental entity resolution on rules and data. VLDB Journal 23:1 (2014), 77–102 http://doi.org/10.1007/s00778-013-0315-0.
81. Whang, S.E., Marmaros, D., Garcia-Molina, H., Pay-as-you-go entity resolution. IEEE Transactions on Knowledge and Data Engineering 25:5 (2013), 1111–1124 http://doi.org/10.1109/TKDE.2012.43.
82. Wohlin, C., Prikladniki, R., Systematic literature reviews in software engineering. Information and Software Technology 55:6 (2013), 919–920 http://doi.org/10.1016/j.infsof.2013.02.002.
83. Xue, X., Wang, Y., Using Memetic Algorithm for instance coreference resolution. 2016 IEEE 32nd international conference on data engineering, ICDE 2016, 28, 2016, 1450–1451 http://doi.org/10.1109/ICDE.2016.7498369.
84. Yang, Y., Sun, Y., Tang, J., Ma, B., Li, J., Entity matching across heterogeneous sources. Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, 2015, 1395–1404 http://doi.org/10.1145/2783258.2783353.
85. Yu, M., Entity linking on graph data. WWW 1 (2014), 21–25 http://doi.org/10.1145/2567948.2567954.
86. Yumusak, S., Dogdu, E., & Kodaz, H. (2014). A Short Survey of Linked Data Ranking, 14–17. http://doi.org/10.1145/2638404.2638523.
87. Zhang, H., Babar, M.A., Ali Babar, M., Systematic reviews in software engineering: An empirical investigation. Information and Software Technology 55:7 (2013), 1341–1354 http://doi.org/10.1016/j.infsof.2012.09.008.
88. Zhang, H., Babar, M.A., Tell, P., Identifying relevant studies in software engineering. Information and Software Technology 53:6 (2011), 625–637 http://doi.org/10.1016/j.infsof.2010.12.010.
89. Zhu, L., Ghasemi-gol, M., Szekely, P., Galstyan, A., Knoblock, C.A., Unsupervised entity resolution on multi-type graphs. International Semantic Web Conference 9981 (2016), 649–667 http://doi.org/10.1007/978-3-319-46523-4.