Quality assessment for Linked Data: A Survey

Semantic Web

Volumn 7, Issue 1, 2016, Pages 63-93

  Zaveri, Amrapali ^a   Rula, Anisa ^b   Maurino, Andrea ^b   Pietrobon, Ricardo ^c   Lehmann, Jens ^a   Auer, Sören ^d  

^a UNIVERSITY OF LEIPZIG   (Germany)

^b UNIVERSITY OF MILANO BICOCCA   (Italy)

^c DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^d UNIVERSITY OF BONN   (Germany)

Author keywords

assessment; Data quality; Linked Data; survey

Indexed keywords

EID: 84947747572     PISSN: 15700844     EISSN: 22104968     Source Type: Journal    
DOI: 10.3233/SW-150175     Document Type: Conference Paper

References (65)

1. M. Acosta, A. Zaveri, E. Simperl, D. Kontokostas, S. Auer and J. Lehmann, Crowdsourcing linked data quality assessment, in: Proc. of the 12th International Semantic Web Conference ISWC, H. Alani, L. Kagal, A. Fokoue, P. Groth, C. Biemann, J.X. Parreira, L. Aroyo, N. Noy, C. Welty and K. Janowicz, eds, Lecture Notes in Computer Science, Vol. 8219, Springer, Berlin, Heidelberg, 2013, pp. 260-276.
2. R. Albertoni and A.G. Perez, Assessing linkset quality for complementing third-party datasets, in: Proc. of the Joint EDBT/ICDT 2013 Workshops, G. Guerrini, ed., ACM, New York, NY, USA, 2013, pp. 52-59.
3. F. Baader, C. Diageo, D. McGuinness, D. Nardi and P. Patel-Schneider (eds), The Description Logic Handbook, Cambridge, 2003.
4. C. Batini and M. Scannapieco, Data Quality: Concepts, Methodologies and Techniques, Springer-Verlag, Inc., New York, 2006.
5. C. Batini, C. Cappiello, C. Francalanci and A. Maurino, Methodologies for data quality assessment and improvement, ACM Computing Surveys 41(3) (2009).
6. C. Bizer, Quality-driven information filtering in the context of web-based information systems, PhD thesis, Freie Universität Berlin, March 2007.
7. C. Bizer and R. Cyganiak, Quality-driven information filtering using the WIQA policy framework, Journal of Web Semantics 7(1) (2009), 1-10.
8. J. Bleiholder and F. Naumann, Data fusion, ACM Computing Surveys (CSUR) 41(1) (2008), 1.
9. C. Böhm, F. Naumann, Z. Abedjan, D. Fenz, T. Grütze, D. Hefenbrock, M. Pohl and D. Sonnabend, Profiling linked open data with ProLOD, in: Proc. of the 26th International Conference on Data Engineering, ICDEW, C.S. Jensen and R.J. Miller, eds, IEEE Computer Society, 2010, pp. 175-178.
10. P.A. Bonatti, A. Hogan, A. Polleres and L. Sauro, Robust and scalable linked data reasoning incorporating provenance and trust annotations, Journal of Web Semantics 9(2) (2011), 165-201.
11. M. Bovee, R.P. Srivastava and B. Mak, A conceptual framework and belief-function approach to assessing overall information quality, International Journal of Intelligent Systems 18(1) (2003), 51-74.
12. J.J. Carroll and Signing RDF graphs, in: Proc. of the 2nd International Semantic Web Conference (ISWC), D. Fensel, K. Sycara and J. Mylopoulos, eds, Lecture Notes in Computer Science, Vol. 2870, Springer, Berlin, Heidelberg, 2003, pp. 369-384.
13. P. Chen and W. Garcia, Hypothesis generation and data quality assessment through association mining, in: Proc. of the 9th IEEE International Conference on Cognitive Informatics, ICCI, F. Sun, Y. Wang, J. Lu, B. Zhang, W. Kinsner and L.A. Zadeh, eds, IEEE Computer Society, 2010, pp. 659-666.
14. M. Dezani-Ciancaglini, R. Horne and V. Sassone, Tracing where and who provenance in linked data: a calculus, Theoretical Computer Science 464 (2012), 113-129.
15. L. Ding and T. Finin, Characterizing the semantic web on the web, in: Proc. of the 5th International Semantic Web Conference, ISWC, I. Cruz, S. Decker, D. Allemang, C. Priest, D. Schwabe, P. Mika, M. Uschold and L. Aroyo, eds, Lecture Notes in Computer Science, Vol. 4273, Springer, Berlin, Heidelberg, 2006, pp. 242-257.
16. K.C. Feeney, D. O'Sullivan,W. Tai and R. Brennan, Improving curated web-data quality with structured harvesting and assessment, International Journal on Semantic Web and Information Systems 10(2) (2014), 35-62.
17. A. Flemming, Qualitätsmerkmale von Linked Dataveröffentlichenden Datenquellen. Diplomarbeit (Quality Criteria for Linked Data Sources), 2011, https://cs.uwaterloo.ca/~ohartig/files/DiplomarbeitAnnikaFlemming.pdf.
18. C. Fürber andM. Hepp, SWIQA - a semantic web information quality assessment framework, in: Proc. of the 19th European Conference on Information Systems (ECIS), V.K. Tuunainen, M. Rossi and J. Nandhakumar, eds, Vol. 15, IEEE Computer Society, 2011, pp. 19-30.
19. M. Gamble and C. Goble, Quality, trust, and utility of scientific data on the web: towards a joint model, in: Proc. of the 3rd International Web Science Conference, D. De Roure and S. Poole, eds, ACM, New York, NY, USA, June 2011, pp. 1-8.
20. Y. Gil and D. Artz, Towards content trust of web resources, Web Semantics 5(4) (December 2007), 227-239.
21. Y. Gil and V. Ratnakar, Trusting information sources one citizen at a time, in: Proc. of the 1st International Semantic Web Conference, ISWC, M. Klusch, S. Ossowski, A. Omicini and H. Laamanen, eds, Lecture Notes in Computer Science, Vol. 2342, Springer, Berlin, Heidelberg, 2002, pp. 162-176.
22. J. Golbeck, Using trust and provenance for content filtering on the semantic web, in: Workshop on Models of Trust for the Web, MTW, T. Finin, L. Kagal and D. Olmedilla, eds, CEUR Workshop Proceedings, Vol. 190, 2006.
23. J. Golbeck, B. Parsia and J. Hendler, Trust networks on the semantic web, in: Proc. of the 7th International Workshop Cooperative Information Agents, CIA, M. Klusch, A. Omicini, S. Ossowski and H. Laamanen, eds, Lecture Notes in Computer Science, Vol. 2782, Springer, Berlin, Heidelberg, 2003, pp. 238-249.
24. C. Guéret, P. Groth, C. Stadler and J. Lehmann, Assessing linked data mappings using network measures, in: Proc. of the 9th International Conference on The Semantic Web: Research and Applications, E. Simperl, P. Cimiano, A. Polleres, O. Corcho and V. Presutti, eds, Lecture Notes in Computer Science, Vol. 7295, Springer, Berlin, Heidelberg, 2012, pp. 87-102.
25. H. Halpin, P. Hayes, J.P. McCusker, D. McGuinness and H.S. Thompson, When owl:sameAs isn't the same: an analysis of identity in linked data, in: Proc. of the 9th International Semantic Web Conference, ISWC, P.F. Patel-Schneider, Y. Pan, P. Hitzler, P. Mika, L. Zhang, J.Z. Pan, I. Horrocks and B. Glimm, eds, Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, 2010, pp. 53-59.
26. O. Hartig, Trustworthiness of data on the web, in: Proc. of the STI Berlin and CSW PhDWorkshop, Co-located with Xinnovations, Berlin, Germany, D. Fensel and E. Simperl, eds, 2008.
27. O. Hartig and J. Zhao, Using web data provenance for quality assessment, in: First International Workshop on the Role of Semantic Web in Provenance Management, J. Freire, P. Missier and S.S. Sahoo, eds, CEUR Workshop Proceedings, Vol. 526, 2009.
28. T. Heath and C. Bizer, Linked data: evolving the web into a global data space, in: Number 1:1 in Synthesis Lectures on the Semantic Web: Theory and Technology, 1st edn, Morgan and Claypool, 2011, pp. 1-136, Chapter 2.
29. A. Hogan, A. Harth, A. Passant, S. Decker and A. Polleres, Weaving the pedantic web, in: 3rd Linked Data on the Web Workshop at WWW, Raleigh, North Carolina, USA, C. Bizer, T. Heath, T. Berners-Lee and M. Hausenblas, eds, CEUR Workshop Proceedings, Vol. 628, 2010.
30. A. Hogan, J. Umbrich, A. Harth, R. Cyganiak, A. Polleres and S. Decker, An empirical survey of linked data conformance, Web Semantics: Science, Services and Agents on the World Wide Web 14 (July 2012), 14-44.
31. I. Jacobi, L. Kagal and A. Khandelwal, Rule-based trust assessment on the semantic web, in: Proc. of the 5th International Conference on Rule-Based Reasoning, Programming, and Applications, N. Bassiliades, G. Governatori and A. Paschke, eds, Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, 2011, pp. 227-241.
32. M. Jarke, M. Lenzerini, Y. Vassiliou and P. Vassiliadis, Fundamentals of Data Warehouses, 2nd edn, Springer Publishing Company, 2010.
33. J.M. Juran, R.S. Bingham and F.M. Gryna, The Quality Control Handbook, 3rd edn, Rainbow-Bridge, 1974.
34. B. Kitchenham, Procedures for performing systematic reviews, Technical report, Joint Technical Report Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1, 2004.
35. S.A. Knight and J. Burn, Developing a framework for assessing information quality on the World Wide Web, Information Science 8 (2005), 159-172.
36. D. Kontokostas, P. Westphal, S. Auer, S. Hellmann, J. Lehmann, R. Cornelissen and A. Zaveri, Test-driven evaluation of linked data quality, in: Proc. of the 23rd International Conference on World Wide Web, WWW, C.-W. Chung, A.Z. Broder, K. Shim and T. Suel, eds, ACM, New York, NY, USA, 2014, pp. 747-758.
37. D. Kopcso, L. Pipino, R. Wang and W. Rybold (eds), Information Quality, Vol. 1, Routledge, 2005.
38. Y.W. Lee, D.M. Strong, B.K. Kahn and R.Y. Wang, AIMQ: a methodology for information quality assessment, Information Management 40(2) (2002), 133-146.
39. J. Lehmann, R. Isele, M. Jakob, A. Jentzsch, D. Kontokostas, P.N. Mendes, S. Hellmann, M. Morsey, P. van Kleef, S. Auer and C. Bizer, DBpedia - a large-scale, multilingual knowledge base extracted from Wikipedia, Semantic Web Journal 6(2) (2013), 167-195.
40. Y. Lei, A. Nikolov, V. Uren and E. Motta, Detecting quality problems in semantic metadata without the presence of a gold standard, in: Workshop on "Evaluation of Ontologies for the Web" (EON) at ISWC, Busan, Korea, R. Garcia-Castro, D. Vrandecic, A. Gómez-Pérez, Y. Sure and Z. Huang, eds, CEUR Workshop Proceedings, Vol. 329, 2007, pp. 51-60.
41. Y. Lei, V. Uren and E. Motta, A framework for evaluating semantic metadata, in: Proc. of 4th International Conference on Knowledge Capture, K-CAP, D. Sleeman and K. Barker, eds, K-CAP 2007, Vol. 8, ACM, New York, NY, USA, 2007, pp. 135-142.
42. H.M. Lewen, Facilitating ontology reuse using user-based ontology evaluation, PhD thesis, Karlsruher Instituts für Technologie (KIT), 2010.
43. D. Maynard, W. Peters and Y. Li, Metrics for evaluation of ontology-based information extraction, in: Workshop on "Evaluation of Ontologies for the Web" (EON) at WWW, Edinburgh, Scotland, D. Vrandecic, M.C. Suárez-Figueroa, A. Gangemi and Y. Sure, eds, CEUR Workshop Proceedings, May 2006.
44. P. Mendes, C. Bizer, Z. Miklos, J.-P. Calbimonte, A. Moraru and G. Flouris, D2.1: conceptual model and best practices for high-quality metadata publishing, Technical report, Planet-Data Deliverable, 2012, Available at http://planet-data.eu/sites/default/files/D2.1.pdf.
45. P. Mendes, H. Mühleisen and C. Bizer, Sieve: linked data quality assessment and fusion, in: Proc. of the 2nd International Workshop on Linked Web Data Management (LWDM 2012) at EDBT 2012, A. Ismail, ed., ACM, New York, NY, USA, March 2012, pp. 116-123.
46. D. Moher, A. Liberati, J. Tetzlaff, D.G. Altman and PRISMA Group, Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement, PLoS Medicine 6(7) (2009).
47. M. Morsey, J. Lehmann, S. Auer, C. Stadler and S. Hellmann, DBpedia and the live extraction of structured data from Wikipedia, Program: Electronic Library and Information Systems 46 (2012), 27.
48. M.-A. Mostafavi, E. Geoffrey and R. Jeansoulin, An ontologybased method for quality assessment of spatial data bases, in: Proc. of the 3rd International Symposium on Spatial Data Quality, Bruck an der Leitha, Austria, A. Frank and E. Grum, eds, GeoInfo Series, 2004, pp. 49-66.
49. F. Naumann, Quality-Driven Query Answering for Integrated Information Systems, LNCS, Vol. 2261, Springer, Berlin, Heidelberg, 2002.
50. H. Paulheim and C. Bizer, Improving the quality of linked data using statistical distributions, International Journal on Semantic Web and Information Systems 10(2) (April 2014), 63-86.
51. L.L. Pipino, Y.W. Lee and R.Y.Wang, Data quality assessment, Communications of the ACM 45(4) (2002).
52. T.C. Redman, Data Quality for the Information Age, 1st edn, Artech House, Inc., USA, 1997.
53. E. Ruckhaus, O. Baldizán and M.-E. Vidal, Analyzing linked data quality with LiQuate, in: On the Move to Meaningful Internet Systems: OTM 2013 Workshops, Y.T. Demey and H. Panetto, eds, Lecture Notes in Computer Science, Vol. 8186, Springer, Berlin, Heidelberg, 2013, pp. 629-638.
54. A. Rula and A. Zaveri, Methodology for assessment of linked data quality, in: Proc. of the 1st Workshop on Linked Data Quality at the 10th International Conference on Semantic Systems, LDQ@SEMANTiCS 2014, Leipzig, Germany, September 2nd, 2014, M. Knuth, D. Kontokostas and H. Sack, eds, CEUR Workshop Proceedings, Vol. 1215, 2014.
55. A. Rula, M. Palmonari, A. Harth, S. Stadtmüller and A. Maurino, On the diversity and availability of temporal information in linked open data, in: Proc. of the 11th International Semantic Web Conference, ISWC, P. Cudré-Mauroux, J. Heflin, E. Sirin, T. Tudorache, J. Euzenat, M. Hauswirth, J.X. Parreira, J. Hendler, G. Schreiber, A. Bernstein and E. Blomqvist, eds, Lecture Notes in Computer Science, Vol. 7649, Springer, Berlin, Heidelberg, 2012, pp. 492-507.
56. A. Rula, M. Palmonari and A. Maurino, Capturing the age of linked open data: towards a dataset-independent framework, in: Proc. of the 6th IEEE International Conference on Semantic Computing, ICSC, IEEE Computer Society, 2012, pp. 218-225.
57. A. Rula, M. Palmonari, A.-C. Ngonga Ngomo, D. Gerber, J. Lehmann and L. Bühmann, Hybrid acquisition of temporal scopes for RDF data, in: Proc. of the 11th International Conference, ESWC, V. Presutti, C. d'Amato, F. Gandon, M. d'Aquin, S. Staab and A. Tordai, eds, Lecture Notes in Computer Science, Vol. 8465, Springer, 2014, pp. 488-503.
58. M. Scannapieco and T. Catarci, Data quality under a computer science perspective, Archivi & Computer 2 (2002), 1-15.
59. S. Shekarpour and S.D. Katebi, Modeling and evaluation of trust with an extension in semantic web, Web Semantics: Science, Services and Agents on the World Wide Web 8(1) (March 2010), 26-36.
60. D. Vrandecic, Ontology evaluation, PhD thesis, Karlsruher Instituts für Technologie (KIT), 2010.
61. Y.Wand and R.Y.Wang, Anchoring data quality dimensions in ontological foundations, Communications of the ACM 39(11) (1996), 86-95.
62. R.Y.Wang,A product perspective on total data quality management, Communications of the ACM 41(2) (Feb 1998), 58-65.
63. R.Y.Wang and D.M. Strong, Beyond accuracy: what data quality means to data consumers, Journal of Management Information Systems 12(4) (1996), 5-33.
64. D. Wienand and H. Paulheim, Detecting incorrect numerical data in DBpedia, in: Proc. of the 11th International Conference, ESWC, V. Presutti, C. d'Amato, F. Gandon, M. d'Aquin, S. Staab and A. Tordai, eds, Lecture Notes in Computer Science, Vol. 8465, Springer, Berlin, Heidelberg, 2014, pp. 504-518.
65. A. Zaveri, D. Kontokostas, M.A. Sherif, L. Bühmann, M. Morsey, S. Auer and J. Lehmann, User-driven quality evaluation of DBpedia, in: Proc. of the 9th International Conference on Semantic Systems, I-SEMANTICS'13, Graz, Austria, September 04-06, M. Sabou, E. Blomqvist, T. Di Noia, H. Sack and T. Pellegrini, eds, ACM, New York, NY, USA, 2013, pp. 97-104.