On data quality assurance and conflation entanglement in crowdsourcing for environmental studies

ISPRS International Journal of Geo-Information

Volumn 6, Issue 3, 2017, Pages

  Leibovici, Didier G ^a   Rosser, Julian F ^a   Hodges, Crona ^b   Evans, Barry ^c   Jackson, Michael J ^a   Higgins, Chris I ^d  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

^b ABERYSTWYTH UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF EXETER   (United Kingdom)

^d UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Citizen science; Crowdsourcing; Data conflation; Data curation; Data fusion; Data quality; ISO standard

Indexed keywords

EID: 85026412550     PISSN: None     EISSN: 22209964     Source Type: Journal    
DOI: 10.3390/ijgi6030078     Document Type: Article

References (43)

1. Craglia, M.; Shanley, L. Data democracy—Increased supply of geospatial information and expanded participatory processes in the production of data. Int. J. Dig. Earth 2015, 8, 679–693. [CrossRef]
2. Haklay, M. Citizen Science and Policy: A European Perspective; Woodrow Wilson International Center for Scholars: Washington, DC, USA, 2015.
3. Pocock, M.J.O.; Chapman, D.S.; Sheppard, L.J.; Roy, H.E. A Strategic Framework to Support the Implementation of Citizen Science for Environmental Monitoring; Final Report to SEPA; Centre for Ecology & Hydrology: Wallingford, Oxfordshire, UK, 2014.
4. Flanagin, A.J.; Metzger, M.J. The credibility of volunteered geographic information. GeoJournal 2008, 72, 137–148. [CrossRef]
5. Fowler, A.; Whyatt, J.D.; Davies, G.; Ellis, R. How Reliable Are Citizen-derived Scientific Data? Assessing the Quality of Contrail Observations Made by the General Public. Trans. GIS 2013, 17, 488–506. [CrossRef]
6. Alabri, A.; Hunter, J. Enhancing the Quality and Trust of Citizen Science Data. In Proceedings of the 2010 IEEE Sixth International Conference on e-Science (e-Science), Bribane, Australia, 7–10 December 2010.
7. Bordogna, G.; Carrara, P.; Criscuolo, L.; Pepe, M.; Rampini, A. On predicting and improving the quality of Volunteer Geographic Information projects. Int. J. Dig. Earth 2016, 9, 134–155. [CrossRef]
8. Goodchild, M.F.; Li, L. Assuring the quality of volunteered geographic information. Spat. Stat. 2012, 1, 110–120. [CrossRef]
9. Leibovici, D.G.; Williams, J.; Rosser, J.F.; Hodges, C.; Scott, D.; Chapman, C.; Higgins, C.; Jackson, M.J. Earth Observation for Citizen Science validation, or, Citizen Science for Earth Observation validation? Role of the Quality Assurance of Volunteered Observations. J. Spat. Inf. Sci. 2017, submitted.
10. Meek, S.; Jackson, M.; Leibovici, D.G. A flexible framework for assessing the quality of crowdsourced data. In Proceedings of the AGILE 2014 Conference, Castellon, Spain, 3–6 June 2014.
11. Higgins, C.I.; Williams, J.; Leibovici, D.G.; Simonis, I.; Davis, M.J.; Muldoon, C.; van Gneuchten, P.; O’Hare, G. Citizen OBservatory WEB (COBWEB): A Generic Infrastructure Platform to Facilitate the Collection of Citizen Science data for Environmental Monitoring. Int. J. Spat. Data Infrastruct. Res. 2016, 11, 20–48.
12. Jackson, M.; Meek, S.; Leibovici, D.G. NSDI data enhancement through crowdsourcing: The role of quality assurance to ensure effective conflation of authoritative and non-authoritative data sources. In Proceedings of the INSPIRE Conference, Aalborg University, Aalborg, Denmark, 16–20 June 2014.
13. Leibovici, D.G.; Evans, B.; Hodges, C.; Wiemann, S.; Meek, S.; Rosser, J.; Jackson, M. On Data Quality Assurance and Conflation Entanglement in Crowdsourcing for Environmental Studies. In Proceedings of the ISSDQ 2015, ISPRS Geospatial Week, La Grande-Motte, France, 29–30 September 2015.
14. Wiemann, S.; Bernard, L. Conflation Services within Spatial Data Infrastructure. In Proceedings of the AGILE 2010 Conference, Guimaraes, Portugal, 11–14 May 2010.
15. Wiemann, S.; Meek, S.; Leibovici, D.G.; Jackson, M.; Chapman, C.; Lars, B. Service-based combination of quality assurance and fusion processes for the validation of crowdsourced observations. In Proceedings of the AGILE 2015 Conference, Lisbon, Portugal, 9–12 June 2015.
16. Meek, S.; Priestnall, G.; Sharples, M.; Goulding, J. Mobile capture of remote points of interest using line of sight modelling. Comput. Geosci. 2013, 52, 334–344. [CrossRef]
17. Comber, A.; See, L.; Fritz, S.; Van der Velde, M.; Perger, C.; Foody, G.M. Using control data to determine the reliability of volunteered geographic information about land cover. Int. J. Appl. Earth Obs. Geoinf. 2013, 23, 37–48. [CrossRef]
18. Foody, G.M.; See, L.; Fritz, S.; van der Velde, M.; Perger, C.; Schill, C.; Boyd, D.S. Assessing the Accuracy of Volunteered Geographic Information arising from Multiple Contributors to an Internet Based Collaborative Project. Trans. GIS 2013, 17, 847–860. [CrossRef]
19. Foody, G.M.; See, L.; Fritz, S.; van der Velde, M.; Perger, C.; Schill, C.; Boyd, D.S.; Comber, A. Accurate Attribute Mapping from Volunteered Geographic Information: Issues of Volunteer Quantity and Quality. Cartogr. J. 2015, 52, 336–344. [CrossRef]
20. See, L.; Comber, A.; Salk, C.; Fritz, S.; van der Velde, M.; Perger, C.; Schill, C.; McCallum, I.; Kraxner, F.; Obersteiner, M. Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts. PLoS ONE 2013, 8, e69958. [CrossRef] [PubMed]
21. Fritz, S.; McCallum, I.; Schill, C.; Perger, C.; See, L.; Schepaschenko, D.; van der Velde, M.; Kraxner, F.; Obersteiner, M. Geo-Wiki: An online platform for improving global land cover. Environ. Model. Softw. 2012, 31, 110–123. [CrossRef]
22. Van Smeden, M.; Naaktgeboren, C.A.; Reitsma, J.B.; Moons, K.G.M.; de Groot, J.A.H. Latent class models in diagnostic studies when there is no reference standard—A systematic review. Am. J. Epidemiol. 2014, 179, 423–431. [CrossRef] [PubMed]
23. Smith, L.; Liang, Q.; James, P.; Lin, W. Assessing the utility of social media as a data source for flood risk management using a real-time modelling framework. J. Flood Risk Manag. 2015. [CrossRef]
24. Leibovici, D.G.; Rosser, J.F. Multiway sensitivity analysis of the fusion of earth observation, topography and social media data for rapid flood mapping Spatial Accuracy. In Proceedings of the 12th International Symposium, Montpellier, France, 5–8 July 2016.
25. Rosser, J.F.; Jackson, M.J.; Leibovici, D.G. Rapid flood inundation mapping using social media, remote sensing and topographic data. Nat. Hazards 2017. [CrossRef]
26. Evans, B.; Brewer, P.; O’Grady, M.; Muldoon, C.; O’Hare, G. Deriving fuzzy flood extents from geo-tagged photographs using Boolean models and smartphone technology. In Proceedings of the COWM2016—International Conference on Citizen Observatories for Water Management, Venice, Italy, 7–9 June 2016.
27. Krupka, M.; Pender, G.; Wallis, S.; Sayers, P.B.; Mulet-Marti, J. A Rapid Flood Inundation Model. In Proceedings of the 32th IAHR Congress, Venice, Italy, 1–6 July 2007.
28. Antelio, M.; Esteves, M.G.P.; Schneider, D.; de Souza, J.M. Qualitocracy: A data quality collaborative framework applied to citizen science. In Proceedings of the 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Seoul, Korea, 14–17 October 2012.
29. Haklay, M. How good is volunteered geographical information? A comparative study of OpenStreetMap and Ordnance Survey datasets. Environ. Plan. B Plan. Des. 2010, 37, 682. [CrossRef]
30. Hunter, J.; Alabri, A.; van Ingen, C. Assessing the quality and trustworthiness of citizen science data. Concurr. Computat. Pract. Exp. 2013, 25, 454–466. [CrossRef]
31. Wamcke-Wang, M.; Ayukaev, V.R.; Hecht, B.; Terveen, L.G. The Success and Failure of Quality Improvement Projects in Peer Production Communities. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW’15, Vancouver, BC, Canada, 14–18 March 2015.
32. Sullivan, B.L.; Wood, C.L.; Iliff, M.J.; Bonney, R.E.; Fink, D.; Kelling, S. eBird: A citizen-based bird observation network in the biological sciences. Biol. Conserv. 2009, 142, 2282–2292. [CrossRef]
33. Wiggins, A.; Crowston, K. From conservation to crowdsourcing: A typology of citizen science. In Proceedings of the 44th Hawaii International Conference on System Sciences (HICSS), Kauai, HI, USA, 4–7 January 2011.
34. Mobasheri, A.; Zipf, A.; Bakillah, M.; Liang, S.H. QualEvS4Geo: A peer-to-peer system architecture for semi-automated quality evaluation of geo-data in SDI. In Proceedings of the Third International Conference on Innovative Computing Technology (INTECH), London, UK, 29–31 August 2013.
35. Fonte, C.C.; Bastin, L.; Foody, G.; Kellenberger, T.; Kerle, N.; Mooney, P.; Olteanu-Raimond, A.-M.; See, L. VGI quality control. In Proceedings of the ISPRS Geospatial Week, La Grande-Motte, France, 29–30 September 2015; pp. 317–324.
36. Bishr, M.; Kuhn, W. Trust and Reputation Models for Quality Assessment of Human Sensor Observations. In Spatial Information Theory, Lecture Notes in Computer Science; Tenbrink, T., Stell, J., Galton, A., Wood, Z., Eds.; Springer International Publishing: Berlin, Germany, 2013; pp. 53–73.
37. Zhao, Y.; Zhou, X.; Li, G.; Xing, H. A Spatio-Temporal VGI Model Considering Trust-Related Information. ISPRS Int. J. Geo Inf. 2016, 5, 10. [CrossRef]
38. Chapman, C.; Hodges, C. Can Citizen Science Seriously Contribute to Policy Development? A Decision Maker’s View. In Analyzing the Role of Citizen Science in Modern Research; Ceccaroni, L., Piera, J., Eds.; IGI-Global: Hershey, PA, USA, 2016.
39. Tweddle, J.C.; Robinson, L.D.; Pocock, M.J.O.; Roy, H.E. Guide to Citizen Science: Developing, Implementing and Evaluating Citizen Science to Study Biodiversity and the Environment in the UK; Natural History Museum and NERC Centre for Ecology & Hydrology for UK-EOF: London, UK, 2012.
40. Pawlowicz, S.; Leibovici, D.G.; Haines-Young, R.; Saull, R.; Jackson, M.J. Dynamical Surveying Adjustments for Crowd-sourced Data Observations. In Proceedings of the EnviroInfo Conference, Ispra, Italy, 5–7 October 2011.
41. Victor, S. Dynamic Model-Based Validation of Crowd-Sourced Data. Ph.D. Thesis, University of Nottingham, Nottingham, UK, 2014.
42. Hedges, L.V.; Olkin, I. Statistical Method for Meta-Analysis; Academic Press: New York, NY, USA, 1985.
43. Nazir, S.; Hunter, K.; Forrest, C.; Kristofferson, K. Crowd Power: The COBWEB Guide to Citizen Science; Lothian, J., Osborne, N., Eds.; Collection BHP Comics, Black Hearted Press Ltd.: Glasgow, UK, 2016.