Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts

PLoS ONE

Volumn 8, Issue 7, 2013, Pages

  See, Linda ^a   Comber, Alexis ^b   Salk, Carl ^a,c   Fritz, Steffen ^a   van der Velde, Marijn ^a   Perger, Christoph ^a,d   Schill, Christian ^e   McCallum, Ian ^a   Kraxner, Florian ^a   Obersteiner, Michael ^a  

^a INTERNATIONAL INSTITUTE FOR APPLIED SYSTEMS ANALYSIS   (Austria)

^b UNIVERSITY OF LEICESTER   (United Kingdom)

^c UNIVERSITY OF COLORADO   (United States)

^d UNIVERSITY OF APPLIED SCIENCES WIENER NEUSTADT   (Austria)

^e UNIVERSITY OF FREIBURG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARTICLE; CROWDSOURCING; HUMAN IMPACT (ENVIRONMENT); IMAGE ANALYSIS; INFORMATION PROCESSING; INTERNET; LAND USE; MATHEMATICAL ANALYSIS; QUALITY CONTROL; REMOTE SENSING;

AGRICULTURE; CONSERVATION OF NATURAL RESOURCES; CROWDSOURCING; ECOSYSTEM; HUMAN ACTIVITIES; HUMANS; INTERNET; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS; TIME FACTORS;

EID: 84881170121     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0069958     Document Type: Article

References (24)

1. Goodchild MF, Li L, (2012) Assuring the quality of volunteered geographic information. Spatial Statistics 1: 110-120 doi:10.1016/j.spasta.2012.03.002.
2. Schuurman N, (2009) The new Brave NewWorld: geography, GIS, and the emergence of ubiquitous mapping and data. Environment and Planning D: Society and Space 27: 571-580.
3. Miller-Rushing A, Primack R, Bonney R, (2012) The history of public participation in ecological research. Frontiers in Ecology and the Environment 10: 285-290 doi:10.1890/110278.
4. Khatib F, DiMaio F, (2011) Group FC, Group FVC, Cooper S, et al (2011) Crystal structure of a monomeric retroviral protease solved by protein folding game players. Nature Structural & Molecular Biology 18: 1175-1177 doi:10.1038/nsmb.2119.
5. Clery D, (2011) Galaxy Zoo Volunteers Share Pain and Glory of Research. Science 333: 173-175 doi:10.1126/science.333.6039.173.
6. Nayar A (2009) Model predicts future deforestation. Nature News. Available: http://www.nature.com/news/2009/091120/full/news.2009.1100.html. Accessed 11 February 2013.
7. Milčinski G (2011) The rise of crowd-sourcing: how valuable data can we get out of VGI Amsterdam, Netherlands.
8. Preis T, Moat HS, Stanley HE, Bishop SR (2012) Quantifying the advantage of looking forward. Scientific Reports 2. Available: http://www.nature.com/doifinder/10.1038/srep00350. Accessed 18 May 2013.
9. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, et al. (2009) Detecting influenza epidemics using search engine query data. Nature 457: 1012-1014 doi:10.1038/nature07634.
10. Van der Velde M, See L, Fritz S, Verheijen FGA, Khabarov N, et al. (2012) Generating crop calendars with Web search data. Environmental Research Letters 7: 024022 doi:10.1088/1748-9326/7/2/024022.
11. Haklay M, Basiouka S, Antoniou V, Ather A, (2010) How Many Volunteers Does it Take to Map an Area Well? The Validity of Linus' Law to Volunteered Geographic Information. The Cartographic Journal 47: 315-322.
12. Comber A, See L, Fritz S, Van der Velde M, Perger C, et al. (2013) Using control data to determine the reliability of volunteered geographic information about land cover. International Journal of Applied Earth Observation and Geoinformation 23: 37-48 doi:10.1016/j.jag.2012.11.002.
13. Foody GM, Boyd D (2012) Using volunteered data in land cover map validation: Mapping tropical forests across West Africa 2368-2371.
14. Fritz S, McCallum I, Schill C, Perger C, Grillmayer R, et al. (2009) Geo-Wiki.Org: The Use of Crowdsourcing to Improve Global Land Cover. Remote Sensing 1: 345-354 doi:10.3390/rs1030345.
15. Fritz S, McCallum I, Schill C, Perger C, See L, et al. (2012) Geo-Wiki: An online platform for improving global land cover. Environmental Modelling & Software 31: 110-123 doi:10.1016/j.envsoft.2011.11.015.
16. Bonney R, Ballard H, Jordan R, McCallie E, Phillips T, et al. (2009) Public Participation in Scientific Research: Defining the Field and Assessing its Potential for Informal Science Education. A CAISE Inquiry Group Report. Washington DC: Center for Advancement of Informal Science Education (CAISE). Available: http://caise.insci.org/uploads/docs/PPSR%20report%20FINAL.pdf.
17. Fritz S, See L, (2005) Comparison of land cover maps using fuzzy agreement. International Journal of Geographical Information Science 19: 787-807 doi:10.1080/13658810500072020.
18. See LM, Fritz S, (2006) A method to compare and improve land cover datasets: application to the GLC-2000 and MODIS land cover products. IEEE Transactions on Geoscience and Remote Sensing 44: 1740-1746 doi:10.1109/TGRS.2006.874750.
19. Fritz S, See L, McCallum I, Schill C, Obersteiner M, et al. (2011) Highlighting continued uncertainty in global land cover maps for the user community. Environmental Research Letters 6: 044005 doi:10.1088/1748-9326/6/4/044005.
20. Fritz S, See L, Van der Velde M, Nalepa RA, Perger C, et al. (2013) Downgrading recent estimates of land available for biofuel production. Environ Sci Technol 47: 1688-1694 doi:10.1021/es303141h.
21. Theobald DM, (2004) Placing exurban land-use change in a human modification framework. Frontiers in Ecology and the Environment 2: 139-144 doi:[];10.1890/1540-9295(2004)002[0139:PELCIA]2.0.CO;2.
22. Perger C, Fritz S, See L, Schill C, Van der Velde M, et al. (2012) A campaign to collect volunteered geographic Information on land cover and human impact. In: Jekel T, Car A, Strobl J, Griesebner G, editors. GI_Forum 2012: Geovisualisation, Society and Learning. Berlin/Offenbach: Herbert Wichmann Verlag. 83-91.
23. Lopresti D, Nagy G, (2002) Issues in ground-truthing graphic documents. In: Blostein D, Kwon Y-B, editors. GREC 2001. LCNS. Heidelberg: Springer, Vol. 2390: 46-66.
24. Bonter DN, Cooper CB, (2012) Data validation in citizen science: a case study from Project FeederWatch. Frontiers in Ecology and the Environment 10: 305-307 doi:10.1890/110273.