Community-based data validation practices in citizen science

Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Volumn 27, Issue , 2016, Pages 1548-1559

  Wiggins, Andrea ^a   He, Yurong ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Citizen science; Data quality; Data validation; Information assessability; Open collaboration

Indexed keywords

COMPUTER SUPPORTED COOPERATIVE WORK; DATA REDUCTION; INTERACTIVE COMPUTER SYSTEMS; MOBILE DEVICES; QUALITY MANAGEMENT;

CITIZEN SCIENCE; DATA QUALITY; DATA VALIDATION; INFORMATION ASSESSABILITY; OPEN COLLABORATION;

GROUPWARE;

EID: 84963625787     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2818048.2820063     Document Type: Conference Paper

References (47)

1. Tammy D. Allen, Stacy E. McManus, and Joyce E.A. Russell. 1999. Newcomer socialization and stress: Formal peer relationships as a source of support. Journal of Vocational Behavior 54, 3 (1999), 453-470. DOI: http://dx.doi.org/10.1006/jvbe.1998.1674.
2. Rick Bonney, Jennifer L. Shirk, Tina B. Phillips, Andrea Wiggins, Heidi L. Ballard, Abraham J. Miller-Rushing, and Julia K. Parrish. 2014. Next steps for citizen science. Science 343, 6178 (2014), 1436-1437. DOI: http://dx.doi.org/10.1126/science.1251554.
3. David N. Bonter and Caren B. Cooper. 2012. Data validation in citizen science: A case study from Project FeederWatch. Frontiers in Ecology and the Environment 10, 6 (2012), 305-307. DOI: http://dx.doi.org/10.1890/110273.
4. Anne E. Bowser, Derek L. Hansen, Jocelyn Raphael, Matthew Reid, Ryan J. Gamett, Yurong He, Dana Rotman, and Jenny J. Preece. 2013. Prototyping in PLACE: A Scalable Approach to Developing Location-based Apps and Games. In Proc. CHI. ACM, 1519-1528. DOI: http://dx.doi.org/10.1145/2470654.2466202.
5. Anne E. Bowser and Andrea Wiggins. 2015. Privacy in Participatory Research: Advancing Policy to support Human Computation. Human Computation 2, 1 (2015), 19-44. DOI:http://dx.doi.org/10.15346/hc.v2i1.3.
6. Caren B. Cooper, Jennifer Shirk, and Benjamin Zuckerberg. 2014. The Invisible Prevalence of Citizen Science in Global Research: Migratory Birds and Climate Change. Plos One 9, 9 (09 2014), e106508. DOI: http://dx.doi.org/10.1371/journal.pone.0106508.
7. Dan Cosley, Dan Frankowski, Sara Kiesler, Loren Terveen, and John Riedl. 2005. How Oversight Improves Member-maintained Communities. In Proc. CHI. ACM, 11-20. DOI: http://dx.doi.org/10.1145/1054972.1054975.
8. Janis L. Dickinson, Benjamin Zuckerberg, and David N. Bonter. 2010. Citizen Science as an Ecological Research Tool: Challenges and Benefits. Annual Review of Ecology, Evolution, and Systematics 41, 1 (2010), 149-172. DOI:http://dx.doi.org/10.1146/annurev-ecolsys-102209-144636.
9. Alexandra Eveleigh, Charlene Jennett, Ann Blandford, Philip Brohan, and Anna L. Cox. 2014. Designing for Dabblers and Deterring Drop-outs in Citizen Science. In Proc. CHI. ACM, 2985-2994. DOI: http://dx.doi.org/10.1145/2556288.2557262.
10. Jerry Alan Fails, Katherine G. Herbert, Emily Hill, Christopher Loeschorn, Spencer Kordecki, David Dymko, Andrew DeStefano, and Zill Christian. 2014. GeoTagger: A Collaborative and Participatory Environmental Inquiry System. In CSCW Companion. ACM, 157-160. DOI: http://dx.doi.org/10.1145/2556420.2556481.
11. Andrea Forte, Nazanin Andalibi, Thomas Park, and Heather Willever-Farr. 2014. Designing Information Savvy Societies: An Introduction to Assessability. In Proc. CHI. ACM, 2471-2480. DOI:http://dx.doi.org/10.1145/2556288.2557072.
12. Judy Foster-Smith and Stewart M. Evans. 2003. The value of marine ecological data collected by volunteers. Biological Conservation 113, 2 (2003), 199 - 213. DOI: http://dx.doi.org/10.1016/S0006-3207(02)00373-7.
13. Dale L. Goodhue and Ronald L. Thompson. 1995. Task-Technology Fit and Individual Performance. MIS Quarterly 19, 2 (1995), 213-236. DOI: http://dx.doi.org/10.2307/249689.
14. Eric A. Graham, Sandra Henderson, and Annette Schloss. 2011. Using mobile phones to engage citizen scientists in research. Eos, Transactions American Geophysical Union 92, 38 (2011), 313-315. DOI: http://dx.doi.org/10.1029/2011EO380002.
15. Robert P. Guralnick, Andrew W. Hill, and Meredith Lane. 2007. Towards a collaborative, global infrastructure for biodiversity assessment. Ecology Letters 10, 8 (2007), 663-672. DOI:http://dx.doi.org/10.1111/j.1461-0248.2007.01063.x.
16. James William Hardin, Joseph M Hilbe, and Joseph Hilbe. 2007. Generalized linear models and extensions. Stata Press.
17. Caroline Haythornthwaite. 2009. Crowds and Communities: Light and Heavyweight Models of Peer Production. In HICSS. IEEE, 1-10. DOI: http://dx.doi.org/10.1109/HICSS.2009.137.
18. Benjamin K. Haywood. 2015. Beyond Data Points and Research Contributions: The Personal Meaning and Value Associated with Public Participation in Scientific Research. International Journal of Science Education, Part B 0, 0 (2015), 1-24. DOI: http://dx.doi.org/10.1080/21548455.2015.1043659.
19. Wesley M. Hochachka, Daniel Fink, Rebecca A. Hutchinson, Daniel Sheldon, Weng-Keen Wong, and Steve Kelling. 2012. Data-intensive science applied to broad-scale citizen science. Trends in Ecology & Evolution 27, 2 (2012), 130 - 137. DOI: http://dx.doi.org/10.1016/j.tree.2011.11.006.
20. James Howison and Kevin Crowston. 2014. Collaboration through open superposition: A theory of the open source way. Mis Quarterly 38, 1 (2014), 29-50.
21. James Howison, Kevin Crowston, and Andrea Wiggins. 2011. Validity issues in the use of social network analysis with digital trace data. Journal of the Association for Information Systems 12 (2011).
22. Justin P. Johnson. 2006. Collaboration, peer review and open source software. Information Economics and Policy 18, 4 (2006), 477 - 497. DOI:http://dx.doi.org/10.1016/j.infoecopol.2006.07.001.
23. Joseph M. Juran and A. Balton Godfrey. 1998. Quality handbook (5th ed.). McGraw-Hill, USA.
24. Steve Kelling, Carl Lagoze, Wong Weng-Keen, Jun Yu, Theodoros Damoulas, Jeff Gerbracht, Daniel Fink, and Carla Gomes. 2013. eBird: A Human/Computer Learning Network to Improve Biodiversity Conservation and Research. AI Magazine 34, 1 (2013), 10 - 20.
25. Sunyoung Kim, Jennifer Mankoff, and Eric Paulos. 2013. Sensr: Evaluating a Flexible Framework for Authoring Mobile Data-collection Tools for Citizen Science. In Proc CSCW. ACM, 1453-1462. DOI: http://dx.doi.org/10.1145/2441776.2441940.
26. Carl Lagoze. 2014. eBird: Curating Citizen Science Data for Use by Diverse Communities. International Journal of Digital Curation 9, 1 (2014), 71-82.
27. Anna Lawrence. 2006.'No Personal Motive' Volunteers, Biodiversity, and the False Dichotomies of Participation. Ethics, Place & Environment 9, 3 (2006), 279-298. DOI: http://dx.doi.org/10.1080/13668790600893319.
28. Ko Ko Lwin and Yuji Murayama. 2011. Web-based GIS System for real-time field data collection using personal mobile phone. Journal of Geographic Information System 3, 04 (2011), 382.
29. Camilo Mora, Derek P. Tittensor, Sina Adl, Alastair G. B. Simpson, and Boris Worm. 2011. How Many Species Are There on Earth and in the Ocean Plos Biol 9, 8 (2011), e1001127. DOI: http://dx.doi.org/10.1371/journal.pbio.1001127.
30. Lev Muchnik, Sinan Aral, and Sean J Taylor. 2013. Social influence bias: A randomized experiment. Science 341, 6146 (2013), 647-651.
31. Gabriel Mugar, Carsten Østerlund, Katie DeVries Hassman, Kevin Crowston, and Corey Brian Jackson. 2014. Planet Hunters and Seafloor Explorers: Legitimate Peripheral Participation Through Practice Proxies in Online Citizen Science. In Proc CSCW. ACM, 109-119. DOI:http://dx.doi.org/10.1145/2531602.2531721.
32. Greg Newman, Andrea Wiggins, Alycia Crall, Eric Graham, Sarah Newman, and Kevin Crowston. 2012. The future of citizen science: Emerging technologies and shifting paradigms. Frontiers in Ecology and the Environment 10, 6 (2012), 298-304.
33. Myle Ott, Claire Cardie, and Jeff Hancock. 2012. Estimating the Prevalence of Deception in Online Review Communities. In Proc WWW. ACM, 201-210. DOI:http://dx.doi.org/10.1145/2187836.2187864.
34. Nathan Prestopnik and Kevin Crowston. 2012. Purposeful Gaming & Socio-computational Systems: A Citizen Science Design Case. In Proc Group. ACM, 75-84. DOI: http://dx.doi.org/10.1145/2389176.2389188.
35. personenvironment.
36. Leslie Ries and Karen Oberhauser. 2015. A Citizen Army for Science: Quantifying the Contributions of Citizen Scientists to our Understanding of Monarch Butterfly Biology. BioScience 65, 4 (2015), 419-430.
37. Christine Robson. 2012. Using Mobile Technology and Social Networking to Crowd source Citizen Science. Ph.D. Dissertation. UC Berkeley, Berkeley, CA.
38. Dana Rotman, Jenny Preece, Jen Hammock, Kezee Procita, Derek Hansen, Cynthia Parr, Darcy Lewis, and David Jacobs. 2012. Dynamic Changes in Motivation in Collaborative Citizen-science Projects. In Proc CSCW. ACM, 217-226. DOI: http://dx.doi.org/10.1145/2145204.2145238.
39. S. Andrew Sheppard and Loren Terveen. 2011. Quality is a Verb: The Operationalization of Data Quality in a Citizen Science Community. In Proc WikiSym. ACM, 29-38. DOI: http://dx.doi.org/10.1145/2038558.2038565.
40. S. Andrew Sheppard, Andrea Wiggins, and Loren Terveen. 2014. Capturing Quality: Retaining Provenance for Curated Volunteer Monitoring Data. In Proc CSCW. ACM, 1234-1245. DOI: http://dx.doi.org/10.1145/2531602.2531689.
41. Jonathan Silvertown, Martin Harvey, Richard Greenwood, Mike Dodd, Jon Rosewell, Tony Rebelo, Janice Ansine, and Kevin McConway. 2015. Crowdsourcing the identification of organisms: A case-study of iSpot. ZooKeys 480 (2015), 125. DOI: http://dx.doi.org/10.3897/zookeys.480.8803.
42. Matthias Stevens, Michalis Vitos, Julia Altenbuchner, Gillian Conquest, Jessica Lewis, and Muk Haklay. 2014. Taking Participatory Citizen Science to Extremes. Pervasive Computing, IEEE 13, 2 (2014), 20-29. DOI: http://dx.doi.org/10.1109/MPRV.2014.37.
43. Brian L. Sullivan, Christopher L. Wood, Marshall J. Iliff, Rick E. Bonney, Daniel Fink, and Steve Kelling. 2009. eBird: A citizen-based bird observation network in the biological sciences. Biological Conservation 142, 10 (2009), 2282 - 2292. DOI: http://dx.doi.org/10.1016/j.biocon.2009.05.006.
44. Abbas Tashakkori and Charles Teddlie. 1998. Mixed methodology: Combining qualitative and quantitative approaches. Vol. 46. Sage.
45. Jacob Theodore, Daniel L. Tennenbaum, and Gloria Krahn. 1987. Factors Influencing the Reliability and Validity of Observation Data. In Family Interaction and Psychopathology, Jacob Theodore (Ed.). Springer US, 297-328. DOI: http://dx.doi.org/10.1007/978-1-4899-0840-7-8.
46. Andrea Wiggins. 2013. Free As in Puppies: Compensating for Ict Constraints in Citizen Science. In Proc CSCW. ACM, 1469-1480. DOI: http://dx.doi.org/10.1145/2441776.2441942.
47. Andrea Wiggins and Kevin Crowston. 2015. Surveying the citizen science landscape. First Monday 20, 1 (2015). DOI:http://dx.doi.org/10.5210/fm.v20i1.5520.