Defining and Measuring Success in Online Citizen Science: A Case Study of Zooniverse Projects

Computing in Science and Engineering

Volumn 17, Issue 4, 2015, Pages 28-41

  Cox, Joe ^a   Oh, Eun Young ^a   Simmons, Brooke ^b   Lintott, Chris ^b   Masters, Karen ^c   Greenhill, Anita ^d   Graham, Gary ^e   Holmes, Kate ^d  

^a UNIVERSITY OF PORTSMOUTH   (United Kingdom)

^b UNIVERSITY OF OXFORD   (United Kingdom)

^c UNIVERSITY OF PORTSMOUTH   (United Kingdom)

^d UNIVERSITY OF MANCHESTER   (United Kingdom)

^e UNIVERSITY OF LEEDS   (United Kingdom)

Author keywords

citizen science; metrics; online; project outcomes; scientific computing; success factors; Zooniverse

Indexed keywords

EID: 84934297712     PISSN: 15219615     EISSN: None     Source Type: Journal    
DOI: 10.1109/MCSE.2015.65     Document Type: Article

References (29)

1. J. Silvertown, "A New Dawn for Citizen Science, " Trends in Ecology & Evolution, vol. 24, no. 9, 2009, pp. 467-471.
2. A. Greenhill et al., "Playing with Science: Gamised Aspects of Gamifcation Found on the Online Citizen Science Project Zooniverse, " GAME-ON 2014, P. Dickinson, ed., Univ. Lincoln, 2014, pp. 15-24.
3. L. Fortson et al., "Galaxy Zoo: Morphological Clas-sifcation and Citizen Science, " Advances in Machine Learning and Data Mining for Astronomy, CRC Press, Taylor & Francis Group, 2012, pp. 213-236.
4. C.J. Lintott et al., "Galaxy Zoo: Morphologies Derived from Visual Inspection of Galaxies from the Sloan Digital Sky Survey, " Monthly Notices of the Royal Astronomical Soc., vol. 389, no. 3, 2008, pp. 1179-1189.
5. A. Wiggins and K. Crowston, "Developing a Conceptual Model of Virtual Organisations for Citizen Science, " Int' l J. Organisational Design and Eng., vol. 1, no. 1, 2010, pp. 148-162.
6. A. Wiggins and K. Crowston, "From Conservation to Crowdsourcing: A Typology of Citizen Science, " Proc. 44th Hawaii Int' l Conf. System Science, 2011, pp. 1-10.
7. A. Wiggins and K. Crowston, "Goals and Tasks: Two Typologies of Citizen Science Projects, " Proc. 45th Hawaii Int' l Conf. System Science, 2012, pp. 3426-3435.
8. J.P. Cohn, "Citizen Science: Can Volunteers Do Real Research?, " BioScience, vol. 58, no. 3, 2008, pp. 192-197.
9. S.B. Cashman et al., "Te Power and the Promise: Working with Communities to Analyze Data, Interpret Findings, and Get to Outcomes, " Am. J. Public Health, vol. 98, no. 8, 2008, pp. 1407-1417.
10. M.M. Gardiner et al., "Lessons from Lady Beetles: Accuracy of Monitoring Data from US and UK Citizen-Science Programs, " Frontiers in Ecology and the Environment, vol. 10, no. 9, 2012, pp. 471-476.
11. S.A. Sheppard and L. Terveen, "Quality Is a Verb: Te Operationalization of Data Quality in a Citizen Science Community, " Proc. 7th Int'l Symp. Wikis and Open Collaboration, 2011, pp. 29-38.
12. C.J. Lortie et al., "Do Citations and Impact Factors Relate to the Real Numbers in Publications? A Case Study of Citation Rates, Impact and Efect Sizes in Ecology and Evolutionary Biology, " Scientometrics, vol. 94, 2013, pp. 675-682.
13. R. Bonney et al., "Citizen Science: A Developing Tool for Expanding Science Knowledge and Scien-tifc Literacy, " BioScience, vol. 59, no. 11, 2009, pp. 977-984.
14. M.J. Raddick et al., "Citizen Science: Status and Research Directions for the Coming Decade, " AGB Stars and Related Phenomenastro 2010: Te Astronomy and Astrophysics Decadal Survey, 2009.
15. D. Rotman et al., "Dynamic Changes in Motivation in Collaborative Citizen-Science Projects, " Proc. ACM Conf. Computer Supported Cooperative Work, 2012, pp. 217-226.
16. H. Riesch and C. Potter, "Citizen Science as Seen by Scientists: Methodological, Epistemological and Ethical Dimensions, " Public Understanding of Science, vol. 23, no. 1, 2013, pp. 107-120.
17. C. Franzoni and H. Sauermann, "Crowd Science: Te Organization of Scientifc Research in Open Collaborative Projects, " Research Policy, vol. 43, no. 1, 2014, pp. 1-20.
18. P. Dai and D.S. Weld, "Decision-Teoretic Control of Crowd-Sourced Workfows, " Proc. 24th AAAI Conf. Artifcial Intelligence, 2010; http://ai.cs.wash-ington.edu/www/media/papers/draft/pdf.
19. M.W. Bauer and P. Jensen, "Te Mobilization of Scientists for Public Engagement, " Public Understanding of Science, vol. 20, no. 1, 2011, p. 3.
20. G. Newman et al., "User-Friendly Web Mapping: Lessons from a Citizen Science Website, " Int'l J. Geographical Information Science, vol. 24, no. 12, 2010, pp. 1851-1869.
21. D. Brossard, B. Lewenstein, and R. Bonney, "Scien-tifc Knowledge and Attitude Change: Te Impact of a Citizen Science Project, " Int' l J. Science Education, vol. 27, no. 9, 2005, pp. 1099-1121.
22. R. Cronje et al., "Does Participation in Citizen Science Improve Scientifc Literacy? A Study to Compare Assessment Methods, " Applied Environmental Education & Communication, vol. 10, no. 3, 2011, pp. 135-145.
23. T.B. Phillips et al., User's Guide for Evaluating Learning Outcomes in Citizen Science, Cornell Lab of Ornithology, 2014.
24. D.J. Trumbull et al., "Tinking Scientifcally during Participation in a Citizen-Science Project, " Science Education, vol. 84, no. 2, 2000, pp. 265-275.
25. J.N. Cummings and S. Kiesler, "Coordination Costs and Project Outcomes in Multi-university Collaborations, " Research Policy, vol. 36, no. 10, 2007, pp. 1620-1634.
26. K.L. Hall et al., "Assessing the Value of Team Science: A Study Comparing Center-and Investigator-Initiated Grants, " Am. J. Preventive Medicine, vol. 42, no. 2, 2012, pp. 157-163.
27. T. Becher and P. Trowler, Academic Tribes and Territories: Intellectual Enquiry and the Culture of Disciplines, McGraw-Hill Int'l, 2001.
28. J.C. Shin and W.K. Cummings, "Multilevel Analysis of Academic Publishing across Disciplines: Research Preference, Collaboration, and Time on Research, " Scientometrics, vol. 85, no. 2, 2010, pp. 581-594.
29. K. Holmberg and M. Telwall, "Disciplinary Differences in Twitter Scholarly Communication, " Sci-entometrics, 2013, pp. 1-16.