Working with a new kind of team: harnessing the wisdom of the crowd in trial identification

EFSA Journal

Volumn 17, Issue S1, 2019, Pages

  Noel Storr, Anna ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

citizen science; crowdsourcing; meta analysis; microtask; randomised controlled trial; systematic review

Indexed keywords

EID: 85068851416     PISSN: None     EISSN: 18314732     Source Type: Journal    
DOI: 10.2903/j.efsa.2019.e170715     Document Type: Article

References (8)

1. Borah R, Brown AW, Capers PL and Kaiser KA, 2017. Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. British Medical Journal Open, 7, e012545.
2. Bornmann L and Mutz R, 2015. Growth rates of modern science: a bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology, 66, 2215–2222. https://doi.org/10.1002/asi.23329
3. Brabham DC, 2008. Crowdsourcing as a model for problem solving: an introduction and cases. Convergence: The International Journal of Research into New Media Technologies, 14, 75–90.
4. Ikediego HO, Ilkan M, Abubakar AM and Bekun FV, 2018. Crowd-sourcing (who, why and what). International Journal of Crowd Science, 2, 27–41. https://doi.org/10.1108/IJCS-07-2017-0005
5. Marshall IJ, Noel-Storr AH, Kuiper J, Thomas J and Wallace B, 2018. Machine learning for identifying Randomized Controlled Trials: an evaluation and practitioner's guide. Research Synthesis Methods, 9, 602–614.
6. Thomas J, Noel-Storr AH, Marshall I, Wallace B, McDonald S, Mavergames C, Glasziou P, Shemilt I, Synnot A, Turner T, Elliott J and the Living Systematic Review Network, 2017. Living systematic reviews: 2. Combining human and machine effort. Journal of Clinical Epidemiology, 91, 31–37. https://doi.org/10.1016/j.jclinepi.2017.08.011
7. Van Noorden R, 2014. Global scientific output doubles every nine years. Nature News Blog. http://blogs.nature.com/news/2014/05/global-scientific-output-doubles-every-nine-years.htmlne-years.html#
8. Wallace BC, Noel-Storr A, Marshall IJ, Cohen AM, Smalheiser NR and Thomas J, 2017. Identifying reports of randomized controlled trials (RCTs) via a hybrid machine learning and crowdsourcing approach. Journal of the American Medical Informatics Association, 24, 1165–1168. https://doi.org/10.1093/jamia/ocx053