Using crowdsourcing to evaluate published scientific literature: Methods and example

PLoS ONE

Volumn 9, Issue 7, 2014, Pages

  Brown, Andrew W ^a   Allison, David B ^a  

^a UNIVERSITY OF ALABAMA AT BIRMINGHAM   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ARTICLE; BEVERAGE; CAUSAL ATTRIBUTION; COST; CROWDSOURCED WORKER; CROWDSOURCING; DIETARY INTAKE; FRUIT; INFORMATION PROCESSING; INFORMATION RETRIEVAL; NUTRITION; OBESITY; ONLINE SYSTEM; PUBLICATION; QUESTIONNAIRE; SCIENTIFIC LITERATURE; SWEET BEVERAGE; VEGETABLE; WORKER; COMPREHENSION; CONSENSUS; HUMAN;

COMPREHENSION; CONSENSUS; CROWDSOURCING; HUMANS; PUBLICATIONS;

EID: 84903790824     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0100647     Document Type: Article

References (9)

1. Warby SC, Wendt SL, Welinder P, Munk EG, Carrillo O, et al. (2014) Sleepspindle detection: crowdsourcing and evaluating performance of experts, nonexperts and automated methods. Nat Methods 11: 385-392.
2. Mortensen JM, Musen MA, Noy NF (2013) Crowdsourcing the verification of relationships in biomedical ontologies. AMIA Annu Symp Proc 2013: 1020-1029.
3. NAACL. Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk: Proceedings of the Workshop; 2010;Los Angeles, CA.
4. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33: 159-174. (Pubitemid 8054849)
5. Brown AW, Bohan Brown MM, Allison DB (2013) Belief beyond the evidence: using the proposed effect of breakfast on obesity to show 2 practices that distort scientific evidence. Am J Clin Nutr 98: 1298-1308.
6. Yavchitz A, Boutron I, Bafeta A, Marroun I, Charles P, et al. (2012) Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study. PLoS Med 9: e1001308.
7. Conger AJ (1980) Integration and generalization of kappas for multiple raters. Psychological Bulletin 88: 322-328.
8. Aday LA, Cornelius LJ (2011) Designing and conducting health surveys: a comprehensive guide : Wiley.com.
9. Harzing AW (2013) A preliminary test of Google Scholar as a source for citation data: A longitudinal study of Nobel prize winners. Scientometrics 94: 1057-1075.