Using CrowdFlower to Study the Relationship between Self-reported Violations and Traffic Accidents

Procedia Manufacturing

Volumn 3, Issue , 2015, Pages 2518-2525

  de Winter, J C F ^a   Kyriakidis, M ^a   Dodou, D ^a   Happee, R ^a  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

CrowdFlower; Crowdsourcing; Driver Behaviour Questionnaire; traffic accidents; traffic violations

Indexed keywords

EID: 85009841289     PISSN: None     EISSN: 23519789     Source Type: Conference Proceeding    
DOI: 10.1016/j.promfg.2015.07.514     Document Type: Conference Paper

References (51)

1. [1] Gosling SD, et al. (2004) Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 59, 93-104.
2. [2] Rentfrow PJ, et al. (2013) Divided we stand: Three psychological regions of the United States and their political, economic, social, and health correlates. J Pers Soc Psychol 105, 996-1012.
3. [3] Mason W, Suri S (2012) Conducting behavioral research on Amazon's Mechanical Turk. Behav Res Methods 44, 1-23.
4. [4] Berinsky AJ, et al. (2012) Evaluating online labor markets for experimental research: Amazon. com's Mechanical Turk. Polit Anal 20, 351-368.
5. [5] Buhrmester M, et al. (2011) Amazon's Mechanical Turk a new source of inexpensive, yet high-quality, data? Perspect Psychol Sci 6, 3-5.
6. [6] Goodman JK, et al. (2013) Data collection in a flat world: The strengths and weaknesses of Mechanical Turk samples. J Behav Decis Mak 26, 213-224.
7. [7] Horton JJ, et al. (2011) The online laboratory: Conducting experiments in a real labor market. Exp Econ 14, 399-425.
8. [8] Paolacci G, et al. (2010) Running experiments on Amazon Mechanical Turk. Judgm Decis Mak 5, 411-419.
9. [9] Simons DJ, Chabris CF (2012) Common (mis) beliefs about memory: A replication and comparison of telephone and Mechanical Turk survey methods. PLOS ONE 7, e51876.
10. [10] Behrend TS, et al. (2011) The viability of crowdsourcing for survey research. Behav Res Methods 43, 800-813.
11. [11] Holden CJ, et al. (2013) Assessing the reliability of the M5-120 on Amazon's Mechanical Turk. Comput Human Behav 29, 1749-1754.
12. [12] Rand DG (2012) The promise of Mechanical Turk: How online labor markets can help theorists run behavioral experiments. J Theor Biol 299, 172-179.
13. [13] Shapiro DN, et al. (2013) Using Mechanical Turk to study clinical populations. Clin Psychol Sci 1, 213-220.
14. [14] Crump MJ, et al. (2013) Evaluating Amazon's Mechanical Turk as a tool for experimental behavioral research. PLOS ONE 8, e57410.
15. [15] Staffelbach M, et al. (2014) Lessons learned from an experiment in crowdsourcing complex citizen engineering tasks with Amazon Mechanical Turk. Collective Intelligence Conference, Cambridge, MA.
16. [16] Vakharia D, Lease M (2013) Beyond AMT: An analysis of crowd work platforms. Retrieved from arxiv.org/abs/1310.1672v1.pdf.
17. [17] Chandler J, et al. (2014) Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers. Behav Res Methods 46, 112-130.
18. [18] Smucker MD, Jethani CP (2011) The crowd vs. the lab: A comparison of crowd-sourced and university laboratory participant behavior. SIGIR 2011 Workshop on Crowdsourcing for Information Retrieval.
19. [19] Le J, et al. (2010) Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution. SIGIR 2010 Workshop on Crowdsourcing for Search Evaluation (pp 21-26).
20. [20] Negri M, Mehdad Y (2010) Creating a bi-lingual entailment corpus through translations with Mechanical Turk: $100 for a 10-day rush. NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon's Mechanical Turk (pp 212-216).
21. [21] Hindriks F, et al. (2014) A new angle on the knobe effect: Intentionality correlates with blame, not with praise. Retrieved from http://singmann.org/download/publications/submitted/Knobe-correlations2_H_word.pdf.
22. [22] Nguyen D, et al. (2014) Using crowdsourcing to investigate perception of narrative similarity. 23rd ACM International Conference on Information and Knowledge Management (pp 321-330).
23. [23] Pepper GV, Nettle D (2014) Out of control mortality matters: The effect of perceived uncontrollable mortality risk on a health-related decision. PeerJ 2, e459.
24. [24] Wolf W, et al. (2015) Ostracism Online: A social media ostracism paradigm. Behav Res Methods 47, 361-373.
25. [25] Marelli M, et al. (in press) Picking buttercups and eating butter cups: Spelling alternations, semantic relatedness, and their consequences for compound processing. Appl Psycholinguist.
26. [26] Over D, et al. (2013) Scope ambiguities and conditionals. Think Reason 19, 284-307.
27. [27] Wang S, et al. (2014) Exploring mental lexicon in an efficient and economic way: Crowdsourcing method for linguistic experiments. COLING 2014 (pp 105-113).
28. [28] Aladhadh S, et al. (2014) Tweet author location impacts on tweet credibility. Australasian Document Computing Symp.
29. [29] Nawrot I, Doucet A (2014) Timeline localization. In Human-computer interaction. Theories, methods, and tools (pp 611-622) Springer.
30. [30] Prpić J, et al. (2014) Experiments on crowdsourcing policy assessment. Ann Rev Policy Design, 2, 1-10.
31. [31] Evans L (2004) Traffic safety. Bloomfield Hills, MI: Science Serving Society.
32. [32] Redelmeier DA, McLellan BA (2013) Modern medicine is neglecting road traffic crashes. PLOS Med 10, e1001463.
33. [33] Lee JD (2007) Technology and teen drivers. J Safety Res 38, 203-213.
34. [34] De Winter JCF, Dodou D (2010) The Driver Behaviour Questionnaire as a predictor of accidents: A meta-analysis. J Safety Res 41, 463-470.
35. [35] Martinussen LM, et al. (2014) Assessing the relationship between the Driver Behavior Questionnaire and the Driver Skill Inventory: Revealing sub-groups of drivers. Transp Res Part F Traffic Psychol Behav 26, 82-91.
36. [36] Af Wåhlberg A, et al. (2012) Commentary on the rebuttal by de Winter and Dodou. J Safety Res 43, 90-93.
37. [37] World Health Organization (2013) WHO global status report on road safety 2013: supporting a decade of action. WHO.
38. [38] Lajunen T, et al. (2004) The Manchester driver behaviour questionnaire: a cross-cultural study. Accid Anal Prev 36, 231-238.
39. [39] Özkan T, et al. (2006) Cross-cultural differences in driving behaviours: A comparison of six countries. Transp Res Part F Traffic Psychol Behav 9, 227-242.
40. [40] Warner HW, et al. (2011) Cross-cultural comparison of drivers’ tendency to commit different aberrant driving behaviours. Transp Res Part F Traffic Psychol Behav 14, 390-399.
41. [41] Bener A, et al. (2008) The driver behaviour questionnaire in arab gulf countries: Qatar and united arab emirates. Accid Anal Prev 40, 1411-1417.
42. [42] Bener A, et al. (2013) A cross “ethnical” comparison of the Driver Behaviour Questionnaire (DBQ) in an economically fast developing country. Glob J Health Sci 5, 165-175.
43. [43] De Winter JCF (2013) Predicting self-reported violations among novice license drivers using pre-license simulator measures. Accid Anal Prev 52, 71-79.
44. [44] Wells P, et al. (2008) Cohort II: A study of learner and new drivers. Volume 1 - Main report. London: Dep Transport.
45. [45] Forgas JP (1976) An unobtrusive study of reactions to national stereotypes in four European countries. J Soc Psychol 99, 37-42.
46. [46] De Winter JCF, et al. (in press) A quarter of a century of the DBQ: some supplementary notes on its validity with regard to accidents. Ergonomics.
47. [47] Cooper EA, Farid H (in press) Does the Sun revolve around the Earth? A comparison between the general public and online survey respondents in basic scientific knowledge. Public Underst Sci.
48. [48] Kang R, et al. (2014) Privacy attitudes of mechanical turk workers and the US public. Symposium on Usable Privacy and Security.
49. [49] Paolacci G, Chandler J (2014) Inside the Turk. Understanding Mechanical Turk as a participant pool. Curr Dir Psychol Sci 23, 184-188.
50. [50] Stewart N, et al. (2015) The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers. Retrieved from https://www.stewart.warwick.ac.uk/publications/MTurk.html.
51. [51] Underwood SE (2014) Automated vehicles forecast. Vehicle Symposium Opinion Survey. Automated Vehicles Symp, San Francisco.