Conducting perception research over the internet: A tutorial review

PeerJ

Volumn 2015, Issue 7, 2015, Pages

  Woods, Andy T ^a,b   Velasco, Carlos ^a   Levitan, Carmel A ^c   Wan, Xiaoang ^d   Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b Xperiment   (United Kingdom)

^c Department of Cognitive Science Occidental College   (United States)

^d TSINGHUA UNIVERSITY   (China)

Author keywords

Citizen science; Haxe; Internet based testing; Mechanical turk; Perception; Prolific academic

Indexed keywords

BEHAVIORAL RESEARCH; COMPARATIVE STUDY; COMPUTER LANGUAGE; COMPUTER PROGRAM; CULTURAL FACTOR; CULTURAL PSYCHOLOGY; ETHICS; FINANCIAL MANAGEMENT; HIGH RISK BEHAVIOR; HUMAN; INFORMATION PROCESSING; ONLINE ANALYSIS; PERCEPTION; QUALITY CONTROL; QUESTIONNAIRE; REVIEW; SOCIAL NETWORK; TASK PERFORMANCE; WEAKNESS;

EID: 84937876446     PISSN: None     EISSN: 21678359     Source Type: Journal    
DOI: 10.7717/peerj.1058     Document Type: Review

References (113)

1. Admin. 2013. The reasons why Amazon Mechanical Turk no longer accepts international Turkers. Available at http://turkrequesters.blogspot.co.uk/2013/01/the-reasons-why-amazon-mechanicalturk.html (accessed 7 March 2015).
2. Aiello LM, Barrat A, Schifanella R, Cattuto C, Markines B, Menczer F. 2012. Friendship prediction and homophily in social media. ACM Transactions on the Web 6:9:1-9 DOI 10.1145/2180861.2180866.
3. Bauer B. 2015. A timely reminder about stimulus display times and other presentation parameters on CRTs and newer technologies. Canadian Journal of Experimental Psychology Epub ahead of print, Mar 16 2015.
4. Behrend TS, Sharek DJ, Meade AW, Wiebe EN. 2011. The viability of crowdsourcing for survey research. Behavior Research Methods 43:800-813 DOI 10.3758/s13428-011-0081-0.
5. Berinsky AJ, Huber GA, Lenz GS. 2012. Evaluating online labor markets for experimental research: Amazon.com's mechanical turk. Political Analysis 20:351-368 DOI 10.1093/pan/mpr057.
6. Berlin B. 1991. Basic color terms: their universality and evolution. Oxford: University of California Press.
7. Brand A, Bradley MT. 2012. Assessing the effects of technical variance on the statistical outcomes of web experiments measuring response times. Social Science Computer Review 30:350-357 DOI 10.1177/0894439311415604.
8. British Psychological Society. 2006. Report of the working party on conducting research on the internet: guidelines for ethical practice in psychological research online. REP62/06.2007.
9. British Psychological Society. 2013. Ethics guidelines for internet-mediated research. INF206/1.2013. Available at www.bps.org.uk/publications/policy-andguidelines/researchguidelines-policydocuments/research-guidelines-poli.
10. Brown HR, Zeidman P, Smittenaar P, Adams RA, McNab F, Rutledge RB, Dolan RJ. 2014. Crowdsourcing for cognitive science-the utility of smartphones. PLoS ONE 9:e100662 DOI 10.1371/journal.pone.0100662.
11. Buhrmester M, Kwang T, Gosling SD. 2011. Amazon's mechanical turk: a new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science 6:3-5 DOI 10.1177/1745691610393980.
12. Chandler J, Mueller P, Paolacci G. 2014. Nonnäiveté among Amazon mechanical turk workers: consequences and solutions for behavioural researchers. Behavioural Research Methods 46:112-130 DOI 10.3758/s13428-013-0365-7.
13. Chandler J, Paolacci G, Mueller P. 2013. Risks and rewards of crowdsourcing marketplaces. In: Michelucci P, ed. Handbook of human computation. New York: Springer, 377-392.
14. Cross I. 2001. Music, cognition, culture, and evolution. Annals of the New York Academy of Sciences 930:28-42 DOI 10.1111/j.1749-6632.2001.tb05723.x.
15. Crump JC, McDonnel JV, Gureckis TM. 2013. Evaluating Amazon's Mechanical Turk as a tool for experimental behavioural research. PLoS ONE 8:e57410 DOI 10.1371/journal.pone.0057410.
16. Dalili M. 2015. Research doesn't just happen in the lab anymore: Mechanical Turk, Prolific Academic, and online testing. TARG Blog. [Blog Post]. Available at Dalili M. 2015. Research doesn't just happen in the lab anymore: Mechanical Turk, Prolific Academic, and online testing. TARG Blog. [Blog Post]. http://targ.blogs.ilrt.org/2015/03/20/research-doesnt-just-happen-in-the-lab-anymore-mechanical-turk-prolific-academicand-online-testing/ (accessed 20 March 2015).
17. De Leeuw JR. 2014. jsPsych: a JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods 39:365-370.
18. De Leeuw JR, Motz BA. Psychophysics in a web browser? Comparing response times collect with JavaScript and Psychophyiscs Toolbox in a visual search task. Behavior Research Methods In Press DOI 10.3758/s13428-014-0458-y.
19. Di Luca M, Machulla TK, Ernst MO. 2009. Recalibration of multisensory simultaneity: Cross-modal transfer coincides with a change in perceptual latency. Journal of Vision 9:1-16 DOI 10.1167/9.12.7.
20. Downs JS, Holbrook MB, Sheng S, Cranor LF. 2010. Are your participants gaming the system? Screening mechanical turk workers. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York: ACM, 2399-2402.
21. Doyen S, Klein O, Pichon CL, Cleeremans A. 2012. Behavioral priming: it's all in the mind, but whose mind? PLoS ONE 7:e29081 DOI 10.1371/journal.pone.0029081.
22. Duchaine B, Nakayama K. 2006. The Cambridge face memory test: results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants. Neuropsychologia 44:576-585 DOI 10.1016/j.neuropsychologia.2005.07.001.
23. Dufau S, Dunãbeitia JA, Moret-Tatay C, McGonigal A, Peeters D, Alario F-X, Balota DA, Brysbaert M, Carreiras M, Ferrand L, Ktori M, Perea M, Rastle K, Sasburg O, Yap MJ, Ziegler JC, Grainger J. 2011. Smart phone, smart science: how the use of smartphones can revolutionize research in cognitive science. PLoS ONE 6:e24974 DOI 10.1371/journal.pone.0024974.
24. Eimer M, Schlaghecken F. 1998. Effects of masked stimuli on motor activation: behavioral and electrophysiological evidence. Journal of Experimental Psychology: Human Perception and Performance 24:1737-1747.
25. El Emam K, Arbuckle L. 2013. Anonymizing health data: case studies and methods to get you started. Sebastopol: O'Reilly Media.
26. Eriksen CW. 1995. The flankers task and response competition: a useful tool for investigating a variety of cognitive problems. Visual Cognition 2:101-118 DOI 10.1080/13506289508401726.
27. Eriksson K, Simpson B. 2010. Emotional reactions to losing explain gender differences in entering a risky lottery. Judgment and Decision Making 5:159-163.
28. Fitzgerald PJ. 2013. Gray colored glasses: is major depression partially a sensory perceptual disorder? Journal of Affective Disorders 151:418-422 DOI 10.1016/j.jad.2013.06.045.
29. Forster KI, Forster JC. 2003. DMDX: a windows display program with millisecond accuracy. Behavior Research Methods, Instruments, & Computers 35:116-124 DOI 10.3758/BF03195503.
30. Garaizar P, Vadillo MA, López-de-Ipiña D, Matute H. 2014. Measuring software timing errors in the presentation of visual stimuli in cognitive neuroscience experiments. PLoS ONE 9:e85108 DOI 10.1371/journal.pone.0085108.
31. Germine L, Nakayama K, Duchaine BC, Chabris CF, Chatterjee G, Wilmer JB. 2012. Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic Bulletin & Review 19:847-857 DOI 10.3758/s13423-012-0296-9.
32. Goodman JK, Cryder CE, Cheema A. 2013. Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples. Journal of Behavioral Decision Making 26:213-224 DOI 10.1002/bdm.1753.
33. Gosling SD, Mason W. 2015. Internet research in psychology. Annual Review of Psychology 66:877-902 DOI 10.1146/annurev-psych-010814-015321.
34. Haston S. 2014. Ultimate slow mo smartphone camera comparison, with fire hand! Available at http://www.mobilegeeks.com/slow-motion-tested-4-top-smartphones-fire-hand/ (accessed 12 March 2015).
35. Hauser DJ, Schwarz N. 2015. Attentive turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behavior Research Methods 1-8 In Press DOI 10.3758/s13428-015-0578-z.
36. Henrich J, Heine SJ, Norenzayan A. 2010. The weirdest people in the world? Behavioral and Brain Sciences 33:61-135 DOI 10.1017/S0140525X0999152X.
37. Ho CJ, Slivkins A, Suri S, Vaughan JW. 2015. Incentivizing high quality crowdwork. In: Proceedings of the International World Wide Web. Florence: IW3C2. Iddemonofelru. 2014. Anyone wanna raise awareness of fair pay? [Blog Post] Available at Ho CJ, Slivkins A, Suri S, Vaughan JW. 2015. Incentivizing high quality crowdwork. In: Proceedings of the International World Wide Web. Florence: IW3C2. Iddemonofelru. 2014. Anyone wanna raise awareness of fair pay? [Blog Post]https://www.reddit.com/r/mturk/comments/257cco/anyonewannaraiseawarenessoffairpay/.
38. Intons-Peterson MJ. 1983. Imagery paradigms: How vulnerable are they to experimenters' expectations? Journal of Experimental Psychology: Human Perception and Performance 9:394-412.
39. Ipeirotis PG. 2010. Analyzing the Amazon mechanical turk marketplace. XRDS: Crossroads, The ACM Magazine for Students 17:16-21 DOI 10.1145/1869086.1869094.
40. James N, Busher H. 2015. Ethical issues in online research. Educational Research and Evaluation 21:89-94 DOI 10.1080/13803611.2015.1024420.
41. Kay P, Regier T. 2003. Resolving the question of color naming universals. Proceedings of the National Academy of Sciences of the United States of America 100:9085-9089 DOI 10.1073/pnas.1532837100.
42. Killingsworth MA, Gilbert DT. 2010. A wandering mind is an unhappy mind. Science 330:932 DOI 10.1126/science.1192439.
43. King G. 2011. Ensuring the data-rich future of the social sciences. Science 331:719-721 DOI 10.1126/science.1197872.
44. Klein RA, Ratliff KA, Vianello M, Adams Jr RB, Bahník S, Bernstein MJ, Bocian K, Brandt MJ, Brooks B, Brumbaugh CC, Cemalcilar Z, Chandler J, Cheong W, Davis WE, Devos T, Eisner M, Frankowska N, Furrow D, Galliani EM, Hasselman F, Hicks JA, Hovermale JF, Hunt SJ, Huntsinger JR, IJzerman H, John M-S, Joy-Gaba JA, Barry Kappes H, Krueger LE, Kurtz J, Levitan CA, Mallett RK, Morris WL, Nelson AJ, Nier JA, Packard G, Pilati R, Rutchick AM, Schmidt K, Skorinko JL, Smith R, Steiner TG, Storbeck J, Van Swol LM, Thompson D, van't Veer AE, Vaughn LA, Vranka M, Wichman AL, Woodzicka JA, Nosek BA. 2014. Investigating variation in replicability. Social Psychology 45:142-152 DOI 10.1027/1864-9335/a000178.
45. Knöferle KM, Woods A, Käppler F, Spence C. 2015. That sounds sweet: using crossmodal correspondences to communicate gustatory attributes. Psychology & Marketing 32:107-120 DOI 10.1002/mar.20766.
46. Krantz JH. 2001. Stimulus delivery on the Web: what can be presented when calibration isn't possible? In: Reips U-D, Bosnjak M, eds. Dimensions of internet science. Lengerich, GE: Pabst Science, 113-130.
47. Kraut R, Olson J, Banaji M, Bruckman A, Cohen J, Couper M. 2004. Psychological research online: report of Board of Scientific Affairs' Advisory Group on the Conduct of Research on the Internet. American Psychologist 59:105-117 DOI 10.1037/0003-066X.59.2.105.
48. Lakkaraju K. 2015. A preliminary study of daily sample composition on Amazon Mechanical Turk (March 11). Available at Lakkaraju K. 2015. A preliminary study of daily sample composition on Amazon Mechanical Turk (March 11).http://ssrn.com/abstract=2560840or http://dx.doi.org/10.2139/ssrn.2560840.
49. Lease M, Hullman J, Bigham JP, Bernstein MS, Kim J, Lasecki W, Bakhshi S, Mitra T, Miller RC. 2013. Mechanical Turk is not anonymous. Available at http://ssrn.com/abstract=2228728.
50. Levitan CA, Ren J, Woods AT, Boesveldt S, Chan JS, McKenzie KJ, Dodson M, Levin JA, Leong C, Van den Bosch JJ. 2014. Cross-cultural color-odor associations. PLoS ONE 9:e101651 DOI 10.1371/journal.pone.0101651.
51. Lin K, Chu D, Mickens J, Zhuang L, Zhao F, Qiu J. 2012. Gibraltar: exposing hardware devices to web pages using AJAX. In: Proceedings of the 3rd USENIX conference on web application development. Boston: USENIX Association, 7.
52. Marder J. 2015. The Internet's hidden science factory. Available at Marder J. 2015. The Internet's hidden science factory.http://www.pbs.org/newshour/updates/inside-amazons-hidden-science-factory/ (accessed 12 February 2015).
53. Martire KA, Watkins I. 2015. Perception problems of the verbal scale: a reanalysis and application of a membership function approach. Science & Justice 55:264-273 DOI 10.1016/j.scijus.2015.01.002.
54. Marx DM, Goff PA. 2005. Clearing the air: the effect of experimenter race on target's test performance and subjective experience. British Journal of Social Psychology 44:645-657 DOI 10.1348/014466604X17948.
55. Mason W, Suri S. 2012. Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods 44:1-23 DOI 10.3758/s13428-011-0124-6.
56. Mason W, Watts DJ. 2010. Financial incentives and the performance of crowds. ACM SIGKDD Explorations Newsletter 11:100-108 DOI 10.1145/1809400.1809422.
57. Matthew D, Krosnick JA, Arthur L. 2010. Methodology report and user's guide for the 2008-2009 ANES panel study. Palo Alto and Ann Arbor: Stanford University and the University of Michigan.
58. McGurk H, MacDonald J. 1976. Hearing lips and seeing speech. Nature 264:746-748 DOI 10.1038/264746a0.
59. Milland K. 2014. The myth of low cost, high quality on Amazon's Mechanical Turk. Available at Milland K. 2014. The myth of low cost, high quality on Amazon's Mechanical Turk.http://turkernation.com/showthread.php?21352-The-Myth-of-Low-Cost-High-Quality-on-Amazon-s-Mechanical-Turk (accessed 12 March 2015).
60. Miller G. 2012. The smartphone psychology manifesto. Perspectives on Psychological Science 7:221-237 DOI 10.1177/1745691612441215.
61. Mirams L, Poliakoff E, Brown RJ, Lloyd DM. 2013. Brief body-scan meditation practice improves somatosensory perceptual decision making. Consciousness and Cognition 22:348-359 DOI 10.1016/j.concog.2012.07.009.
62. Narayanan A, Shmatikov V. 2008. Robust de-anonymization of large sparse datasets. In: IEEE symposium on security and privacy. Oakland: IEEE, 111-125.
63. Narayanan A, Shmatikov V. 2009. De-anonymizing social networks. In: Security and privacy, 2009 30th IEEE symposium. Oakland: IEEE, 173-187.
64. Neath I, Earle A, Hallett D, Surprenant AM. 2011. Response time accuracy in Apple Macintosh computers. Behavior Research Methods 43:353-362 DOI 10.3758/s13428-011-0069-9.
65. Nicholls ME, Loveless KM, Thomas NA, Loetscher T, Churches O. 2014. Some participants may be better than others: sustained attention and motivation are higher early in semester. The Quarterly Journal of Experimental Psychology 68:1-19.
66. Nieuwenhuis S, Stins JF, Posthuma D, Polderman TJ, Boomsma DI, de Geus EJ. 2006. Accounting for sequential trial effects in the flanker task: conflict adaptation or associative priming? Memory & Cognition 34:1260-1272 DOI 10.3758/BF03193270.
67. Nijholt A. 2014. Breaking fresh ground in human-media interaction research. Frontiers in ICT 1:4 DOI 10.3389/fict.2014.00004.
68. Nosofsky RM, Gluck MA, Palmeri TJ, McKinley SC, Glauthier P. 1994. Comparing modes of rule-based classification learning: a replication and extension of Shepard, Hovland & Jenkins (1961). Memory & Cognition 22:352-369 DOI 10.3758/BF03200862.
69. Oppenheimer DM, Meyvis T, Davidenko N. 2009. Instructional manipulation checks: detecting satisficing to increase statistical power. Journal of Experimental Social Psychology 45:867-872 DOI 10.1016/j.jesp.2009.03.009.
70. Orne MT. 1962. On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications. American Psychologist 17:776-783 DOI 10.1037/h0043424.
71. Paolacci G, Chandler J. 2014. Inside the turk: understanding mechanical turk as a participant pool. Current Directions in Psychological Science 23:184-188 DOI 10.1177/0963721414531598.
72. Paolacci G, Chandler J, Ipeirotis PG. 2010. Running experiments on Amazon mechanical turk. Judgment and Decision Making 5:411-419.
73. Paredes-Valverde MA, Alor-Hernández G, Rodríguez-González A, Valencia-García R, Jiménez-Domingo E. 2015. A systematic review of tools, languages, and methodologies for mashup development. Software: Practice and Experience 45:365-397.
74. Pashler H, Wagenmakers E-J. 2012. Editors' introduction to the special section on replicability in psychological science: a crisis of confidence? Perspectives on Psychological Science 7:528-530 DOI 10.1177/1745691612465253.
75. Peer E, Samat S, Brandimarte L, Acquisti A. 2015. Beyond the Turk: An empirical comparison of alternative platforms for crowdsourcing online behavioral research. Available at Peer E, Samat S, Brandimarte L, Acquisti A. 2015. Beyond the Turk: An empirical comparison of alternative platforms for crowdsourcing online behavioral research.http://dx.doi.org/10.2139/ssrn.2594183 (accessed 14 April 2015).
76. Peromaa T. 2015. Colors of the dress (original & red-green versions): percepts of 884 readers. Available at Peromaa T. 2015. Colors of the dress (original & red-green versions): percepts of 884 readers.http://tperomaa.vapaavuoro.uusisuomi.fi/kulttuuri/189048-colors-of-"the-dress"-original-red-green-versions-percepts-of-884-readers (accessed 7 March 2015).
77. Piqueras-Fiszman B, Velasco C, Spence C. 2012. Exploring implicit and explicit crossmodal colour-flavour correspondences in product packaging. Food Quality and Preference 25:148-155 DOI 10.1016/j.foodqual.2012.02.010.
78. Plant RR, Turner G. 2009. Millisecond precision psychological research in a world of commodity computers: New hardware, new problems? Behavior Research Methods 41:598-614 DOI 10.3758/BRM.41.3.598.
79. Poerio GL, Totterdell P, Miles E. 2013.Mind-wandering and negative mood: Does one thing really lead to another? Consciousness and Cognition 22:1412-1421 DOI 10.1016/j.concog.2013.09.012.
80. Rand DG, Peysakhovich A, Kraft-Todd GT, Newman GE, Wurzbacher O, Nowak MA, Greene JD. 2014. Social heuristics shape intuitive cooperation. Nature Communications 5:3677 DOI 10.1038/ncomms4677.
81. Reimers S, Stewart N. 2014. Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments. Behavior Research Methods DOI 10.3758/s13428-014-0471-1.
82. Ross MW. 2014. Do research ethics need updating for the digital age? Monitor on Psychology 45:64.
83. Rumenik DK, Capasso DR, Hendrick C. 1977. Experimenter sex effects in behavioral research. Psychological Bulletin 84:852-877 DOI 10.1037/0033-2909.84.5.852.
84. Schubert TW, Murteira C, Collins EC, Lopes D. 2013. ScriptingRT: a software library for collecting response latencies in online studies of cognition. PLoS ONE 8:e67769 DOI 10.1371/journal.pone.0067769.
85. Searles K, Ryan J. 2015. Researchers are rushing to Amazon's Mechanical Turk. Should they? Available at Searles K, Ryan J. 2015. Researchers are rushing to Amazon's Mechanical Turk. Should they?http://www.washingtonpost.com/blogs/monkey-cage/wp/2015/05/04/researchers-are-rushing-to-amazons-mechanical-turk-should-they/ (accessed 5 May 2015).
86. Shams L, Kamitani Y, Shimojo S. 2002. Visual illusion induced by sound. Cognitive Brain Research 14:147-152 DOI 10.1016/S0926-6410(02)00069-1.
87. Shapiro KL, Raymond JE, Arnell KM. 1997. The attentional blink. Trends in Cognitive Sciences 1:291-296 DOI 10.1016/S1364-6613(97)01094-2.
88. Sheehan K. 2015. How many HITs are academic HITs? My data part 1. Available at Sheehan K. 2015. How many HITs are academic HITs? My data part 1.https://mturk4academics.wordpress.com/2015/04/17/how-many-hits-are-academic-hits-my-data-part-1/ (accessed 5 May 2015).
89. Shepard RN, Hovland CI, Jenkins HM. 1961. Learning and memorization of classifications. Psychological Monographs: General and Applied 75:1-42 DOI 10.1037/h0093825.
90. Shermer DZ, Levitan CA. 2014. Red hot: the crossmodal effect of color intensity on piquancy. Multisensory Research 27:207-223 DOI 10.1163/22134808-00002457.
91. Silberman S, Milland K, LaPlante R, Ross J, Irani L. 2015. Stop citing Ross et al. 2010. Available at https://medium.com/@silberman/stop-citing-ross-et-al-2010-who-are-the-crowdworkersb3b9b1e8d300 (accessed 22 March 2015).
92. Simcox T, Fiez JA. 2014. Collecting response times using Amazon Mechanical Turk and Adobe Flash. Behavior Research Methods 46:95-111 DOI 10.3758/s13428-013-0345-y.
93. Simonsohn U, Nelson LD, Simmons JP. 2014. P-curve: a key to the file-drawer. Journal of Experimental Psychology: General 143:534-547 DOI 10.1037/a0033242.
94. Spence C. 2007. Audiovisual multisensory integration. Acoustical Science & Technology 28:61-70 DOI 10.1250/ast.28.61.
95. Spellman BA. 2012. Introduction to the special section data, data, everywhere. especially in my file drawer. Perspectives on Psychological Science 7:58-59 DOI 10.1177/1745691611432124.
96. Stafford T, Dewar M. 2014. Tracing the trajectory of skill learning with a very large sample of online game players. Psychological Science 25:511-518 DOI 10.1177/0956797613511466.
97. Thompson S. 1996. Internet connectivity: addiction and dependency study. Doctoral dissertation, Available at http://www.academia.edu/download/30519620/Thompson-IADS.pdf.
98. To L, Woods RL, Goldstein RB, Peli E. 2013. Psychophysical contrast calibration. Vision Research 90:15-24 DOI 10.1016/j.visres.2013.04.011.
99. Velasco C, Wan X, Knoeferle K, Zhou X, Salgado-Montejo A, Spence C. 2015b. Searching for flavor labels in food products: the influence of color-flavor congruence and association strength. Frontiers in Psychology 6:301 DOI 10.3389/fpsyg.2015.00301.
100. Velasco C, Wan X, Salgado-Montejo A, Woods A, Onate G, Mi B, Spence C. 2014. The context of colour-flavour associations in crisps packaging: a cross-cultural study comparing Chinese, Colombian, and British consumers. Food Quality and Preference 38:49-57 DOI 10.1016/j.foodqual.2014.05.011.
101. Velasco C, Woods AT, Deroy O, Spence C. 2015a. Hedonic mediation of the crossmodal correspondence between taste and shape. Food Quality and Preference 41:151-158 DOI 10.1016/j.foodqual.2014.11.010.
102. Velasco C, Woods A, Liu J, Spence C. 2015. Assessing the role of taste intensity and hedonics in taste/shape correspondences. Multisensory Research In Press. Available at http://booksandjournals.brillonline.com/content/journals/10.1163/22134808-00002489.
103. Wan X, Velasco C, Michel M, Mu B, Woods AT, Spence C. 2014a. Does the shape of the glass influence the crossmodal association between colour and flavour? A cross-cultural comparison. Flavour 3:3 DOI 10.1186/2044-7248-3-3.
104. Wan X, Woods AT, Seoul K-H, Butcher N, Spence C. 2015. When the shape of the glass influences the flavour associated with a coloured beverage: evidence from consumers in three countries. Food Quality & Preference 39:109-116 DOI 10.1016/j.foodqual.2014.07.004.
105. Wan X, Woods AT, Van den Bosch JJF, McKenzie KJ, Velasco C, Spence C. 2014b. Cross-cultural differences in crossmodal correspondences between tastes and visual features. Frontiers in Psychology: Cognition 5:1365 DOI 10.3389/fpsyg.2014.01365.
106. Wechsler D. 2008. Wechsler adult intelligence scale-fourth edition (WAIS-IV). San Antonio: NCS Pearson.
107. Wikipedia. 2015. Source-to-source compiler. Available at https://en.wikipedia.org/wiki/Source-to-sourcecompiler (accessed 13 February 2015).
108. Wilson RE, Gosling SD, Graham LT. 2012. A review of Facebook research in the social sciences. Perspectives on Psychological Science 7:203-220 DOI 10.1177/1745691612442904.
109. Witzel J, Cornelius S, Witzel N, Forster KI, Forster JC. 2013. Testing the viability of webDMDX for masked priming experiments. The Mental Lexicon 8:421-449 DOI 10.1075/ml.8.3.07wit.
110. Woods AT, Levitan CA, Butcher N, Spence C. 2015. Bouba Kiki data over several samples from different populations. Available at http://dx.doi.org/10.6084/m9.figshare.1408803 (accessed 9 May 2015).
111. Woods AT, Spence C, Butcher N, Deroy O. 2013. Fast lemons and sour boulders: testing the semantic hypothesis of crossmodal correspondences using an internet-based testing methodology. i-Perception 4:365-369 DOI 10.1068/i0586.
112. W3Schools. 2015. Browser statistics. Available at http://www.w3schools.com/browsers/browsersstats.asp (accessed 7 February 2015).
113. Yung A, Cardoso-Leite P, Dale G, Bavelier D, Green CS. 2015. Methods to test visual attention online. Journal of Visualized Experiments 96:e52470.