Twenty years of Internet-based research at SCiP: A discussion of surviving concepts and new methodologies

Behavior Research Methods

Volumn 49, Issue 5, 2017, Pages 1615-1620

  Wolfe, Christopher R ^a  

^a MIAMI UNIVERSITY   (United States)

Author keywords

History of psychology; Society for Computers in Psychology; Web based psychology experiments

Indexed keywords

BEHAVIORAL RESEARCH; HUMAN; INTERNET; METHODOLOGY; PERSONNEL; PROCEDURES; PSYCHOLOGY;

BEHAVIORAL RESEARCH; HUMANS; INTERNET; PSYCHOLOGY; RESEARCH DESIGN; RESEARCH PERSONNEL;

EID: 85011906809     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-017-0858-x     Document Type: Article

References (47)

1. American Academy of Sleep Medicine. (2005). International classification of sleep disorders—Second edition (Diagnostic & coding manual). Westchester, IL: Author.
2. Anderson, M. D. (1996, November). Effecting changes in cognition through the use of HTML. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
3. Barnhoorn, J. S., Haasnoot, E., Bocanegra, B. R., & van Steenbergen, H. (2015). QRTEngine: An easy solution for running online reaction time experiments using Qualtrics. Behavior Research Methods, 47, 918–929. doi:10.3758/s13428-014-0530-7
4. Birnbaum, M. H. (2001). Introduction to behavioral research on the Internet. Upper Saddle River, NJ: Prentice Hall.
5. Briñol, P., Petty, R. E., & Wagner, B. (2009). Body posture effects on self-evaluation: A self-validation approach. European Journal of Social Psychology, 39, 1053–1064.
6. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5. doi:10.1177/1745691610393980
7. de Leeuw, J. R. (2015). jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods, 47, 1–12. doi:10.3758/s13428-014-0458-y
8. Diedenhofen B., & Musch, J. (2016, November). PageFocus: Using paradata to detect window switching behavior in online tests. Paper presented to the 46th annual meeting of the Society for Computers in Psychology, Boston, MA.
9. Funke, F., & Reips, U.-D. (2012). Why semantic differentials in web-based research should be made from Visual Analogue Scales and not from 5-point scales. Field Methods, 24, 310–327. doi:10.1177/1525822X12444061
10. Funke, F., Reips, U.-D., & Thomas, R. K. (2011). Sliders for the smart: Type of rating scale on the web interacts with educational level. Social Science Computer Review, 29, 221–231. doi:10.1177/0894439310376896
11. Garaizar, P., & Reips, U.-D. (2015). Visual DMDX: A web-based authoring tool for DMDX, a Windows display program with millisecond accuracy. Behavior Research Methods, 47, 620–631. doi:10.3758/s13428-014-0493-8
12. Gaydosh, C. N. (1996, November). Using the Internet for triple-blind psychological research studies. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
13. Germine, L., Nakayama, K., Duchaine, B. C., Chabris, C. F., Chatterjee, G., & Wilmer, J. B. (2012). Is the Web as good as the lab? Comparable performance from Web and lab in cognitive/perceptual experiments. Psychonomic Bulletin & Review, 19, 847–857. doi:10.3758/s13423-012-0296-9
14. Gosling, S., & Johnson, J. A. (2010). Advanced methods for behavior research on the Internet. Washington, DC: American Psychological Association.
15. Gureckis, T. M., Martin, J., McDonnell, J., Rich, A. S., Markant, D., Coenen, A., … Chan, P. (2015). psiTurk: An open-source framework for conducting replicable behavioral experiments online, Behavior Research Methods, 48, 829–842. doi:10.3758/s13428-015-0642-8
16. Jazwinski, C. H., & Valdes, L. A. (1996, November). Where do the data go? Collecting demo data from web pages. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
17. Joinson, A. N., McKenna, K., Postmes, T., & Reips, U.-D. (Eds.). (2007). The Oxford handbook of internet psychology. Oxford, UK: Oxford University Press.
18. Krantz, J. H. (1996). Psychological research on the net. Available at http://psych.hanover.edu/research/exponnet.html
19. Krantz, J. H., Ballard, J., & Scher, J. (1996, November). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
20. Krantz, J. H., & Reips, U.-D. (2016, November). Update on the health and use of the web for psychological research. Paper presented to the 46th annual meeting of the Society for Computers in Psychology, Boston, MA.
21. Krantz, J. H., & Reips, U.-D. (2017). Twenty years of web research: Lots of use but how are they learning? Behavior Research Methods, 49, (in press).
22. Kuhlmann, T., Reips, U.-D., & Stieger, S. (2016, November). Smartphone tilt as a measure of well-being? Results from a longitudinal smartphone app study. Paper presented to the 46th annual meeting of the Society for Computers in Psychology, Boston, MA.
23. Lange, K., Kühn, S., & Filevich, E. (2015). “Just another tool for online studies” (JATOS): An easy solution for setup and management of web servers supporting online studies. PLoS ONE, 10, e0130834. doi:10.1371/journal.pone.0130834
24. Litman, L., Robinson, J., & Abberbock, T. (2016). TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior Research Methods. Advance online publication. doi:10.3758/s13428-016-0727-z
25. Litman, L., Robinson, J., & Rosenzweig, C. (2015). The relationship between motivation, monetary compensation, and data quality among US- and India-based workers on Mechanical Turk. Behavior Research Methods, 47, 519–528. doi:10.3758/s13428-014-0483-x
26. Mangan, M. (2016, November). “Is there anybody out there?” Sleepsex.org, a longstanding hub for research and exchange on sexsomnia. Paper presented to the 46th annual meeting of the Society for Computers in Psychology, Boston, MA.
27. Mangan, M., & Reips, U.-D. (2006). Sleep, sex, and the Web: Surveying the difficult-to-reach clinical population suffering from sexsomnia. Behavior Research Methods, 39, 233–236.
28. Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon’s Mechanical Turk. Behavior Research Methods, 44, 1–23. doi:10.3758/s13428-011-0124-6
29. Musch, J., & Reips, U.-D. (2000). A brief history of Web experimenting. In M. H. Birnbaum (Ed.), Psychological experiments on the Internet (pp. 61–87). New York, NY: Academic Press.
30. Ottaway, S. (1996, November). A Web-page for administration of psychology and social science experiments. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
31. Reips, U.-D. (2000). The Web Experimental Psychology Lab: Five years of data collection on the Internet. Behavior Research Methods, Instruments, & Computers, 33, 201–211.
32. Reips, U.-D., & Neuhaus, C. (2002). WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures. Behavior Research Methods, Instruments, & Computers, 34, 234–240. doi:10.3758/BF03195449
33. Reips, U.-D. (1996, November). Experimenting in the World Wide Web. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
34. Reips, U.-D., Stieger, S., Heinrichs, S., & de Spindler, A. (2016, November). Svendroid: A generic smartphone app configurator for mobile assessment studies. Paper presented to the 46th annual meeting of the Society for Computers in Psychology, Boston, MA.
35. Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006). Experimental study of inequality and unpredictability in an artificial cultural market. Science, 31, 854–856.
36. Schiano, D. J. (1996, November). Convergent methodologies in cyber-psychology: A case study. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
37. Schmidt, W. C. (1996, November). World-Wide Web survey research: Benefits, potential problems, and solutions. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
38. Smith, M., & Leigh, B. (1996, November). Using the World Wide Web to institute a distributed, on-line participant pool. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL
39. Society for Computers in Psychology. (1996). Conference program of the 26th annual meeting of the Society for Computers in Psychology. Accessed online 12/21/16 from www.SCiP.ws
40. Stern, S. E., & Faber, J. E. (1996, November). The lost email method: Milgram’s lost letter technique in the age of the Internet. Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.
41. Stieger, S., Lewetz, D., & Reips, U.-D. (2016, November). The measurement of pace of life: Results from an experience sampling smartphone app study. Paper presented to the 46th annual meeting of the Society for Computers in Psychology, Boston, MA.
42. Summerville, A., & Chartier, C. R. (2013). Pseudo-dyadic “interaction” on Amazon’s Mechanical Turk. Behavior Research Methods, 45, 116–124. doi:10.3758/s13428-012-0250-9
43. Widmer, C. L., Wolfe, C. R., Reyna, V. F., Cedillos-Whynott, E. M., Brust-Renck, P. G., & Weil, A. M. (2015). Tutorial dialogues and gist explanations of genetic breast cancer risk. Behavior Research Methods, 47, 632–648.
44. Wolfe, C. R. (2006). SCiP at 35: An idiosyncratic history of the Society for Computers in Psychology. Behavior Research Methods, 38, 245–250. doi:10.3758/BF03192776
45. Wolfe, C. R., & Fisher, C. R. (2013). Individual differences in base rate neglect: A fuzzy processing preference index. Learning and Individual Differences, 25, 1–11. doi:10.1016/j.lindif.2013.03.003
46. Wolfe, C. R., & Reyna, V. F. (2010). Semantic coherence and fallacies in estimating joint probabilities. Journal of Behavioral Decision Making, 23, 203–223. doi:10.1002/bdm.650
47. Young, K. S. (1996, November). Internet addiction: Is it real and how significant are the consequences? Paper presented to the 26th annual meeting of the Society for Computers in Psychology, Chicago, IL.