Behavioral Research and Data Collection via the Internet

Handbook of Human Factors in Web Design, Second Edition

Volumn , Issue , 2011, Pages 563-585

  Reips, Ulf Dietrich ^a   Birnbaum, Michael H ^b  

^a UNIVERSITY OF DEUSTO   (Spain)

^b Department of Psychology ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84856840653     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1201/b10855-32     Document Type: Chapter

References (83)

1. American Psychological Association. 2010. Publication Manual of the American Psychological Association, 6th ed. Washington, DC: Author.
2. Barchard, K. A., and J. E. Williams. 2008. Practical advice for con-ducting ethical online experiments and questionnaires for United States psychologists. Behavior Research Methods 40: 1111-1128.
3. Baron, J., and M. Siepmann. 2000. Techniques for creating and using web questionnaires in research and teaching. In Psychological experiments on the Internet, ed. M. H. Birnbaum, 235-265. San Diego, CA: Academic Press.
4. Berker, T. 1999. Online-offline: Methodologische Erträge einer Internetnutzungsstudie zur Klärung einer Zentralkategorie des Online-Research [On-line versus off-line: Methodological earnings of a study on Internet use devised to clarify a central category of on-line research]. In Current Internet Science-Trends, Techniques, Results. Aktuelle Online Forschung-Trends, Techniken, Ergebnisse, eds. U.-D. Reips et al. Zürich: Online Press, available at http://dgof.de/tband99/.
5. Berker, T. 2002. World Wide Web use at a German university-com-puters, sex, and imported names: results of a log file analysis. In Online Social Sciences, eds. B. Batinic, U.-D. Reips, and M. Bosnjak, 365-382. Göttingen, Germany: Hogrefe.
6. Birnbaum, M. H. 1999a. How to show that 9 > 221: Collect judg-ments in a between-subjects design. Psychological Methods 4(3): 243-249.
7. Birnbaum, M. H. 1999b. Testing critical properties of decision mak-ing on the Internet. Psychological Science 10: 399-407.
8. Birnbaum, M. H. 2000a. Psychological Experiments on the Internet. San Diego: Academic Press.
9. Birnbaum, M. H. 2000b. SurveyWiz and FactorWiz: JavaScript Web pages that make HTML forms for research on the Internet. Behavior Research Methods, Instruments, and Computers 32(2): 339-346.
10. Birnbaum, M. H. 2001a. Introduction to Behavioral Research on the Internet. Upper Saddle River, NJ: Prentice-Hall.
11. Birnbaum, M. H. 2001b. A Web-based program of research on deci-sion making. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 23-55. Lengerich, Germany: Pabst Science.
12. Birnbaum, M. H. 2004a. Human research and data collection via the Internet. Annual Review of Psychology 55: 803-832.
13. Birnbaum, M. H. 2004b. Methodological and ethical issues in conduct-ing social psychology research via the Internet. In Handbook of Methods in Social Psychology, eds. C. Sansone, C. C. Morf, and A. T. Panter, 359-382. Thousand Oaks, CA: Sage.
14. Birnbaum, M. H. 2007. Designing online experiments. In The Oxford Handbook of Internet Psychology, eds. A. Joinson et al., 391-403. Oxford, UK: Oxford University Press.
15. Birnbaum, M. H., and B. A. Mellers. 1989. Mediated models for the analysis of confounded variables and self-selected samples. Journal of Educational Statistics 14: 146-158.
16. Birnbaum, M. H., and S. V. Wakcher. 2002. Web-based experiments controlled by JavaScript: an example from probability learn-ing. Behavior Research Methods, Instruments, and Computers 34: 189-199.
17. Buchanan, T. 2000. Potential of the Internet for personality research. In Psychological Experiments on the Internet, ed. M. H. Birnbaum, 121-140. San Diego, CA: Academic Press.
18. Buchanan, T. 2001. Online personality assessment. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 57-74. Lengerich, Germany: Pabst Science.
19. Dillman, D. A., and D. K. Bowker. 2001. The Web questionnaire challenge to survey methodologists. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 159-178. Lengerich, Germany: Pabst Science.
20. Dillman, D. A., J. D. Smyth, and L. M. Christian. 2008. Internet, Mail, and Mixed-mode Surveys: The Tailored Design Method. New York: Wiley.
21. Drake, P. J. W. 2001. Successful aging: investment in genealogy as a function of generativity, mobility and sense of place. Master of Arts Thesis. California State University, Fullerton.
22. Eichstaedt, J. 2001. An inaccurate-timing filter for reaction-time measurement by JAVA-applets implementing Internet-based experiments. Behavior Research Methods, Instruments, and Computers 33: 179-186.
23. Frick, A., M. T. Bächtiger, and U.-D. Reips. 2001. Financial incen-tives, personal information, and drop-out in online studies. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 209-219. Lengerich: Pabst Science.
24. Fraley, R. C. 2004. How to Conduct Behavioral Research over the Internet: A Beginner’s Guide to HTML and CGI/Perl. New York: The Guilford Press.
25. Francis, G., I. Neath, and A. M. Surprenant. 2000. The cognitive psychology online laboratory. In Psychological Experiments on the Internet, ed. M. H. Birnbaum, 267-283. San Diego, CA: Academic Press.
26. Funke, F., and U.-D. Reips. 2007. Messinstrumente und Skalen [Measuring devices and scales]. In Online-Forschung 2007: Grundlagen und Fallstudien, eds. M. Welker and O. Wenzel, 52-76. Köln: Herbert von Halem.
27. Garrett, J. J. 2005. Ajax: A new approach to Web applications. http://www.adaptivepath.com/ideas/essays/archives/000385.php (accessed Feb. 8, 2010).
28. Göritz, A. S. 2006. Web-based data collection. Retrieved April 10, 2010, from http://www.goeritz.net/ati/material.pdf.
29. Göritz, A. S. 2007. Using online panels in psychological research. In The Oxford Handbook of Internet Psychology, eds. A. N. Joinson et al., 473-485. Oxford, UK: Oxford University Press.
30. Göritz, A. S. 2009. Building and managing an online panel with PHP PanelAdmin. Behavior Research Methods 41(4): 1177-1182.
31. Göritz, A. S., and M. H. Birnbaum. 2005. Generic HTML form pro-cessor: a versatile PHP Script to save Web-collected data into a MySQL database. Behavior Research Methods 37: 703-710.
32. Hardin, C., and M. H. Birnbaum. 1990. Malleability of “ratio” judgments of occupational prestige. American Journal of Psychology 103: 1-20.
33. Knapp, F., and M. Heidingsfelder. 2001. Drop-out analysis: effects of the survey design. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 221-230. Lengerich, Germany: Pabst Science.
34. Krantz, J. H. 2001. Stimulus delivery on the Web: What can be presented when calibration isn’t possible? In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 113-130. Lengerich, Germany: Pabst Science.
35. Krantz, J. H., J. Ballard, and J. Scher. 1997. Comparing the results of laboratory and World-Wide Web samples on the determi-nants of female attractiveness. Behavior Research Methods, Instruments, and Computers, 29: 264-269.
36. Krantz, J. H., and R. Dalal. 2000. Validity of Web-based psychological research. In Psychological Experiments on the Internet, eds. M. H. Birnbaum, 35-60. San Diego, CA: Academic Press.
37. Krantz, J. H., and J. E. Williams. 2010. Using graphics, pho-tographs, and dynamic media. In Advanced Methods for Behavioral Research on the Internet, eds. S. Gosling and J. A. Johnson, 45-61. Washington, DC: American Psychological Association.
38. Mangan, M., and Reips, U.-D. 2007. Sleep, sex, and the Web: Surveying the difficult-to-reach clinical population suffering from sexsomnia. Behavior Research Methods, 39, 233-236.
39. McGraw, K. O., M. D. Tew, and J. E. Williams. 2000. PsychExps: An on-line psychology laboratory. In Psychological experi-ments on the Internet, ed. M. H. Birnbaum, 219-233. San Diego, CA: Academic Press.
40. Michalak, E. E., and A. Szabo. 1998. Guidelines for Internet research: an update. European Psychologist 3(1): 70-75.
41. Musch, J., A. Bröder, and K. C. Klauer. 2001. Improving survey research on the World-Wide Web using the randomized response technique. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 179-192. Lengerich: Pabst Science Publishers.
42. Musch, J., and U.-D. Reips. 2000. A brief history of Web experi-menting. In Psychological Experiments on the Internet, ed. M. H. Birnbaum, 61-87. San Diego, CA: Academic Press.
43. Parducci, A. 1995. Happiness, Pleasure, and Judgment. Mahwah, NJ: Lawrence Erlbaum.
44. Reips, U.-D. 1995. The Web experiment method. http://www.uni-tue bingen.de/uni/sii/Ulf/Lab/wwwExpMethod.html, now at http:// wexlab.eu/wwwExpMethod.html (accessed Sept. 1, 1995).
45. Reips, U.-D. 1997. Das psychologische Experimentieren im Internet. In Internet für Psychologen, ed. B. Batinic, 245-265. Göttingen, Germany: Hogrefe.
46. Reips, U.-D. 1999. Online Research with children. In Current Internet Science-Trends, Techniques, Results, eds. U.-D. Reips et al., http://gor.de/gor99/tband99/pdfs/q_z/reips.pdf. Zürich: Online Press.
47. Reips, U.-D. 2000. The Web experiment method: Advantages, disadvantages, and solutions. In Psychological experiments on the Internet, ed. M. H. Birnbaum, 89-117. San Diego, CA: Academic Press.
48. Reips, U.-D. 2001a. Merging field and institution: running a Web laboratory. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 1-22. Lengerich, Germany: Pabst Science Publishers.
49. Reips, U.-D. 2001b. The Web Experimental Psychology Lab: Five years of data collection on the Internet. Behavior Research Methods, Instruments, and Computers 33: 201-211.
50. Reips, U.-D. 2002a. Context effects in Web surveys. In Online Social Sciences, eds. B. Batinic, U.-D. Reips, and M. Bosnjak, 69-79. Göttingen, Germany: Hogrefe and Huber.
51. Reips, U.-D. 2002b. Internet-based psychological experimenting: Five do’s and five don’ts. Social Science Computer Review 20(3): 241-249.
52. Reips, U.-D. 2002c. Standards for Internet-based experimenting. Experimental Psychology 49(4): 243-256.
53. Reips, U.-D. 2002d. Theory and techniques of conducting Web experiments. In Online Social Sciences, eds. B. Batinic, U.-D. Reips, and M. Bosnjak, 219-249. Seattle: Hogrefe and Huber.
54. Reips, U.-D. 2006. Web-based methods. In Handbook of Multimethod Measurement in Psychology, eds. M. Eid and E. Diener, 73-85. Washington, DC: American Psychological Association.
55. Reips, U.-D. 2007. The methodology of Internet-based experiments. In The Oxford Handbook of Internet Psychology, eds. A. Joinson et al., 373-390. Oxford: Oxford University Press.
56. Reips, U.-D. 2010. Design and formatting in Internet-based research. In Advanced Internet Methods in the Behavioral Sciences, eds. S. Gosling and J. A. Johnson, 29-43. Washington, DC: American Psychological Association.
57. Reips, U.-D. in press. Using the internet to collect data. In APA Handbook of Research Methods in Psychology, eds H. Cooper, P. Camic, R. Gonzalez, D. Long, and A. Panter. Washington, DC: American Psychological Association.
58. Reips, U.-D., and M. Bosnjak, eds. 2001. Dimensions of Internet Science. Lengerich, Germany: Pabst Science.
59. Reips, U.-D., T. Buchanan, A. Joinson, and C. Paine. 2010. Internet questionnaires in e-health contexts: Non-response to sensitive items. Manuscript submitted for publication.
60. Reips, U.-D., and L. Franek. 2004. Mitarbeiterbefragungen per Internet oder Papier? Der Einfluss von Anonymität, Freiwilligkeit und Alter auf das Antwortverhalten [Employee surveys via Internet or paper? The influence of anonymity, voluntariness and age on answering behavior]. Wirtschaftspsychologie 6(1): 67-83.
61. Reips, U.-D., and F. Funke. 2008. Interval level measurement with visual analogue scales in Internet-based research: VAS Generator. Behavior Research Methods 40: 699-704.
62. Reips, U.-D., and J. Krantz. 2010. Conducting true experiments on the Web. In Advanced Internet Methods in the Behavioral Sciences, eds. S. Gosling and J. Johnson, (193-216). Washington, DC: American Psychological Association.
63. Reips, U.-D., and R. Lengler. 2005. The Web Experiment List: A Web service for the recruitment of participants and archiving of Internet-based experiments. Behavior Research Methods 37: 287-292.
64. Reips, U.-D., and C. Neuhaus. 2002. WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures. Behavior Research Methods, Instruments, and Computers 34: 234-240.
65. Reips, U.-D., and S. Stieger. 2004. Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psycho-logical research. Behavior Research Methods, Instruments, and Computers 36: 304-311.
66. Rose, B. J., and M. H. Birnbaum. 1975. Judgments of differences and ratios of numerals. Perception and Psychophysics 18: 194-200.
67. Schmidt, W. C. 1997a. World-Wide Web survey research: Benefits, potential problems, and solutions. Behavioral Research Methods, Instruments, and Computers 29: 274-279.
68. Schmidt, W. C. 1997b. World-Wide Web survey research made easy with WWW Survey Assistant. Behavior Research Methods, Instruments, and Computers 29: 303-304.
69. Schmidt, W. C. 2000. The server-side of psychology Web experi-ments. In Psychological Experiments on the Internet, ed. M. H. Birnbaum, 285-310. San Diego, CA: Academic Press.
70. Schmidt, W. C. 2007. Technical considerations when implementing online research. In The Oxford Handbook of Internet Psychology, eds. A. Joinsonet al., 461-472. Oxford: Oxford University Press.
71. Schmidt, W. C., R. Hoffman, and J. MacDonald. 1997. Operate your own World-Wide Web server. Behavior Research Methods, Instruments, and Computers 29: 189-193.
72. Schultz, E. E. this volume. Web security, privacy, and usability. In Handbook of Human Factors in Web Design, 2nd ed., eds. K.-P. L. Vu and R. W. Proctor, 663-676. Boca Raton, FL: CRC Press.
73. Schwarz, S., and U.-D. Reips. 2001. CGI versus JavaScript: A Web experiment on the reversed hindsight bias. In Dimensions of Internet Science, eds. U.-D. Reips and M. Bosnjak, 75-90. Lengerich: Pabst.
74. Smith, M. A., and B. Leigh. 1997. Virtual subjects: Using the Internet as an alternative source of subjects and research environment. Behavior Research Methods, Instruments, and Computers 29: 496-505.
75. Smyth, J. D., D. A. Dillman, L. M. Christian, and M. J. Stern. 2006. Effects of using visual design principles to group response options in Web surveys. International Journal of Internet Science 1: 6-16.
76. Stevenson, M. K. 1993. Decision making with long-term conse-quences: Temporal discounting for single and multiple out-comes in the future. Journal of Experimental Psychology: General 122: 3-22.
77. Stieger, S., and U.-D. Reips. 2010. What are participants doing while filling in an online questionnaire: A paradata collection tool and an empirical study. Computers in Human Behavior 26: 1488-1495.
78. Tuten, T. L., M. Bosnjak, and W. Bandilla. 2000. Banner-advertised Web surveys. Marketing Research 11(4): 17-21.
79. Tuten, T. L., D. J. Urban, and M. Bosnjak. 2002. Internet surveys and data quality: A review. In Online Social Sciences, eds. B. Batinic, U.-D. Reips, and M. Bosnjak, 7-26. Seattle, WA: Hofrefe and Huber.
80. Welch, N., and J. H. Krantz. 1996. The world-wide Web as a medium for psychoacoustical demonstrations and experi-ments: Experience and results. Behavior Research Methods, Instruments, and Computers 28: 192-196.
81. Wikibooks, n.d. Mac OS X Tiger/Using your Mac as a Web Server. http://en.wikibooks.org/wiki/Mac_OS_X_Tiger/Using_ your_Mac_as_a_Web_Server (accessed March 24, 2010).
82. Wikipedia. 2010. Ajax (programming). http://en.wikipedia.org/w/index.php?title=Ajax_(programming)andoldid=352212625 (accessed Jan. 27, 2010).
83. Williams, J. E., K. O. McGraw, and M. D. Tew. 1999. Undergraduate labs and computers: The case for PsychExps. Behavioral Research Methods, Instruments, and Computers 31(2): 287-291.