What are participants doing while filling in an online questionnaire: A paradata collection tool and an empirical study

Computers in Human Behavior

Volumn 26, Issue 6, 2010, Pages 1488-1495

  Stieger, Stefan ^a   Reips, Ulf Dietrich ^b,c  

^a UNIVERSITY OF VIENNA   (Austria)

^b UNIVERSITY OF DEUSTO   (Spain)

^c BASQUE FOUNDATION FOR SCIENCE   (Spain)

Author keywords

Non reactive data; Online questionnaire; Paradata; Response behavior; Response latency; Response visualization

Indexed keywords

NON-REACTIVE DATA; ONLINE QUESTIONNAIRE; PARADATA; RESPONSE BEHAVIOR; RESPONSE LATENCY; RESPONSE VISUALIZATION;

BEHAVIORAL RESEARCH; SURVEYS; VISUALIZATION;

DATA VISUALIZATION;

EID: 77956188835     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2010.05.013     Document Type: Article

References (45)

1. Adams, C., & Kleiss, J. (2003). An overview of Ergosoft's usability testing method. Retrieved 18.3.2010.
2. A. Baravalle, and V. Lanfranchi Remote Web usability testing Behavior Research Methods, Instruments, and Computers 35 2003 364 368
3. J.N. Bassili, and J.F. Fletcher Response-time measurement in survey research: A method for CATI and a new look at nonattitudes Public Opinion Quarterly 55 1991 331 346
4. B. Batinic, and M. Bosnjak Fragebogenuntersuchungen im Internet [Questionnaire studies on the Internet] B. Batinic, Internet für Psychologen 2000 Hogrefe Göttingen 287 317
5. M.H. Birnbaum Human research and data collection via the Internet Annual Review of Psychology 55 2004 803 832
6. M.H. Birnbaum, and U.-D. Reips Behavioral research and data collection via the Internet R.W. Proctor, K.-P.L. Vu, The handbook of human factors in Web design 2005 Erlbaum Mahwah, New Jersey 471 492
7. Buchanan, T., & Reips, U.-D. (2001). Platform-dependent biases in online research: Do Mac users really think different? In: K. J. Jonas, P. Breuer, B. Schauenburg, & M. Boos (Eds.), Perspectives on Internet Research: Concepts and Methods. Retrieved 18.3.2010.
8. C.D. Chambers, and M. Brown Timing accuracy under Microsoft Windows revealed through external chronometry Behavior Research Methods, Instruments, and Computers 35 2003 96 108
9. P.E. Converse Attitudes and non-attitudes: Continuation of a dialogue E.R. Tufte, The quantitative analysis of social problems 1970 Addison-Wesley Reading, MA 168 189
10. M.P. Couper Usability evaluation of computer-assisted survey instruments Social Science Computer Review 18 2000 384 396
11. M.P. Couper, M.W. Traugott, and M.J. Lamias Web survey design and administration Public Opinion Quarterly 65 2001 230 253
12. Cugini, J., & Laskowski, S. 2001. Design of a file format for logging website interaction. In: NIST Special Publications 500-248. Retrieved 18.3.2010.
13. Edmonds, A. 2001. Lucidity. Retrieved 18.3.2010.
14. A. Edmonds Uzilla: A new tool for Web usability testing Behavior Research Methods, Instruments, and Computers 35 2003 194 201
15. M. Etgen, and J. Cantor What does getting WET (Web Event-logging Tool): Mean for Web usability? In: Proceedings of the Fifth Conference on Human Factors and the Web 1999 Gaithersburg MD
16. F. Funke, and U.-D. Reips Messinstrumente und Skalen [Measuring devices and scales] M. Welker, O. Wenzel, Online-Forschung 2007: Grundlagen und Fallstudien 2007 Herbert von Halem Köln 52 76
17. M. Gellner, and F. Forbrig ObSys-A tool for visualizing usability evaluation patterns with mousemaps J. Jacko, C. Stephanidis, Human-computer interaction: Vol. 1. Theory and practice, proceedings of the 10th international conference on HCI 2003 Erlbaum Mahwah, NJ 469 473
18. D. Heerwegh Explaining response latencies and changing answers using client-side paradata from a web survey Social Science Computer Review 21 2003 360 373
19. D.M. Hilbert, and D.F. Redmiles Extracting usability information from user interface events ACM Computing Surveys 32 2000 384 421
20. J.I. Hong, J. Heer, S. Waterson, and J.A. Landay WebQuilt: A proxy-based approach to remote web usability testing ACM Transactions on Informations Systems 19 2001 263 285
21. M.Y. Ivory, and M.A. Hearst The state of the art in automating usability evaluation of user interfaces ACM Computing Surveys 33 2001 470 516
22. A. Jeavons Ethology and the Web. Observing respondent behavior in web surveys Marketing and Research Today 28 1999 69 76
23. E. Kaufmann, and U.-D. Reips Internet-basierte Messung sozialer Erwünschtheit [Internet-based measurement of social desirability] 2008 VDM Verlag Dr. Müller Saarbrücken
24. E. Nichols, and B. Sedivi Economic data collection via the Web: A census bureau case study. In: Proceedings of the survey research methods section (pp. 366-371) 1998 American Statistical Association Alexandria, VA
25. NIST (1999). WebVIP: Overview. Retrieved 18.3.2010.
26. R. Ratcliff Methods for dealing with reaction time outliers Psychological Bulletin 114 1993 510 532
27. Reeder, R. W., Pirolli, P., & Card, S. K. (2001). WebLogger: A data collection tool for Web-use studies. UIR technical reports (UIR-R-2000-6). Xerox PARC.
28. U.-D. Reips Psychological experimenting on the Internet B. Batinic, Internet für Psychologen 1997 Hogrefe Göttingen 245 265
29. U.-D. Reips The Web experiment method: Advantages, disadvantages, and solutions M.H. Birnbaum, Psychological experiments on the Internet 2000 Academic Press San Diego 89 117
30. U.-D. Reips The Web Experimental Psychology Lab: Five years of data collection on the Internet Behavior Research Methods, Instruments, and Computers 33 2001 201 211
31. U.-D. Reips The methodology of Internet-based experiments A. Joinson, K. McKenna, T. Postmes, U.-D. Reips, The Oxford handbook of Internet psychology 2007 Oxford University Press Oxford, UK 373 390
32. Reips, U.-D. (2009). Schöne neue Forschungswelt: Zukunftstrends [Beautiful new world of research: Future trends]. Nicht-reaktive Erhebungsverfahren (pp. 129-138). Bonn, Germany: GESIS Schriftenreihe, Band 1.
33. U.-D. Reips Design and formatting in Internet-based research S. Gosling, J. Johnson, Advanced internet methods in the behavioral sciences 2010 American Psychological Association Washington, DC 29 43
34. Reips, U.-D. (submitted for publication). Reaction times in internet-based versus laboratory research: Potential problems and a solution.
35. U.-D. Reips, and F. Funke Interval level measurement with visual analogue scales in Internet-based research: VAS generator Behavior Research Methods 40 2008 699 704
36. U.-D. Reips, and R. Lengler The Web experiment list: A Web service for the recruitment of participants and archiving of Internet-based experiments Behavior Research Methods 37 2005 287 292
37. U.-D. Reips, and S. Stieger Scientific LogAnalyzer: A web-based tool for analyses of server log files in psychological research Behavior Research Methods, Instruments, and Computers 36 2004 304 311
38. W.C. Schmidt Presentation accuracy of web animation methods Behavior Research Methods, Instruments, and Computers 33 2001 187 200
39. W.C. Schmidt Technical considerations when implementing online research A.N. Joinson, K.Y.A. McKenna, T. Postmes, U.-D. Reips, The Oxford handbook of Internet psychology 2007 Oxford University Press Oxford, UK 461 472
40. S. Schwarz, and U.-D. Reips CGI versus JavaScript: A web experiment on the reversed hindsight bias U.-D. Reips, M. Bosnjak, Dimensions of internet science 2001 Pabst Lengerich 75 90
41. S. Stieger, and A. Göritz Using instant messaging for Internet-based interviews CyberPsychology and Behavior 9 2006 552 559
42. S. Stieger, and U.-D. Reips Dynamic interviewing program (DIP): Automatic online interviews via the instant messenger ICQ CyberPsychology and Behavior 11 2008 201 207
43. Turnbull, D. (1998). WebTracker: A tool for understanding Web use. Retrieved 18.3.2010.
44. M. Voracek, S. Stieger, and A. Gindl Online replication of evolutionary psychological evidence. Sex differences in sexual jealousy in imagined scenarios of mate's sexual versus emotional infidelity U.-D. Reips, M. Bosnjak, Dimensions of internet science 2001 Pabst Lengerich 91 112
45. M. Wittchen, D. Schlereth, and G. Hertel Indispensability effects in spite of temporal and spatial separation: Motivation gains in a sequential task during anonymous cooperation on the Internet International Journal of Internet Science 2 2007 12 27