메뉴 건너뛰기




Volumn , Issue , 2015, Pages 1364-1378

Labin the wild: Conducting large-scale online experiments with uncompensated samples

Author keywords

crowdsourcing; Online experimentation; replication; social comparison; uncompensated samples; WEIRD

Indexed keywords

COMPUTER SUPPORTED COOPERATIVE WORK; CROWDSOURCING; INTERACTIVE COMPUTER SYSTEMS;

EID: 84963518126     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2675133.2675246     Document Type: Conference Paper
Times cited : (113)

References (39)
  • 1
    • 55349090313 scopus 로고    scopus 로고
    • The neglected 95%: Why American psychology needs to become less American
    • Arnett, J. The neglected 95%: Why American psychology needs to become less American. American Psychologist 63(7) (2008), 602-14.
    • (2008) American Psychologist , vol.63 , Issue.7 , pp. 602-614
    • Arnett, J.1
  • 2
    • 0035087628 scopus 로고    scopus 로고
    • The Reading the Mind in the Eyes Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism
    • Feb
    • Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., and Plumb, I. The "Reading the Mind in the Eyes" Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of child psychology and psychiatry, and allied disciplines 42, 2 (Feb. 2001), 241-251.
    • (2001) Journal of Child Psychology and Psychiatry, and Allied Disciplines , vol.42 , Issue.2 , pp. 241-251
    • Baron-Cohen, S.1    Wheelwright, S.2    Hill, J.3    Raste, Y.4    Plumb, I.5
  • 3
    • 84864517335 scopus 로고    scopus 로고
    • Using mechanical turk as a subject recruitment tool for experimental research
    • Berinsky, A. J., Huber, G. A., and Lenz, G. S. Using Mechanical Turk as a subject recruitment tool for experimental research. Political Analysis 20 (2012), 351-68.
    • (2012) Political Analysis , vol.20 , pp. 351-368
    • Berinsky, A.J.1    Huber, G.A.2    Lenz, G.S.3
  • 4
    • 79960392344 scopus 로고    scopus 로고
    • Amazons Mechanical Turk: A new source of inexpensive, yet high-quality, data?
    • Buhrmester, M., Kwang, T., and Gosling, S. D. Amazons Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science 6, 1 (2011), 3-5.
    • (2011) Perspectives on Psychological Science , vol.6 , Issue.1 , pp. 3-5
    • Buhrmester, M.1    Kwang, T.2    Gosling, S.D.3
  • 5
    • 0342422736 scopus 로고
    • Relation between the immediate memory span and the memory search rate
    • Cavanagh, J. P. Relation between the immediate memory span and the memory search rate. Psychological Review 79, 6 (1972), 525-530.
    • (1972) Psychological Review , vol.79 , Issue.6 , pp. 525-530
    • Cavanagh, J.P.1
  • 6
    • 0041850050 scopus 로고
    • The equivalence of target and nontarget processing in visual search
    • Nov
    • Cavanagh, J. P., and Chase, W. G. The equivalence of target and nontarget processing in visual search. Perception & Psychophysics 9, 6 (Nov. 1971), 493-495.
    • (1971) Perception & Psychophysics , vol.9 , Issue.6 , pp. 493-495
    • Cavanagh, J.P.1    Chase, W.G.2
  • 7
    • 0000336166 scopus 로고
    • Modality and similarity effects in short-Term recognition memory
    • Chase, W. G., and Calfee, R. C. Modality and similarity effects in short-Term recognition memory. J Exp Psychol 81, 3 (1969), 510-514.
    • (1969) J Exp Psychol , vol.81 , Issue.3 , pp. 510-514
    • Chase, W.G.1    Calfee, R.C.2
  • 8
    • 48749127077 scopus 로고    scopus 로고
    • Effect of a simple experimental control: The recall constraint in Sternbergs memory scanning task
    • Sept
    • Corbin, L., and Marquer, J. Effect of a simple experimental control: The recall constraint in Sternbergs memory scanning task. European Journal of Cognitive Psychology 20, 5 (Sept. 2008), 913-935.
    • (2008) European Journal of Cognitive Psychology , vol.20 , Issue.5 , pp. 913-935
    • Corbin, L.1    Marquer, J.2
  • 9
    • 34248955329 scopus 로고
    • Recoding strategies and the retrieval of information from memory
    • Cruse, D., and Clifton, Jr, C. Recoding strategies and the retrieval of information from memory. Cognitive Psychology 4, 2 (1973), 157-193.
    • (1973) Cognitive Psychology , vol.4 , Issue.2 , pp. 157-193
    • Cruse, D.1    Clifton, C.2
  • 10
    • 77954009273 scopus 로고    scopus 로고
    • Are your participants gaming the system?: Screening Mechanical Turk workers
    • ACM
    • Downs, J. S., Holbrook, M. B., Sheng, S., and Cranor, L. F. Are your participants gaming the system?: Screening Mechanical Turk workers. In Proc. CHI10, ACM (2010), 2399-2402.
    • (2010) Proc. CHI10 , pp. 2399-2402
    • Downs, J.S.1    Holbrook, M.B.2    Sheng, S.3    Cranor, L.F.4
  • 11
    • 77954526127 scopus 로고    scopus 로고
    • Emotional reactions to losing explain gender differences in entering a risky lottery
    • Eriksson, K., and Simpson, B. Emotional reactions to losing explain gender differences in entering a risky lottery. Judgment and Decision Making 5, 3 (2010), 159-163.
    • (2010) Judgment and Decision Making , vol.5 , Issue.3 , pp. 159-163
    • Eriksson, K.1    Simpson, B.2
  • 12
    • 4644234910 scopus 로고
    • A theory of social comparison processes
    • Festinger, L. A theory of social comparison processes. Human relations 7(2) (1954), 117-140.
    • (1954) Human Relations , vol.7 , Issue.2 , pp. 117-140
    • Festinger, L.1
  • 13
  • 15
    • 84879603028 scopus 로고    scopus 로고
    • Data collection in a flat world: The strengths and weaknesses of mechanical turk samples
    • Goodman, J. K., Cryder, C. E., and Cheema, A. Data collection in a flat world: The strengths and weaknesses of mechanical turk samples. Journal of Behavioral Decision Making 26, 3 (2013), 213-224.
    • (2013) Journal of Behavioral Decision Making , vol.26 , Issue.3 , pp. 213-224
    • Goodman, J.K.1    Cryder, C.E.2    Cheema, A.3
  • 16
    • 77953992027 scopus 로고    scopus 로고
    • Crowdsourcing graphical perception: Using Mechanical Turk to assess visualization design
    • Heer, J., and Bostock, M. Crowdsourcing graphical perception: Using Mechanical Turk to assess visualization design. In Proc. CHI10 (2010), 203-212.
    • (2010) Proc. CHI10 , pp. 203-212
    • Heer, J.1    Bostock, M.2
  • 18
  • 22
    • 57649217556 scopus 로고    scopus 로고
    • Crowdsourcing user studies with mechanical turk
    • ACM
    • Kittur, A., Chi, E. H., and Suh, B. Crowdsourcing user studies with Mechanical Turk. In Proc. CHI08, ACM (2008), 453-456.
    • (2008) Proc. CHI08 , pp. 453-456
    • Kittur, A.1    Chi, E.H.2    Suh, B.3
  • 23
    • 84877958002 scopus 로고    scopus 로고
    • Crowdsourcing performance evaluations of user interfaces
    • Komarov, S., Reinecke, K., and Gajos, K. Z. Crowdsourcing performance evaluations of user interfaces. In Proc. CHI13 (2013), 207-216.
    • (2013) Proc. CHI13 , pp. 207-216
    • Komarov, S.1    Reinecke, K.2    Gajos, K.Z.3
  • 25
    • 30344444323 scopus 로고    scopus 로고
    • Attention web designers: You have 50 milliseconds to make a good first impression!
    • Lindgaard, G., Fernandes, G., Dudek, C., and Brown, J. Attention web designers: You have 50 milliseconds to make a good first impression! Behaviour & Information Technology 25, 2 (2006), 115-126.
    • (2006) Behaviour & Information Technology , vol.25 , Issue.2 , pp. 115-126
    • Lindgaard, G.1    Fernandes, G.2    Dudek, C.3    Brown, J.4
  • 26
    • 82655180226 scopus 로고    scopus 로고
    • Conducting behavioral research on Amazons Mechanical Turk
    • Mason, W., and Suri, S. Conducting behavioral research on Amazons Mechanical Turk. Behavior research methods 44, 1 (2012), 1-23.
    • (2012) Behavior Research Methods , vol.44 , Issue.1 , pp. 1-23
    • Mason, W.1    Suri, S.2
  • 27
    • 0013968277 scopus 로고
    • Response times with a memory-dependent decision task
    • Nov
    • Nickerson, R. S. Response times with a memory-dependent decision task. J Exp Psychol 72, 5 (Nov. 1966), 761-769.
    • (1966) J Exp Psychol , vol.72 , Issue.5 , pp. 761-769
    • Nickerson, R.S.1
  • 28
    • 67651014851 scopus 로고    scopus 로고
    • Instructional manipulation checks: Detecting satisficing to increase statistical power
    • Oppenheimer, D., Meyvis, T., and Davidenko, N. Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology 45, 4 (2009), 867-872.
    • (2009) Journal of Experimental Social Psychology , vol.45 , Issue.4 , pp. 867-872
    • Oppenheimer, D.1    Meyvis, T.2    Davidenko, N.3
  • 29
    • 84921258882 scopus 로고    scopus 로고
    • Demand characteristics and the concept of quasi-controls
    • R. Rosenthal and R L. Rosnow, Eds. Oxford University Press, July ch. 5
    • Orne, M. T. Demand characteristics and the concept of quasi-controls. In Artifacts in Behavioral Research, R. Rosenthal and R. L. Rosnow, Eds. Oxford University Press, July 2009, ch. 5.
    • (2009) Artifacts in Behavioral Research
    • Orne, M.T.1
  • 31
    • 84857918066 scopus 로고    scopus 로고
    • The promise of Mechanical Turk: How online labor markets can help theorists run behavioral experiments
    • Rand, D. G. The promise of Mechanical Turk: How online labor markets can help theorists run behavioral experiments. Journal of theoretical biology (2012).
    • (2012) Journal of Theoretical Biology
    • Rand, D.G.1
  • 32
    • 84900413258 scopus 로고    scopus 로고
    • Quantifying visual preferences around the world
    • ACM
    • Reinecke, K., and Gajos, K. Z. Quantifying visual preferences around the world. In Proc. CHI14, ACM (2014), 11-20.
    • (2014) Proc. CHI14 , pp. 11-20
    • Reinecke, K.1    Gajos, K.Z.2
  • 33
    • 84874833853 scopus 로고    scopus 로고
    • Doodle around the world: Online scheduling behavior reflects cultural differences in time perception and group decision-making
    • ACM
    • Reinecke, K., Nguyen, M. K., Bernstein, A., Näf, M., and Gajos, K. Z. Doodle around the world: Online scheduling behavior reflects cultural differences in time perception and group decision-making. In Proc. CSCW13, ACM (2013), 45-54.
    • (2013) Proc. CSCW13 , pp. 45-54
    • Reinecke, K.1    Nguyen, M.K.2    Bernstein, A.3    Näf, M.4    Gajos, K.Z.5
  • 34
    • 79955134548 scopus 로고    scopus 로고
    • Designing incentives for inexpert human raters
    • ACM
    • Shaw, A. D., Horton, J. J., and Chen, D. L. Designing incentives for inexpert human raters. In Proc. CSCW11, ACM (2011), 275-284.
    • (2011) Proc. CSCW11 , pp. 275-284
    • Shaw, A.D.1    Horton, J.J.2    Chen, D.L.3
  • 35
    • 0014006763 scopus 로고
    • High-speed scanning in human memory
    • Aug
    • Sternberg, S. High-speed scanning in human memory. Science 153, 3736 (Aug. 1966), 652-654.
    • (1966) Science , vol.153 , Issue.3736 , pp. 652-654
    • Sternberg, S.1
  • 36
    • 0001887831 scopus 로고
    • Two operations in character recognition: Some evidence from reaction-Time measurements
    • Sternberg, S. Two operations in character recognition: Some evidence from reaction-Time measurements. Perception & Psychophysics 2, 2 (1967), 45-53.
    • (1967) Perception & Psychophysics , vol.2 , Issue.2 , pp. 45-53
    • Sternberg, S.1
  • 39
    • 78049367748 scopus 로고    scopus 로고
    • Evidence for a collective intelligence factor in the performance of human groups
    • Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N., and Malone, T. W. Evidence for a collective intelligence factor in the performance of human groups. science 330, 6004 (2010), 686-688.
    • (2010) Science , vol.330 , Issue.6004 , pp. 686-688
    • Woolley, A.W.1    Chabris, C.F.2    Pentland, A.3    Hashmi, N.4    Malone, T.W.5


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.