From question-behaviour effects in trials to the social psychology of research participation

Psychology and Health

Volumn 30, Issue 1, 2015, Pages 72-84

  McCambridge, Jim ^a  

^a LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

Author keywords

demand characteristics; Hawthorne effect; mere measurement effect; question behaviour effect; randomised controlled trials; research participation

Indexed keywords

HEALTH BEHAVIOR; HUMAN; PSYCHOLOGY; RANDOMIZED CONTROLLED TRIAL (TOPIC); RESEARCH SUBJECT; SOCIAL PSYCHOLOGY; STATISTICAL BIAS;

BIAS (EPIDEMIOLOGY); HEALTH BEHAVIOR; HUMANS; PSYCHOLOGY, SOCIAL; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH SUBJECTS;

EID: 84918549014     PISSN: 08870446     EISSN: 14768321     Source Type: Journal    
DOI: 10.1080/08870446.2014.953527     Document Type: Article

References (80)

1. Adamson, J., Cockayne, S., Puffer, S., & Torgerson, D. J. (2006). Review of randomised trials using the post-randomised consent (Zelen’s) design. Contemporary Clinical Trials, 27, 305–319.10.1016/j.cct.2005.11.003
2. Allen, E., Polikina, O., Saburova, L., McCambridge, J., Elbourne, D., Pakriev, S., … Leon, D. A. (2011). The efficacy of a brief intervention in reducing hazardous drinking in working age men in Russia: The HIM (Health for Izhevsk men) individually randomised parallel group exploratory trial. Trials, 12, 238. doi:10.1186/1745-6215-12-23810.1186/1745-6215-12-238
3. Amrhein, P. C., Miller, W. R., Yahne, C. E., Palmer, M., & Fulcher, L. (2003). Client commitment language during motivational interviewing predicts drug use outcomes. Journal of Consulting and Clinical Psychology, 71, 862–878.10.1037/0022-006X.71.5.862
4. Ayling, K., Brierley, S., Johnson, B., Heller, S., & Eiser, C. (2015). How standard is standard care? Exploring control group outcomes in behaviour change interventions for young people with type 1 diabetes. Psychology & Health, 30(1), 85–103.
5. Ayres, K., Conner, M., Prestwich, A., Hurling, R., Cobain, M., Lawton, R., & O’Connor, D. B. (2013). Exploring the question-behaviour effect: Randomized controlled trial of motivational and question-behaviour interventions. British Journal of Health Psychology, 18, 31–44. doi:10.1111/j.2044-8287.2012.02075.x10.1111/bjhp.2013.18.issue-1
6. Bishop, F. L., Fenge-Davies, A. L., Kirby, S., & Geraghty, A. W. A. (2015). Context effects and behaviour change techniques in randomized trials: A systematic review using the example of trials to increase adherence to physical activity in musculoskeletal pain. Psychology & Health, 30(1), 104–121.
7. Bravata, D. M., Smith-Spangler, C., Sundaram, V., Gienger, A. L., Lin, N., & Lewis, R., … Sirard, J. R. (2007). Using pedometers to increase physical activity and improve health: A systematic review. Journal of American Medical Association, 298, 2296–2304. doi:10.1001/jama.298.19.229610.1001/jama.298.19.2296
8. Brewin, C. R., & Bradley, C. (1989). Patient preferences and randomized clinical trials. British Medical Journal, 299, 313–315.10.1136/bmj.299.6694.313
9. Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297–312.10.1037/h0040950
10. Cartwright, M., Ogden, J., Grunfeld, E. A., & Weinman, J. (2012). Can self-report questionnaires create illness cognitions in middle-aged men? Health Psychology, 31, 534–538. doi:10.1037/a002650410.1037/a0026504
11. Chiesa, M., & Hobbs, S. (2008). Making sense of social research: How useful is the Hawthorne effect? European Journal of Social Psychology, 38, 67–74. doi:10.1002/ejsp.40110.1002/(ISSN)1099-0992
12. Clemes, S. A., & Parker, R. A. (2009). Increasing our understanding of reactivity to pedometers in adults. Medicine and Science in Sports and Exercise, 41, 674–680. doi:10.1249/MSS.0b013e31818cae32
13. Clifford, P. R., & Maisto, S. A. (2000). Subject reactivity effects and alcohol treatment outcome research. Journal of Studies on Alcohol, 61, 787–793.
14. Conner, M., Godin, G., Norman, P., & Sheeran, P. (2011). Using the question-behavior effect to promote disease prevention behaviors: Two randomized controlled trials. Health Psychology, 30, 300–309. 2011-09497-008[pii]. doi:10.1037/a0023036
15. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis. issues for field settings. Chicago, IL: Rand McNally.
16. Cooke, R., & French, D. P. (2011). The role of context and timeframe in moderating relationships within the theory of planned behaviour. Psychology & Health, 26, 1225–1240. doi:10.1080/08870446.2011.57226010.1080/08870446.2011.572260
17. Cox, A. D., Cox, D., Cyrier, R., Graham-Dotson, Y., & Zimet, G. D. (2012). Can self-prediction overcome barriers to Hepatitis B vaccination? A randomized controlled trial. Health Psychology, 31, 97–105.10.1037/a0025298
18. Crutzen, R., Viechtbauer, W., Spigt, M., & Kotz, D. (2015). Differential attrition in health behaviour change trials: A systematic review and meta-analysis. Psychology & Health, 30(1), 122–134.
19. Cunningham, J. A., Kypri, K., & McCambridge, J. (2013, Decemner 6). Exploratory randomized controlled trial evaluating the impact of a waiting list control design. BMC Medical Research Methodology, 13, 150. [Epub ahead of print].10.1186/1471-2288-13-150
20. Davis, C. G., Thake, J., & Vilhena, N. (2010). Social desirability biases in self-reported alcohol consumption and harms. Addictive Behaviors, 35, 302–311. doi:10.1016/j.addbeh.2009.11.00110.1016/j.addbeh.2009.11.001
21. de Bruin, M., McCambridge, J., & Prins, J. M. (2015). Reducing the risk of bias in health behaviour change trials: Improving trial design, reporting, or bias assessment criteria? A review and Case study. Psychology & Health, 30(1), 8–34.
22. Dholakia, U. M. (2010). A critical review of question-behavior effect research. Review of Marketing Research, 7, 145–197. doi:10.1108/S1548-6435(2010)000000700910.1108/S1548-6435(2010)0000007009
23. Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, mail, and mixed-mode surveys: The tailored design method. Hoboken, NJ: Wiley.
24. Etter, J. F. (2004). Asking about quantity and frequency of alcohol consumption before asking the CAGE questions produces lower ratings on the CAGE test. Drug and Alcohol Dependence, 74, 211–214.10.1016/j.drugalcdep.2003.12.007
25. Evers, S. M. A. A., Hiligsmann, M., & Adarkwah, C. C. (2015). Risk of bias in trial-based economic evaluations: Identification of sources and bias-reducing strategies. Psychology & Health, 30(1), 52–71.
26. Feil, P. H., Grauer, J. S., Gadbury-Amyot, C. C., Kula, K., & McCunniff, D. D. S. (2002). Intentional use of the Hawthorne effect to improve oral hygiene compliance in orthodontic patients. Journal of Dental Education, 66, 1129–1135.
27. Feldman, J. M., & Lynch, J. G. (1988). Self-generated validity and other effects of measurement on belief, attitude, intention, and behavior. Journal of Applied Psychology, 73, 421–435.10.1037/0021-9010.73.3.421
28. Fitzsimons, G. J., & Moore, S. G. (2008). Should we ask our children about sex, drugs and rock & roll? Potentially harmful effects of asking questions about risky behaviors. Journal of Consumer Psychology, 18, 82–95.10.1016/j.jcps.2008.01.002
29. Freedland, K. E., Mohr, D. C., Davidson, K. W., & Schwartz, J. E. (2011). Usual and unusual care: Existing practice control groups in randomized controlled trials of behavioral interventions. Psychosomatic Medicine, 73, 323–335. doi:10.1097/PSY.0b013e318218e1fb10.1097/PSY.0b013e318218e1fb
30. French, D. P., & Sutton, S. (2010). Reactivity of measurement in health psychology: How much of a problem is it? What can be done about it? British Journal of Health Psychology, 15, 453–468. bjhp777[pii]. doi:10.1348/135910710X492341
31. French, J. R. P. (1953). Experiments in field settings. In L. Festinger & D. Katz (Eds.), Research methods in the behavioral sciences (pp. 1–10). New York, NY: Holt, Rinehart & Winston.
32. Godin, G., Bélanger-Gravel, A., Amireault, S., Vole, M. C., & Perusse, L. (2011). The effect of mere-measurement of cognitions on physical activity behavior: A randomized controlled trial among overweight and obese individuals. International Journal of Behavioral Nutrition and Physical Activity, 8, 2.10.1186/1479-5868-8-2
33. Godin, G., Bélanger-Gravel, A., Vézina-Im, L. A., Amireault, S., & Bilodeau, A. (2012). Question–behaviour effect: A randomised controlled trial of asking intention in the interrogative or declarative form. Psychology & Health, 27, 1086–1099.
34. Godin, G., Germain, M., Conner, M., Delage, G., & Sheeran, P. (2014). Promoting the return of lapsed blood donors: A seven-arm randomized controlled trial of the question-behavior effect. Health Psychology, 33, 646–655. doi:10.1037/a0033505
35. Godin, G., Sheeran, P., Conner, M., Delage, G., Germain, M., Belanger-Gravel, A., & Naccache, H. (2010). Which survey questions change behavior? Randomized controlled trial of mere measurement interventions. Health Psychology, 29, 636–644. doi:10.1037/a002113110.1037/a0021131
36. Godin, G., Sheeran, P., Conner, M., & Germain, M. (2008). Asking questions changes behavior: Mere measurement effects on frequency of blood donation. Health Psychology, 27, 179–184. 2008-03424-006[pii]. doi:10.1037/0278-6133.27.2.179
37. Greenwald, A. G., Carnot, C. G., Beach, R., & Young, B. (1987). Increasing voting behaviour by asking young people if they expect to vote. Journal of Applied Psychology, 72, 315–318.10.1037/0021-9010.72.2.315
38. Higgins, J. P. T., Altman, D. G., Sterne, J. A. C. on behalf of the Cochrane Statistical Methods Group and the Cochrane Bias Methods Group. (2011). Chapter 8: Assessing risk of bias in included studies. In J. P. T. Higgins & S. Green (Eds.), Cochrane handbook for systematic reviews of interventions version 5.1.0 (updated March 2011). The Cochrane Collaboration. Retrieved from www.cochrane-handbook.org
39. Johnson, B. T., Low, R. E., & MacDonald, H. V. (2015). Panning for the gold in health research: Incorporating studies’ methodological quality in meta-analysis. Psychology & Health, 30(1), 135–152.
40. Kassam, K. S., & Mendes, W. B. (2013). The effects of measuring emotion: Physiological reactions to emotional situations depend on whether someone is asking. PLoS ONE, 8, e64959. doi:10.1371/journal.pone.006495910.1371/journal.pone.0064959
41. King, M., Nazareth, I., Lampe, F., Bower, P., Chandler, M., Morou, M., … Lai, R. (2005). Impact of participant and physician intervention preferences on randomized trials: A systematic review. Journal of American Medical Association, 293, 1089–1099.10.1001/jama.293.9.1089
42. Kirsch, I. (2000). Are drug and placebo effects in depression additive? Biological Psychiatry, 47, 733–735. S0006-3223(00)00832-5[pii]
43. Kuntsche, E., & Labhart, F. (2013). ICAT: Development of an Internet-based data collection method for ecological momentary assessment using personal cell phones. European Journal of Psychological Assessment, 29, 140–148. doi:10.1027/1015-5759/a00013710.1027/1015-5759/a000137
44. Kvalem, I. L., Sundet, J. M., Rivo, K. I., Eilertsen, D. A., & Bakketeig, L. S. (1996). The effect of sex education on adolescents’ use of condoms: Applying the solomon four-group design. Health Education Quarterly, 23, 34–47.10.1177/109019819602300103
45. Kypri, K., McCambridge, J., Wilson, A., Attia, J., Sheeran, P., Bowe, S., & Vater, T. (2011). Effects of study design and allocation on participant behaviour – ESDA: Study protocol for a randomized controlled trial. Trials, 12, 42. 1745-6215-12-42[pii]. doi:10.1186/1745-6215-12-4210.1186/1745-6215-12-42
46. Lawrence, C., & Ferguson, E. (2012). The role of context stability and behavioural stability in the mere measurement effect: An examination across six behaviours. Journal of Health Psychology, 17, 1041–1052. doi:10.1177/135910531143334610.1177/1359105311433346
47. McCambridge, J. (2009). Research assessments: Instruments of bias and brief interventions of the future? Addiction, 104, 1311–1312. ADD2684[pii]. doi:10.1111/j.1360-0443.2009.02684.x
48. McCambridge, J., Butor-Bhavsar, K., Witton, J., & Elbourne, D. (2011). Can research assessments themselves cause bias in behaviour change trials? A systematic review of evidence from Solomon 4-group studies. PLoS ONE, 6, e25223.10.1371/journal.pone.0025223
49. McCambridge, J., de Bruin, M., & Witton, J. (2012). The effects of demand characteristics on research participant behaviours in non-laboratory settings: A systematic review. PLoS ONE, 7, e39116. doi:10.1371/journal.pone.003911610.1371/journal.pone.0039116
50. McCambridge, J., & Kypri, K. (2011). Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials. PLoS ONE, 6, e23748. doi:10.1371/journal.pone.002374810.1371/journal.pone.0023748
51. McCambridge, J., Kypri, K., Attia, J., & Elbourne, D. (2009). Re: Promoting regular mammography screening I. A systematic assessment of validity in a randomized trial. Journal of the National Cancer Institute, 101, 1029–1030. djp154[pii]. doi:10.1093/jnci/djp15410.1093/jnci/djp154
52. McCambridge, J., Kypri, K., & Elbourne, D. (2014). In randomisation we trust? There are overlooked problems in experimenting with people in behavioural intervention trials. Journal of Clinical Epidemiology, 67, 247–253.
53. McCambridge, J., Sorhaindo, A., Quirk, A., & Nanchahal, K. (2014). Patient preferences and performance bias in a weight loss trial with a usual care arm. Patient Education and Counseling. doi:10.1016/j.pec.2014.1001.1003
54. McCambridge, J., Witton, J., & Elbourne, D. (2014). Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. Journal of Clinical Epidemiology, 67, 267–277.
55. Milton, A. C., & Mullan, B. (2012). An application of the theory of planned behavior – A randomized controlled food safety pilot intervention for young adults. Health Psychology, 31, 250–259.10.1037/a0025852
56. O’Carroll, R. E., Dryden, J., Hamilton-Barclay, T., & Ferguson, E. (2011). Anticipated regret and organ donor registration – A pilot study. Health Psychology, 30, 661–664. 2011-11462-001[pii]. doi: 10.1037/a002418210.1037/a0024182
57. Orne, M. T. (1959). The nature of hypnosis: Artifact and essence. Journal of Abnormal and Social Psychology, 58, 277–299.10.1037/h0046128
58. Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17, 776–783.10.1037/h0043424
59. Park, E. W., Tudiver, F. G., & Campbell, T. (2012). Enhancing partner support to improve smoking cessation. Cochrane Database of Systematic Reviews. Art. No. CD002928. doi:10.1002/14651858.CD002928.pub3
60. Preference Collaborative Review Group. (2008). Patients’ preferences within randomised trials: Systematic review and patient level meta-analysis. British Medical Journal, 337, a1864.
61. Sandberg, T., & Conner, M. (2009). A mere measurement effect for anticipated regret: Impacts on cervical screening attendance. British Journal of Social Psychology, 48, 221–236. 305324[pii]. doi:10.1348/014466608X34700110.1348/014466608X347001
62. Sandberg, T., & Conner, M. (2011). Using self-generated validity to promote exercise behaviour. British Journal of Social Psychology, 50, 769–783. doi:10.1111/j.2044-8309.2010.02004.x10.1111/bjso.2011.50.issue-4
63. Schwarz, N. (2007). Cognitive aspects of survey methodology. Applied Cognitive Psychology, 21, 277–287.10.1002/(ISSN)1099-0720
64. Sherman, S. J. (1980). On the self-erasing nature of errors of prediction. Journal of Personality and Social Psychology, 39, 211–221.10.1037/0022-3514.39.2.211
65. Sigall, H., & Mills, J. (1998). Measures of independent variables and mediators are useful in social psychology experiments: But are they necessary? Personality and Social Psychology Review, 2, 218–226. doi:10.1207/s15327957pspr0203_510.1207/pspr.1998.2.issue-3
66. Silverman, W. A., & Altman, D. G. (1996). Patients’ preferences and randomised trials. Lancet, 347, 171–174.10.1016/S0140-6736(96)90347-5
67. Solomon, R. L. (1949). An extension of control group design. Psychological Bulletin, 46, 137–150.10.1037/h0062958
68. Sommer, R. (1968). The Hawthorne dogma. Psychological Bulletin, 70, 592–595. doi:10.1037/h002672810.1037/h0026728
69. Spangenberg, E. R., & Greenwald, A. G. (1999). Social influence by requesting self-prophecy. Journal of Consumer Psychology, 8, 61–89.10.1207/s15327663jcp0801_03
70. Spangenberg, E. R., Greenwald, A. G., & Sprott, D. E. (2008). Will you read this article’s abstract? Theories of the question–behavior effect. Journal of Consumer Psychology, 18, 102–106.10.1016/j.jcps.2008.02.002
71. Sprott, D. E., Spangenberg, E. R., Block, L. G., Fitzsimons, G. J., Moritz, V. G., & Williams, P. (2006). The question-behavior effect: What we know and where we go from here. Social Influence, 1, 128–137.10.1080/15534510600685409
72. Sprott, D. E., Spangenberg, E. R., & Fisher, R. J. (2003). The importance of normative beliefs to the self-prophecy effect. Journal of Applied Psychology, 88, 423–431.10.1037/0021-9010.88.3.423
73. Tarquinio, C., Kivits, J., Minary, L., Coste, J., & Alla, F. (2015). Evaluating complex interventions: Perspectives and issues for health behaviour change interventions. Psychology & Health, 30(1), 35–51.
74. Todd, J., & Mullan, B. (2011). Using the theory of planned behaviour and prototype willingness model to target binge drinking in female undergraduate university students. Addictive Behaviors, 36, 980–986. doi:10.1016/j.addbeh.2011.05.01010.1016/j.addbeh.2011.05.010
75. Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133, 859–883. 2007-12463-007[pii]. doi:10.1037/0033-2909.133.5.85910.1037/0033-2909.133.5.859
76. Van Dongen, A. M., Abraham, C., Ruiter, R. A. C., & Veldhuizen, I. J. T. (2013). Does questionnaire distribution promote blood donation? An investigation of question-behavior effects. Annals Behavioral Medicine, 45, 163–172.10.1007/s12160-012-9449-3
77. Willson, V. L., & Putnam, R. R. (1982). A meta-analysis of pretest sensitization effects in experiemntal design. American Educational Research Journal, 19, 249–258.10.3102/00028312019002249
78. Wood, C., Conner, M., Sandberg, T., Godin, G., & Sheeran, P. (2014). Why does asking questions change health behaviours? The mediating role of attitude accessibility. Psychology & Health, 29, 390–404. doi:10.1080/08870446.2013.858343
79. Zelen, M. (1979). A new design for randomized clinical trials. New England Journal of Medicine, 300, 1242–1245.10.1056/NEJM197905313002203
80. Zelen, M. (1990). Randomized consent designs for clinical trials: An update. Statistics in Medicine, 9, 654–656.