Can research assessments themselves cause bias in behaviour change trials? A systematic review of evidence from Solomon 4-group studies

PLoS ONE

Volumn 6, Issue 10, 2011, Pages

  McCambridge, Jim ^a   Butor Bhavsar, Kaanan ^a   Witton, John ^b   Elbourne, Diana ^a  

^a LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^b KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIOR CHANGE; CONTROLLED CLINICAL TRIAL (TOPIC); EFFECT SIZE; HEALTH PROMOTION; HIGH SCHOOL; HUMAN; INTERNAL VALIDITY; INTERVENTION STUDY; MEDICAL RESEARCH; METHODOLOGY; OUTCOME ASSESSMENT; OUTCOMES RESEARCH; PRIMARY SCHOOL; REVIEW; SYSTEMATIC ERROR; SYSTEMATIC REVIEW; VALIDATION STUDY; ADULT; BEHAVIOR THERAPY; CHILD; OBSERVER VARIATION; RANDOMIZED CONTROLLED TRIAL (TOPIC);

ADULT; BEHAVIOR THERAPY; CHILD; HUMANS; OBSERVER VARIATION; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 80054791687     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0025223     Document Type: Review

References (45)

1. Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ, (2006) Global and regional burden of disease and risk factors, 2001: Systematic analysis of population health data. Lancet 367: 1747-1757.
2. Institute for Government & UK Government Cabinet Office (2010) MINDSPACE: Influencing behaviour through public policy.
3. Solomon RL, (1949) An extension of control group design. Psychol Bull 46: 137-150.
4. Fox MC, Ericsson KA, Best R, (2011) Do procedures for verbal reporting of thinking have to be reactive? A meta-analysis and recommendations for best reporting methods. Psychol Bull 137: 316-344.
5. Campbell DT, (1957) Factors relevant to the validity of experiments in social settings. Psychol Bull 54: 297-312.
6. Kirsch I, (2000) Are drug and placebo effects in depression additive? Biol Psychiatry 47: 733-735.
7. Kirsch I, Deacon BJ, Huedo-Medina TB, Scoboria A, Moore TJ, et al. (2008) Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration. PLoS Med 5: e45.
8. Kaptchuk TJ, Kelley JM, Conboy LA, Davis RB, Kerr CE, et al. (2008) Components of placebo effect: randomised controlled trial in patients with irritable bowel syndrome. BMJ 336: 999-1003.
9. McCambridge J, (2009) [Commentary] Research assessments: instruments of bias and brief interventions of the future? Addiction 104: 1311-1312.
10. Daeppen JB, Gaume J, Bady P, Yersin B, Calmes JM, et al. (2007) Brief alcohol intervention and alcohol assessment do not influence alcohol use in injured patients treated in the emergency department: a randomized controlled clinical trial. Addiction 102: 1224-1233.
11. del Junco DJ, Vernon SW, Coan SP, Tiro JA, Bastian LA, et al. (2008) Promoting regular mammography screening I. A systematic assessment of validity in a randomized trial. J Natl Cancer Inst 100: 333-346.
12. Cherpitel CJ, Korcha RA, Moskalewicz J, Swiatkiewicz G, Ye Y, et al. (2010) Screening, brief intervention, and referral to treatment (SBIRT): 12-month outcomes of a randomized controlled clinical trial in a Polish emergency department. Alcohol Clin Exp Res 34: 1922-1928.
13. Kypri K, Langley JD, Saunders JB, Cashell-Smith ML, (2007) Assessment may conceal therapeutic benefit: findings from a randomized controlled trial for hazardous drinking. Addiction 102: 62-70.
14. Carey KB, Carey MP, Maisto SA, Henson JM, (2006) Brief motivational interventions for heavy college drinkers: A randomized controlled trial. Journal of Consulting and Clinical Psychology 74: 943-954.
15. Clifford PR, Maisto SA, Davis CM, (2007) Alcohol treatment research assessment exposure subject reactivity effects part I. Alcohol use and related consequences. Journal of Studies on Alcohol and Drugs 68: 519-528.
16. Godin G, Sheeran P, Conner M, Germain M, (2008) Asking questions changes behavior: mere measurement effects on frequency of blood donation. Health Psychol 27: 179-184.
17. McCarney R, Warner J, Iliffe S, van Haselen R, Griffin M, et al. (2007) The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol 7: 30.
18. Sandberg T, Conner M, (2009) A mere measurement effect for anticipated regret: impacts on cervical screening attendance. Br J Soc Psychol 48: 221-236.
19. Walters ST, Vader AM, Harris TR, Jouriles EN, (2009) Reactivity to alcohol assessment measures: an experimental test. Addiction 104: 1305-1310.
20. McCambridge J, Day M, (2008) Randomized controlled trial of the effects of completing the Alcohol Use Disorders Identification Test questionnaire on self-reported hazardous drinking. Addiction 103: 241-248.
21. Kraut RE, Mcconahay Jb, (1973) How Being Interviewed Affects Voting- Experiment. Public Opinion Quarterly 37: 398-406.
22. Dignan M, Michielutte R, Blinson K, Wells HB, Case LD, et al. (1996) Effectiveness of health education to increase screening for cervical cancer among eastern-band Cherokee Indian women in North Carolina. J Natl Cancer Inst 88: 1670-1676.
23. Dignan MB, Michielutte R, Wells HB, Sharp P, Blinson K, et al. (1998) Health education to increase screening for cervical cancer among Lumbee Indian women in North Carolina. Health Educ Res 13: 545-556.
24. Lusk SL, Hong OS, Ronis DL, Eakin BL, Kerr MJ, et al. (1999) Effectiveness of an intervention to increase construction workers' use of hearing protection. Human Factors 41: 487-494.
25. van Sluijs EM, van Poppel MN, Twisk JW, van Mechelen W, (2006) Physical activity measurements affected participants' behavior in a randomized controlled trial. J Clin Epidemiol 59: 404-411.
26. Duryea EJ, (1983) Utilizing tenets of inoculation theory to develop and evaluate a preventive alcohol education intervention. J Sch Health 53: 250-256.
27. Kvalem IL, Sundet JM, Rivo KI, Eilertsen DA, Bakketeig LS, (1996) The effect of sex education on adolescents' use of condoms: applying the Solomon four-group design. Health Educ Q 23: 34-47.
28. Traeen B, (2003) Effect of an intervention to prevent unwanted pregnancy in adolescents. A randomized, prospective study from Nordland County, Norway, 1999-2001. Journal of Community & Applied Social Psychology 13: 207-223.
29. Campanelli PC, Dielman TE, Shope JT, Butchart AT, Renner DS, (1989) Pretest and treatment effects in an elementary school-based alcohol misuse prevention program. Health Educ Q 16: 113-130.
30. Shope JT, Dielman TE, Butchart AT, Campanelli PC, Kloska DD, (1992) An elementary school-based alcohol misuse prevention program: a follow-up evaluation. J Stud Alcohol 53: 106-121.
31. Freeman GD, Sullivan K, Fulton CR, (2003) Effects of creative drama on self-concept, social skills, and problem behavior. Journal of Educational Research 96: 131-138.
32. Braver MCW, Braver SL, (1988) Statistical treatment of the Solomon four-group design: A meta-analytic approach. Psychological Bulletin 104: 150-154.
33. McCambridge J, Kalaitzaki E, White IR, Khadjesari Z, Murray E, Linke S, Thompson SG, Godfrey C, Wallace P, (2011) Can differences in the length or relevance of questionnaires impact upon attrition in online trials? A randomised controlled trial. Journal of Medical Internet Research in press.
34. Kypri K, McCambridge J, Wilson A, Attia J, Sheeran P, et al. (2011) Effects of Study Design and Allocation on participant behaviour- ESDA: study protocol for a randomized controlled trial. Trials 12: 42.
35. Clemes SA, Parker RA, (2009) Increasing our understanding of reactivity to pedometers in adults. Med Sci Sports Exerc 41: 674-680.
36. Nuesch E, Trelle S, Reichenbach S, Rutjes AW, Tschannen B, et al. (2010) Small study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study. BMJ 341: c3515.
37. Coyne JC, Thombs BD, Hagedoorn M, (2010) Ain't necessarily so: review and critique of recent meta-analyses of behavioral medicine interventions in health psychology. Health Psychol 29: 107-116.
38. Lawson DM, Frankish CJ, (1982) Anticipated Versus Unanticipated Fitness Assessment and Dropout Following Exercise Prescription. Journal of Behavioral Assessment 4: 287-297.
39. Mungas DM, Walters HA, (1979) Pretesting Effects in the Evaluation of Social Skills Training. Journal of Consulting and Clinical Psychology 47: 216-218.
40. Spence JC, Burgess J, Rodgers W, Murray T, (2009) Effect of pretesting on intentions and behaviour: A pedometer and walking intervention. Psychology & Health 24: 777-789.
41. Willson VL, Putnam RR, (1982) A meta-analysis of pretest sensitization effects in experiemntal design. American Educational Research Journal 19: 249-258.
42. French DP, Sutton S, (2010) Reactivity of measurement in health psychology: how much of a problem is it? What can be done about it? Br J Health Psychol 15: 453-468.
43. Braeken AP, Lechner L, van Gils FC, Houben RM, Eekers D, et al. (2009) The effectiveness of the Screening Inventory of Psychosocial Problems (SIPP) in cancer patients treated with radiotherapy: design of a cluster randomised controlled trial. BMC Cancer 9: 177.
44. McCambridge J, Kypri K, (2011) Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials. PLoS ONE in press.
45. Clifford PR, Maisto SA, (2000) Subject reactivity effects and alcohol treatment outcome research. J Stud Alcohol 61: 787-793.