Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research

Implementation Science

Volumn 9, Issue 1, 2014, Pages

  Huijg, Johanna M ^a   Gebhardt, Winifred A ^a   Crone, Mathilde R ^b   Dusseldorp, Elise ^c   Presseau, Justin ^d  

^a LEIDEN UNIVERSITY   (Netherlands)

^b LEIDEN UNIVERSITY MEDICAL CENTER   (Netherlands)

^c TNO   (Netherlands)

^d NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

Discriminant content validity; Implementation; Questionnaire development; Theoretical domains framework

Indexed keywords

ARTICLE; ATTITUDE TO HEALTH; ENVIRONMENT; EVIDENCE BASED MEDICINE; HEALTH PERSONNEL ATTITUDE; LANGUAGE; MASS COMMUNICATION; METHODOLOGY; MOTIVATION; PROFESSIONAL STANDARD; QUESTIONNAIRE; REPRODUCIBILITY; SELF CONCEPT; THEORETICAL MODEL; TRANSLATIONAL RESEARCH;

ATTITUDE OF HEALTH PERSONNEL; DIFFUSION OF INNOVATION; ENVIRONMENT; EVIDENCE-BASED MEDICINE; HEALTH KNOWLEDGE, ATTITUDES, PRACTICE; LANGUAGE; MODELS, THEORETICAL; MOTIVATION; PROFESSIONAL ROLE; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; SELF EFFICACY; TRANSLATIONAL MEDICAL RESEARCH;

EID: 84892489617     PISSN: None     EISSN: 17485908     Source Type: Journal    
DOI: 10.1186/1748-5908-9-11     Document Type: Article

References (70)

1. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci 2012, 7:50. 10.1186/1748-5908-7-50, 3462671, 22651257.
2. Glasgow RE, Lichtenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health 2003, 93:1261-1267. 10.2105/AJPH.93.8.1261, 1447950, 12893608.
3. Haines A, Kuruvilla S, Borchert M. Policy and Practice Bridging the implementation gap between knowledge and action for health. B World Health Organization 2004, 82:724-732.
4. Eakin EG, Glasgow RE, Riley KM. Review of primary care-based physical activity intervention studies. J Fam Practice 2000, 49:158-168.
5. Petrella RJ, Lattanzio CN. Does counseling help patients get practice? Systematic review of the literature. Can Fam Physician 2002, 48:72-80. 2213933, 11852615.
6. Sørensen JB, Skovgaard T, Puggaard L. Exercise on prescription in general practice: a systematic review. Scand J Prim Health 2006, 24:69-74.
7. Orrow G, Kinmonth A-L, Sanderson S, Sutton S. Effectiveness of physical activity promotion based in primary care: systematic review and meta-analysis of randomised controlled trials. BMJ 2012, 344:e1389. 10.1136/bmj.e1389, 3312793, 22451477.
8. Glasgow RE, Eakin EG, Fisher EB, Bacak SJ, Brownson RC. Physician advice and support for physical activity: results from a national survey. Am J Prev Med 2001, 21:189-196. 10.1016/S0749-3797(01)00350-6, 11567839.
9. Fallon EA, Wilcox S, Laken M. Health care provider advice for African American adults not meeting health behavior recommendations. Prev Chron Dis 2006, 3:1-12.
10. Helmink JHM, Meis JJM, de Weerdt I, Visser FN, de Vries NK, Kremers SPJ. Development and implementation of a lifestyle intervention to promote physical activity and healthy diet in the Dutch general practice setting: the BeweegKuur programme. Int J Behav Nutr Phy 2010, 7:49.
11. Verheijden MW, Bakx JC, Delemarre ICG, Wanders AJ, Woudenbergh NM, Bottema BJAM, van Weel C, van Staveren WA. GPs' assessment of patients' readiness to change diet, activity and smoking. Brit J Gen Pract 2005, 55:452-457.
12. Glasgow RE, Bull SS, Gilette C, Klesges LM, Dzewaltowski DA. Behavior change intervention research in healthcare settings: a review of recent reports with emphasis on external validity. Am J Prev Med 2002, 23:62-69. 10.1016/S0749-3797(02)00437-3, 12093425.
13. Bartholomew KL, Parcel GS, Kok G, Gottlieb NH, Fernández ME. Planning Health Promotion Programs: An Intervention Mapping Approach 2011, San Fransisco: Jossey-Bass.
14. Foy R, Eccles M, Grimshaw J. Why does primary care need more implementation research?. Fam Pract 2001, 18:353-355. 10.1093/fampra/18.4.353, 11477039.
15. Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N. Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol 2005, 58:107-112. 10.1016/j.jclinepi.2004.09.002, 15680740.
16. Fleuren M, Wiefferink K, Paulussen T. Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health C 2004, 16:107-123.
17. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004, 82:581-629. 10.1111/j.0887-378X.2004.00325.x, 2690184, 15595944.
18. Grol R, Wensing M, Eccles M. Improving Patient Care: The Implementation of Change in Clinical Practice 2005, Oxford: Elsevier.
19. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet 2003, 362:1225-1230. 10.1016/S0140-6736(03)14546-1, 14568747.
20. Rogers EM. Diffusion of Innovations 1983, New York: The Free Press.
21. Francis JJ, Tinmouth A, Stanworth SJ, Grimshaw JM, Johnston M, Hyde C, Stockton C, Brehaut JC, Fergusson D, Eccles MP. Using theories of behaviour to understand transfusion prescribing in three clinical contexts in two countries: development work for an implementation trial. Implement Sci 2009, 4:70. 10.1186/1748-5908-4-70, 2777847, 19852832.
22. Grol RPTM, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q 2007, 85:93-138. 10.1111/j.1468-0009.2007.00478.x, 2690312, 17319808.
23. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol 2008, 57:660-680.
24. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluationg complex interventions: the new medical research council guidance. BMJ 2008, 337:a1655. 10.1136/bmj.a1655, 2769032, 18824488.
25. Francis J, Johnston M, Bonetti D. Health psychology research advances theory by addressing problems: illustrations from theory-based studies of health professional behaviour. Eur Health Psychol 2007, 2:20-25.
26. French SD, Green SE, O'Connor DA, McKenzie JE, Francis JJ, Michie S, Buchbinder R, Schattner P, Spike N, Grimshaw JM. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the Theoretical Domains Framework. Implement Sci 2012, 7:38. 10.1186/1748-5908-7-38, 3443064, 22531013.
27. Presseau J, Johnston M, Francis J, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw J, Elovainio M, Hunter M, Eccles M. Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med 2013, epub ahead of print.
28. Chaudoir SR, Dugan AG, Barr CHI. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level. Implement Sci 2013, 8:22. 10.1186/1748-5908-8-22, 3598720, 23414420.
29. Rothman AJ. 'Is there nothing more practical than a good theory?': why innovations and advances in health behavior change will arise if interventions are used to test and refine theory. Int J Behav Nutr Phy 2004, 1:11.
30. Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw JM, Hyde C, Tinmouth A, Stanworth SJ. Evidence-based selection of theories for designing behaviour change interventions: using methods based on theoretical construct domains to understand clinicians' blood transfusion behaviour. Brit J Health Psychol 2009, 14:625-646.
31. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care 2005, 14:26-33. 10.1136/qshc.2004.011155, 1743963, 15692000.
32. Patey AM, Islam R, Francis JJ, Bryson GL, Grimshaw JM. Anesthesiologists' And surgeons' perceptions about routine pre-operative testing in low-risk patients: application of the theoretical domains framework (TDF) to identify factors that influence physicians' decisions to order pre-operative tests. Implement Sci 2012, 7:52. 10.1186/1748-5908-7-52, 3522997, 22682612.
33. McSherry LA, Dombrowski SU, Francis JJ, Murphy J, Martin CM, O'Leary JJ, Sharp L, ATHENS Group 'It's a can of worms': understanding primary care practitioners' behaviours in relation to HPV using the theoretical domains framework. Implement Sci 2012, 7:73. 10.1186/1748-5908-7-73, 3523072, 22862968, ATHENS Group.
34. Amemori M, Michie S, Korhonen T, Murtomaa H, Kinnunen TH. Assessing implementation difficulties in tobacco use prevention and cessation counselling among dental providers. Implement Sci 2011, 6:50. 10.1186/1748-5908-6-50, 3130685, 21615948.
35. Beenstock J, Sniehotta FF, White M, Bell R, Milne EM, Araujo-Soares V. What helps and hinders midwives in engaging with pregnant women about stopping smoking? A cross-sectional survey of perceived implementation difficulties among midwives in the northeast of England. Implement Sci 2012, 7:36. 10.1186/1748-5908-7-36, 3465235, 22531641.
36. Taylor N, Parveen S, Robins V, Slater B, Lawton R. Development and initial validation of the Influences on Patient Safety Behaviours Questionnaire. Implement Sci 2013, 8:81. 10.1186/1748-5908-8-81, 3846501, 23895628.
37. Cane J, O'Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci 2012, 7:37. 10.1186/1748-5908-7-37, 3483008, 22530986.
38. Fishbein M. Attitude and the Prediction of Behavior. Readings in Atttiude Theory and Measurement 1967, 477-492. New York: Wiley, Fishbein M.
39. Lynn MR. Determination and quantification of content validity. Nurs Res 1986, 35:382-385.
40. Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: conducting a content validity study in social work research. Soc Work Res 2003, 27:94-104.
41. Ajzen I. The theory of planned behavior. Organ Behav Hum Dec 1991, 50:179-211.
42. Bandura A. Health promotion from the perspective of social cognitive theory. Psychol Health 1998, 13:623-649.
43. Huijg JM, van der Zouwe N, Gebhardt WA, Crone MR, Verheijden MW, Middelkoop BJC. Introducing physical activity interventions in primary health care: a qualitative study of perceived facilitators and barriers [abstract]. Int J Behav Med 2012, 19:S1-S341.
44. Huijg JM, Crone MR, Verheijden MW, van der Zouwe N, Middelkoop BJC, Gebhardt WA. Factors influencing the adoption, implementation, and continuation of physical activity interventions in primary health care: a delphi study. BMC Fam Pract 2013, 14:142. 10.1186/1471-2296-14-142, 3848920, 24070166.
45. Maes S, Karoly P, de Gucht V, Ruehlman LS, Heiser W. The self regulation skills battery 2006, Leiden/Phoenix: Leiden University/Arizona State University.
46. Sniehotta FF, Schwarzer R, Scholz U, Schüz B. Action planning and coping planning for long-term lifestyle change: theory and assessment. Eur J Soc Psycho 2005, 35:565-576.
47. Gardner B, Abraham C, Lally P, de Bruijn G-J. Towards parsimony in habit measurement: Testing the convergent and predictive validity of an automaticity subscale of the Self-Report Habit Index. Int J Behav Nutr Phys 2012, 9:102.
48. Goldberg DP, Blackwell B. Psychiatric illness in general practice: a detailed study using a new method of case identification. Brit Med J 1970, 1:439-443. 1700485, 5420206.
49. Thompson ER. Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). J Cross Cult Psychol 2007, 38:227-242.
50. Frese M. Social support as a moderator of the relationship between work stressors and psychological dysfunctioning: a longitudinal study with objective measures. J Occup Health Psych 1999, 4:179-192.
51. Derryberry D, Reed MA. Anxiety-related attentional biases and their regulation by attentional control. J Abnorm Psychol 2002, 111:225-236.
52. Scheier MF, Carver CS, Bridges MW. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. J Pers Soc Psychol 1994, 67:1063-1078.
53. Cialdini R, Kallgren C, Reno R. A Focus Theory of Normative Conduct: A Theoretical Refinement and Reevaluation of the Role of Norms in Human Behavior. Advances in Experimental Social Psychology 1991, 202-232. San Diego: Academic Press.
54. Dixon D, Pollard B, Johnston M. What does the chronic pain grade questionnaire measure?. Pain 2007, 130:249-253. 10.1016/j.pain.2006.12.004, 17257751.
55. Dixon D, Johnston M, McQueen M, Court-Brown C. The disabilities of the Arm, shoulder and hand questionnaire (DASH) can measure the impairment, activity limitations and participation restriction constructs from the international classification of functioning, disability and health (ICF). BMC Musculoskel Dis 2008, 9:114.
56. American Psychological Association (APA) APA Dictionary of Psychology 2007, Washington: American Psychological Association, American Psychological Association (APA).
57. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc B Met 1995, 57:289-300.
58. IBM Corp IBM SPSS statistics for windows, version 19.0 2010, Armonk, NY: IBM Corp, IBM Corp.
59. Conger A. Integration and generalization of kappas for multiple raters. Psychol Bull 1980, 88:322-328.
60. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977, 33:159-174. 10.2307/2529310, 843571.
61. R Development Core Team R R: a Language and Environment for Statistical Computing 2012, Vienna, Austria: R Foundation for Statistical Computing, R Development Core Team R.
62. Falissard B. Psy: Various Procedures Used in Psychometry 2012, : R Package Version 1.1.
63. Taylor N, Lawton R, Connor M. Development and initial validation of the determinants of physical activity questionnaire. Int J Behav Nutr Phy 2013, 10:74.
64. Stevens J. Applied Multivariate Statistics for the Social Sciences 1992, Hillsdale: Lawrence Erlbaum.
65. Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci 2013, 8:123. 10.1186/1748-5908-8-123, 3854455, 24131864.
66. Dyson J, Lawton R, Jackson C, Cheater F. Development of a theory-based instrument to identify barriers and levers to best hand hygiene practice among healthcare practitioners. Implement Sci 2013, 8:111. 10.1186/1748-5908-8-111, 3850814, 24059289.
67. Dyson J, Lawton R, Jackson C, Cheater F. Does the use of a theoretical approach tell us more about hand hygiene behavior? The barriers and levers to hand hygiene. J Infect Prev 2011, 12:17-24.
68. Bonetti D, Johnston M, Clarkson JE, Grimshaw J, Pitts NB, Eccles M, Steen N, Thomas R, Maclennan G, Glidewell L, Walker A. Applying psychologial theories to evidence-based clinical practice: identifying factors predictive of placing preventive fissure sealants. Implement Sci 2010, 5:25. 10.1186/1748-5908-5-25, 2864198, 20377849.
69. Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci 2010, 5:14. 10.1186/1748-5908-5-14, 2832624, 20181130.
70. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004, 8:1-72.