Searching for rigour in the reporting of mixed methods population health research: A methodological review

Health Education Research

Volumn 30, Issue 6, 2015, Pages 811-839

  Brown, K M ^a   Elliott, S J ^a   Leatherdale, S T ^a   Robertson Wilson, J ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b WILFRID LAURIER UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN; INFORMATION PROCESSING; METHODOLOGY; MORPHOMETRY; ORGANIZATION AND MANAGEMENT; PEDIATRIC OBESITY; PUBLIC HEALTH SERVICE; SCHOOL HEALTH SERVICE; SEDENTARY LIFESTYLE; STANDARDS; STATISTICAL ANALYSIS;

BODY WEIGHTS AND MEASURES; DATA COLLECTION; DATA INTERPRETATION, STATISTICAL; HUMANS; PEDIATRIC OBESITY; PUBLIC HEALTH PRACTICE; RESEARCH DESIGN; SCHOOL HEALTH SERVICES; SEDENTARY LIFESTYLE;

EID: 84958658861     PISSN: 02681153     EISSN: 14653648     Source Type: Journal    
DOI: 10.1093/her/cyv046     Document Type: Review

References (73)

1. Albright K, Gechter K, Kempe A. Importance of mixed methods in pragmatic trials and dissemination and implementation research. Acad Pediatr 2013; 13: 400-7.
2. Bronfenbrenner U. Toward an experimental ecology of human development. Am Psychol 1977; 32: 513-31.
3. Lobstein T, Baur L, Uauy R. Obesity in children and young people: a crisis in public health. Obes Rev 2004; 5: 4-85
4. Roberts KC, Shields M, de Groh M et al. Overweight and obesity in children and adolescents: Results from the 2009 to 2011 Canadian Health Measures Survey. Health Rep 2012; 23: 37-41.
5. Ogden CL, Carroll MD, Kit BK et al. Prevalence of childhood and adult obesity in the United States, 2011-2012. JAMA 2014; 311: 806-14.
6. Hobin EP, Leatherdale ST, Manske SR et al. A multilevel examination of school and student characteristics associated with moderate and high levels of physical activity among elementary school students (Ontario, Canada). Can J Public Health 2010; 101: 495-9.
7. Hobin E, Leatherdale S,Manske S et al. A multilevel examination of factors of the school environment and time spent in moderate to vigorous physical activity among a sample of secondary school students in grades 9-12 inOntario, Canada. Int J Public Health 2012; 57: 699-709.
8. Leatherdale ST, Manske S, Faulkner G et al. A multi-level examination of school programs, policies and resources associated with physical activity among elementary school youth in the PLAY-ONstudy. Int J Behav Nutr Phys Act 2010; 7: 6.
9. Creswell JW, Plano Clark VL. Designing and Conducting Mixed Methods Research, 2nd edn. Thousand Oaks, CA: SAGE Publications, Inc., 2011.
10. Kroll T, Neri M. Designs for mixed methods research. In: Andrew S, Halcomb EJ (eds). Mixed Methods Research for Nursing and the Health Sciences. Chichester,UK: Blackwell Publishing Ltd, 2009, 31-49.
11. Sammons P. The contribution of mixed methods to recent research on educational effectiveness. In: Tashakkori A, Teddlie C (eds). SAGE Handbook of Mixed Methods in Social & Behavioural Research, 2nd edn. Thousand Oaks, CA: SAGE Publications, Inc., 2010, 697-723.
12. Tashakkori A, Teddlie C (eds). SAGE Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn. Thousand Oaks, CA: SAGE Publications, Inc., 2010.
13. Greene JC, Hall JN. Dialectics and pragmatism: being of consequence. In: Tashakkori A, Teddlie C (eds). SAGE Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn. Thousand Oaks, CA: SAGE Publications, Inc., 2010, 119-43.
14. Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health 2014; 35: 29-45.
15. Ivankova NV, Kawamura Y. Emerging trends in the utilization of integrated designs in the social, behavioral, and health sciences. In: Tashakkori A, Teddlie C (eds). SAGE Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn. Thousand Oaks, CA: SAGE Publications, Inc., 2010, 581-611.
16. Creswell JW, Klassen AC, Plano Clark VL et al. Best Practices for Mixed Methods Research in the Health Sciences. Bethesda,MD: National Institutes of Health, 2011.
17. Plano Clark V. The adoption and practice of mixed methods: U.S. trends in federally funded health-related research. Qual Inq 2010; 16: 428-40.
18. Seale C. Ensuring rigour in qualitative research. Eur J Public Health 1997; 7: 379-84.
19. Whittemore R, Chase S, Mandle C. Validity in qualitative research. Qual Health Res 2001; 11: 522-37.
20. Bryman A, Becker S, Sempik J. Quality criteria for quantitative, qualitative and mixed methods research: a view from social policy. Int J Soc Res Methodol 2008; 11: 261-76.
21. Lincoln YS, Guba EG (eds). Naturalistic Inquiry. Newbury Park, CA: Sage Publications, Inc. 1985.
22. Sparkes AC, Smith B. Qualitative Research in Sport, Exercise and Health: From Process to Product. New York, NY: Routledge, 2014.
23. Onwuegbuzie AJ, Johnson RB. The validity issue in mixed research. Res Sch 2006; 13: 48-63.
24. O'Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Health Serv Res Policy 2008; 13: 92-8.
25. O'Cathain A. Assessing the quality of mixed methods research: toward a comprehensive framework. In: Tashakkori A, Teddlie C (eds). SAGE Handbook of Mixed Methods in Social & Behavioral Research, 2nd edn. Thousand Oaks, CA: SAGE Publications, Inc., 2010, 531-55.
26. Wisdom JP, Cavaleri MA, Onwuegbuzie AJ et al. Methodological reporting in qualitative, quantitative, and mixed methods health services research articles. Health Serv Res 2012; 47: 721-45.
27. Curry L, Nunez-Smith M.Mixed Methods inHealth Sciences Research: A Practical Primer. Thousand Oaks, CA: Sage Publications, Inc., 2015.
28. Giddings LS, GrantBM. From rigour to trustworthiness: validating mixed methods In: Andrew S, Halcomb EJ (eds). Mixed Methods Research for Nursing and the Health Sciences. Chichester, UK: Blackwell Publishing Ltd, 2009, 119-34.
29. O'Cathain A, Murphy E, Nicholl J. Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study. BMC Health Serv Res 2007; 7: 85.
30. O' stlund U, Kidd L, Wengstro'mYet al. Combining qualitative and quantitative research within mixedmethod research designs: a methodological review. Int J Nurs Stud 2011; 48: 369-83.
31. Palinkas LA, Horwitz SM, Chamberlain P et al. Mixedmethods designs in mental health services research: a review. Psychiatr Serv 2011; 62: 255-63.
32. Plano Clark VL, Anderson N, Wertz JA et al. Conceptualizing longitudinal mixed methods designs: a methodological review of health sciences research. J Mix Methods Res 2015; 9: 297-319.
33. Johnson RB, Onwuegbuzie AJ, Turner LA. Toward a definition of mixed methods research. J Mix Methods Res 2007; 1: 112-33.
34. Law M, Stewart D, Pollock N et al. Critical Review Form-Quantitative Studies, 1998. Available at: http://srs-mcmas ter.ca/wp-content/uploads/2015/05/Guidelines-for-Critical-Review-Form-Quantitative-Studies.pdf. Accessed: 30 September 2015
35. Letts L, Wilkins S, Law M et al. Critical Review Form-Qualitative Studies (Version 2.0), 2007. Available at: http://srs-mcmaster.ca/wp-content/uploads/2015/05/Guide lines-for-Critical-Review-Form-Qualitative-Studies.pdf. Accessed: 30 September 2015.
36. Long, A. Evaluative Tool for Mixed Method Studies, 2005. Available at: http://usir.salford.ac.uk/13070/1/Evaluative-Tool-for-Mixed-Method-Studies.pdf. Accessed: 30 September 2015.
37. de Meij JSB, van der Wal MF, van Mechelen W et al. A mixed methods process evaluation of the implementation of JUMP-in, a multilevel school-based intervention aimed at physical activity promotion. Health Promot Pract 2013; 14: 777-90.
38. Ardzejewska K, Tadros R, Baxter D. A descriptive study on the barriers and facilitators to implementation of the NSW (Australia) healthy school canteen strategy. Health Educ J 2013; 72: 136-45.
39. Gittelsohn J, Merkle S, Story M et al. School climate and implementation of the Pathways study. Prev Med 2003; 37: S97-S106.
40. Naylor P-J, Macdonald HM, Zebedee JA et al. Lessons learned from Action Schools! BC-an 'active school' model to promote physical activity in elementary schools. J SciMed Sport 2006; 9: 413-23.
41. Steckler A, Ethelbah B, Martin CJ et al. Pathways process evaluation results: a school-based prevention trial to promote healthful diet and physical activity in American Indian third, fourth, and fifth grade students. Prev Med 2003; 37: S80-S90.
42. Callaghan C, Mandich G, He M. Healthier snacks in school vending machines: a pilot project in four Ontario high schools. Can J Diet Pract Res 2010; 71: 186-91.
43. Goldberg JP, Collins JJ, Folta SC et al. Retooling food service for early elementary school students in Somerville, Massachusetts: the Shape Up Somerville experience. Prev Chron Dis 2009; 6: A103.
44. Slater J. Is cooking dead? The state of home economics food and nutrition education in a Canadian province. Int J Consum Stud 2013; 37: 617-24.
45. Martens M, van Assema P, Paulussen T et al. Krachtvoer: process evaluation of a Dutch programme for lower vocational schools to promote healthful diet. Health Educ Res 2006; 21: 695-704.
46. Orme J, Jones M, Salmon D et al. A process evaluation of student participation in a whole school food programme. Health Educ 2013; 113: 168-82.
47. Austin G, Bell T, Caperchione C et al. Translating research to practice: using the RE-AIM framework to examine an evidence-based physical activity intervention in primary school settings. Health Promot Pract 2011; 12: 932-41.
48. Longley CH, Sneed J. Effects of federal legislation on wellness policy formation in school districts in the United States. J Am Diet Assoc 2009; 109: 95-101
49. Bergin M. NVivo 8 and consistency in data analysis: reflecting on the use of a qualitative data analysis program. Nurse Res 2011; 18: 6-12.
50. Bowen GA. Supporting a grounded theory with an audit trail: an illustration. Int J Soc Res Methodol 2009; 12: 305-16.
51. Whittemore R, Chao A, Jang M et al. Implementation of a school-based internet obesity prevention programfor adolescents. J Nutr Educ Behav 2013; 45: 586-94.
52. Zhang W, Watanabe-Galloway S. Using mixed methods effectively in prevention science: designs, procedures, and examples. Prev Sci 2013; 15: 654-62.
53. Catalani C, Minkler M. Photovoice: a review of the literature in health and public health. Health Educ Behav 2010; 37: 424-51.
54. Warne M, Snyder K, Gillander Gadin K. Photovoice: an opportunity and challenge for students' genuine participation. Health Promot Int 2013; 28: 299-310.
55. Martin N, Garcia AC, Leipert B. Photovoice and its potential use in nutrition and dietetic research. Can J Diet Pract Res 2010; 71: 93-7.
56. Morgan P,Hansen V. Recommendations to improve primary school physical education: classroom teachers' perspective. J Educ Res 2007; 101: 99-111.
57. Creswell JW, Tashakkori A. Developing publishable mixed methods manuscripts. J Mix Methods Res 2007; 1: 107-11.
58. Dahlberg B, Wittink MN, Gallo JJ. Funding and publishing integrated studies: writing effective mixed methods manuscripts and proposals. In: Tashakkori A, Teddlie C (eds). SAGE Handbook of Mixed Methods in Social and Behavioral Research, 2nd edn. Thousand Oaks, CA: SAGE Publications, Inc., 2010, 775-802.
59. Mertens D. Publishing mixed methods research. J Mix Methods Res 2011; 5: 3-6.
60. O'Cathain A. Reporting mixed methods projects. In:Andrew S, Halcomb EJ (eds). Mixed Methods Research for Nursing and the Health Sciences. Chichester, UK: Blackwell Publishing Ltd, 2009, 135-58.
61. CONSORT Group. CONSORT 2010, 2010. Available at: http://www.consort-statement.org/consort-2010. Accessed: 30 September 2015.
62. Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs-principles and practices. Health Serv Res 2013; 48: 2134-56.
63. Sale JEM, Brazil K. A strategy to identify critical appraisal criteria for primary mixed-method studies. QualQuant 2004; 38: 351-65.
64. Bouck MS, St Onge R, He M et al. Northern fruit and vegetable pilot program: a process evaluation. Can J Diet Pract Res 2011; 72: 14-22.
65. ChenQ, GotoK,WolffCet al. Cooking up diversity: impact of a multicomponent, multicultural, experiential intervention on food and cooking behaviors among elementary-school students from low-income ethnically diverse families. Appetite 2014; 80: 114-22.
66. Gibson CA, Smith BK, DuBose KD et al. Physical activity across the curriculum: year one process evaluation results. Int J Behav Nutr Phys Act 2008; 5: 36.
67. He C, Breiting S, Perez-Cueto FJA. Effect of organic school meals to promote healthy diet in 11-13 year old children: a mixed methods study in four Danish public schools. Appetite 2012; 59: 866-76.
68. Kong AS, Sussman AL, Negrete S et al. Implementation of a walking school bus: lessons learned. J Sch Health 2009; 79: 319-25.
69. Morgan PJ, Hansen V. Classroom teachers' perceptions of the impact of barriers to teaching physical education on the quality of physical education programs. Res Q Exerc Sport 2008; 79: 506-16.
70. Morgan PJ, Hansen V. Physical education in primary schools: classroom teachers' perceptions of benefits and outcomes. Health Educ J 2008; 67: 196-207.
71. Pettigrew S, Pescud M, Donovan RJ. Outcomes of the west Australian school healthy food and drink policy. Nutr Diet 2012; 69: 20-5.
72. Prusak KA, Davis T, Pennington TR et al. Children's perceptions of a district-wide physical education program. J Teach Phys Educ 2013; 33: 4-27.
73. Baxter J, Eyles J. Evaluating qualitative research in social geography: establishing 'rigour' in interview analysis. Trans Inst Br Geogr 1997; 22: 505-25.