Methodological quality is underrated in systematic reviews and meta-analyses in health psychology

Journal of Clinical Epidemiology

Volumn 86, Issue , 2017, Pages 59-70

  Oliveras, Isabel ^a   Losilla, Josep Maria ^a   Vives, Jaume ^a  

^a UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

Author keywords

Meta analysis; Meta review; Methodological quality; Research synthesis; Risk of bias; Systematic review

Indexed keywords

CLINICAL PSYCHOLOGY; DATA BASE; HEALTH; HUMAN; META ANALYSIS (TOPIC); METHODOLOGY; OUTCOME ASSESSMENT; PRIORITY JOURNAL; QUALITY CONTROL; RESEARCH; REVIEW; RISK; SYNTHESIS; SYSTEMATIC REVIEW (TOPIC); BEHAVIORAL MEDICINE; LITERATURE; STANDARDS;

BEHAVIORAL MEDICINE; HUMANS; META-ANALYSIS AS TOPIC; RESEARCH DESIGN; REVIEW LITERATURE AS TOPIC;

EID: 85020409826     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2017.05.002     Document Type: Review

References (148)

1. Johnson, B.T., Low, R.E., MacDonald, H.V., Panning for the gold in health research: Incorporating studies’ methodological quality in meta-analysis. Psychol Health 30 (2014), 135–152.
2. Wells, K., Littell, J.H., Study quality assessment in systematic reviews of research on intervention effects. Res Soc Work Pract 19 (2009), 52–62.
3. Jüni, P., Altman, D.G., Egger, M., Systematic reviews in health care - assessing the quality of controlled clinical trials. Br Med J 323 (2001), 42–46.
4. Whittemore, R., Chao, A., Jang, M., Minges, K.E., Park, C., Methods for knowledge synthesis: an overview. Heart Lung 43 (2014), 453–461.
5. von Elm, E., Altman, D.G., Egger, M., Pocock, S.J., Gøtzsche, P.C., Vandenbroucke, J.P., et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol 61 (2008), 344–349.
6. Botella, J., Sánchez-Meca, J., Meta-análisis en ciencias sociales y de la salud. 2015, Editorial Síntesis, Madrid.
7. Linde, K., Scholz, M., Ramirez, G., Clausius, N., Melchart, D., Jonas, W.B., Impact of study quality on outcome in placebo-controlled trials of homeopathy. J Clin Epidemiol 52 (1999), 631–636.
8. Detsky, A.S., Naylor, C.D., O'Rourke, K., McGeer, A.J., L'Abbe, K.A., Incorporating Variations in the quality of individual randomized trials into Metaanalysis. J Clin Epidemiol 45 (1992), 255–265.
9. Moja, L.P., Telaro, E., D'Amico, R., Moschetti, I., Coe, L., Liberati, A., Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study. BMJ, 330, 2005, 1053.
10. Ochodo, E.A., van Enst, W.A., Naaktgeboren, C.A., de Groot, J.A.H., Hooft, L., Moons, K.G.M., et al. Incorporating quality assessments of primary studies in the conclusions of diagnostic accuracy reviews: a cross-sectional study. BMC Med Res Methodol, 14, 2014, 33.
11. Whiting, P., Rutjes, A.W.S., Dinnes, J., Reitsma, J.B., Bossuyt, P.M.M., Kleijnen, J., A systematic review finds that diagnostic reviews fail to incorporate quality despite available tools. J Clin Epidemiol 58 (2005), 1–12.
12. Ahn, S., Becker, B.J., Incorporating quality scores in meta-analysis. J Educ Behav Stat 36 (2011), 555–585.
13. Conn, V.S., Rantz, M.J., Focus on research methods: research methods: Managing primary study quality in meta-analyses. Res Nurs Health 26 (2003), 322–333.
14. Verhagen, A.P., de Vet, H.C.W., Vermeer, F., Widdershoven, J.W.M.G., de Bie, R.A., Kessels, A.G.H., et al. The influence of methodologic quality on the conclusion of a landmark meta-analysis on thrombolytic therapy. Int J Technol Assess Health Care 18 (2002), 11–23.
15. Greenland, S., O'Rourke, K., On the bias produced by quality scores in meta-analysis, and a hierarchical view of proposed solutions. Biostatistics 2 (2001), 463–471.
16. Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available at: http://handbook.cochrane.org/. Accessed April 4, 2016.
17. Guyatt, G.H., Oxman, A.D., Vist, G.E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 336 (2008), 924–926.
18. Viswanathan, M., Berkman, N.D., Development of the RTI item bank on risk of bias and precision of observational studies. J Clin Epidemiol 65 (2012), 163–178.
19. Deeks, J.J., Dinnes, J., D'Amico, R., Sowden, A.J., Sakarovitch, C., Song, F., et al. Evaluating non-randomised intervention studies. Health Technol Assess, 7, 2003 iii–x, 1–173.
20. Sanderson, S., Tatt, I.D., Higgins, J.P.T., Tools for assessing quality and susceptibility to bias in observational studies in epidemiology: a systematic review and annotated bibliography. Int J Epidemiol 36 (2007), 666–676.
21. Bai, A., Shukla, V.K., Bak, G., Wells, G., Quality Assessment Tools Project Report. 2012, Canadian Agency for Drugs and Technologies in Health, Ottawa.
22. Jarde, A., Losilla, J.M., Vives, J., Methodological quality assessment tools of non-experimental studies: a systematic review. An Psicol 28 (2012), 617–628.
23. Jarde, A., Losilla, J.M., Vives, J., Suitability of three different tools for the assessment of methodological quality in ex post facto studies. Int J Clin Heal Psychol 12 (2012), 97–108.
24. Hootman, J.M., Driban, J.B., Sitler, M.R., Harris, K.P., Cattano, N.M., Reliability and validity of three quality rating instruments for systematic reviews of observational studies. Res Synth Methods 2 (2011), 110–118.
25. Jüni, P., Witschi, A., Bloch, R., Egger, M., The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 282 (1999), 1054–1060.
26. Herbison, P., Hay-Smith, J., Gillespie, W.J., Adjustment of meta-analyses on the basis of quality scores should be abandoned. J Clin Epidemiol 59 (2006), 1249–1256.
27. Whiting, P., Harbord, R., Kleijnen, J., No role for quality scores in systematic reviews of diagnostic accuracy studies. BMC Med Res Methodol, 5, 2005, 19.
28. Cooper, H., Hedges, L.V., Valentine, J.C., (eds.) The Handbook of Research Synthesis and Meta-Analysis, 2009, Russell Sage Foundation, New York.
29. Schulz, K.F., Altman, D.G., Moher, D., CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol 63 (2010), 834–840.
30. Ioannidis, J.P.A., Commentary: adjusting for bias: a user's guide to performing plastic surgery on meta-analyses of observational studies. Int J Epidemiol 40 (2011), 777–779.
31. Borenstein, M., Hedges, L.V., Higgins, J.P.T., Rothstein, H.R., Introduction to Meta-Analysis. 2009, John Wiley & Sons Ltd, Chichester, West Sussex, UK.
32. Littell, J.H., Corcoran, J., Pillai, V.K., Systematic reviews and meta-analysis. 2008, Oxford University Press, Oxford.
33. Rothwell, P.M., Subgroup analysis in randomised controlled trials: importance, indications, and interpretation. Lancet 365 (2005), 176–186.
34. Tanniou, J., van der Tweel, I., Teerenstra, S., Roes, K.C.B., Subgroup analyses in confirmatory clinical trials: time to be specific about their purposes. BMC Med Res Methodol, 16, 2016, 20.
35. Burke, J.F., Sussman, J.B., Kent, D.M., Hayward, R.A., Three simple rules to ensure reasonably credible subgroup analyses. BMJ, 351, 2015, h5651.
36. Berard, A., Bravo, G., Combining studies using effect sizes and quality scores: Application to bone loss in postmenopausal women. J Clin Epidemiol 51 (1998), 801–807.
37. Doi, S.A.R., Thalib, L., A quality-effects model for meta-analysis. Epidemiology 19 (2008), 94–100.
38. Doi, S.A.R., Barendregt, J.J., Khan, S., Thalib, L., Williams, G.M., Advances in the meta-analysis of heterogeneous clinical trials II: the quality effects model. Contemp Clin Trials 45 (2015), 123–129.
39. Turner, R.M., Spiegelhalter, D.J., Smith, G.C.S., Thompson, S.G., Bias modelling in evidence synthesis. J R Stat Soc Ser A Stat Soc 172 (2009), 21–47.
40. Dias, S., Sutton, A.J., Welton, N.J., Ades, A.E., Evidence synthesis for decision making 3: heterogeneity–subgroups, meta-regression, bias, and bias-adjustment. Med Decis Making 33 (2013), 618–640.
41. AlAqeel, B., Margolese, H.C., Remission in schizophrenia: critical and systematic review. Harv Rev Psychiatry 20 (2012), 281–297.
42. Alisic, E., Krishna, R.N., Groot, A., Frederick, J.W., Children's mental health and well-being after parental intimate partner Homicide: a systematic review. Clin Child Fam Psychol Rev 18 (2015), 328–345.
43. Allott, K., Liu, P., Proffitt, T.M., Killackey, E., Cognition at illness onset as a predictor of later functional outcome in early psychosis: systematic review and methodological critique. Schizophr Res 125 (2011), 221–235.
44. Boden, J.M., Fergusson, D.M., Alcohol and depression. Addiction 106 (2011), 906–914.
45. Borges, G., Bagge, C.L., Orozco, R., A literature review and meta-analyses of cannabis use and suicidality. J Affect Disord 195 (2016), 63–74.
46. Brennan, M.E., Spillane, A.J., Uptake and predictors of post-mastectomy reconstruction in women with breast malignancy - systematic review. Eur J Surg Oncol 39 (2013), 527–541.
47. Brito, K., Edirimanne, S., Eslick, G.D., The extent of improvement of health-related quality of life as assessed by the SF36 and Paseika scales after parathyroidectomy in patients with primary hyperparathyroidism - a systematic review and meta-analysis. Int J Surg 13 (2015), 245–249.
48. Burton, B.K., Hjorthoj, C., Jepsen, J.R., Thorup, A., Nordentoft, M., Plessen, K.J., Research Review: do motor deficits during development represent an endophenotype for schizophrenia? A meta-analysis. J Child Psychol Psychiatry 57 (2016), 446–456.
49. Cerimele, J.M., Katon, W.J., Associations between health risk behaviors and symptoms of schizophrenia and bipolar disorder: a systematic review. Gen Hosp Psychiatry 35 (2013), 16–22.
50. Chen, S., Zhong, X., Jiang, L., Zheng, X., Xiong, Y., Ma, S., et al. Maternal autoimmune diseases and the risk of autism spectrum disorders in offspring: a systematic review and meta-analysis. Behav Brain Res 296 (2016), 61–69.
51. da Silva, J., Goncalves-Pereira, M., Xavier, M., Mukaetova-Ladinska, E.B., Affective disorders and risk of developing dementia: systematic review. Br J Psychiatry 202 (2013), 177–186.
52. de Maat, S., de Jonghe, F., de Kraker, R., Leichsenring, F., Abbass, A., Luyten, P., et al. The current state of the empirical evidence for psychoanalysis: a meta-analytic approach. Harv Rev Psychiatry 21 (2013), 107–137.
53. Diaz-Piedra, C., Di Stasi, L.L., Baldwin, C.M., Buela-Casal, G., Catena, A., Sleep disturbances of adult women suffering from fibromyalgia: a systematic review of observational studies. Sleep Med Rev 21 (2015), 86–99.
54. Dickens, C., Katon, W., Blakemore, A., Khara, A., McGowan, L., Tomenson, B., et al. Does depression predict the use of urgent and unscheduled care by people with long term conditions? A systematic review with meta-analysis. J Psychosom Res 73 (2012), 334–342.
55. DiGangi, J.A., Gomez, D., Mendoza, L., Jason, L.A., Keys, C.B., Koenen, K.C., Pretrauma risk factors for posttraumatic stress disorder: a systematic review of the literature. Clin Psychol Rev 33 (2013), 728–744.
56. Diniz, B.S., Butters, M.A., Albert, S.M., Dew, M.A., Reynolds, C.F. 3rd, Late-life depression and risk of vascular dementia and Alzheimer's disease: systematic review and meta-analysis of community-based cohort studies. Br J Psychiatry 202 (2013), 329–335.
57. Elbers, N.A., Hulst, L., Cuijpers, P., Akkermans, A.J., Bruinvels, D.J., Do compensation processes impair mental health? A meta-analysis. Injury 44 (2013), 674–683.
58. El-Nashar, S.A., Hopkins, M.R., Barnes, S.A., Pruthi, R.K., Gebhart, J.B., Cliby, W.A., et al. Health-related quality of life and patient satisfaction after global endometrial ablation for menorrhagia in women with bleeding disorders: a follow-up survey and systematic review. Am J Obstet Gynecol 202 (2010), 348.e1–348.e7.
59. Faedda, G.L., Marangoni, C., Serra, G., Salvatore, P., Sani, G., Vazquez, G.H., et al. Precursors of bipolar disorders: a systematic literature review of prospective studies. J Clin Psychiatry 76 (2015), 614–624.
60. Fan, Z., Wu, Y., Shen, J., Ji, T., Zhan, R., Schizophrenia and the risk of cardiovascular diseases: a meta-analysis of thirteen cohort studies. J Psychiatr Res 47 (2013), 1549–1556.
61. Flak, A.L., Su, S., Bertrand, J., Denny, C.H., Kesmodel, U.S., Cogswell, M.E., The association of mild, moderate, and binge prenatal alcohol exposure and child neuropsychological outcomes: a meta-analysis. Alcohol Clin Exp Res 38 (2014), 214–226.
62. Geulayov, G., Gunnell, D., Holmen, T.L., Metcalfe, C., The association of parental fatal and non-fatal suicidal behaviour with offspring suicidal behaviour and depression: a systematic review and meta-analysis. Psychol Med 42 (2012), 1567–1580.
63. Goldfarb, S.S., Tarver, W.L., Locher, J.L., Preskitt, J., Sen, B., A systematic review of the association between family meals and adolescent risk outcomes. J Adolesc 44 (2015), 134–149.
64. Heerde, J.A., Scholes-Balog, K.E., Hemphill, S.A., Associations between youth homelessness, sexual offenses, sexual victimization, and sexual risk behaviors: a systematic literature review. Arch Sex Behav 44 (2015), 181–212.
65. Heikkilä, K., Madsen, I.E.H., Nyberg, S.T., Fransson, E.I., Ahola, K., Alfredsson, L., et al. Job strain and the risk of inflammatory bowel diseases: individual-participant meta-analysis of 95,000 men and women. PLoS One, 9, 2014, e88711.
66. Hemmi, M.H., Wolke, D., Schneider, S., Associations between problems with crying, sleeping and/or feeding in infancy and long-term behavioural outcomes in childhood: a meta-analysis. Arch Dis Child 96 (2011), 622–629.
67. Hu, R., Li, Y., Zhang, Z., Yan, W., Antenatal depressive symptoms and the risk of preeclampsia or operative deliveries: a meta-analysis. PLoS One, 10, 2015, e0119018.
68. Hughes, K., Bellis, M.A., Jones, L., Wood, S., Bates, G., Eckley, L., et al. Prevalence and risk of violence against adults with disabilities: a systematic review and meta-analysis of observational studies. Lancet 379 (2012), 1621–1629.
69. Jokela, M., Batty, G.D., Hintsa, T., Elovainio, M., Hakulinen, C., Kivimaki, M., Is personality associated with cancer incidence and mortality? An individual-participant meta-analysis of 2156 incident cancer cases among 42,843 men and women. Br J Cancer 110 (2014), 1820–1824.
70. Jokela, M., Batty, G.D., Nyberg, S.T., Virtanen, M., Nabi, H., Singh-Manoux, A., et al. Personality and all-cause mortality: individual-participant meta-analysis of 3,947 deaths in 76,150 adults. Am J Epidemiol 178 (2013), 667–675.
71. Käkelä, J., Panula, J., Oinas, E., Hirvonen, N., Jääskeläinen, E., Miettunen, J., et al. Family history of psychosis and social, occupational and global outcome in schizophrenia: a meta-analysis. Acta Psychiatr Scand 130 (2014), 269–278.
72. Kaymaz, N., Drukker, M., Lieb, R., Wittchen, H.-U., Werbeloff, N., Weiser, M., et al. Do subthreshold psychotic experiences predict clinical outcomes in unselected non-help-seeking population-based samples? A systematic review and meta-analysis, enriched with new results. Psychol Med 42 (2012), 2239–2253.
73. Keall, R.M., Clayton, J.M., Butow, P.N., Therapeutic life review in palliative care: a systematic review of quantitative evaluations. J Pain Symptom Manage 49 (2015), 747–761.
74. Keshaviah, A., Edkins, K., Hastings, E.R., Krishna, M., Franko, D.L., Herzog, D.B., et al. Re-examining premature mortality in anorexia nervosa: a meta-analysis redux. Compr Psychiatry 55 (2014), 1773–1784.
75. Kropelin, T.F., Neyens, J.C.L., Halfens, R.J.G., Kempen, G.I.J.M., Hamers, J.P.H., Kröpelin, T.F., et al. Fall determinants in older long-term care residents with dementia: a systematic review. Int Psychogeriatrics 25 (2013), 549–563.
76. Kuijpers, K.F., van der Knaap, L.M., Lodewijks, I.A.J., Victims’ influence on intimate partner violence revictimization: a systematic review of prospective evidence. Trauma Violence Abuse 12 (2011), 198–219.
77. Laisné, F., Lecomte, C., Corbière, M., Biopsychosocial predictors of prognosis in musculoskeletal disorders: a systematic review of the literature (corrected and republished)*. Disabil Rehabil 34 (2012), 1912–1941.
78. LeBlanc, A.G., Spence, J.C., Carson, V., Gorber, S.C., Dillman, C., Janssen, I., et al. Systematic review of sedentary behaviour and health indicators in the early years (aged 0-4 years). Appl Physiol Nutr Metab 37 (2012), 753–772.
79. Lehmann, V., Hagedoorn, M., Tuinman, M.A., Body image in cancer survivors: a systematic review of case-control studies. J Cancer Surviv 9 (2014), 339–348.
80. Leung, Y.W., Flora, D.B., Gravely, S., Irvine, J., Carney, R.M., Grace, S.L., The impact of premorbid and postmorbid depression onset on mortality and cardiac morbidity among patients with coronary heart disease: meta-analysis. Psychosom Med 74 (2012), 786–801.
81. Linsell, L., Malouf, R., Johnson, S., Morris, J., Kurinczuk, J.J., Marlow, N., Prognostic factors for behavioral problems and psychiatric disorders in children born very preterm or very low birth weight: a systematic review. J Dev Behav Pediatr 37 (2016), 88–102.
82. Liu, B., Tarigan, L.H., Bromet, E.J., Kim, H., World Trade Center disaster exposure-related probable posttraumatic stress disorder among responders and civilians: a meta-analysis. PLoS One, 9, 2014, e101491.
83. Liu, R.T., Alloy, L.B., Stress generation in depression: a systematic review of the empirical literature and recommendations for future study. Clin Psychol Rev 30 (2010), 582–593.
84. Liu, S., Zhu, Y., Chen, W., Sun, T., Cheng, J., Zhang, Y., Risk factors for the second contralateral hip fracture in elderly patients: a systematic review and meta-analysis. Clin Rehabil 29 (2015), 285–294.
85. Long, M.H., Johnston, V., Bogossian, F., Work-related upper quadrant musculoskeletal disorders in midwives, nurses and physicians: a systematic review of risk factors and functional consequences. Appl Ergon 43 (2012), 455–467.
86. Lovato, C., Watts, A., Stead, L.F., Impact of tobacco advertising and promotion on increasing adolescent smoking behaviours. Cochrane Database Syst Rev, 2011, CD003439.
87. Mäkikangas, A., Kinnunen, U., Feldt, T., Schaufeli, W., The longitudinal development of employee well-being: a systematic review. Work Stress 8373 (2016), 1–25.
88. Makin, S.D.J., Turpin, S., Dennis, M.S., Wardlaw, J.M., Cognitive impairment after lacunar stroke: systematic review and meta-analysis of incidence, prevalence and comparison with other stroke subtypes. J Neurol Neurosurg Psychiatry 84 (2013), 893–900.
89. Malik, S., Kanwar, A., Sim, L.A., Prokop, L.J., Wang, Z., Benkhadra, K., et al. The association between sleep disturbances and suicidal behaviors in patients with psychiatric diagnoses: a systematic review and meta-analysis. Syst Rev, 3, 2014, 18.
90. Masson, M., East-Richard, C., Cellard, C., A meta-analysis on the impact of psychiatric disorders and maltreatment on cognition. Neuropsychology 30 (2016), 143–156.
91. Modabbernia, A., Mollon, J., Boffetta, P., Reichenberg, A., Impaired Gas Exchange at birth and risk of Intellectual Disability and autism: a meta-analysis. J Autism Dev Disord 46 (2016), 1847–1859.
92. Monette, M.C.E., Baird, A., Jackson, D.L., A meta-analysis of cognitive functioning in Nondemented adults with type 2 Diabetes Mellitus. Can J Diabetes 38 (2014), 401–408.
93. Moulton, C.D., Koychev, I., The effect of penicillin therapy on cognitive outcomes in neurosyphilis: a systematic review of the literature. Gen Hosp Psychiatry 37 (2015), 49–52.
94. Murri, M.B., Prestia, D., Mondelli, V., Pariante, C., Patti, S., Olivieri, B., et al. The HPA axis in bipolar disorder: systematic review and meta-analysis. Psychoneuroendocrinology 63 (2016), 327–342.
95. Nieuwenhuijsen, K., Bruinvels, D., Frings-Dresen, M., Psychosocial work environment and stress-related disorders, a systematic review. Occup Med (Lond) 60 (2010), 277–286.
96. Nilaweera, I., Doran, F., Fisher, J., Prevalence, nature and determinants of postpartum mental health problems among women who have migrated from South Asian to high-income countries: a systematic review of the evidence. J Affect Disord 166 (2014), 213–226.
97. Okun, M.A., Yeung, E.W.H., Brown, S., Volunteering by older adults and risk of mortality: a meta-analysis. Psychol Aging 28 (2013), 564–577.
98. Palmisano, G.L., Innamorati, M., Vanderlinden, J., Life adverse experiences in relation with obesity and binge eating disorder: a systematic review. J Behav Addict 5 (2016), 11–31.
99. Picorelli, A.M.A., Pereira, L.S.M., Pereira, D.S., Felicio, D., Sherrington, C., Assumpcao Picorelli, A.M., et al. Adherence to exercise programs for older people is influenced by program characteristics and personal factors: a systematic review. J Physiother 60 (2014), 151–156.
100. Pinquart, M., Duberstein, P.R., Depression and cancer mortality: a meta-analysis. Psychol Med 40 (2010), 1797–1810.
101. Pompili, M., Gonda, X., Serafini, G., Innamorati, M., Sher, L., Amore, M., et al. Epidemiology of suicide in bipolar disorders: a systematic review of the literature. Bipolar Disord 15 (2013), 457–490.
102. Prang, K.-H., Newnam, S., Berecki-Gisolf, J., The impact of family and work-related social support on musculoskeletal injury outcomes: a systematic review. J Occup Rehabil 25 (2015), 207–219.
103. Prieto, M.L., Cuéllar-Barboza, A.B., Bobo, W.V., Roger, V.L., Bellivier, F., Leboyer, M., et al. Risk of myocardial infarction and stroke in bipolar disorder: a systematic review and exploratory meta-analysis. Acta Psychiatr Scand 130 (2014), 342–353.
104. Proper, K.I., Singh, A.S., van Mechelen, W., Chinapaw, M.J.M., Sedentary behaviors and health outcomes among adults: a systematic review of prospective studies. Am J Prev Med 40 (2011), 174–182.
105. Raggi, A., Giovannetti, A.M., Quintas, R., D'Amico, D., Cieza, A., Sabariego, C., et al. A systematic review of the psychosocial difficulties relevant to patients with migraine. J Headache Pain 13 (2012), 595–606.
106. Ramond, A., Bouton, C., Richard, I., Roquelaure, Y., Baufreton, C., Legrand, E., et al. Psychosocial risk factors for chronic low back pain in primary care–a systematic review. Fam Pract 28 (2011), 12–21.
107. Rashid, M., Goez, H.R., Mabood, N., Damanhoury, S., Yager, J.Y., Joyce, A.S., et al. The impact of pediatric traumatic brain injury (TBI) on family functioning: a systematic review. J Pediatr Rehabil Med 7 (2014), 241–254.
108. Rehm, J., Taylor, B., Mohapatra, S., Irving, H., Baliunas, D., Patra, J., et al. Alcohol as a risk factor for liver cirrhosis: a systematic review and meta-analysis. Drug Alcohol Rev 29 (2010), 437–445.
109. Rossi, G., Frediani, S., Rossi, R., Rossi, A., Long-acting antipsychotic drugs for the treatment of schizophrenia: use in daily practice from naturalistic observations. BMC Psychiatry, 12, 2012, 122.
110. Sbarra, D.A., Law, R.W., Portley, R.M., Divorce and Death: a meta-analysis and research Agenda for clinical, social, and health psychology. Perspect Psychol Sci 6 (2011), 454–474.
111. Schmidt, U., Willmund, G.-D., Holsboer, F., Wotjak, C.T., Gallinat, J., Kowalski, J.T., et al. Searching for non-genetic molecular and imaging PTSD risk and resilience markers: systematic review of literature and design of the German Armed Forces PTSD biomarker study. Psychoneuroendocrinology 51 (2015), 444–458.
112. Sømhovd, M.J., Hansen, B.M., Brok, J., Esbjørn, B.H., Greisen, G., Anxiety in adolescents born preterm or with very low birthweight: a meta-analysis of case-control studies. Dev Med Child Neurol 54 (2012), 988–994.
113. Song, J., Viggiano, A., Monda, M., De Luca, V., Peripheral glutamate levels in schizophrenia: evidence from a meta-analysis. Neuropsychobiology 70 (2014), 133–141.
114. Stehr, M.D., Von Lengerke, T., Preventing weight gain through exercise and physical activity in the elderly: a systematic review. Maturitas 72 (2012), 13–22.
115. Sturmberg, C., Marquez, J., Heneghan, N., Snodgrass, S., van Vliet, P., Attentional focus of feedback and instructions in the treatment of musculoskeletal dysfunction: a systematic review. Man Ther 18 (2013), 458–467.
116. Surkan, P.J., Kennedy, C.E., Hurley, K.M., Black, M.M., Maternal depression and early childhood growth in developing countries: systematic review and meta-analysis. WHO Bull 89 (2011), 608–615.
117. Taylor, G., McNeill, A., Girling, A., Farley, A., Lindson-Hawley, N., Aveyard, P., Change in mental health after smoking cessation: systematic review and meta-analysis. BMJ, 348, 2014, g1151.
118. Tetley, A., Moghaddam, N.G., Dawson, D.L., Rennoldson, M., Parental bonding and eating disorders: a systematic review. Eat Behav 15 (2014), 49–59.
119. Thangaratinam, S., Rogozinska, E., Jolly, K., Glinkowski, S., Duda, W., Borowiack, E., et al. Interventions to reduce or prevent obesity in pregnant women: a systematic review. Health Technol Assess, 16, 2012 iii–iv, 1–191.
120. Theorell, T., Hammarstrom, A., Aronsson, G., Traskman Bendz, L., Grape, T., Hogstedt, C., et al. A systematic review including meta-analysis of work environment and depressive symptoms. BMC Public Health, 15, 2015, 738.
121. Trenchard, S.O., Rust, S., Bunton, P., A systematic review of psychosocial outcomes within 2 years of paediatric traumatic brain injury in a school-aged population. Brain Inj 27 (2013), 1217–1237.
122. Vangeli, E., Stapleton, J., Smit, E.S., Borland, R., West, R., Predictors of attempts to stop smoking and their success in adult general population samples: a systematic review. Addiction 106 (2011), 2110–2121.
123. Vu, J.A., Babikian, T., Asarnow, R.F., Academic and language outcomes in children after traumatic brain injury: a meta-analysis. Except Child 77 (2011), 263–281.
124. Wang, Y.-M., Shu, B.-C., Fetzer, S., Chang, Y.-J., Parenting style of women who conceived using in vitro fertilization: a meta-analysis. J Nurs Res 22 (2014), 69–80.
125. Weierink, L., Vermeulen, R.J., Boyd, R.N., Brain structure and executive functions in children with cerebral palsy: a systematic review. Res Dev Disabil 34 (2013), 1678–1688.
126. Wilson, L.C., Mass Shootings: a meta-analysis of the Dose-response relationship. J Trauma Stress 27 (2014), 631–638.
127. Winters, B.D., Eberlein, M., Leung, J., Needham, D.M., Pronovost, P.J., Sevransky, J.E., Long-term mortality and quality of life in sepsis: a systematic review. Crit Care Med 38 (2010), 1276–1283.
128. Xenaki, L.-A., Pehlivanidis, A., Clinical, neuropsychological and structural convergences and divergences between Attention Deficit/Hyperactivity disorder and Borderline personality disorder: a systematic review. Pers Individ Dif 86 (2015), 438–449.
129. Zhu, T., Ye, X., Zhang, T., Lin, Z., Shi, W., Wei, X., et al. Association between alcohol consumption and multiple sclerosis: a meta-analysis of observational studies. Neurol Sci 36 (2015), 1543–1550.
130. Zijlmans, M.A.C., Riksen-Walraven, J.M., de Weerth, C., Associations between maternal prenatal cortisol concentrations and child outcomes: a systematic review. Neurosci Biobehav Rev 53 (2015), 1–24.
131. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med, 6, 2009, e1000097.
132. Stroup, D.F., Berlin, J.A., Morton, S.C., Olkin, I., Williamson, G.D., Rennie, D., et al. Meta-analysis of observational studies in epidemiology - a proposal for reporting. JAMA 283 (2000), 2008–2012.
133. Centre for Reviews and Dissemination. Systematic Reviews: CRD's guidance for undertaking reviews in health care. York: University of York, 2009. Available at: https://www.york.ac.uk/crd/guidance/. Accessed November 24, 2016.
134. Wells G, Shea B, O'connell D, Peterson J. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses n.d. Available at http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Accessed November 24, 2016.
135. Effective Public Health Practice Project: Quality assessment Tool for Quantitative Studies n.d. Available at http://www.ephpp.ca/tools.html. Accessed November 24, 2016.
136. Stalenhoef, P.A., Crebolder, H.F.J.M., Knottnerus, J.A., Van Der Horst, F.G.E.M., Incidence, risk factors and consequences of falls among elderly subjects living in the community: a criteria-based analysis. Eur J Public Health 7 (1997), 328–334.
137. Sherehiy, B., Karwowski, W., Marek, T., Relationship between risk factors and musculoskeletal disorders in the nursing profession: a systematic review. Occup Ergon 4 (2004), 241–279 39p.
138. Tak, L.M., Cleare, A.J., Ormel, J., Manoharan, A., Kok, I.C., Wessely, S., et al. Meta-analysis and meta-regression of hypothalamic-pituitary-adrenal axis activity in functional somatic disorders. Biol Psychol 87 (2011), 183–194.
139. Mirza, I., Jenkins, R., Risk factors, prevalence, and treatment of anxiety and depressive disorders in Pakistan: systematic review. BMJ, 328, 2004, 794.
140. Downs, S.H., Black, N., The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 52 (1998), 377–384.
141. Kmet, L.M., Lee, R.C., Cook, L.S., Standard quality assessment criteria for evaluating primary research papers. Alberta Herit Found Med Res 13 (2004), 1–22.
142. National Institute for Mental Health and Clinical Excellence. The guidelines manual. 2009, NICE, London.
143. Ariëns, G.A.M., Van Mechelen, W., Bongers, P.M., Bouter, L.M., Van Der Wal, G., Physical risk factors for neck pain. Scand J Work Environ Heal 26 (2000), 7–19.
144. Hayden, J.A., van der Windt, D.A., Cartwright, J.L., Côté, P., Bombardier, C., Assessing bias in studies of prognostic factors. Ann Intern Med 158 (2013), 280–286.
145. Hopewell, S., Boutron, I., Altman, D.G., Ravaud, P., Incorporation of assessments of risk of bias of primary studies in systematic reviews of randomised trials: a cross-sectional study. BMJ Open, 3, 2013, e003342.
146. Jarde, A., Losilla, J.M., Vives, J., Rodrigo, M.F., Q-Coh: a tool to screen the methodological quality of cohort studies in systematic reviews and meta-analyses. Int J Clin Heal Psychol 13 (2013), 138–146.
147. Sterne, J.A., Hernán, M.A., Reeves, B.C., Savović, J., Berkman, N.D., Viswanathan, M., et al. ROBINS-I: a tool for assessing risk of bias in non-randomized studies of interventions. BMJ, 355, 2016, i4919.
148. Thompson, S., Ekelund, U., Jebb, S., Lindroos, A.K., Mander, A., Sharp, S., et al. A proposed method of bias adjustment for meta-analyses of published observational studies. Int J Epidemiol 40 (2011), 765–777.