An original stepwise multilevel logistic regression analysis of discriminatory accuracy: The case of neighbourhoods and health

PLoS ONE

Volumn 11, Issue 4, 2016, Pages

  Merlo, Juan ^a   Wagner, Philippe ^a,b   Ghith, Nermin ^a,c   Leckie, George ^d  

^a LUND UNIVERSITY   (Sweden)

^b UPPSALA UNIVERSITY   (Sweden)

^c BISPEBJERG HOSPITAL   (Denmark)

^d UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANTIDEPRESSANT AGENT; HYPNOTIC SEDATIVE AGENT; PSYCHOTROPIC AGENT;

ACCURACY; ADULT; AGE DISTRIBUTION; ANALYTIC METHOD; AREA UNDER THE CURVE; ARTICLE; DISCRIMINATORY ACCURACY; DRUG USE; FEMALE; GENERAL PRACTITIONER; HEALTH CARE ACCESS; HEALTH CARE DELIVERY; HUMAN; LOGISTIC REGRESSION ANALYSIS; LOWEST INCOME GROUP; MALE; MENTAL HEALTH; METHODOLOGY; MIDDLE AGED; MULTILEVEL LOGISTIC REGRESSION ANALYSIS; NEIGHBORHOOD; ODDS RATIO; ORIGINAL STEPWISE ANALYTICAL APPROACH; PREDICTION; PREVALENCE; PRIVATE PRACTICE; PROBABILITY; PUBLIC HEALTH; SEX DIFFERENCE; SOCIAL EPIDEMIOLOGY; SOCIETY; DEMOGRAPHY; LONGITUDINAL STUDY; MULTILEVEL ANALYSIS; PROCEDURES; RECEIVER OPERATING CHARACTERISTIC; SOCIOECONOMICS; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA; SWEDEN;

ADULT; FEMALE; GENERAL PRACTITIONERS; HUMANS; LOGISTIC MODELS; LONGITUDINAL STUDIES; MALE; MIDDLE AGED; MULTILEVEL ANALYSIS; PSYCHOTROPIC DRUGS; PUBLIC HEALTH; RESIDENCE CHARACTERISTICS; ROC CURVE; SOCIOECONOMIC FACTORS; SWEDEN;

EID: 84966333781     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0153778     Document Type: Article

References (83)

1. Duncan C, Jones K, Moon G. Context, composition and heterogeneity: using multilevel models in health research. Soc Sci Med. 1998; 46(1):97-117. PMID: 9464672
2. Merlo J. Invited commentary: multilevel analysis of individual heterogeneity - a fundamental critique of the current probabilistic risk factor epidemiology. American Journal of Epidemiology. 2014; 180 (2):208-12. Epub 2014/06/14. doi: 10.1093/aje/kwu108 PMID: 24925064.
3. Merlo J. Multilevel analytical approaches in social epidemiology: measures of health variation compared with traditional measures of association. J Epidemiol Community Health. 2003; 57(8):550-2. Epub 2003/07/29. PMID: 12883048; PubMed Central PMCID: PMC1732554.
4. Merlo J, Viciana-Fernandez FJ, Ramiro-Farinas D, Research Group of Longitudinal Database of Andalusian P. Bringing the individual back to small-area variation studies: a multilevel analysis of all-cause mortality in Andalusia, Spain. Soc Sci Med. 2012; 75(8):1477-87. Epub 2012/07/17. doi: 10.1016/j.socscimed.2012.06.004 PMID: 22795359.
5. Jones K, Subramanian SV. Developing multilevel models for analysing contextuality, heterogeneity and change using MLwiN 2.2: University of Bristol; 2015.
6. Subramanian SV, Jones K, Duncan C. Multilevel methods for public health research. In: Kawachi I, Berkman LF, editors. Neighborhoods and Health. New York, NY: Oxford University Press; 2003. p. 65-111.
7. Merlo J, Ohlsson H, Lynch KF, Chaix B, Subramanian SV. Individual and collective bodies: using measures of variance and association in contextual epidemiology. J Epidemiol Community Health. 2009; 63 (12):1043-8. Epub 2009/08/12. doi: 10.1136/jech.2009.088310 PMID: 19666637.
8. Duncan C, Jones K, Moon G. Do places matter? A multi-level analysis of regional variations in health-related behaviour in Britain. Soc Sci Med. 1993; 37(6):725-33. PMID: 8211288.
9. Boyle MH, Willms JD. Place effects for areas defined by administrative boundaries. AmJEpidemiol. 1999; 149(6):577-85.
10. Merlo J, Ostergren PO, Hagberg O, Lindstrom M, Lindgren A, Melander A, et al. Diastolic blood pressure and area of residence: multilevel versus ecological analysis of social inequity. J Epidemiol Community Health. 2001; 55(11):791-8. Epub 2001/10/18. PMID: 11604434; PubMed Central PMCID: PMC1763308.
11. Merlo J, Asplund K, Lynch J, Rastam L, Dobson A. Population effects on individual systolic blood pressure: a multilevel analysis of the World Health Organization MONICA Project. Am J Epidemiol. 2004; 159(12):1168-79. Epub 2004/06/12. doi: 10.1093/aje/kwh160 PMID: 15191934.
12. Clarke P, Wheaton B. Addressing Data Sparseness in Contextual Population Research: Using Cluster Analysis to Create Synthetic Neighborhoods. Sociological Methods Research. 2007; 35:311-51.
13. Riva M, Gauvin L, Barnett TA. Toward the next generation of research into small area effects on health: a synthesis of multilevel investigations published since July 1998. J Epidemiol Community Health. 2007; 61(10):853-61. PMID: 17873220.
14. Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P, et al. A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health. 2006; 60(4):290-7. Epub 2006/03/16. doi: 10.1136/jech.2004.029454 PMID: 16537344; PubMed Central PMCID: PMC2566165.
15. Merlo J, Chaix B, Yang M, Lynch J, Rastam L. A brief conceptual tutorial on multilevel analysis in social epidemiology: interpreting neighbourhood differences and the effect of neighbourhood characteristics on individual health. J Epidemiol Community Health. 2005; 59(12):1022-8. Epub 2005/11/16. doi: 10.1136/jech.2004.028035 PMID: 16286487; PubMed Central PMCID: PMC1732971.
16. Merlo J, Chaix B, Yang M, Lynch J, Rastam L. A brief conceptual tutorial of multilevel analysis in social epidemiology: linking the statistical concept of clustering to the idea of contextual phenomenon. J Epidemiol Community Health. 2005; 59(6):443-9. Epub 2005/05/25. doi: 10.1136/jech.2004.023473 PMID: 15911637; PubMed Central PMCID: PMC1757045.
17. Merlo J, Yang M, Chaix B, Lynch J, Rastam L. A brief conceptual tutorial on multilevel analysis in social epidemiology: investigating contextual phenomena in different groups of people. J Epidemiol Community Health. 2005; 59(9):729-36. Epub 2005/08/16. doi: 10.1136/jech.2004.023929 PMID: 16100308; PubMed Central PMCID: PMC1733145.
18. Petronis KR, Anthony JC. A different kind of contextual effect: geographical clustering of cocaine incidence in the USA. J Epidemiol Community Health. 2003; 57(11):893-900. PMID: 14600117.
19. Rose G. Sick individuals and sick populations. 1985. Bull World Health Organ. 2001; 79(10):990-6. Epub 2001/11/06. PMID: 11693983; PubMed Central PMCID: PMC2566665.
20. Ibanez B, Librero J, Bernal-Delgado E, Peiro S, Lopez-Valcarcel BG, Martinez N, et al. Is there much variation in variation? Revisiting statistics of small area variation in health services research. BMC health services research. 2009; 9:60. PMID: 19341469. doi: 10.1186/1472-6963-9-60
21. Diez Roux AV. Residential environments and cardiovascular risk. Journal of urban health: bulletin of the New York Academy of Medicine. 2003; 80(4):569-89. Epub 2004/01/08. doi: 10.1093/jurban/jtg065 PMID: 14709706.
22. Wemrell M, Merlo J, Mulinari S, Hornborg A-C. Contemporary epidemiology: a review of critical discussions within the discipline and a call for further dialogue with social theory. Sociology Compass 2016; 10(2):153-71. Epub 3 FEB 2016. doi: 10.1111/soc4.12345
23. Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol. 2004; 159(9):882-90. Epub 2004/04/24. PMID: 15105181.
24. Pepe MS. Problems with risk reclassification methods for evaluating prediction models. Am J Epidemiol. 2011; 173(11):1327-35. Epub 2011/05/11. doi: 10.1093/aje/kwr013 PMID: 21555714; PubMed Central PMCID: PMC3139963.
25. Hidden J, Gerds T. Evaluating the impact of novel biomarkers: Do not rely on IDI and NRI. Department of Biostatistics, University of Copenhagen, Denmark. 2012;Research Report 12/08.
26. Goldstein H, Browne W, Rasbash J. Partitioning variation in generalised linear multilevel models. Understanding Statistics. 2002; 1:223-32.
27. Browne WJ, Subramanian SV, Jones K, Goldstein H. Variance partitioning in multilevel logistic models that exhibit overdispersion. Journal of the Royal Statistical Society: Series A (Statistics in Society). 2005; 168(3):599-613.
28. Li J, Gray BR, Bates DM. An Empirical Study of Statistical Properties of Variance Partition Coefficients for Multi-Level Logistic Regression Models. Communications in Statistics - Simulation and Computation. 2008; 37:2010-26.
29. Larsen K, Merlo J. Appropriate assessment of neighborhood effects on individual health: integrating random and fixed effects in multilevel logistic regression. Am J Epidemiol. 2005; 161(1):81-8. Epub 2004/12/24. doi: 10.1093/aje/kwi017 PMID: 15615918.
30. Larsen K, Petersen JH, Budtz-Jorgensen E, Endahl L. Interpreting parameters in the logistic regression model with random effects. Biometrics. 2000; 56(3):909-14. PMID: 10985236
31. Bennett B. Use of the tetrachoric correlation model in assessing clinical tests. Biometrical Journal. 1980; 22(4):335-8.
32. Lorenzo-Seva U, Ferrando PJ. TETRA-COM: a comprehensive SPSS program for estimating the tetrachoric correlation. Behavior research methods. 2012; 44(4):1191-6. Epub 2012/04/06. doi: 10.3758/s13428-012-0200-6 PMID: 22477439.
33. Wagner P, Merlo J. Measures of discriminatory accuracy in multilevel analysis. European journal of epidemiology. 2013; 28(1, Supplement):135.
34. Wagner P, Merlo J. Discriminatory accuracy of a random effect in multilevel logistic regression. 20th IEA World Congress of Epidemiology (WCE2014). 2014.
35. Wettermark B, Hammar N, Fored CM, Leimanis A, Otterblad Olausson P, Bergman U, et al. The new Swedish Prescribed Drug Register - opportunities for pharmacoepidemiological research and experience from the first six months. Pharmacoepidemiology and drug safety. 2007; 16(7):726-35. PMID: 16897791.
36. WHO Collaborating Centre for Drug Statistics Methodology. ATC/DDD Index. Available: http://wwwwhoccno/atc-ddd-index/. 2013.
37. Sweden S. Product catalogue. Statistics Sweden's Market Profiles. 2014; Available: http://www.scb.se/marketprofiles/.
38. Pencina MJ, D'Agostino RB, Pencina KM, Janssens AC, Greenland P. Interpreting incremental value of markers added to risk prediction models. Am J Epidemiol. 2012; 176(6):473-81. Epub 2012/08/10. doi: 10.1093/aje/kws207 PMID: 22875755.
39. Pencina MJ, D'Agostino RB Sr., Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011; 30(1):11-21. Epub 2011/01/05. doi: 10.1002/sim.4085 PMID: 21204120; PubMed Central PMCID: PMC3341973.
40. Pencina MJ, D'Agostino RB Sr., D'Agostino RB Jr., Vasan RS. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Statistics in Medicine. 2008; 27(2):157-72. doi: 10.1002/sim.2929 WOS:000253098900001. PMID: 17569110
41. Pepe MS, Fan J, Feng Z, Gerds T, Hilden J. The Net Reclassification Index (NRI): a Misleading Measure of Prediction Improvement Even with Independent Test Data Sets. Stat Biosci. 2015; 7(2):282-95. doi: 10.1007/s12561-014-9118-0 PMID: 26504496.
42. Leckie G, Goldstein H. Understanding Uncertainty in School League Tables. Fiscal Studies. 2011
43. Leckie G, Goldstein H. The limitations of using school league tables to inform school choice. Journal of the Royal Statistical Society: Series A (Statistics in Society),. 2009;(172):835-51.
44. Leckie G, Goldstein H. A note on "The limitations of using school league tables to inform school choice". Journal of the Royal Statistical Society: Series A (Statistics in Society),. 2011;(174):833-6.
45. Browne WJ. MCMC Estimation in MLwiN (Version 2.13) Centre for Multilevel Modelling, University of Bristol. Available: http://wwwbristolacuk/cmm/software/mlwin/download/mcmc-printpdf. 2009; Accessed 27 March 2014.
46. Spiegelhalter DJ, Best N, Carlin BP, Linde AVD. Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society Series C, Applied statistics. 2002; 64:583-639.
47. Lunn D, Jackson C, Best N, Thomas A, Spiegelhalter D. The BUGS book: A practical introduction to Bayesian analysis. Boca Raton, FL: Chapman & Hall/CRC Texts in Statistical Science. 2012.
48. Browne WJ. MCMC estimation in MLwiN. Version 2.31. Centre for Multilevel Modelling, University of Bristol. 2014;ISBN: 978-0-903024-99-0 (Available: http://www.bristol.ac.uk/cmm/media/migrated/2-31/mcmc-print.pdf (by November 2015)).
49. Yang M, Eldridge S, Merlo J. Multilevel survival analysis of health inequalities in life expectancy. International journal for equity in health. 2009; 8:31. PMID: 19698159. doi: 10.1186/1475-9276-8-31
50. Merlo J, Ohlsson H, Chaix B, Lichtenstein P, Kawachi I, Subramanian SV. Revisiting causal neighborhood effects on individual ischemic heart disease risk: a quasi-experimental multilevel analysis among Swedish siblings. Soc Sci Med. 2013; 76(1):39-46. Epub 2012/11/10. doi: 10.1016/j.socscimed.2012.08.034 PMID: 23137763.
51. Mulinari S, Juárez S, Wagner P, Merlo J. Does maternal country of birth matter for understanding offspring's birthweight? A multilevel analysis of individual heterogeneity in Sweden. PLOS-ONE (in press). 2015.
52. Maas CJM, Hox JJ. The influence of violations of assumptions on multilevel parameter etimates and their standar errors. Computational statistics & data analysis. 2004; 46:427-40.
53. Goldstein H, Noden P. Modelling social segregation. Oxford Review of Education,. 2003; 29(2):225-37.
54. Leckie G, Goldstein H. A multilevel modelling approach to measuring changing patterns of ethnic composition and segregation among London secondary schools, 2001-2010. Journal of the Royal Statistical Society: Series A (Statistics in Society),. 2015; 178:405-24.
55. Leckie G, Pillinger R, Jones K, Goldstein H. Multilevel Modeling of Social Segregation. JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS 2012; 37 (1):3-30.
56. Oakes JM. The (mis)estimation of neighborhood effects: causal inference for a practicable social epidemiology. Soc Sci Med. 2004; 58(10):1929-52. PMID: 15020009.
57. Johnell K, Merlo J, Lynch J, Blennow G. Neighbourhood social participation and women's use of anxiolytic-hypnotic drugs: a multilevel analysis. J Epidemiol Community Health. 2004; 58(1):59-64. Epub 2003/12/20. PMID: 14684728; PubMed Central PMCID: PMC1757021.
58. Collaboration. Farmakoterapi vid ångest - Behandlingsrekommendation. Information från Läkemedelsverket 4:2006, Sweden. 2006.
59. Hälso- och sjukvårdslag. 1982:763. Available: http://www.riksdagen.se/webbnav/index.aspx?nid=3911&bet=1982:763, (1982).
60. Beckman A. Country of birth and socioeconomic disparities in utilisation of health care and disability pension - a multilevel approach. [Thesis doctoral]. Malmö Lunds University; 2005.
61. Veblen T. The Theory of the Leisure Class. Baltimore: Penguin Books; 1994.
62. Pickett KE, Pearl M. Multilevel analyses of neighbourhood socioeconomic context and health outcomes: a critical review. JEpidemiolCommunity Health. 2001; 55(2):111-22.
63. Diez Roux AV. Next steps in understanding the multilevel determinants of health. J Epidemiol Community Health 1470-2738 (Electronic). 2008; 62(11):957-9. Epub 2008/10/16. doi: 10.1136/jech.2007.064311 PMID: 18854498.
64. Merlo J, Wagner P. The tyranny of the averages and the indiscriminate use of risk factors in public health: a call for revolution. European journal of epidemiology. 2013; 28(1, Supplement):148.
65. Mitchell R. Multilevel modeling might not be the answer. Environ Plan A. 2001; 33:1357-60.
66. Rasbash J, Leckie G, Pillinger R, Jenkins J. Children's educational progress: partitioning family, school and area effects. Journal of the Royal Statistical Society: Series A (Statistics in Society). 2010; 173 (3):657-82.
67. Leckie G. The complexity of school and neighbourhood effects and movements of pupils on school differences in models of educational achievement. Journal of the Royal Statistical Society: Series A (Statistics in Society). 2009; 172(537-554).
68. Morenoff JD. Neighborhood mechanisms and the spatial dynamics of birth weight. AJS. 2003; 108 (5):976-1017. PMID: 14560732.
69. Ohlsson H, Merlo J. Place effects for areas defined by administrative boundaries: a life course analysis of mortality and cause specific morbidity in Scania, Sweden. Soc Sci Med. 2011; 73(8):1145-51. Epub 2011/09/03. doi: 10.1016/j.socscimed.2011.08.005 PMID: 21885175.
70. Sariaslan A, Langstrom N, D'Onofrio B, Hallqvist J, Franck J, Lichtenstein P. The impact of neighbourhood deprivation on adolescent violent criminality and substance misuse: a longitudinal, quasi-experimental study of the total Swedish population. International Journal of Epidemiology. 2013; 42(4):1057-66. Epub 2013/09/26. doi: 10.1093/ije/dyt066 PMID: 24062294; PubMed Central PMCID: PMC3780994.
71. Leckie G. Cross-classified Multilevel Models - Concepts. LEMMA VLE Module 12, 1-60. 2013.
72. Leckie G. Multiple Membership Multilevel Models - Concepts. LEMMA VLE Module 13, 1-61. 2013.
73. Browne WJ, Goldstein H, Rasbash J. Multiple membership multiple classification (MMMC) models. Statistical Modelling. 2001; 1(2):103-24.
74. Skrondal A., Rabe-Hesketh S. Prediction in multilevel generalized linear models. J R Statist Soc A 2009; 172(Part 3):659-87
75. Van Oirbeek R, Lesaffre E.Assessing the predictive ability of a multilevel binary regression model. Computational Statistics and Data Analysis 2012; 56(6):1966-80.
76. Neyman J, Scott E L. Consistent estimates based on partially consistent observations. Econometrica 16, 1-32. Econometrica 1948; 16:1-32.
77. Dundas R, Leyland AL, Macintyre S. Early life school, neighbourhood and family influences on adult health: a multilevel cross-classified analysis of the Aberdeen Children of the 1950s study. American Journal of Epidemiology. 2014;AJE-00606-2013.R5.
78. Leyland AH, Naess O. The effect of area of residence over the life course on subsequent mortality. Journal of the Royal Statistical Society Series A. 2009; 172(3):555-78. Epub 2009/06/01. doi: 10.1111/j.1467-985X.2008.00581.x PMID: 21197131; PubMed Central PMCID: PMC3001114.
79. Bauer GR. Incorporating intersectionality theory into population health research methodology: challenges and the potential to advance health equity. Soc Sci Med. 2014; 110:10-7. doi: 10.1016/j.socscimed.2014.03.022 PMID: 24704889.
80. Knol MJ, VanderWeele TJ. Recommendations for presenting analyses of effect modification and interaction. Int J Epidemiol. 2012; 41(2):514-20. doi: 10.1093/ije/dyr218 PMID: 22253321; PubMed Central PMCID: PMCPMC3324457.
81. Luke DA, Stamatakis KA. Systems science methods in public health: dynamics, networks, and agents. Annual review of public health. 2012; 33:357-76. doi: 10.1146/annurev-publhealth-031210-101222 PMID: 22224885; PubMed Central PMCID: PMCPMC3644212.
82. Cummins S, Curtis S, Diez-Roux AV, Macintyre S. Understanding and representing 'place' in health research: A relational approach. Soc Sci Med. 2007; 65(9):1825-38. PMID: 17706331.
83. Macintyre S, Ellaway A, Cummins S. Place effects on health: how can we conceptualise, operationalise and measure them? Soc Sci Med. 2002; 55(1):125-39. PMID: 12137182.