Vignettes and health systems responsiveness in cross-country comparative analyses

Journal of the Royal Statistical Society. Series A: Statistics in Society

Volumn 175, Issue 2, 2012, Pages 337-369

  Rice, Nigel ^a   Robone, Silvana ^a   Smith, Peter C ^b  

^a UNIVERSITY OF YORK   (United Kingdom)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Anchoring vignettes; Cross country comparison; Health system performance; Healthcare responsiveness; Hierarchical ordered probit

Indexed keywords

EID: 84863402619     PISSN: 09641998     EISSN: 1467985X     Source Type: Journal    
DOI: 10.1111/j.1467-985X.2011.01021.x     Document Type: Article

References (75)

1. Bago d'Uva, T., van Doorlsaer, E., Lindeboom, M. and O'Donnell, O. (2008) Does reporting heterogeneity bias the measurement of health disparities? Hlth Econ., 17, 351-375.
2. Bago d'Uva, T., Lindeboom, M., O'Donnell, O. and van Doorslaer, E.(2009) Slipping anchor?: testing the vignettes approach to identification and correction of reporting heterogeneity. Discussion Paper 09-091/3. Tinbergen Institute, Rotterdam.
3. Blendon, R. J., Schoen, C., DesRoches, C., Osborn, R. and Zapert, K. (2003) Common concerns amid diverse systems: health care experiences in five countries. Hlth Aff., 22, no. 3, 106-121.
4. Brislin, R. W. (1986) The wording and translation of research instruments: field methods in cross-cultural research. In Field Methods in Cross-cultural Research (eds W. J. Lonner and J. W. Berry), pp. 137-164. Beverly Hills: Sage.
5. Coulter, A. and Magee, H. (2003) The European Patient of the Future (State of Health). Maidenhead: Open University Press.
6. Datta Gupta, N., Kristensen, N. and Pozzoli, D. (2010) External Validation of the use of vignettes in cross-country health studies. Econ. Modllng, 27, 854-865.
7. Ferguson, B. D., Tandon, A., Gakidou, E. and Murray, C. J. L. (2003) Estimating permanent income using indicator variables. In Health Systems Performance Assessment: Debates, Methods and Empiricism (eds C. J. L. Murray and D. B. Evans), pp. 748-760. Geneva: World Health Organization.
8. Gonzalez Block, M. A. (1997) Comparative research and analysis methods for shared learning from health system reforms. Hlth Poly, 42, 187-209.
9. Greene, W. H. (2003) Econometric Analysis. Upper Saddle River: Pearson.
10. Greene, W. H. and Hensher, D. A. (2009) Modeling Ordered Choices: a Primer and Recent Developments. New York: Cambridge University Press.
11. de Groot, W. (2000) Adaptation and scale of reference bias in self-assessments of quality of life. J. Hlth Econ., 19, 403-420.
12. Hollingsworth, B. and Wildman, J. (2003) The efficiency of health production: re-estimating the WHO panel data using parametric and non-parametric approaches to provide additional information. Hlth Econ., 12, 493-504.
13. Iburg, K. M., Salomon, J., Tandon, A. and Murray, C. J. L. (2002) Cross-country comparability of physician-assessed and self-reported measures of health. In Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications (eds C. J. Murray, J. A. Salomon, C. D. Mathers and A. D. Lopez), pp. 433-448. Geneva: World Health Organization.
14. Idler, E. L. and Kasl, S. V. (1995) Self-ratings of health: do they also predict change in functional ability? J. Gerontol. Soc. Sci. B, 50, 344-353.
15. Jürges, H. (2007) True health versus response styles: exploring cross-country differences in self-reported health. Hlth Econ., 16, 163-178.
16. Kapteyn, A., Smith, J. and van Soest, A. (2007) Vignettes and self-reports of work disability in the US and the Netherlands. Am.Econ. Rev., 97, 461-473.
17. Kempen, G. I., Steverink, N., Ormel, J. and Deeg, D. J. (1996) The assessment of ADL among frail elderly in an interview survey: self-report versus performance-based tests and determinants of discrepancies. J. Gerontol. Soc. Sci. B, 51, 254-260.
18. Kerkhofs, M. J. M. and Lindeboom, M. (1995) Subjective health measures and state dependent reporting errors. Hlth Econ., 4, 221-235.
19. King, G., Murray, C. J. L., Salomon, J. and Tandon, A. (2004) Enhancing the validity and cross-cultural comparability of measurement in survey research. Am. Polit. Sci. Rev., 98, 184-191.
20. King, G. and Wand, J. (2007) Comparing incomparable survey responses: new tools for anchoring vignettes. Polit. Anal., 15, 46-66.
21. Kristensen, N. and Johansson, E. (2008) New evidence on cross-country differences in job satisfaction using anchoring vignettes. Lab. Econ., 15, 96-117.
22. Lindeboom, M. and van Doorslaer, E. (2004) Cut-point shift and index shift in self-reported health. J. Hlth Econ., 23, 1083-1099.
23. Lynn, P., Japec, L. and Lyberg, L. (2006) What's so special about cross-national surveys? Working Paper 2005-16. Institute for Social and Economic Research, University of Essex, Colchester.
24. Manderbacka, K. (1998) Examining what self-rated health question is understood to mean by respondents. Scand. J. Soc. Med., 26, 145-153.
25. Murray, C. J. L. and Frenk, J. (2000) A framework for assessing the performance of health systems. Bull. Wrld Hlth Orgnzn, 78, 717-731.
26. Murray, C. J. L., Ozaltin, E., Tandon, A., Salomon, J., Sadana, R. and Chatterji, S. (2003) Empirical evaluation of the anchoring vignettes approach in health surveys. In Health Systems Performance Assessment: Debates, Methods and Empiricism (eds C. J. L. Murray and D. B. Evans), pp. 369-399. Geneva: World Health Organization.
27. Okazaki, S. and Sue, S. (1995) Methodological issues in assessment research with ethnic minorities. Psychol. Assessmnt, 7, 367-375.
28. O'Mahony, M. and Stevens, P. A. (2004) International Comparisons of Performance in the Provision of Public Services: Outcome Based Measures for Education. London: National Institute of Economic and Social Research.
29. Peracchi, F. and Rossetti, C. (2010) The heterogeneous thresholds ordered response model: identification and inference. Working Paper 10/12. Einaudi Institute for Economics and Finance, Rome. (Available from).
30. Pudney, S. and Shields, M. (2000) Gender, race, pay and promotion in the British nursing profession: estimation of a generalized ordered probit model. J. Appl. Econ., 15, 367-399.
31. Puentes Rosas, E., Gómez Dantés, O. and Garrido Latorre, F. (2006) Trato a los usuarios en los servicios públicos de salud en México. Rev. Panam. Salud Publ., 9, 394-402.
32. Rice, N., Robone, S. and Smith, P. C. (2010) International comparison of public sector performance: the use of anchoring vignettes to adjust self-reported data. Evaluation, 16, 81-100.
33. Rice, N., Robone, S. and Smith, P. C. (2011) Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness. Eur. J. Hlth Econ., 12, 141-162.
34. Sadana, R., Mathers, C. D., Lopez, A. D., Murray, C. J. L. and Iburg, K. M. (2002) Comparative analyses of more than 50 household surveys on health status. In Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications (eds C. J. Murray, J. A. Salomon, C. D. Mathers and A. D. Lopez), pp. 369-386. Geneva: World Health Organization.
35. Sirven, N., Santos-Eggimann, B. and Spagnoli, J. (2008) Comparability of health care responsiveness in Europe: using anchoring vignettes from SHARE. Working Paper DT 15. Institut de Recherche et Documentation en Economie de la Santé, Paris.
36. van Soest, A., Delaney, L., Harmon, C., Kapteyn, A. and Smith, J. P. (2007) Validating the use of vignettes for subjective threshold scales. Mimeo. RAND Corporation, Santa Monica.
37. Tandon, A., Murray, C. J. L., Salomon, J. A. and King, G. (2003) Statistical models for enhancing cross-population comparability. In Health Systems Performance Assessment: Debates, Methods and Empiricism (eds C. J. L. Murray and D. B. Evans), pp. 727-746. Geneva: World Health Organization.
38. Terza, J. V. (1985) Ordinal probit: a generalization. Communs Statist. Theor. Meth., 14, 1-11.
39. United Nation Development Programme (2006) Human Development Report. New York: United Nations Development Programe.
40. Üstün, T. B., Chatterji, S., Mechbal, A., Murray, C. and WHS Collaborating Groups (2003) The World Health Surveys. In Health Systems Performance Assessment: Debates, Methods and Empiricism (eds C. J. L. Murray and D. B. Evans), pp. 797-808. Geneva: World Health Organization.
41. Valentine, N. B., De Silva, A., Kawabata, K., Darby, C., Murray, C. J. L. and Evans, D. (2003a) Health system responsiveness: concepts, domains and operationalization. In Health Systems Performance Assessment: Debates, Methods and Empiricism (eds C. J. L. Murray and D. B. Evans), pp. 573-596. Geneva: World Health Organization.
42. Valentine, N. B., Ortiz, J. P., Tandon, A., Kawabata, K., Evans, D. B. and Murray, C. J. L. (2003b) Patient experiences with health services: population surveys from 16 OECD countries. In Health Systems Performance Assessment: Debates, Methods and Empiricism (eds C. J. L. Murray and D. B. Evans), pp. 643-652. Geneva: World Health Organization.
43. Valentine, N. B., Prasad, A., Rice, N., Robone, S. and Chatterji, S.(2009) Health systems responsiveness-a measure of the acceptability of health care processes and systems. In Performance Measurement for Health System Improvement: Experiences, Challenges and Prospects (eds P. Smith, E. Mossialos and S. Leatherman). London: World Health Organization European Regional Office.
44. Wand, J., King, G. and Lau, O. (2007) Anchors: software for anchoring vignette data. J. Statist. Softwr., 20, no. 2, 1-25.
45. Williams, A. (2001) Science or marketing at WHO?: a commentary on 'World Health 2000'. Hlth Econ., 10, 93-100.
46. Angelini, V., Cavapozzi, D., Corazzini, L. and Paccagnella, O. (2012) Age, health, and life satisfaction among older Europeans. Socl Indic. Res., 105, 293-308.
47. Bago d'Uva, T., Lindeboom, M., O'Donnell, O. and van Doorslaer, E. (2009) Slipping anchor?: testing the vignettes approach to identification and correction of reporting heterogeneity. Discussion Paper 09-09113. Tinbergen Institute, Rotterdam.
48. Bago d'Uva, T., Lindeboom, M., O'Donnell, O. and van Doorslaer, E. (2011) Slipping anchor?: testing the vignettes approach to identification and correction of reporting heterogeneity. J. Hum. Res., 46, 872-903.
49. Bonsang, E. and van Soest, A. (2012a) Satisfaction with job and income among older individuals across European countries. Socl Indic. Res., 105, 227-254.
50. Bonsang, E. and van Soest, A. (2012b) Satisfaction with social contacts of older Europeans. Socl Indic. Res., 105, 273-292.
51. Borg, I. and Groenen, P. (2005) Modern Multidimensional Scaling: Theory and Applications, 2nd edn. New York: Springer.
52. Brunsdon, C., Fotheringham, S. and Charlton, M. (1998) Geographically weighted regression-modelling spatial non-stationarity. Statistician, 47, 431-443.
53. Buckley, J. (2008) Survey context effects in anchoring vignettes. Working Paper. (Available from).
54. Corrado, L. and Weeks, M. (2010). Working Paper CWPE1031. Cambridge.
55. Davison, A. C. and Hinkley, D. V. (1997) Boootstrap Methods and Their Applications. Cambridge: Cambridge University Press.
56. Efron, B. and Tibshirani, R. J. (1994) An Introduction to the Bootstrap. New York: Chapman and Hall.
57. Fan, J. Q. and Zhang, W. Y. (2008) Statistical methods with varying coefficient models. Statist. Interface, 1, 179-195.
58. Freudenberg, M. (2003) Composite indicators of country performance: a critical assessment. Working Paper DSTI/DOC 2003/16. Organisation for Economic Co-operation and Development, Paris.
59. Goldstein, H. and Spiegelhalter, D. J. (1996) League tables and their limitation: statistical issues in comparisons of institutional performance (with discussion). J. R. Statist. Soc. A, 159, 385-443.
60. Hand, D. J. (1996) Statistics and the theory of measurement (with discussion). J. R. Statist. Soc. A, 159, 445-492.
61. Harkness, J. A., Braun, M., Edwards, B., Johnson, T. P., Lyberg, L., Mohler, P. P., Pennell, B.-E. and Smith, T. W. (eds) (2010) Survey Methods in Multinational, Multiregional, and Multicultural Contexts. Hoboken: Wiley.
62. Harzing, A. (2006) Response styles in cross-national survey research: a 26-country study. Int. J. Cross Cult. Mangmnt, 6, 243-266.
63. Hopkins, D. J. and King, G. (2010) Improving Anchoring Vignettes: designing surveys to correct interpersonal incomparability. Publ. Opin. Q., 74, 201-222.
64. Jacobs, R., Goddard, M. and Smith, P. C. (2007) Composite performance measures in the Public Sector. Policy Discussion Briefing. Centre for Health Economics, University of York, York.
65. Jasso, G. and Opp, K.-D. (1997) Probing the character of norms: a factorial survey analysis of the norms of political action. Am. Sociol. Rev., 62, 947-964.
66. Kapteyn, A., Smith, J. P., van Soest, A. and Voňková, H. (2011) Anchoring vignettes and response consistency. Working Paper WR-840. RAND Corporation, Santa Monica.
67. King, G., Murray, C. J. L., Salomon, J. and Tandon, A. (2004) Enhancing the validity and cross-cultural comparability of measurement in survey research. Am. Polit. Sci. Rev., 98, 184-191.
68. King, G. and Wand, J. (2007) Comparing incomparable survey responses: new tools for anchoring vignettes. Polit. Anal., 15, 46-66.
69. Oberski, D., Saris, W. E. and Hagenaars, J. A. (2010) Categorization errors and differences in the quality of questions in comparative surveys. In Survey Methods in Multinational, Multiregional, and Multicultural Contexts (eds J. A. Harkness, M. Braun, B. Edwards, T. P. Johnson, L. Lyberg, P. P. Mohler, B.-E. Pennell and T. W. Smith), pp. 435-453. Hoboken: Wiley.
70. Peracchi, F. and Rossetti, C. (2011) The heterogeneous threshold ordered response model: identification and inference. Working Paper 10/12. Einaudi Institute for Economics and Finance, Rome. (Available from).
71. Porter, T. M. (1995) Trust in Numbers: the Pursuit of Objectivity in Science and Public Life. Princeton: Princeton University Press.
72. Rice, N., Robone, S. and Smith, P. (2011) Analysis of the validity of the vignette approach to correct for heterogeneity in reporting health system responsiveness. Eur. J. Hlth Econ., 12, 141-162.
73. van Soest, A., Delaney, L., Harmon, C., Kapteyn, A. and Smith, J. P. (2011) Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions. J. R. Statist. Soc. A, 174, 575-595.
74. Stiglitz, J., Sen, A. and Fitoussi, J.-P. (2009) Report of the Commission on the Measurement of Economic Performance and Social Progress. Report. Commission on the Measurement of Economic Performance and Social Progress, Paris.
75. Voňková, H. and Hullegie, P. (2011) Is the anchoring vignette method sensitive to the domain and choice of the vignette? J. R. Statist Soc. A, 174, 597-620.