We need to compare, but how? Measurement equivalence in comparative public administration

Public Administration Review

Volumn 75, Issue 1, 2015, Pages 36-48

  Jilke, Sebastian ^a   Meuleman, Bart ^b   Van de Walle, Steven ^a  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^b UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84919684327     PISSN: 00333352     EISSN: 15406210     Source Type: Journal    
DOI: 10.1111/puar.12318     Document Type: Article

References (63)

1. Bollen, Kenneth A. 2002. Latent Variables in Psychology and the Social Sciences. Annual Review of Psychology 53: 605-34.
2. Brower, Ralph S., Mitchel Y. Abolafia, and Jered B. Carr. 2000. On Improving Qualitative Methods in Public Administration Research. Administration & Society 32(4): 363-97.
3. Byrne, Barbara M., Richard J. Shavelson, and Bengt Muthén. 1989. Testing for the Equivalence of Factor Covariance and Mean Structure: The Issue of Partial Measurement Invariance. Psychological Bulletin 105(3): 456-66.
4. Charbonneau, Étienne, and Gregg G. Van Ryzin. 2012. Performance Measures and Parental Satisfaction with New York City Schools. American Review of Public Administration 41(1): 54-65.
5. Chen, Fang Fang. 2007. Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling 14(3): 464-504.
6. Davidov, Eldad, Bart Meuleman, Jaak Billiet, and Peter Schmidt. 2008. Values and Support for Immigration: A Cross-Country Comparison. European Sociological Review 24(5): 583-99.
7. Davidov, Eldad, Bart Meuleman, Jan Cieciuch, Peter Schmidt, and Jaak Billiet. 2014. Measurement Equivalence in Cross-National Research. Annual Review of Sociology 40: 55-75.
8. Favero, Nathan, and Kenneth J. Meier. 2013. Evaluating Urban Public Schools: Parents, Teachers, and State Assessments. Public Administration Review 73(3): 401-12.
9. Grimmelikhuijsen, Stephan G., and Albert J. Meijer. 2014. Effects of Transparency on the Perceived Trustworthiness of a Government Organization: Evidence from an Online Experiment. Journal of Public Administration Research and Theory 24(1): 137-57.
10. Herian, Mitchel N., and Alan J. Tomkins. 2012. Citizen Satisfaction Survey Data: A Mode Comparison of the Derived Importance-Performance Approach. American Review of Public Administration 42(1): 66-86.
11. Horn, John L., and J. Jack McArdle. 1992. A Practical and Theoretical Guide to Measurement Invariance in Aging Research. Experimental Aging Research 18(3): 117-44.
12. Hox, Joop J., Edith D. de Leeuw, Matthieu J. S. Brinkhuis, and Jeroen Ooms. 2012. Multigroup and Multilevel Approaches to Measurement Equivalence. In Methods, Theories, and Empirical Applications in the Social Sciences: Festschrift for Peter Schmidt, edited by Samuel Salzborn, Eldad Davidov, and Jost Reinecke, 91-96. Wiesbaden, Germany: Springer Verlag.
13. Jackson, Dennis L. 2003. Revisiting Sample Size and Number of Parameter Estimates: Some Support for the N:q Hypothesis. Structural Equation Modeling 10(1): 128-41.
14. James, Oliver. 2009. Evaluating the Expectations Disconfirmation and Expectations Anchoring Approaches to Citizen Satisfaction with Local Services. Journal of Public Administration Research and Theory 19(1): 107-23.
15. Jilke, Sebastian. 2014. Choice and Equality: Are Vulnerable Citizens Worse Off after Liberalization Reforms? Public Administration. Published electronically on July 28. doi:10.1111/padm.12102.
16. Johnson, Timothy, Patrick Kulesa, Young Ik Cho, and Sharon Shavitt. 2005. The Relation between Culture and Response Styles: Evidence from 19 Countries. Journal of Cross-Cultural Psychology 36(2): 264-77.
17. Jöreskog, Karl G. 1971. Simultaneous Factor Analysis in Several Populations. Psychometrika 36(4): 409-26.
18. Kampen, Jarl K., Steven Van de Walle, and Geert Bouckaert. 2006. Assessing the Relation between Satisfaction with Public Service Delivery and Trust in Government: The Impact of the Predisposition of Citizens toward Government on Evaluations of Its Performance. Public Performance and Management Review 29(4): 387-404.
19. Kankaraš, Miloš, Jeroen K. Vermunt, and Guy Moors. 2011. Measurement Equivalence of Ordinal Items: A Comparison of Factor Analytic, Item Response Theory, and Latent Class Analysis Approaches. Sociological Methods and Research 40(2): 279-310.
20. Kim, Sangmook, Wouter Vandenabeele, Bradley Wright, Lotte Andersen, Francesco Paolo Cerase, Robert K. Christensen, Céline Desmarais, Maria Koumenta, Peter Leisink, Bangcheng Liu, Jolanta Palidauskaite, Lene Holm Pdersen, James L. Perry, Adrian Ritz, Jeanette Taylor, and Paola De Vivo. 2013. Investigating the Structure and Meaning of Public Service Motivation across Populations: Developing an International Instrument and Addressing Issues of Measurement Invariance. Journal of Public Administration Research and Theory 23(1): 79-102.
21. King, Gary, Christopher J. L. Murray, Joshua A. Salomon, and Ajay Tandon. 2004. Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research. American Political Science Review 98(1): 191-207.
22. Kline, Rex B. 2011. Principles and Practice of Structural Equation Modeling. 3rd ed. New York: Guilford Press.
23. Kline, Rex B. 2013. Exploratory and Confirmatory Factor Analysis. In Applied Quantitative Analysis in the Social Sciences, edited by Yaacov Petscher, Christopher Schatschneider, and Donald L. Compton, 171-207. New York: Routledge.
24. Lee, Geon, Jennifer Benoit-Bryan, and Timothy P. Johnson. 2012. Survey Research in Public Administration: An Assessment of Mainstream Public Administration Journals. Public Administration Review 72(1): 87-97.
25. Little, Roderick J. A., and Donald B. Rubin. 2002. Statistical Analysis with Missing Data. 2nd ed. Hoboken, NJ: Wiley.
26. Marien, Sofie, and Marc Hooghe. 2011. Does Political Trust Matter? An Empirical Investigation into the Relation between Political Trust and Support for Law Compliance. European Journal of Political Research 50(2): 267-91.
27. Meredith, William. 1993. Measurement Invariance, Factor Analysis, and Factorial Invariance. Psychometrika 58(4): 525-34.
28. Meuleman, Bart. 2012. When Are Item Intercept Differences Substantively Relevant in Measurement Invariance Testing? In Methods, Theories, and Empirical Applications in the Social Sciences: Festschrift for Peter Schmidt, edited by Samuel Salzborn, Eldad Davidov, and Jost Reinecke, 97-104. Wiesbaden, Germany: Springer Verlag.
29. Meuleman, Bart, and Jaak Billiet. 2012. Measuring Attitudes toward Immigration in Europe: The Cross-Cultural Validity of the ESS Immigration Scales. Research and Methods 21(1): 5-29.
30. Millsap, Roger E., and Jenn Yun-Tein. 2004. Assessing Factorial Invariance in Ordered-Categorical Measures. Multivariate Behavioral Research 39(3):479-515.
31. Mishler, William, and Richard Rose. 1997. Trust, Distrust and Skepticism: Popular Evaluations of Civil and Political Institutions in Post-Communist Societies. Journal of Politics 59(2): 418-51.
32. Morgeson, Forrest V., III. 2013. Expectations, Disconfirmation, and Citizen Satisfaction with the U.S. Federal Government: Testing and Expanding the Model. Journal of Public Administration Research and Theory 23(2): 289-305.
33. Muthén, Linda K., and Bengt O. Muthén. 2010. Mplus User's Guide. 6th ed. Los Angeles, CA: Muthén & Muthén.
34. Newton, Kenneth, and Pippa Norris. 2000. Confidence in Public Institutions: Faith, Culture, or Performance? In Disaffected Democracies: What's Troubling the Trilateral Countries?, edited by Susan J. Pharr and Robert D. Putnam, 52-73. Princeton, NJ: Princeton University Press.
35. Oberski, Daniel L. 2014. Evaluating Sensitivity of Parameters of Interest to Measurement Invariance in Latent Variable Models. Political Analysis 22(1): 45-60.
36. Pollitt, Christopher. 2011. Not Odious but Onerous: Comparative Public Administration. Public Administration 89(1): 114-27.
37. Pollitt, Christopher, and Geert Bouckaert. 2011. Public Management Reform: A Comparative Analysis-New Public Management, Governance and the Neo-Weberian State. Oxford, UK: Oxford University Press.
38. Poortinga, Ype H. 1989. Equivalence of Cross-Cultural Data: An Overview of Basic Issues. International Journal of Psychology 24(6): 737-56.
39. Poznyak, Dimitry, Bart Meuleman, Koen Abts, and George F. Bishop. 2013. Trust in American Government: Longitudinal Measurement Equivalence in the ANES, 1964-2008. Social Indicators Research 118(2): 741-58.
40. Raju, Nambury S., Larry J. Laffitte, and Barbara M. Byrne. 2002. Measurement Equivalence: A Comparison of Methods Based on Confirmatory Factor Analysis and Item Response Theory. Journal of Applied Psychology 87(3): 517-29.
41. Reeve, Bryce B., and Peter Fayers. 2005. Applying Item Response Theory Modeling for Evaluating Questionnaire Item and Scale Properties. In Assessing Quality of Life in Clinical Trials: Methods of Practice, edited by Peter Fayers and Ron D. Hayes, 55-73. Oxford, UK: Oxford University Press.
42. Reise, Steven P., Keith F. Widaman, and Robin H. Pugh. 1993. Confirmatory Factor Analysis and Item Response Theory: Two Approaches for Exploring Measurement Invariance. Psychological Bulletin 114(3): 552-56.
43. Samejima, Fumiko. 1969. Estimation of Latent Ability Using a Response Pattern of Graded Scores. Richmond, VA: William Byrd Press.
44. Saris, Willem E., Albert Satorra, and Dag Sörbom. 1987. The Detection and Correction of Specification Errors in Structural Equation Models. In Sociological Methodology, edited by Clifford C. Clogg, 105-29. San Francisco: Jossey-Bass.
45. Saris, Willem E., Albert Satorra, and William M. Van der Veld. 2009. Testing Structural Equation Models or Detection of Misspecifications? Structural Equation Modeling 16(4): 561-82.
46. Sass, Daniel A. 2011. Testing Measurement Invariance and Comparing Latent Factor Means within a Confirmatory Factor Framework. Journal of Psychoeducational Assessment 29(4): 347-62.
47. Shingler, John, Mollie E. Van Loon, Theodore R. Alter, and Jeffrey C. Brider. 2008. The Importance of Subjective Data for Public Agency Performance Evaluation. Public Administration Review 68(6): 1101-11.
48. Skrondal, Anders, and Sophia Rabe-Hesketh. 2004. Generalized Latent Variable Modeling: Multilevel, Longitudinal, and Structural Equation Models. Boca Raton, FL: Chapman & Hall.
49. Steenkamp, Jan-Benedict E. M., and Hans Baumgartner. 1998. Assessing Measurement Invariance in Cross-National Consumer Research. Journal of Consumer Research 25(1): 78-107.
50. Stegmueller, Daniel. 2011. Apples and Oranges? The Problem of Equivalence in Comparative Research. Political Analysis 19(4): 471-87.
51. Van de Vijver, Fons J. R. 2003. Bias and Equivalence: Cross-Cultural Perspectives. In Cross-Cultural Survey Methods, edited by Janet A. Harkness, Fons J. R. Van de Vijver, and Peter Ph. Mohler, 143-56. Hoboken, NJ: Wiley.
52. Van de Vijver, Fons J. R., and Kwok Leung. 1997. Methods and Data Analysis for Cross-Cultural Research. Newbury Park, CA: Sage Publications.
53. Van de Walle, Steven, and Geert Bouckaert. 2003. Public Service Performance and Trust in Government: The Problem of Causality. International Journal of Public Administration 29(8-9): 891-913.
54. Van de Walle, Steven, and Gregg G. Van Ryzin. 2011. The Order of Questions in a Survey on Citizen Satisfaction with Public Services: Lessons from a Split-Ballot Experiment. Public Administration 89(4): 1436-50.
55. Van Ryzin, Gregg G. 2006. Testing the Expectancy Disconfirmation Model of Citizen Satisfaction with Local Government. Journal of Public Administration Research and Theory 16(4): 599-611.
56. Van Ryzin, Gregg G. 2011. Outcomes, Process, and Trust of Civil Servants. Journal of Public Administration Research and Theory 21(4): 745-60.
57. Van Ryzin, Gregg G. 2013. An Experimental Test of the Expectancy-Disconfirmation Theory of Citizen Satisfaction. Journal of Policy Analysis and Management 32(3): 597-614.
58. Vandenberg, Robert J., and Charles E. Lance. 2000. A Review and Synthesis of the Measurement Invariance Literature: Suggestions and Recommendations for Organizational Research. Organizational Research Methods 3(1): 4-69.
59. Vermunt, J. K., and J. Magidson. 2005. Latent GOLD 4.0 User Manual. Belmont, MA: Statistical Innovation.
60. Vigoda-Gadot, Eran. 2007. Citizens' Perceptions of Politics and Ethics in Public Administration: A Five-Year National Study of their Relationship to Satisfaction with Services, Trust in Governance, and Voice Orientation. Journal of Public Administration Research and Theory 17(2): 285-305.
61. Whittaker, Tiffany A. 2012. Using the Modification Index and Standardized Expected Parameter Change for Model Modification. Journal of Experimental Education 80(1): 26-44.
62. Williams, Larry J., Robert J. Vandenberg, and Jeffrey R. Edwards. 2009. Structural Equation Modeling in Management Research: A Guide for Improved Analysis. Academy of Management Annals 3(1): 543-604.
63. Wright, Bradley E., Lepora J. Manigault, and Tamika R. Black. 2004. Quantitative Research Measurement in Public Administration: An Assessment of Journal Publications. Administration & Society 35(6): 747-64.