What to Do (and Not to Do) with the Comparative Manifestos Project Data

Political Studies

Volumn 61, Issue SUPPL.1, 2013, Pages 3-23

  Gemenis, Kostas ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Comparative Manifestos Project; Measurement quality; Policy positions; Reliability; Validity

Indexed keywords

EID: 84875288689     PISSN: 00323217     EISSN: 14679248     Source Type: Journal    
DOI: 10.1111/1467-9248.12015     Document Type: Article

References (71)

1. Albright, J. J. (2008) 'Bayesian Estimates of Party Left-Right Scores', Society for Political Methodology Working Paper.
2. Bakker, R. (2007) Re-measuring Left-Right: A Better Model for Extracting Left-Right Political Party Policy Preference Scores. Unpublished PhD thesis, University of North Carolina-Chapel Hill.
3. Bakker, R. (2009) 'Re-measuring Left-Right: A Comparison of SEM and Bayesian Approaches for Extracting Latent Dimensions from Political Texts', Electoral Studies, 28 (3), 413-421.
4. Bara, J. (1987) 'Israel 1949-1981', in I. Budge, D. Robertson and D. J. Hearl (eds), Ideology, Strategy and Party Change: Spatial Analyses of Post-war Election Programmes in 19 Democracies. Cambridge: Cambridge University Press, pp. 111-133.
5. Benoit, K. and Laver, M. (2006) Party Policy in Modern Democracies. London: Routledge.
6. Benoit, K. and Laver, M. (2007) 'Estimating Party Policy Positions: Comparing Expert Surveys and Hand-Coded Content Analysis', Electoral Studies, 26 (1), 90-107.
7. Benoit, K., Mikhaylov, S. and Laver, M. (2009) 'Treating Words as Data with Error: Uncertainty in Text Statements of Policy Positions', American Journal of Political Science, 53 (2), 495-513.
8. Benoit, K., Laver, M., Lowe, W. and Mikhaylov, S. (2012) 'How to Scale Coded Text Units without Bias: A Response to Gemenis', Electoral Studies, 31 (3), 605-608.
9. Braun, D., Mikhaylov, S. and Schmitt, H. (2010) 'Manifesto Study Documentation Advance Release', pre-release B, 22 July. Available from: http://www.piredeu.eu/ [Accessed 7 November 2012].
10. Budge, I. (1987) 'The Internal Analysis of Election Programmes', in I. Budge, D. Robertson and D. J. Hearl (eds), Ideology, Strategy and Party Change: Spatial Analyses of Post-war Election Programmes in 19 Democracies. Cambridge: Cambridge University Press.
11. Budge, I. (2001a) 'Theory and Measurement of Party Policy Positions', in I. Budge, H.-D. Klingemann, A. Volkens, J. Bara and E. Tanenbaum (eds), Mapping Policy Preferences: Estimates for pasties, Electors and Governments 1945-1998. Oxford: Oxford University Press.
12. Budge, I. (2001b) 'Validating Party Policy Placements', British Journal of Political Science, 31 (1), 210-223.
13. Budge, I. and Bara, J. (2001) 'Introduction: Content Analysis and Political Texts', in I. Budge, H.-D. Klingemann, A. Volkens, J. Bara and E. Tanenbaum (eds), Mapping Policy Preferences: Estimates for Parties, Electors, and Governments, 1945-1998. Oxford: Oxford University Press, pp. 1-16.
14. Budge, I. and Farlie, D. (1977) Voting and Party Competition. London: Wiley & Sons.
15. Budge, I. and Klingemann, H.-D. (2001) 'Finally! Comparative Overtime Mapping of Policy Movement', in I. Budge, H.-D. Klingemann, A. Volkens, J. Bara and E. Tanenbaum (eds), Mapping Policy Preferences: Estimates for Parties, Electors, and Governments, 1945-1998. Oxford: Oxford University Press, pp. 19-50.
16. Budge, I. and Pennings, P. (2007a) 'Do They Work? Validating Computerised Word Frequency Estimates against Policy Series', Electoral Studies, 26 (1), 121-129.
17. Budge, I. and Pennings, P. (2007b) 'Missing the Message and Shooting the Messenger: Benoit and Laver's "Response"', Electoral Studies, 26 (1), 136-141.
18. Budge, I., Robertson, D. and Hearl, D. J. (eds) (1987) Ideology, Strategy and Party Change: Spatial Analyses of Post-war Election Programmes in 19 Democracies. Cambridge: Cambridge University Press.
19. Budge, I., Klingemann, H.-D., Volkens, A., Bara, J. and Tanenbaum, E. (eds) (2001) Mapping Policy Preferences: Estimates for Parties, Electors, and Governments, 1945-1998. Oxford: Oxford University Press.
20. Clarke, H. D., Sanders, D., Stewart, M. C. and Whiteley, P. (2004) Political Choice in Britain. Oxford: Oxford University Press.
21. Däubler, T., Benoit, K., Mikhaylov, S. and Laver, M. (2012) 'Natural Sentences as Valid Units for Coded Political Texts', British Journal of Political Science, 42 (4), 937-951.
22. Dinas, E. and Gemenis, K. (2010) 'Measuring Parties' Ideological Positions with Manifesto Data: A Critical Evaluation of the Competing Methods', Party Politics, 16 (4), 427-450.
23. Elff, M. (2012) 'Electoral Platforms, Political Positions and Their Evolution: Spatial Models of Coded Political Texts'. Paper presented at the MPSA Annual Conference, Chicago 12-15 April.
24. Franzmann, S. (2011) 'Competition, Contest, and Cooperation: The Analytic Framework of the Issue Market', Journal of Theoretical Politics, 23 (3), 317-343.
25. Franzmann, S. (2012) 'The Manifesto Project from the Perspective of Content Analysis: Logical and Substantial Inferences using MARPOR', prepared for A. Volkens etal. (eds), Mapping Policy Preferences III. Oxford: Oxford University Press.
26. Franzmann, S. and Kaiser, A. (2006) 'Locating Political Parties in Policy Space: A Reanalysis of Party Manifesto Data', Party Politics, 12 (2), 163-188.
27. Fuchs, D. and Klingemann, H.-D. (1990) 'The Left-Right Schema', in K. M. Jennings (ed.), Continuities in Political Action. Berlin: De Gruyter, pp. 203-234 (DOI: 10.1057/ap.2011.10).
28. Gabel, M. J. and Huber, J. D. (2000) 'Putting Parties in Their Place: Inferring Party Left-Right Ideological Positions from Party Manifestos Data', American Journal of Political Science, 44 (1), 94-103.
29. Gemenis, K. (2012a) 'Proxy Documents as a Source of Measurement Error in the Comparative Manifestos Project', Electoral Studies, 31 (3), 594-604.
30. Gemenis, K. (2012b) 'Estimating Parties' Positions through Voting Advice Applications: Some Methodological Considerations', Acta Politica.
31. Gemenis, K., Katsanidou, A. and Vasilopoulou, S. (2012) 'The Politics of Anti-environmentalism: Positional Issue Framing by the European Radical Right'. Paper presented at the MPSA Annual Conference, Chicago 12-15 April.
32. Hans, S. and Hönnige, C. (2008) 'Noughts and Crosses: Challenges in Generating Political Positions from CMP-Data', Kaiserslautern Occasional Papers in Political Science No. 2.
33. Hansen, M. E. (2008) 'Back to the Archives? A Critique of the Danish Part of the Manifesto Dataset', Scandinavian Political Studies, 31 (2), 201-216.
34. Hayes, A. F. and Krippendorff, K. (2007) 'Answering the Call for a Standard Reliability Measure for Coding Data', Communication Methods and Measures, 1 (1), 77-89.
35. Hearl, D. J. (1987) 'Belgium 1946-1981', in I. Budge, D. Robertson and D. J. Hearl (eds), Ideology, Strategy and Party Change: Spatial Analyses of Post-war Election Programmes in 19 Democracies. Cambridge: Cambridge University Press, pp. 230-253.
36. Hearl, D. J. (2001) 'Checking the Party Policy Estimates: Reliability', in I. Budge, H.-D. Klingemann, A. Volkens, J. Bara and E. Tanenbaum (eds), Mapping Policy Preferences: Estimates for Parties, Electors, and Governments, 1945-1998. Oxford: Oxford University Press, pp. 111-125.
37. Hooghe, L., Bakker, R., Brigevich, A., de Vries, C., Edwards, E., Marks, G., Rovny, J., Steenbergen, M. and Vachudova, M. (2010) 'Reliability and Validity of the 2002 and 2006 Chapel Hill Expert Surveys on Party Positioning', European Journal of Political Research, 49 (5), 687-703.
38. Ivarsflaten, E. (2008) 'What Unites Right-Wing Populists in Western Europe? Re-examining Grievance Mobilization Models in Seven Successful Cases', Comparative Political Studies, 41 (1), 3-23.
39. Janda, K., Harmel, R., Edens, C. and Goff, P. (1995) 'Changes in Party Identity: Evidence from Party Manifestos', Party Politics, 1 (2), 171-196.
40. Kim, H.-M. and Fording, R. C. (1998) 'Voter Ideology in Western Democracies, 1946-1989', European Journal of Political Research, 33 (1), 73-97.
41. Klingemann, H.-D. (1995) 'Party Positions and Voter Orientations', in H.-D. Klingemann and D. Fuchs (eds), Citizens and the State. Oxford: Oxford University Press, pp. 183-206.
42. Klingemann, H.-D., Volkens, A., Bara, J., Budge, I. and McDonald, M. D. (2006) Mapping Policy Preferences II: Estimates for Parties, Electors and Governments in Central and Eastern Europe, European Union and OECD, 1990-2003. New York: Oxford University Press.
43. Krippendorff, K. (2004a) Content Analysis: An Introduction to its Methodology, second edition. Thousand Oaks CA: Sage.
44. Krippendorff, K. (2004b) 'Reliability in Content Analysis: Some Common Misconceptions', Human Communication Research, 30 (3), 411-433.
45. Laver, M. (2001a) 'On Mapping Policy Preferences using Manifesto Data', unpublished paper, Trinity College Dublin.
46. Laver, M. (2001b) 'Position and Salience in the Policies of Political Actors', in M. Laver (ed.), Estimating the Policy Position of Political Actors. London: Routledge, pp. 66-75.
47. Laver, M. and Budge, I. (1992) 'Measuring Policy Distances and Modelling Coalition Formation', in M. Laver and I. Budge (eds), Party Policy and Government Coalitions. Basingstoke: Macmillan, pp. 15-40.
48. Laver, M. and Garry, J. (2000) 'Estimating Policy Positions from Political Texts', American Journal of Political Science, 44 (3), 619-634.
49. Laver, M., Benoit, K. and Garry, J. (2003) 'Estimating the Policy Positions of Political Actors using Words as Data', American Political Science Review, 97 (2), 311-331.
50. Lin, L. I.-K. (1989) 'A Concordance Correlation Coefficient to Evaluate Reproducibility', Biometrics, 45 (1), 255-268.
51. Linhart, E. and Shikano, S. (2009) 'Ideological Signals of German Parties in a Multi-dimensional Space: An Estimation of Party Preferences using the CMP Data', German Politics, 18 (3), 301-322.
52. Lombard, M., Snyder-Duch, J. and Bracken, C. C. (2002) 'Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability', Human Communication Research, 28 (4), 587-604.
53. Lowe, W., Benoit, K., Mikhaylov, S. and Laver, M. (2011) 'Scaling Policy Positions from Hand-Coded Political Texts', Legislative Studies Quarterly, 36 (1), 123-155.
54. McDonald, M. D. and Mendes, S. M. (2001a) 'Checking the Party Policy Estimates: Convergent Validity', in I. Budge, H.-D. Klingemann, A. Volkens, J. Bara and E. Tanenbaum (eds), Mapping Policy Preferences: Estimates for Parties, Electors, and Governments, 1945-1998. Oxford: Oxford University Press, pp. 127-141.
55. McDonald, M. D. and Mendes, S. M. (2001b) 'The Policy Space of Party Manifestos', in M. Laver (ed.), Estimating the Policy Position of Political Actors. London: Routledge, pp. 90-114.
56. Meyer, T. (2010) Party Competition over Time: How Voters and Intraparty Structure Constrain Party Policy Shifts. Unpublished PhD thesis, University of Mannheim.
57. Mikhaylov, S., Laver, M. and Benoit, K. (2012) 'Coder Reliability and Misclassification in the Human Coding of Party Manifestos', Political Analysis, 20 (1), 78-91.
58. Pardos-Prado, S. (2012) 'Valence beyond Consensus: Party Competence and Policy Dispersion from a Comparative Perspective', Electoral Studies, 31 (2), 342-352.
59. Pelizzo, R. (2003) 'Party Positions or Party Direction? An Analysis of Party Manifesto Data', West European Politics, 26 (2), 67-89.
60. Pennings, P. (2011) 'Assessing the "Gold Standard" of Party Policy Placements: Is Computerized Replication Possible?', Electoral Studies, 30 (3), 561-570.
61. Proksch, S.-O. and Slapin, J. B. (2009) 'How to Avoid Pitfalls in Statistical Analysis of Political Texts: The Case of Germany', German Politics, 18 (3), 323-344.
62. Proksch, S.-O., Slapin, J. B. and Thies, M. F. (2010) 'Party System Dynamics in Post-war Japan: A Quantitative Content Analysis of Electoral Pledges', Electoral Studies, 30 (1), 114-124.
63. Protsyk, O. and Garaz, S. (2011) 'Politicization of Ethnicity in Party Manifestos', Party Politics [online]. doi: 10.1177/1354068811398058.
64. Robertson, D. (1976) A Theory of Party Competition. London: John Wiley.
65. Robertson, D. (1987) 'Britain, Australia, New Zealand and the United States, 1946-1981: An Initial Comparative Analysis', in I. Budge, D. Robertson and D. J. Hearl (eds), Ideology, Strategy and Party Change: Spatial Analyses of Post-war Election Programmes in 19 Democracies. Cambridge: Cambridge University Press, pp. 39-73.
66. Schrodt, P. A. (2010) 'Seven Deadly Sins of Contemporary Quantitative Political Analysis', Society for Political Methodology Working Paper.
67. Van der Brug, W. (2001) 'Analysing Party Dynamics by Taking Partially Overlapping Snapshots', in M. Laver (ed.), Estimating the Policy Position of Political Actors. London: Routledge, pp. 115-132.
68. Veen, T. (2011) 'Positions and Salience in European Union Politics: Estimation and Validation of a New Dataset', European Union Politics, 12 (2), 267-288.
69. Volkens, A. (2001) 'Quantifying the Election Programmes: Coding Procedures and Controls', in I. Budge, H.-D. Klingemann, A. Volkens, J. Bara and E. Tanenbaum (eds), Mapping Policy Preferences: Estimates for Parties, Electors, and Governments, 1945-1998. Oxford: Oxford University Press, pp. 93-109.
70. Volkens, A., Bara, J. and Budge, I. (2009) 'Data Quality in Content Analysis: The Case of the Comparative Manifestos Project', Historical Social Research, 34 (1), 234-251.
71. Weale, A., Pridham, G., Cini, M., Konstadakopulos, D., Porter, M. and Flynn, B. (2000) Environmental Governance in Europe: An Ever Closer Ecological Union? Oxford: Oxford University Press.