Estimating parties' policy positions through voting advice applications: Some methodological considerations

Acta Politica

Volumn 48, Issue 3, 2013, Pages 268-295

  Gemenis, Kostas ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Likert scales; parties; policy positions; reliability; validity

Indexed keywords

EID: 84879936355     PISSN: 00016810     EISSN: 17411416     Source Type: Journal    
DOI: 10.1057/ap.2012.36     Document Type: Article

References (59)

1. Benoit, K. and Laver, M. (2012) The dimensionality of political space: Epistemological and methodological considerations. European Union Politics 13(2): 194-218.
2. Bradburn, N.M., Sudman, S. and Wansink, B. (2004) Asking Questions, Revised edn. San Francisco, CA: Jossey-Bass.
3. Budge, I. (2001) Theory and measurement of party policy positions. In: I. Budge, H-D.Klingemann, A. Volkens, J. Bara and E. Tanenbaum (eds.) Mapping Policy Preferences. Oxford, UK: Oxford University Press, pp. 75-91.
4. Cronbach, L. (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16(3): 297-334.
5. DeVellis, R.F. (2011) Scale Development: Theory and Applications, 3rd edn. Thousand Oaks, CA: Sage.
6. Dinas, E. and Gemenis, K. (2010) Measuring parties' ideological positions with manifesto data: A critical evaluation of the competing methods. Party Politics 16(4): 427-450.
7. Duncan, O.D. and Stenbeck, M. (1987) Are Likert scales unidimensional Social Science Research 16(3): 245-259.
8. Fivaz, J. and Nadig, G. (2010) Impact of Voting Advice Applications (VAAs) on voter turnout and their potential use for civic education. Policy and Internet 2(4): 167-200.
9. Garzia, D. (2010) The effects of VAAs on users' voting behaviour: An overview. In: L. Cadroni and D. Garzia (eds.) Voting Advice Applications in Europe. Naples, Italy: ScriptaWeb, pp. 13-47.
10. Gemenis, K. (2012) Proxy documents as a source of measurement error in the Comparative Manifestos Project. Electoral Studies 31(3): 594-604.
11. Gemenis, K. and Dinas, E. (2010) Confrontation still Examining parties' policy positions in Greece. Comparative European Politics 8(2): 179-201.
12. Groot, L. (2003) Een kritische evaluatie van de StemWijzer 2002. Tijdschrift voor Beleid, Politiek en Maatschappij 30(1): 20-30.
13. Gschwend, T. and Proksch, S.-O. (2010) Improving the measurement of policy preferences in surveys: Bringing the status-quo back in. Paper presented at the REPCONG-Workshop Policy Representation Europe; 28-29 May, Mannheim, Germany.
14. Hansen, J.M. (1998) Individuals, institutions, and public preferences over public finance. American Political Science Review 92(3): 513-531. (Pubitemid 128185240)
15. Hartwig, P. (2010) The internet, political participation and election turnout: A case study of Germany's, www.abgeordnetenwatch.de. German Politics and Society 28(3): 156-175.
16. Hattie, J. (1985) Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement 9(2): 139-164.
17. Hix, S., Noury, A. and Gérard, R. (2006) Dimensions of politics in the European Parliament. American Journal of Political Science 50(2): 494-511. (Pubitemid 43475154)
18. Hodge, D.R. and Gillespie, D.F. (2004) Phrase completion scales. In: K. Kempf-Leonard (ed.) Encyclopedia of Social Measurement, Vol. 3, Amsterdam, the Netherlands: Elsevier, pp. 53-62.
19. Hooghe, L. et al (2010) Reliability and validity of the 2002 and 2006 Chapel Hill expert surveys on party positioning. European Journal of Political Research 49(5): 687-703.
20. Hooghe, L., Marks, G. and Wilson, C. (2002) Does left/right structure party positions on European integration Comparative Political Studies 35(8): 973-976.
21. Jacoby, W. (1991) Data Theory and Dimensional Analysis. Thousand Oaks, CA: Sage.
22. Johns, R. (2005) One size doesn't fit all: Selecting response scales for attitude items. Journal of Elections, Public Opinion and Parties 15(2): 237-264.
23. Johns, R. (2010) Likert items and scales. Colchester: UK Data Archive. Survey Question Bank Methods Fact Sheet 1.
24. Katsanidou, A. and Lefkofridi, Z. (2012) Citizen representation in the European Union: Policy congruence in the 2009 EP election. In: S. Banducci et al (eds.) An Audit of Democracy in the EU. Florence, Italy: European University Institute, pp. 153-174.
25. Kleinnijenhuis, J. and Krouwel, A. (2008) Simulation of decision rules for party advice websites. Amsterdam: Free University Amsterdam (mimeo).
26. Kriesi, H., Grande, E., Lachat, R., Dolezal, M., Bornschier, S. and Frey, T. (2006) Globalization and the transformation of the national political space: Six European countries compared. European Journal of Political Research 45(6): 921-956. (Pubitemid 44657144)
27. Krippendorff, K. (2004) Content Analysis: An Introduction to Its Methodology, 2nd edn. Thousand Oaks, CA: Sage.
28. Krosnick, J.A. (1991) Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology 5(3): 213-236.
29. Krosnick, J.A. and Presser, S. (2010) Question and questionnaire design. In: P.V. Marsden and J.D. Wright (eds.) Handbook of Survey Research, 2nd edn. Bingley, UK: Emerald, pp. 263-314.
30. Ladner, A. and Pianzola, J. (2010) Do voting advice applications have an effect electoral participation and voter turnout Evidence from the 2007 Swiss federal elections. In: E. Tambouris, A. Macintosh and O. Glassey (eds.) Electronic Participation. Berlin, Germany: Springer, pp. 211-224.
31. Laver, M. (2001) Position and salience in the policies of political actors. In: M. Laver (ed.) Estimating the Policy Position of Political Actors. London: Routledge, pp. 66-75.
32. Laver, M., Benoit, K. and Garry, J. (2003) Estimating the policy positions of political actors using words as data. American Political Science Review 97(2): 311-331. (Pubitemid 36737850)
33. Likert, R. (1932) A technique for the measurement of attitudes. Archives of Psychology 22: 1-55.
34. Lin, L.I. (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45(1): 255-268.
35. Louwerse, T. and Rosema, M. (2011) The design effects of voting advice applications: Comparing methods of calculating results. Paper presented at the ECPR General Conference; 25-27 August, Reykjavik, Iceland.
36. Lowe, W. (2008) Understanding Wordscores. Political Analysis 16(4): 356-371.
37. Marschall, S. and Schmidt, C. (2008) Preaching to the converted or making a difference Mobilizing effects of an internet application at the German general election 2005. In: D. Farrell and R. Schmitt-Beck (eds.) Non-party Actors in Electoral Politics. Baden-Baden, Germany: Nomos, pp. 259-278.
38. McDonald, R.A., Thurston, P.W. and Nelson, M.R. (2000) A Monte Carlo study of missing items methods. Organizational Research Methods 3(1): 71-92.
39. Nezi, R., Sotiropoulos, D.A. and Toka, P. (2010) Attitudes of Greek parliamentarians towards European and national identity, representation and scope of governance. South European Society and Politics 15(1): 79-96.
40. Oppenheim, A.N. (1992) Questionnaire Design, Interviewing and Attitude Measurement, New edn. London: Pinter.
41. Pellikaan, H., van der Meer, T. and de Lange, S. (2003) The road from a depoliticized to a centrifugal democracy. Acta Politica 38(1): 23-49.
42. Ramonaite, A. (2010) Voting advice applications in Lithuania: Promoting programmatic competition or breeding populism Policy and Internet 2(1): 117-147.
43. Schwarz, D., Schädel, L. and Ladner, A. (2011) Pre-election positions and voting behaviour in parliament: Consistency among Swiss MPs. Swiss Political Science Review 16(3): 533-564.
44. Sijtsma, K. (2009) On the use, the misuse, and the very limited usefulness of Cronbach's alpha. Psychometrika 74(1): 107-120.
45. Skop, M. (2010) Are the Voting Advice Applications (VAAs) telling the truth Measuring VAAs' quality. In: L. Cedroni and D. Garzia (eds.) Voting Advice Applications in Europe. Naples, Italy: ScriptaWeb, pp. 199-230.
46. Spector, P.E. (1992) Summated Rating Scale Construction: An Introduction. Newbury Park, CA: Sage.
47. Spirling, A. and McLean, I. (2007) UK OC OK Interpreting optimal classification scores for the U.K. House of Commons. Political Analysis 15(1): 85-96.
48. Talonen, J. and Sulkava, M. (2011) Analyzing parliamentary elections based on voting advice application data. In: J. Gamma, E. Bradley and J. Hollmen (eds.) Advances in Intelligent Data Analysis X. Berlin, Germany: Springer, pp. 340-351.
49. Trechsel, A.H. (2010) EU-Profiler: Positioning of the parties in the European Elections [computer file]. European University Institute [distributor] V5.
50. Trechsel, A.H. and Mair, M. (2011) When parties (also) position themselves: An introduction to the EU Profiler. Journal of Information Technology and Politics 8(1): 1-20.
51. van der Eijk, C. (2001) Measuring agreement in ordered rating scales. Quality & Quantity 35(3): 325-341.
52. van Schuur, W.H. (2003) Mokken scale analysis: Between the Guttman scale and parametric item response theory. Political Analysis 11(2): 139-163.
53. Veen, T. (2011) Positions and salience in European Union politics: Estimation and validation of a new dataset. European Union Politics 12(2): 267-288.
54. Volkens, A. (2007) Strengths and weaknesses of approaches to measuring policy positions of parties. Electoral Studies 26(1): 108-120. (Pubitemid 46209939)
55. Wagner, M. and Ruusuvirta, O. (2012) Matching voters to parties: Voting advice applications and models of party choice. Acta Politica, 47(4): 400-422.
56. Walgrave, S., Nuytemans, M. and Pepermans, K. (2009) Voting advice applications and the effect of statement selection. West European Politics 32(6): 1161-1180.
57. Walgrave, S., van Aelst, P. and Nuytemans, M. (2008) 'Do the vote test': The electoral effects of a popular vote advice application at the 2004 Belgian elections. Acta Politica 43(1): 50-70.
58. Wall, M., Sudulich, M.L., Costello, R. and Leon, E. (2009) Picking your party online: An investigation of Ireland's first online voting advice application. Information Polity 14(3): 203-218.
59. Wheatley, J., Carman, C., Mendez, F. and Mitchell, J. (2012) The dimensionality of the Scottish political space: Results from an experiment on the 2011 Holyrood elections. Party Politics, in press.