Democracy indices explained

Democracy indices are quantitative and comparative assessments of the state of democracy^[1] for different countries according to various definitions of democracy.^[2]

The democracies indices differ in whether they are categorical, such as classifying countries into democracies, hybrid regimes, and autocracies,^{[3] [4]} or continuous values.^[5] The qualitative nature of democracy indices enables data analytical approaches for studying causal mechanisms of regime transformation processes.

Democracy indices differ in scope and weighting of different aspects of democracy, including the breadth of core democratic institutions, competitiveness and inclusiveness of polyarchy, freedom of expression, various aspects of governance, democratic norm transgressions, co-option of opposition, electoral system manipulation, electoral fraud, and popular support of anti-democratic alternatives.^{[6] [7] [8]}

Prominent democracy indices

Operating

• The Economist Democracy Index, by the UK-based Economist Intelligence Unit, is an assessment of countries' democracy. Countries are rated as full democracies, flawed democracies, hybrid regimes, or authoritarian regimes. The index is based on five different categories measuring pluralism, civil liberties, and political culture.^[9]
• V-Dem Democracy indices by V-Dem Institute distinguishes between five high-level principles of democracy: electoral, liberal, participatory, deliberative, and egalitarian, and quantifies these principles. The V-Dem Democracy indices include the Citizen-initiated component of direct popular vote index, which indicates the strength of direct democracy and the presidentialism index, which indicates higher concentration of political power in the hands of one individual.
• Bertelsmann Transformation Index by the Bertelsmann Stiftung evaluates the development status and governance of political and economic transformation processes on the path to constitutional democracy and a market economy for developing and transition countries around the world. Bertelsmann Transformation Index categorizes countries into: hard-line autocracy, moderate autocracy, very defective democracy, defective democracy, consolidating democracy.^[10]
• The Global State of Democracy Indices by International Institute for Democracy and Electoral Assistance assesses democratic performance using different types of sources: expert surveys, standards-based coding by research groups and analysts, observational data and composite measures.^[11]
• The Democracy Perception Index, published annually by the Alliance of Democracies, is the world's largest annual survey on how people perceive the state of democracy^[12] (cf. the Corruption Perceptions Index which similarly seeks to measure public perception).

Indices measuring aspects of democracy

• Freedom in the World, is a yearly survey and report by the U.S.-based^[13] non-governmental organization Freedom House that measures the degree of civil liberties and political rights in every nation and significant related and disputed territories around the world.^[14]
• Effective number of parties is an index of the adjusted number of political parties in a country's party system.^[15]
• Electoral Integrity Project surveys academics on the perceived electoral integrity of countries and subnational entities
• Fragile States Index, formerly the Failed States Index, is an annual report that aims to assess states' vulnerability to conflict or collapse, ranking all sovereign states with membership in the United Nations where there is enough data available for analysis.^[16]
• Gallagher index measures an electoral system's relative disproportionality between votes received and seats in a legislature.^[17]
• The Pedersen index is a measure of political volatility in party systems.

Other measured aspects of democracy include voter turnout, efficiency gap, wasted vote, and political efficacy.^{[18] [19]}

Historical

• Democracy-Dictatorship Index is a binary measure of democracy and dictatorship.^[20]
• Democracy Ranking is a democracy ranking by the Association for Development and Advancement of the Democracy Award.^[21]
• Polity data series contains annual information on regime authority characteristics and covers the years 1800–2018 based on competitiveness, openness, and level of participation, sponsored by the Political Instability Task Force (PITF).^[22]
• Boix-Miller-Rosato dichotomous coding of democracy, easy-to-observe characteristics, few evaluations by own researchers based on academic literature. As a classification: non-democracy to democracy.^[23]
• Lexical Index of Electoral Democracy (LIED) by Skaaning et al. democracy's characteristics assessed with easy-to-observe characteristics, few evaluations by own researchers based on academic research. Then evaluating whether necessary characteristics are present or not.^[24]
• The Index of Democratization created by Tatu Vanhanen

Maps of indices

Difficulties in measuring democracy

Because democracy is an overarching concept that includes the functioning of diverse institutions which are not easy to measure, limitations exist in quantifying and econometrically measuring the potential effects of democracy or its relationship with other phenomena—whether inequality, poverty, education etc.^[25] Given the constraints in acquiring reliable data with within-country variations on aspects of democracy, academics have largely studied cross-country variations, yet variations in democratic institutions can be large within countries. Another way of conceiving the difficulties in measuring democracy is through the debate between minimalist versus maximalist definitions of democracy. A minimalist conception of democracy defines democracy by primarily considering the essence of democracy; such as electoral procedures.^[26] A maximalist definition of democracy can include outcomes, such as economic or administrative efficiency, into measures of democracy.^[27] Some aspects of democracy, such as responsiveness^[28] or accountability, are generally not included in democracy indices due to the difficulty measuring these aspects. Other aspects, such as judicial independence or quality of the electoral system, are included in some democracy indices but not in others.

Some measures of democracy, notably Freedom House and Polity IV, deploy a maximalist understanding of democracy by analyzing indicators that go beyond electoral procedure.^[29] These measures attempt to gauge contestation and inclusion; two features Robert Dahl argued are essential in democracies that successfully promote accountable governments.^{[30] [31]} The democratic rating given by these mainstream measures can vary greatly depending on the indicators and evidence they deploy.^[32] The definition of democracy utilized by these measures is important because of the discouraging and alienating power such ratings can have, particularly when determined by indicators which are biased toward Western democracies.^[33]

Dieter Fuchs and Edeltraud Roller suggest that, in order to truly measure the quality of democracy, objective measurements need to be complemented by "subjective measurements based on the perspective of citizens".^[34] Similarly, Quinton Mayne and Brigitte Geißel also defend that the quality of democracy does not depend exclusively on the performance of institutions, but also on the citizens' own dispositions and commitment.^[35]

Critiques of measures of democracy

Data on democracy, and particularly global indices of democracy, have been scrutinized and criticized by various scholars. Gerardo L. Munck and Jay Verkuilen questioned various aspects of the data produced by Freedom House and Polity, such as the concept of democracy they measured, the design of indicators, and the aggregation rule.^[36] Political scientists Andrew T. Little and Anne Meng "highlight measurement concerns regarding time-varying bias in expert-coded data" such as Freedom House and V-Dem and encourage improving expert-coding practices.^[37] Knutsen et al.^[38] did not see evidence for time-varying bias in their expert-coded data and note the application of item response theory, factor analysis and estimates of uncertainties to limit expert biases while discussing concerns in operationalization of observer-invariant measures of democracy.

See also

• Corruption Perception Index
• Democratic transition
• Types of democracy
• List of international rankings
• List of freedom indices
• List of globalization-related indices
• List of countries by system of government
• List of forms of government

Further reading

• Book: Munck, G.L. . Measuring Democracy: A Bridge between Scholarship and Politics . Johns Hopkins University Press . Democratic Transition and Consolidation . 2009 . 978-0-8018-9650-7 .
• Book: Kahn, H. . On Measuring Democracy: Its Consequences and Concomitants: Conference Papers . Taylor & Francis . 2017 . 978-1-351-50205-4 .
• Coppedge . Michael . Gerring . John . Altman . David . Bernhard . Michael . Fish . Steven . Hicken . Allen . Kroenig . Matthew . Lindberg . Staffan I. . McMann . Kelly . Paxton . Pamela . Semetko . Holli A. . Skaaning . Svend-Erik . Staton . Jeffrey . Teorell . Jan . Conceptualizing and Measuring Democracy: A New Approach . Perspectives on Politics . [American Political Science Association, Cambridge University Press] . 9 . 2 . 2011 . 1537-5927 . 41479651 . 247–267 . 10.1017/S1537592711000880 . 11629045 .
• Croissant . Aurel . Pelke . Lars . Measuring Policy Performance, Democracy, and Governance Capacities: A conceptual and methodological assessment of the Sustainable Governance Indicators (SGI) . European Policy Analysis . Wiley . 8 . 2 . 2022-04-25 . 2380-6567 . 10.1002/epa2.1141 . 136–159. free .
• Sönmez . Hakan . Democratic Backsliding or Stabilization? . Politikon: The IAPSS Journal of Political Science . International Association for Political Science Students . 46 . 2020-09-30 . 2414-6633 . 10.22151/politikon.46.3 . 54–78. 224846248 . free .

External links

• Democracy data: how do researchers measure democracy? - Our World in Data
• How do you measure ‘democracy’? - The Washington Post
• Catalogue of Indices 2016 - Global Observatory

Notes and References

1. Geissel . Brigitte . Kneuer . Marianne . Lauth . Hans-Joachim . Measuring the quality of democracy: Introduction . International Political Science Review . Sage Publications . 37 . 5 . 2016 . 0192-5121. 26556872 . 571–579 . 10.1177/0192512116669141 . 151808737 . 2023-04-03.
2. Web site: Greenwood . Shannon . Appendix A: Classifying democracies . Pew Research Center's Global Attitudes Project . 2022-12-06 . 2022-12-27.
3. Book: Dobratz, B.A. . Power, Politics, and Society: An Introduction to Political Sociology . Taylor & Francis . 2015 . 978-1-317-34529-9 . Apr 30, 2023 . 47.
4. Book: Michie, J. . Reader's Guide to the Social Sciences . Taylor & Francis . 2014 . 978-1-135-93226-8 . 2023-04-03 . 95–97.
5. Web site: Democracy data: how do researchers measure democracy? . Our World in Data . Jun 17, 2022 . Apr 17, 2023.
6. Web site: The 'Varieties of Democracy' data: how do researchers measure democracy? . Our World in Data . 2022-11-30 . 2023-04-03.
7. Web site: Breaking Down Democracy . Freedom House . 2023-04-03.
8. https://connect.apsanet.org/s35/wp-content/uploads/sites/26/2023/06/Democracy-and-Autocracy-211_June-2023.pdf Democracy and Autocracy, Why do Democracies Develop and Decline, Vol. 21(1) June 2023, Democracy and Autocracy Section, American Political Science Association
9. Web site: Democracy Index 2021: the China challenge . . en-GB.
10. Web site: Governance Report . BTI 2022 . Apr 17, 2023.
11. Web site: The Global State of Democracy Indices . International Institute for Democracy and Electoral Assistance . May 26, 2023.
12. Web site: Democracy Perception Index – Alliance of Democracies .
13. Web site: Freedom House Report: Asia Sees Some Significant Progress . William Ide . January 11, 2000 . Voice of America . 4 December 2013 . https://web.archive.org/web/20131204022723/http://www.voanews.com/content/report--asia-sees-some-significant-progress-81235887/165280.html . October 13, 2012 . dead . dmy .
14. Web site: Freedom in the World . Freedom House . 2021-02-01 . 2023-04-03.
15. Laakso . Markku . Taagepera . Rein. 1979. "Effective" Number of Parties: A Measure with Application to West Europe . Comparative Political Studies . en . 12 . 1 . 3–27 . 10.1177/001041407901200101. 143250203 . 0010-4140.
16. Web site: Failed States FAQ . the Fund for Peace . 2007-08-25 . 2010-11-18 . https://web.archive.org/web/20101118014620/http://www.fundforpeace.org/web/index.php?option=com_content&task=view&id=102&Itemid=327 . dead .
17. Web site: The Gallagher Index – iscanadafair.ca . iscanadafair.ca . Apr 3, 2023.
18. Karp . Jeffrey A. . Banducci . Susan A. . Political Efficacy and Participation in Twenty-Seven Democracies: How Electoral Systems Shape Political Behaviour . British Journal of Political Science . Cambridge University Press . 38 . 2 . 2008 . 0007-1234. 27568347. 2023-06-16 . 311–334. 10.1017/S0007123408000161 . 10036/64393 . 55486399 . free .
19. Web site: Internal and external political efficacy - Government at a Glance 2021 . OECD iLibrary . 2023-06-16 .
20. Web site: Democracy-Dictatorship_Index . Kaggle . Jul 17, 2020 . Apr 3, 2023.
21. Web site: Home . Democracy Ranking . Feb 12, 2017 . de . Apr 3, 2023.
22. Web site: Polity IV Project. Table footnote. 11 Jan 2020. 4 May 2020. https://web.archive.org/web/20200504221240/http://www.systemicpeace.org/polity/polity4.htm. live.
23. Web site: Boix-Miller-Rosato dichotomous coding of democracy, 1800-2020, version 4.0 - bmr . xmarquez.github.io . Apr 17, 2023.
24. Skaaning . Svend-Erik . Gerring . John . Bartusevičius . Henrikas . A Lexical Index of Electoral Democracy . Comparative Political Studies . SAGE Publications . 48 . 12 . Apr 26, 2015 . 0010-4140 . 10.1177/0010414015581050 . 1491–1525. 16062427 .
25. The scientific limits of understanding the (potential) relationship between complex social phenomena: the case of democracy and inequality. Alexander. Krauss. January 2, 2016. Journal of Economic Methodology. 23. 1. 97–109. CrossRef. 10.1080/1350178X.2015.1069372. 51782149 .
26. Dahl, Robert A., Ian Shapiro, José Antônio Cheibub, and Adam Przeworski. “Minimalist Conception of Democracy: A Defense.” Essay. In The Democracy Sourcebook, 12–17. Cambridge, MA, MA: MIT Press, 2003.
27. Schmitter, Philippe C. and Terry Lynn Karl. 1991. "What Democracy is.. . and is Not." Journal of Democracy 2 (3): 75-88
28. Advances in the Study of Democratic Responsiveness: An Introduction . 10.1177/0010414016633226 . 2017 . Esaiasson . Peter . Wlezien . Christopher . Comparative Political Studies . 50 . 6 . 699–710 .
29. Coppedge, Michael, Angel Alvarez, and Claudia Maldonado. 2008. "Two Persistent Dimensions of Democracy: Contestation and Inclusiveness." The Journal of Politics70 (3): 632-647.
30. Samuels, David. “Chapter 3: Democratic Political Regimes.” Essay. In Comparative Politics. New York: Pearson Education, 2013.
31. Clark, William Roberts, Matt Golder, and Sona Nadenichek Golder. “Chapter 5: Economic Determinates of Democracy.” Chapter. In Foundations of Comparative Politics, 351–92.
32. Högström . John . 2013 . Does the Choice of Democracy Measure Matter? Comparisons between the Two Leading Democracy Indices, Freedom House and Polity IV . Government and Opposition . en . 48 . 2 . 201–221 . 10.1017/gov.2012.10.
33. Piironen, Ossi. 2005. "Minimalist Democracy without Substance? an Evaluation of the Mainstream Measures of Democracy." Politiikka 47 (3): 189-204.
34. Fuchs . Dieter . Roller . Edeltraud . Conceptualizing and Measuring the Quality of Democracy: The Citizens' Perspective . Politics and Governance . 6 . 1 . 22 . 10.17645/pag.v6i1.1188 . 2018 . free.
35. Mayne . Quinton . Geißel . Brigitte . Don't Good Democracies Need "Good" Citizens? Citizen Dispositions and the Study of Democratic Quality . Politics and Governance . 6 . 1 . 33 . 10.17645/pag.v6i1.1216 . 2018 . free.
36. Gerardo L. Munck and Jay Verkuilen, “Conceptualizing and Measuring Democracy: Evaluating Alternative Indices,” Comparative Political Studies 35, 1 (2002): 5-34. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.469.3177&rep=rep1&type=pdf
37. Little . Andrew T. . Meng . Anne . 2024-01-11 . Measuring Democratic Backsliding . PS: Political Science & Politics . 57 . 2 . en . 149–161 . 10.1017/S104909652300063X . 1049-0965. free .
38. Knutsen . Carl Henrik . Marquardt . Kyle L. . Seim . Brigitte . Coppedge . Michael . Edgell . Amanda B. . Medzihorsky . Juraj . Pemstein . Daniel . Teorell . Jan . Gerring . John . Lindberg . Staffan I. . 2024-01-11 . Conceptual and Measurement Issues in Assessing Democratic Backsliding . PS: Political Science & Politics . 57 . 2 . en . 162–177 . 10.1017/S104909652300077X . 1049-0965. free .