Glicko rating system explained

The Glicko rating system and Glicko-2 rating system are methods of assessing a player's strength in zero-sum two-player games. The Glicko rating system was invented by Mark Glickman in 1995 as an improvement on the Elo rating system and initially intended for the primary use as a chess rating system. Glickman's principal contribution to measurement is "ratings reliability", called RD, for ratings deviation.

Overview

Mark Glickman created the Glicko rating system in 1995 as an improvement on the Elo rating system.^[1]

Both the Glicko and Glicko-2 rating systems are under public domain and have been implemented on game servers online like , Team Fortress 2,^[2] Dota 2,^[3] Guild Wars 2,^[4] Splatoon 2,^[5] Lichess and chess.com.^[6]

The Reliability Deviation (RD) measures the accuracy of a player's rating, where the RD is equal to one standard deviation. For example, a player with a rating of 1500 and an RD of 50 has a real strength between 1400 and 1600 (two standard deviations from 1500) with 95% confidence. Twice (exact: 1.96) the RD is added and subtracted from their rating to calculate this range. After a game, the amount the rating changes depends on the RD: the change is smaller when the player's RD is low (since their rating is already considered accurate), and also when their opponent's RD is high (since the opponent's true rating is not well known, so little information is being gained). The RD itself decreases after playing a game, but it will increase slowly over time of inactivity.

The Glicko-2 rating system improves upon the Glicko rating system and further introduces the rating volatility σ.^[7] A very slightly modified version of the Glicko-2 rating system is implemented by the Australian Chess Federation.^[8]

The algorithm of Glicko

Step 1: Determine ratings deviation

The new Ratings Deviation (

RD ) is found using the old Ratings Deviation (RD _{0} ):RD = min \left(\sqrt{{RD ^{2} _{0 }} + c ^{2} t}, 350 \right)

where

t is the amount of time (rating periods) since the last competition and '350' is assumed to be the RD of an unrated player. If several games have occurred within one rating period, the method treats them as having happened simultaneously. The rating period may be as long as several months or as short as a few minutes, according to how frequently games are arranged. The constant c is based on the uncertainty of a player's skill over a certain amount of time. It can be derived from thorough data analysis, or estimated by considering the length of time that would have to pass before a player's rating deviation would grow to that of an unrated player. If it is assumed that it would take 100 rating periods for a player's rating deviation to return to an initial uncertainty of 350, and a typical player has a rating deviation of 50 then the constant can be found by solving350 = \sqrt{ 50 ^{2} +100 c ^{2}} for c .^[9]

Or

c = \sqrt{( 350 ^{2} - 50 ^{2)/100}} ≈ 34 . 6

Step 2: Determine new rating

The new ratings, after a series of m games, are determined by the following equation:

r = r _{0} + (q)/((1)/(+ (1)/(d ^{2}) RD ^{2})) \sum ^{m} _{i =1} {g(RD _{i)(s} _{i-E(s|r} _{0,r} _{i,RD} _{i))}}

where:

g(RD _{i)} = (1)/(\sqrt{ 1 + (3 q ^{2} (RD ^{2 )} _{i})/(\pi ^{2})) }E(s|r _{0,r} _{i,RD} _{i)} = (1)/(1+10 ^{\left( (g(RD _{i)(r} _{0-r} _{i)})/(\right) -400)}) q = (ln ( 10 ))/(400) = 0 . 00575646273 d ^{2} = (1)/(q ^{2} \sum ^{m} _{i =1} {(g(RD ^{2} _{i))} E(s|r _{0,r} _{i,RD} _{i)} ( 1- E(s|r _{0,r} _{i,RD} _{i))}) }r _{i} represents the ratings of the individual opponents.RD _{i} represents the rating deviations of the individual opponents.s _{i} represents the outcome of the individual games. A win is 1, a draw is (1)/(2) , and a loss is 0.

Step 3: Determine new ratings deviation

The function of the prior RD calculation was to increase the RD appropriately to account for the increasing uncertainty in a player's skill level during a period of non-observation by the model. Now, the RD is updated (decreased) after the series of games:

RD' = \sqrt{\left( (1)/(+ RD ^{2}) (1)/(d ^{2}) \right) ^{-1} }

Glicko-2 algorithm

Glicko-2 works in a similar way to the original Glicko algorithm, with the addition of a rating volatility

\sigma which measures the degree of expected fluctuation in a player’s rating, based on how erratic the player's performances are. For instance, a player's rating volatility would be low when they performed at a consistent level, and would increase if they had exceptionally strong results after that period of consistency. A simplified explanation of the Glicko-2 algorithm is presented below:

Step 1: Compute ancillary quantities

Across one rating period, a player with a current rating

\mu and ratings deviation \phi plays against m opponents, with ratings \mu _{1,...,\mu} _{m} and RDs \phi _{1,...,\phi} _{m} , resulting in scores s _{1,...,s} _{m} . We first need to compute the ancillary quantities v and \Delta :v = \left[ \sum ^{m} _{j =1} g(\phi ^{2} _{j)} E(\mu,\mu _{j,\phi} _{j)} \{ 1 - E(\mu,\mu _{j,\phi} _{j)\}} \right] ^{-1} \Delta = v \sum ^{m} _{j =1} g(\phi _{j)} \{s _{j} - E(\mu,\mu _{j,\phi} _{j)\}}

where

g(\phi _{j)} = (1)/(\sqrt{ 1 + 3 \phi ^{2 /\pi} _{j} ^{2}) },E(\mu,\mu _{j,\phi} _{j)} = (1)/(1+ \exp\{ - g(\phi _{j)(\mu} - \mu _{j)\}) }.

Step 2: Determine new rating volatility

We then need to choose a small constant

\tau which constrains the volatility over time, for instance \tau =0 . 2 (smaller values of \tau prevent dramatic rating changes after upset results). Then, forf(x) = (1)/(2) (e ^{x(\Delta} ^{2} - \phi ^{2} - v - e ^{x)})/((\phi ^{2} + v + e ^{x)} ^{2}) - (x -ln ({\sigma ^{2})/()}{\tau) ^{2},}

we need to find the value

A which satisfies f(A) =0 . An efficient way of solving this would be to use the Illinois algorithm, a modified version of the regula falsi procedure (see for details on how this would be done). Once this iterative procedure is complete, we set the new rating volatility \sigma' as\sigma' = \exp\{A/ 2 \}.

Step 3: Determine new ratings deviation and rating

We then get the new RD

\phi' =1 / \sqrt{ (1)/(\phi ^{2} + \sigma' ^{2}) + (1)/(v) },

and new rating

\mu' = \mu + \phi' ^{2} \sum ^{m} _{j =1} g(\phi _{j)} \{s _{j} - E(\mu,\mu _{j,\phi} _{j)\}.}

These ratings and RDs are on a different scale than in the original Glicko algorithm, and would need to be converted to properly compare the two.

See also

• Chess rating system

References

1. Web site: Glickman . Mark . The Glicko System . October 13, 2022 . November 3, 2022 . https://web.archive.org/web/20221103170241/http://glicko.net/glicko/glicko.pdf . live .
2. Web site: Valve. Team Fortress 2 Update Released. 29 June 2021. 29 June 2021. https://web.archive.org/web/20210629195229/https://store.steampowered.com/oldnews/38643. live.
3. Web site: The New Frontiers Update - Gameplay Update 7.33. 20 April 2023. 20 April 2023. https://web.archive.org/web/20230420235651/https://www.dota2.com/newfrontiers?v=2. live.
4. Web site: Justin. O'Dell. Finding the perfect match. 16 January 2015. 11 November 2020. https://web.archive.org/web/20201111213505/https://www.guildwars2.com/en/news/finding-the-perfect-match/. live.
5. Web site: Oatmealdome. An In-Depth Look at the Splatoon 2 Ranking System. 24 March 2024. 24 March 2024. https://web.archive.org/web/20240324210808/https://oatmealdome.me/blog/an-in-depth-look-at-the-splatoon-2-ranking-system/. live.
6. Book: Johnson . Ben . Perpetual Chess Improvement: Practical Chess Advice from World-Class Players and Dedicated Amateurs . 26 October 2023 . Continental Sales, Inc..
7. Web site: Example of the Glicko-2 system. Glickman. Mark E.. November 30, 2013. Glicko.net. January 27, 2020. February 11, 2020. https://web.archive.org/web/20200211053834/http://www.glicko.net/glicko/glicko2.pdf. live.
8. Web site: Australian Chess Federation Ratings By-Law. 17 January 2019. 11 March 2020. https://web.archive.org/web/20200311195757/https://auschess.org.au/wp-content/uploads/2018/09/ACF-Ratings-By-Law.pdf. live.
9. Web site: Welcome to Glicko ratings. 2010-02-11. 2020-12-12. https://web.archive.org/web/20201212081630/http://www.glicko.net/glicko.html. live.

External links

• Professor Glickman's Glicko-Website
• TrueSkill https://www.microsoft.com/en-us/research/publication/trueskilltm-a-bayesian-skill-rating-system/ rating system by Microsoft borrows many ideas from Glicko.
• forwardloop/glicko2s Glicko-2 implementation for the JVM
• RobKohr/glicko JavaScript Glicko-2 implementation.
• mmai/glicko2js Client side javascript and node.js Glicko-2 implementation
• deepy/glicko2 Python Glicko-2 implementation.
• sublee/glicko2 Python Glicko-2 implementation.
• PlayerRatings R Glicko implementation by Alec Stephenson and Jeff Sonas.
• scala-glicko2 Scala Glicko-2 implementation.
• dimos/glicko2 Glicko-2 implementation for Scala and Scala.js