Gomocup Explained

Gomocup is a worldwide tournament of artificial intelligences (AI) playing Gomoku and Renju. The tournament has been played since 2000 and takes place every year.[1] As of 2016,[2] it is the most famous and largest Gomoku AI tournament in the world, with around 40 participants from about 10 countries.

Rules

Gomocup has been played in the freestyle Gomoku rule with the board size of 20 since it was started in 2000.[3] In 2009, the standard Gomoku rule was added into Gomocup as a tournament, in which the board size is 15 and more than five in a row is not considered to be a win.[4] In 2016, the Renju rule was also added into Gomocup, with a board size of 15 and forbidden moves for black.[5] In particular, since there are a large number of participants in the freestyle Gomoku tournament, the freestyle Gomoku tournament is divided into several leagues, and the fast game tournament is introduced.[6]

To get rid of the fact that there is a winning strategy for the player who plays first in Gomoku,[7] balanced openings have been prepared by Gomoku experts since 2006.[8] Games would be started from these balanced openings, and neither side would have a big advantage from the very beginning.

AI vs. Human Tournament

There were two AI vs. Human tournaments held in the Czech Republic in 2006 and 2011.

In 2006, the top 3 programs in Gomocup had a tournament with 3 of the top 10 players in Piškvorky online. There were 2 games between each pair of AI and human players. The result was one win, one draw and one loss for AIs, and the total score was 3:3.[9]

In 2011, the tournament was between the top 4 programs in Gomocup and 4 players at the top of the Czech Gomoku rating list. Similar to the 1st tournament, there were 2 games between each pair of AI. This time there were 3 draws and 1 win for AIs, and the total score was 5:3.[10]

Elo Rating

The Elo rating system for Gomocup was built in 2016 and calculated with all the historical tournament results ever since.[11] The rating is calculated with the open-source tool BayesElo,[12] with a few parameters modified to get adapted to the Gomoku game. There is a rating list for each game rule. The Elo ratings are updated every year after the Gomocup tournament finishes.

Elo Ratings for Freestyle Gomoku
Rank AI Author Country Elo Rating
1 Yixin Sun Kai 2409
2 Goro Victor Barykin 1981
3 RenjuSolver Wen Xiangdong 1951
4 SlowRenju Hao Tianyi 1937
4 Tito Andrej Tokarjev 1928
6 Hewer Tomas Kubes 1887
7 Swine Jiri Fontan 1843
8 Onix Istvan Virag
Janos Wagner
1843
9 Carbon Michal Czardybon 1810
10 HGarden Han Bingqing 1739
11 Wine Wang Jinjie 1696
12 Embryo Mira Fontan 1647
13 Pela Petr Lastovicka 1632
14 Whose Hou Wen 1608
15 GMotor Roman Vancura 1555
16 HFM Csaba Jergler 1549
17 Kanec Jaroslav Babak 1509
18 Chis Zheng Peiming 1472
19 Zetor Tomas Chmela 1455
20 XoXo Jakub Horak 1442
21 HighFive Peter Karpov 1429
22 Beta Tomas Kubes 1362
23 Bestmove Wen Xiangdong 1292
24 Eulring Bian Junyi 1286
25 Amoeba Galli Zoltan 1283
26 Pecuchet Vilem Walter 1204
27 Jude Li Tian 1200
28 Sparkle Lee Jaechan 1172
29 Ignitor Lee Jaechan 1100
30 QMentat Vojta Havranek 1083
31 Krysa Jiri Fontan 1080
32 Noesis Mark Mammel 1065
33 Nabamoku Jiri Isa 1011
34 Trunkat Jiri Trunkat 1000
35 PureGM Paul Dwyer 993
36 Imro Imrich Kovac 972
37 Puskvorec Patrik Bezdicek 969
38 FastGomoku Wang Zheng 932
39 Pisq Martin Petricek 897
40 Djall Ladislav Petr 969
41 Licht Li Xinhui 814
42 Brutefor Vasek Synacek 811
43 Stahlfaust Marco Kunze
Sebastian Nowozin
806
44 Valkyrie Takashi Kokubun 792
45 Leonardo Milan Matlak 792
46 Benjamin Benjamin Vejnar 789
47 FiveRow Yaroslav 782
48 AI Jan Macura 754
49 DeepBlue Vojta Havranek 742
50 PureRocky Paul Dwyer 740
51 Crusher Nils Beckmann 672
52 Curnpis Jan Curn 662
53 Prolog David Macek 623
54 Mushroom Chen Kai 383
Elo Ratings for Fastgame Gomoku
Rank AI Author Country Elo Rating
1 Yixin Sun Kai 2297
2 Goro Victor Barykin 2073
3 Hewer Tomas Kubes 1930
4 SlowRenju Hao Tianyi 1863
5 Tito Andrej Tokarjev 1855
6 Swine Jiri Fontan 1789
7 Carbon Michal Czardybon 1780
8 HGarden Han Bingqing 1705
9 Wine Wang Jinjie 1695
10 Pela Petr Lastovicka 1663
11 Embryo Mira Fontan 1658
12 Whose Hou Wen 1630
13 GMotor Roman Vancura 1606
14 Chis Zheng Peiming 1598
15 HFM Csaba Jergler 1545
16 XoXo Jakub Horak 1505
17 HighFive Peter Karpov 1480
18 Kanec Jaroslav Babak 1466
19 Zetor Tomas Chmela 1456
20 Amoeba Galli Zoltan 1325
21 Eulring Bian Junyi 1310
22 Licht Li Xinhui 1283
23 Pecuchet Vilem Walter 1230
24 Jude Li Tian 1219
25 Sparkle Lee Jaechan 1219
26 Ignitor Lee Jaechan 1139
27 QMentat Vojta Havranek 1086
28 Noesis Mark Mammel 1061
29 Trunkat Jiri Trunkat 1060
30 Imro Imrich Kovac 1019
31 Puskvorec Patrik Bezdicek 1011
32 Nabamoku Jiri Isa 1000
33 PureGM Paul Dwyer 965
34 FastGomoku Wang Zheng 957
35 Pisq Martin Petricek 938
36 Djall Ladislav Petr 904
37 Leonardo Milan Matlak 891
38 Benjamin Benjamin Vejnar 862
39 AI Jan Macura 837
40 Valkyrie Takashi Kokubun 822
41 Stahlfaust Marco Kunze
Sebastian Nowozin
807
42 FiveRow Yaroslav 773
43 Curnpis Jan Curn 728
44 PureRocky Paul Dwyer 727
45 Crusher Nils Beckmann 669
46 Prolog David Macek 610
47 Mushroom Chen Kai 416
Elo Ratings for Standard Gomoku
Rank AI Author Country Elo Rating
1 Yixin Sun Kai 2409
2 RenjuSolver Wen Xiangdong 1978
3 SlowRenju Hao Tianyi 1958
4 Tito Andrej Tokarjev 1944
5 Hewer Tomas Kubes 1928
6 Whose Hou Wen 1665
7 Carbon Michal Czardybon 1624
8 GMotor Roman Vancura 1595
9 Pela Petr Lastovicka 1572
10 Zetor Tomas Chmela 1507
Elo Ratings for Renju
Rank AI Author Country Elo Rating
1 Yixin Sun Kai 2725
2 RenjuSolver Wen Xiangdong 2334
3 SlowRenju Hao Tianyi 2316
4 Carbon Michal Czardybon 2155
5 XL Chen Chengtao 1982
6 Pela Petr Lastovicka 1970
7 Whose Hou Wen 1927

Results

The results for the Gomocup tournaments since 2000 is in the following.[13]

Year! colspan="3"
1st2nd3rd BalancedOpening
AIAuthorCountryAIAuthorCountryAIAuthorCountry
2000Pisq 5Martin PetricekCzech RepublicPisq 4Martin PetricekCzech RepublicPisq 3Martin PetricekCzech Republicalign=center Not used
2001Pisq 5Martin PetricekCzech RepublicMentatVojta HavranekCzech RepublicLeonardoMilan MatlakCzech Republicalign=center Not used
2002TrunkatJiri TrunkatCzech RepublicKrysaJiri FontanCzech RepublicXMentatVojta HavranekCzech Republicalign=center Not used
2003SvineJiri FontanCzech RepublicHewerTomas KubesCzech RepublicTrunkatJiri TrunkatCzech Republicalign=center Not used
2004SvineJiri FontanCzech RepublicGoroVictor BarykinRussiaBestmoveWen XiangdongChinaalign=center Not used
2005GoroVictor BarykinRussiaSwineJiri FontanCzech RepublicPelaPetr LastovickaCzech Republicalign=center Not used
2006GoroVictor BarykinRussiaTitoAndrej TokarjevHungaryHGardenHan BingqingChinaalign=center Used
2007TitoAndrej TokarjevHungaryHGardenHan BingqingChinaSwineJiri FontanCzech Republicalign=center Used
2008TitoAndrej TokarjevHungaryOnixIstvan Virag
Janos Wagner
HungaryHGardenHan BingqingChinaalign=center Used
2009GoroVictor BarykinRussiaOnixIstvan Virag
Janos Wagner
HungaryHGardenHan BingqingChinaalign=center Used
2010GoroVictor BarykinRussiaTitoAndrej TokarjevHungaryOnixIstvan Virag
Janos Wagner
Hungaryalign=center Used
2011TitoAndrej TokarjevHungaryRenjuSolverWen XiangdongChinaSwineJiri FontanCzech Republicalign=center Used
2012YixinSun KaiChinaRenjuSolverWen XiangdongChinaHewerTomas KubesCzech Republicalign=center Used
2013YixinSun KaiChinaTitoAndrej TokarjevHungaryRenjuSolverWen XiangdongChinaalign=center Used
2014YixinSun KaiChinaRenjuSolverWen XiangdongChinaHewerTomas KubesCzech Republicalign=center Used
2015YixinSun KaiChinaRenjuSolverWen XiangdongChinaTitoAndrej TokarjevHungaryalign=center Used
2016YixinSun KaiChinaRenjuSolverWen XiangdongChinaSlowRenjuHao TianyiChinaalign=center Used
2017YixinSun KaiChinaRenjuSolverWen XiangdongChinaGoroVictor BarykinRussiaalign=center Used
2018YixinSun KaiChinaRenjuSolverWen XiangdongChinaGoroVictor BarykinRussiaalign=center Used
Year! colspan="3"
1st2nd3rd BalancedOpening
AIAuthorCountryAIAuthorCountryAIAuthorCountry
2005PelaPetr LastovickaCzech RepublicGoroVictor BarykinRussiaBetaTomas KubesCzech Republicalign=center Not used
2006PelaPetr LastovickaCzech RepublicTitoAndrej TokarjevHungaryGoroVictor BarykinRussiaalign=center Used
2007TitoAndrej TokarjevHungaryHGardenHan BingqingChinaPelaPetr LastovickaCzech Republicalign=center Used
2008TitoAndrej TokarjevHungaryHGardenHan BingqingChinaHewerTomas KubesCzech Republicalign=center Used
2009HewerTomas KubesCzech RepublicHGardenHan BingqingChinaKanecJaroslav BabakCzech Republicalign=center Used
2010GoroVictor BarykinRussiaHewerTomas KubesCzech RepublicTitoAndrej TokarjevHungaryalign=center Used
2011SwineJiri FontanCzech RepublicTitoAndrej TokarjevHungaryRenjuSolverWen XiangdongChinaalign=center Used
2012HewerTomas KubesCzech RepublicYixinSun KaiChinaSwineJiri FontanCzech Republicalign=center Used
2013YixinSun KaiChinaHewerTomas KubesCzech RepublicHGardenHan BingqingChinaalign=center Used
2014YixinSun KaiChinaGoroVictor BarykinRussiaHewerTomas KubesCzech Republicalign=center Used
2015YixinSun KaiChinaGoroVictor BarykinRussiaHewerTomas KubesCzech Republicalign=center Used
2016YixinSun KaiChinaGoroVictor BarykinRussiaSlowRenjuHao TianyiChinaalign=center Used
2017YixinSun KaiChinaGoroVictor BarykinRussiaHewerTomas KubesCzech Republicalign=center Used
Year! colspan="3"
1st2nd3rd BalancedOpening
AIAuthorCountryAIAuthorCountryAIAuthorCountry
2009HewerTomas KubesCzech RepublicPelaPetr LastovickaCzech Republic-align=center Used
2010HewerTomas KubesCzech RepublicTitoAndrej TokarjevHungaryPelaPetr LastovickaCzech Republicalign=center Used
2011TitoAndrej TokarjevHungaryHewerTomas KubesCzech RepublicGMotorRoman VancuraCzech Republicalign=center Used
2012HewerTomas KubesCzech RepublicTitoAndrej TokarjevHungaryYixinSun KaiChinaalign=center Used
2013YixinSun KaiChinaTitoAndrej TokarjevHungaryHewerTomas KubesCzech Republicalign=center Used
2014TitoAndrej TokarjevHungaryYixinSun KaiChinaHewerTomas KubesCzech Republicalign=center Used
2015YixinSun KaiChinaTitoAndrej TokarjevHungaryHewerTomas KubesCzech Republicalign=center Used
2016YixinSun KaiChinaRenjuSolverWen XiangdongChinaTitoAndrej TokarjevHungaryalign=center Used
2017YixinSun KaiChinaRenjuSolverWen XiangdongChinaSlowRenjuHao TianyiChinaalign=center Used
Year! colspan="3"
1st2nd3rd BalancedOpening
AIAuthorCountryAIAuthorCountryAIAuthorCountry
2016YixinSun KaiChinaRenjuSolverWen XiangdongChinaSlowRenjuHao TianyiChinaalign=center Used
2017YixinSun KaiChinaRenjuSolverWen XiangdongChinaSlowRenjuHao TianyiChinaalign=center Used

References

  1. Web site: The Gomoku AI programming tournament. Gomocup. dead. https://web.archive.org/web/20160604205643/http://gomocup.org/home/. 2016-06-04.
  2. News: Gomocup 2016, the 17th tournament (April the 22nd-24th, 2016).
  3. Web site: Detailed Information. Gomocup.
  4. Web site: Gomocup 2009, the 10th tournament (April the 4th, 2009). Gomocup.
  5. Web site: Gomocup 2016 Announcement. Gomocup. https://web.archive.org/web/20160514045616/http://gomocup.org/gomocup-2016-announcement/. 2016-05-14. dead.
  6. Web site: Gomocup 2005, the 6th tournament (April the 16th, 2005). Gomocup.
  7. Web site: Go-Moku and Threat Space Search. 2017-05-07. 2016-09-28. https://web.archive.org/web/20160928113745/http://www.renju.nu/wp-content/uploads/sites/46/2016/09/Go-Moku.pdf. dead.
  8. Web site: Gomocup 2006, the 7th tournament (April the 28th, 2006). Gomocup.
  9. Web site: The 1st tournament AI vs. Human (November the 11th, 2006). Gomocup. 2016-06-02.
  10. Web site: AI vs. Člověk 2011 Česká federace piškvorek a renju. www.piskvorky.cz. 2016-06-02.
  11. Web site: Elo Ratings. Gomocup.
  12. Web site: Bayesian Elo Rating. Coulom. Rémi. www.remi-coulom.fr. 2016-06-02.
  13. Web site: Results Gomocup. Gomocup. 2016-06-02.