Master (software) explained

Master is a version of DeepMind's Go software AlphaGo, named after the account name (originally Magister/Magist) used online, which won 60 straight online games against human professional Go players from 29 December 2016 to 4 January 2017. This version was also used in the Future of Go Summit in May 2017.[1] [2] It used four TPUs on a single machine with Elo rating 4,858.[3] DeepMind claimed that AlphaGo Master was 3-stone stronger than the version used in AlphaGo v. Lee Sedol.[4]

DeepMind released a version of AlphaGo Master in December 2017 that serves as a teaching tool analyzing the win rates of 6,000 Go openings from 230,000 human games.[5] [6]

Matches

Online games

The software was first used to play games against professional players on 29 December 2016 on the Tygem Go server, under the account name 'Magister' (shown as 'Magist' at the server's Chinese version). The account name was changed to 'Master' on 30 December. After playing 30 games on Tygem, it was moved to the FoxGo server on 1 January 2017.

Master played at the pace of 10 games per day. Many quickly suspected it to be an AI player due to little or no resting between games. After winning its 59th game it was revealed in the chatroom that Master was controlled by Aja Huang of the DeepMind team.[7] On 4 January 2017, after these games were completed, Demis Hassabis, the co-founder of DeepMind, confirmed that Magister and Master both played using an updated version of AlphaGo[8] [9] and said, "We're looking forward to playing some official, full-length games later [in 2017] in collaboration with Go organizations and experts".

Gu Li, a 9-dan player and co-founder of FoxGo, offered a bounty of 100,000 RMB (14,400 USD) to the first human player who could defeat Master. However, no one took the bounty since Master's final online record was 60 wins and 0 losses,[10] including three victories over Go's top ranked player, Ke Jie,[11] who had been quietly briefed in advance that Master was a version of AlphaGo.

Master's adversaries included many world champions such as Ke Jie, Park Jeong-hwan, Yuta Iyama, Tuo Jiaxi, Mi Yuting, Shi Yue, Chen Yaoye, Li Qincheng, Gu Li, Chang Hao, Tang Weixing, Fan Tingyu, Zhou Ruiyang, Jiang Weijie, Chou Chun-hsun, Kim Ji-seok, Kang Dong-yun, Park Yeong-hun, and Won Seong-jin, and also included national champions or world championship runners-up such as Lian Xiao, Tan Xiao, Meng Tailing, Dang Yifei, Huang Yunsong, Yang Dingxin, Gu Zihao, Shin Jinseo, Cho Han-seung, and An Sungjoon.[12] All 60 games except one were fast-paced games with three 20 or 30 seconds byo-yomi. Master offered to extend the byo-yomi to one minute when playing with Nie Weiping due to his old age.

No. Date Player (dan during the game) Time control Moves Master color and result
1 29 December 2016 Pan Tingyu (1 dan) three 20-second byo-yomi 146 White won by resignation
2 29 December 2016 Zhang Ziliang (1 dan) three 20-second byo-yomi 174 White won by resignation
3 29 December 2016 Ding Shixiong (3 dan) three 20-second byo-yomi 151 Black won by resignation
4 29 December 2016 Xie Erhao (4 dan) three 20-second byo-yomi 222 White won by resignation
5 29 December 2016 Yu Zhiying (5 dan) three 20-second byo-yomi 113 Black won by resignation
6 29 December 2016 Li Xiangyu (3 dan) three 20-second byo-yomi 131 Black won by resignation
7 29 December 2016 Qiao Zhijian (4 dan) three 20-second byo-yomi 163 Black won by resignation
8 29 December 2016 Han Yizhou (5 dan) three 20-second byo-yomi 104 White won by resignation
9 29 December 2016 Meng Tailing (6 dan) three 20-second byo-yomi 275 Black won by 4.5 points
10 29 December 2016 Meng Tailing (6 dan) three 20-second byo-yomi 148 White won by resignation
11 30 December 2016 Chen Hao (5 dan) three 20-second byo-yomi 170 White won by resignation
12 30 December 2016 Ryu Suhang (5 dan) three 20-second byo-yomi 144 White won by resignation
13 30 December 2016 Wang Haoyang (6 dan) three 20-second byo-yomi 136 White won by resignation
14 30 December 2016 Yan Zaiming (3 dan) three 20-second byo-yomi 129 Black won by resignation
15 30 December 2016 Park Junghwan (9 dan) three 20-second byo-yomi 150 White won by time
16 30 December 2016 Lian Xiao (7 dan) three 20-second byo-yomi 122 White won by resignation
17 30 December 2016 Lian Xiao (7 dan) three 20-second byo-yomi 164 White won by resignation
18 30 December 2016 Ke Jie (9 dan) three 20-second byo-yomi 228 Black won by 5.5 points
19 30 December 2016 Ke Jie (9 dan) three 20-second byo-yomi 128 White won by resignation
20 30 December 2016 Park Junghwan (9 dan) three 20-second byo-yomi 255 Black won by 5.5 points
21 31 December 2016 Chen Yaoye (9 dan) three 20-second byo-yomi 270 White won by 5.5 points
22 31 December 2016 Chen Yaoye (9 dan) three 20-second byo-yomi 277 White won by 4.5 points
23 31 December 2016 Kim Jung-hyun (6 dan) three 20-second byo-yomi 135 Black won by resignation
24 31 December 2016 Park Junghwan (9 dan) three 20-second byo-yomi 223 Black won by resignation
25 31 December 2016 Park Junghwan (9 dan) three 20-second byo-yomi 261 White won by 0.5 points
26 31 December 2016 Yun Chanhee (6 dan) three 20-second byo-yomi 217 Black won by resignation
27 31 December 2016 Fan Tingyu (9 dan) three 30-second byo-yomi 215 Black won by resignation
28 31 December 2016 Meng Tailing (6 dan) three 20-second byo-yomi 163 Black won by resignation
29 31 December 2016 Mi Yuting (9 dan) three 30-second byo-yomi 311 White won by 0.5 points
30 31 December 2016 Tang Weixing (9 dan) three 30-second byo-yomi 186 White won by resignation
31 1 January 2017 Li Qincheng (9 dan) 1 minute + three 20-second byo-yomi 179 Black won by resignation
32 2 January 2017 Gu Li (9 dan) 1 minute + three 30-second byo-yomi 154 White won by resignation
33 2 January 2017 Gu Li (9 dan) 1 minute + three 30-second byo-yomi 191 Black won by resignation
34 2 January 2017 Dang Yifei (9 dan) 1 minute + three 30-second byo-yomi 149 Black won by resignation
35 2 January 2017 Jiang Weijie (9 dan) 1 minute + three 30-second byo-yomi 280 White won by 1.5 points
36 2 January 2017 Gu Zihao (5 dan) 1 minute + three 30-second byo-yomi 209 Black won by resignation
37 2 January 2017 Park Yeong-hun (9 dan) 1 minute + three 30-second byo-yomi 173 Black won by resignation
38 2 January 2017 Tuo Jiaxi (9 dan) 1 minute + three 30-second byo-yomi 239 Black won by resignation
39 2 January 2017 Yuta Iyama (9 dan) 1 minute + three 30-second byo-yomi 135 Black won by resignation
40 2 January 2017 Meng Tailing (6 dan) 1 minute + three 30-second byo-yomi 274 White won by 2.5 points
41 2 January 2017 Kim Ji-seok (9 dan) 1 minute + three 30-second byo-yomi 170 White won by resignation
42 3 January 2017 Yang Dingxin (4 dan) 1 minute + three 30-second byo-yomi 125 Black won by resignation
43 3 January 2017 Kang Dong-yun (9 dan) 1 minute + three 30-second byo-yomi 165 Black won by resignation
44 3 January 2017 An Sung-joon (7 dan) 1 minute + three 30-second byo-yomi 260 White won by 2.5 points
45 3 January 2017 Shi Yue (9 dan) 1 minute + three 30-second byo-yomi 167 Black won by resignation
46 3 January 2017 Lian Xiao (7 dan) 1 minute + three 30-second byo-yomi 144 White won by resignation
47 3 January 2017 Tan Xiao (7 dan) 1 minute + three 30-second byo-yomi 191 Black won by resignation
48 3 January 2017 Park Junghwan (9 dan) 1 minute + three 30-second byo-yomi 270 White won by 1.5 points
49 3 January 2017 Won Seong-jin (9 dan) 1 minute + three 30-second byo-yomi 222 White won by resignation
50 3 January 2017 Ke Jie (9 dan) 1 minute + three 30-second byo-yomi 178 White won by resignation
51 4 January 2017 Chou Chun-hsun (9 dan) 1 minute + three 30-second byo-yomi 118 White won by resignation
52 4 January 2017 Fan Tingyu (9 dan) 1 minute + three 30-second byo-yomi 202 White won by resignation
53 4 January 2017 Huang Yunsong (5 dan) 1 minute + three 30-second byo-yomi 133 Black won by resignation
54 4 January 2017 Nie Weiping (9 dan) 1 minute + three 60-second byo-yomi 254 Black won by 7.5 points
55 4 January 2017 Chen Yaoye (9 dan) 1 minute + three 30-second byo-yomi 267 White won by 1.5 points
56 4 January 2017 Cho Han-seung (9 dan) 1 minute + three 30-second byo-yomi 171 Black won by resignation
57 4 January 2017 Shin Jin-seo (6 dan) 1 minute + three 30-second byo-yomi 139 Black won by resignation
58 4 January 2017 Chang Hao (9 dan) 1 minute + three 30-second byo-yomi 178 White won by resignation
59 4 January 2017 Zhou Ruiyang (9 dan) 1 minute + three 30-second byo-yomi 161 Black won by resignation
60 4 January 2017 Gu Li (9 dan) 1 minute + three 30-second byo-yomi 235 White won by 2.5 points

Future of Go Summit

See main article: Future of Go Summit. The Master version also participated in the Future of Go summit in May 2017.[1] It defeated Ke Jie in a three-game match by three to zero and beat a human team with five top Go professionals.

Innovative moves

Go experts were extremely impressed by Master's performance and by its non-human play style in its online games. Ke Jie stated, "After humanity spent thousands of years improving our tactics, computers tell us that humans are completely wrong... I would go as far as to say not a single human has touched the edge of the truth of Go".

Master played many innovative moves and inspired professional players.[13] [14] [15] [16] [17] [18] [19]

In the 23rd online game Master invaded the 3-3 point at a very early stage.[20]

In the 24th online game Master played six stones along the second line.

Operator errors

On 20 January 2017, DeepMind team members Fan Hui[21] and Aja Huang[22] disclosed that Master's operator accidentally entered a move other than AlphaGo's choice in two situations during the online games.

In the 9th online game, Master recommended point a for Move 107.

In the 39th online game, Master recommended point a for Move 99.

Example game

Online game 30: Master (white) v. Tang Weixing (31 December 2016), Master won by resignation. White 36 was widely praised.[23]

Notes and References

  1. Web site: AlphaGo官方解读让三子 对人类高手没这种优势. Sina. 25 May 2017. 1 June 2017. Chinese.
  2. Web site: 各版alphago实力对比 master能让李世石版3子. Sina. 24 May 2017. 2 June 2017. Chinese.
  3. David . Silver. David Silver (programmer). Julian. Schrittwieser. Karen. Simonyan. Ioannis. Antonoglou. Aja. Huang. Aja Huang. Arthur. Guez. Thomas. Hubert. Lucas. Baker. Matthew. Lai. Adrian. Bolton. Yutian. Chen. Chen Yutian. Timothy. Lillicrap. Hui. Fan. Fan Hui. Laurent. Sifre. George van den. Driessche. Thore. Graepel. Demis. Hassabis . Demis Hassabis. Mastering the game of Go without human knowledge. Nature. 0028-0836. 354–359. 550. 7676. 10.1038/nature24270. 29052630. 19 October 2017. 2017Natur.550..354S. 205261034.
  4. Web site: AlphaGo棋力比去年涨三子 柯洁想赢它可能只剩一招. Sina. 25 May 2017. 1 June 2017. Chinese.
  5. Web site: AlphaGo teaching tool. DeepMind.
  6. Web site: AlphaGo教学工具上线 樊麾:使用Master版本. Sina.com.cn. 11 December 2017. 11 December 2017. Chinese.
  7. Web site: 横扫中日韩棋手斩获59胜的Master发话:我是阿尔法狗. 澎湃新闻. 2017-01-04.
  8. Web site: Demis Hassabis. Demis Hassabis on Twitter: "Excited to share an update on #AlphaGo!". Demis Hassabis's Twitter account. 4 January 2017. 4 January 2017. Demis Hassabis.
  9. Web site: Elizabeth Gibney. Google reveals secret test of AI bot to beat top Go players. Nature. 4 January 2017. 4 January 2017.
  10. News: Humans Mourn Loss After Google Is Unmasked as China's Go Master. 6 January 2017. Wall Street Journal. 5 January 2017.
  11. News: The world's best Go player says he still has "one last move" to defeat Google's AlphaGo AI. 6 January 2017. Quartz. 4 January 2017.
  12. Web site: Full list of human players participating in the 60 games. Chinese. Sohu. 13 February 2017. 23 April 2017.
  13. Web site: 神秘高手Master颠覆了围棋传统,这更证明了藤泽秀行那句话. Toutiao. 3 January 2017. 24 April 2017. Nie Weiping. Chinese. Nie Weiping.
  14. Web site: 韩国研究新版AlphaGo:穿越而来展示未来围棋. Sina.com. 11 January 2017. 24 April 2017. Chinese.
  15. Web site: 金成龙分析AlphaGo:愿你为人类划开围棋的新天地. Sina.com. 28 January 2017. 24 April 2017. Chinese.
  16. Web site: 韩国家队分析AlphaGo60局1 很强但不"完美". Sina.com. 31 January 2017. 24 April 2017. Chinese.
  17. Web site: 韩国家队分析AlphaGo60局2 井山一局最有机会. Sina.com. 2 February 2017. 24 April 2017. Chinese.
  18. Web site: 阿法狗最令人感动一手 王铭琬:推波助澜. Sina.com. 6 February 2017. 24 April 2017. Chinese.
  19. Web site: 李昌镐学习"阿法狗流",日本棋手放下包袱仍有一战. Toutiao. Nie Weiping. 19 January 2017. 24 April 2017. Chinese. Nie Weiping.
  20. Web site: Innovations of AlphaGo. DeepMind. 23 April 2017. 27 July 2019. https://web.archive.org/web/20190727184357/https://deepmind.com/blog/innovations-alphago/. dead.
  21. Web site: Clarification. Fan Hui's Sina Weibo. 20 January 2017. 11 May 2017.
  22. Web site: Clarification. Aja Huang's Facebook. 20 January 2017. 11 May 2017.
  23. Web site: 高手战Master技术分析:人类仍有机会赢AI?. QQ.com. 2 May 2017. 13 May 2017. Chinese.