American Go E-Journal » Computer Go/AI

AlphaGo Zero-AlphaGo Master: A similar “taste” but things turn sour quickly

Friday December 8, 2017

“AG Zero and the Ke Jie version sort of resemble each other, in the way that they play around the 3-3 invasions, and there’s a 2017.12.08_ag-ag-zero-master-3‘taste’ to their play that’s quite similar,” says Michael Redmond 9p in his third commentary on the AG Zero games. “That said, the Ke Jie version tends to jump into fights more quickly and that’s very exciting, but in the Zero version, there’s a lot of hidden reading, like we saw in Game 2. Just as Master did against human players, Zero is controlling the game to a much greater degree, and a lot of the reading is not actually coming out on the board.”

“In this game, Master has black again and will be playing a lot of moves towards the center,” Redmond says. “So there are lot of stones floating around in the center of the board and looking kind of neat. I think Master had a good opening in this game and then there’s one move I really don’t like, that’s really the turning point of the game. And just like when I’m playing a formidable player, I find that just one move can turn things very sour quite quickly.”

Click here for Redmond’s video commentary, hosted by the AGA E-Journal’s Chris Garlock, and see below for the sgf commentary. To support this content, please consider joining or renewing your membership in the American Go Association; click here for details.

Video produced by Michael Wanek and Andrew Jackson. The sgf files were created by Redmond, with editing and transcription by Garlock and Myron Souris.

[link]

Share

Google’s AlphaZero destroys highest-rated chess engine in 100-game match

Thursday December 7, 2017

Chess changed forever today. And maybe the rest of the world did, too.2017.12.07_alphazero-stockfish

A little more than a year after AlphaGo sensationally won against the top Go player, the artificial-intelligence program AlphaZero has obliterated the highest-rated chess engine.

Stockfish, which for most top players is their go-to preparation tool, and which won the 2016 TCEC Championship and the 2017 Chess.com Computer Chess Championship, didn’t stand a chance. AlphaZero won the closed-door, 100-game match with 28 wins, 72 draws, and zero losses.

Oh, and it took AlphaZero only four hours to “learn” chess. Sorry humans, you had a good run.

That’s right — the programmers of AlphaZero, housed within the DeepMind division of Google, had it use a type of “machine learning,” specifically reinforcement learning. Put more plainly, AlphaZero was not “taught” the game in the traditional sense. That means no opening book, no endgame tables, and apparently no complicated algorithms dissecting minute differences 2017.12.07_michael-adams-demis-hassabisbetween center pawns and side pawns.

This would be akin to a robot being given access to thousands of metal bits and parts, but no knowledge of a combustion engine, then it experiments numerous times with every combination possible until it builds a Ferrari. That’s all in less time that it takes to watch the “Lord of the Rings” trilogy. The program had four hours to play itself many, many times, thereby becoming its own teacher.

“It’s a remarkable achievement, even if we should have expected it after AlphaGo,” GM Garry Kasparov told Chess.com. “It approaches the ‘Type B,’ human-like approach to machine chess dreamt of by Claude Shannon and Alan Turing instead of brute force.”

You can read the full paper here. GM Peter Heine Nielsen said that “After reading the paper but especially seeing the games I thought, well, I always wondered how it would be if a superior species landed on earth and showed us how they play chess. I feel now I know.”

After the Stockfish match, AlphaZero then “trained” for only two hours and then beat the best Shogi-playing computer program “Elmo.”

“[This is] actual artificial intelligence,” said Nielsen. “It goes from having something that’s relevant to chess to something that’s gonna win Nobel Prizes or even bigger than Nobel Prizes. I think it’s basically cool for us that they also decided to do four hours on chess because we get a lot of knowledge. We feel it’s a great day for chess but of course it goes so much further.”

Excerpted from Mike Klein’s December 6 report on chess.com. photo: Deepmind’s Demis Hassabis (right) playing with Michael Adams at the ProBiz event at Google Headquarters London just a few days ago. | Photo: Maria Emelianova/Chess.com.

Share

AlphaGo doc now available to rent or buy

Wednesday December 6, 2017

“AlphaGo,” the 2016 documentary about the historic AlphaGo-Lee Sedol match, is now available on the Google “Play” store for2017.12.06_alphaGo-movie rental and purchase.
“AlphaGo” chronicles a journey from the backstreets of Bordeaux, past the coding terminals of Google DeepMind, to Seoul, where a legendary go master faces an unproven AI challenger. As the drama unfolds, questions emerge: What can artificial intelligence reveal about a 3000-year-old game? What will it teach us about humanity?

“This is such a beautiful telling of this historic moment,” comments Ben Murdoch on the site. “An intimate and at times tense portrayal of a milestone moment in AI history. Captivating!” says Marek Barwiński.

Share

AlphaGo Zero-AlphaGo Master: A Master misread?

Sunday December 3, 2017

“Although the openings in this series are pretty repetitive, the games themselves vary,” says Michael Redmond 9p in his2017.12.01_ag-ag-zero-master-2 second commentary on the AG Zero games. “So in some, you’ll see a half-point game, and in others we’ll see Master crash. This game is interesting because it’s the first time that Zero has black. Also, later in the game, I get the feeling that Master is acting like it did in the 60-game series earlier this year against top human players, where it thinks its winning and is sort of closing up shop and wrapping up the game. So I wonder whether it mis-read a tsume-go — actually a 60-move sequence — in this game.”

Click here for Redmond’s video commentary, hosted by the AGA E-Journal’s Chris Garlock, and see below for the sgf commentary.

Video produced by Michael Wanek and Andrew Jackson. The sgf files were created by Redmond, with editing and transcription by Garlock and Myron Souris.

[link]

Share

AlphaGo Zero series to officially launch on Black Friday

Thursday November 23, 2017

After taking last Friday off, Michael Redmond’s AlphaGo video commentary series officially launches an AG Zero-Master series Friday at 6p 2017.11.24_ag-ag-zero-master-1EDT, with at least four more Zero-Master commentaries planned through the end of the year. Click here for the first Zero-Master commentary.

“Zero shows a strong2017.11.23_AlphaGo Zero vs. Master with Michael Redmond 9p Game 1 bias for territory, and this makes it’s overall game plan relatively easy to understand,” says Redmond. “Quite often we will see Zero diving into Master’s moyo, with some exciting fighting.”

Meanwhile, click here to check out Redmond’s exploration of Zero’s main openings and here for a playlist of 15 Redmond commentaries on the AlphaGo self-play games.

Video produced by Michael Wanek and Andrew Jackson. The sgf files were created by Redmond, with editing and transcription by Garlock and Myron Souris.

[link]

Share

DeepMind has yet to find out how smart its AlphaGo Zero AI could be

Monday November 13, 2017

“Perhaps the most interesting thing about AlphaGo Zero, though, isn’t how fast it was able to do what it did, or with such efficacy, but also that2017.11.12_hassabis-techcrunch it ultimately didn’t even achieve its full potential,” reports TechCrunch. “DeepMind CEO and co-founder Demis Hassabis explained on stage at Google’s Go North conference in Toronto that the company actually shut down the experiment before it could determine the upper limits of AlphaGo Zero’s maximum intelligence.”

“We never actually found the limit of how good this version of AlphaGo could get,” he said. “We needed the computers for something else.”

Hassabis said that DeepMind may spin up AlphaGo Zero again in future to find out how much further it can go, though the main benefit of that exercise might be to help teach human AlphaGo players about additional, “alien” moves and stratagems that they can study to improve their own play.

PLUS: The October issue of Games magazine includes “A God of Go: AlphaGo Crosses the Next Frontier of Artificial Intelligence”

Share

AlphaGo Zero-AlphaGo Master: Two openings, less variety

Saturday November 11, 2017

“In the set of 20 games between AG Zero and AG Master, there are pretty much just two openings — i.e. identical moves for about the first 202017.11.11_ag-ag-zero-opening moves — one with Zero as Black and one with Master as Black,” says Michael Redmond 9p in this first commentary on the recently released AG Zero games. “This provides an opportunity to examine how Zero differs from Master, as well as how Master differs from earlier versions. ”

“When AGMaster plays against AGZero, it does not show the variety that it had before,” says Redmond. “As AG does not change within a version, I find it hard to accept that it apparently does not have the option to play moves that it played before in identical board positions. In the ‘Master series’, 60 games played against top pros in Dec 2016 to Jan 2017, Master could play the 3-4 point as it’s first move in about 1/4 of the games when it had Black. Incidentally, AGKeJie also could play the 3-4 point in some of it’s games. The fact that Master repeats the same opening every time in these games against AGZero bothers me and makes me question, is this truly the same version of AGMaster that played the Master series, and if so, what caused it to play the same opening every time in this series, when it was allowed to have variety in previous games with identical board positions? The difference in calculated winning percentage between A and B should be extremely small and I would expect it to have little or no effect on the ultimate win-loss record. This set of games would be much more valuable if Master had been allowed to vary in it’s choices for moves.”

Click here for Redmond’s video commentary, hosted by the AGA E-Journal’s Chris Garlock, and see below for the two sgf commentaries. Note that these commentaries focus only on the two openings; watch for a full-game Zero-Master commentary next week. Click here for a playlist of all the Redmond AG commentaries.

Video produced by Michael Wanek and Andrew Jackson. The sgf files were created by Redmond, with editing and transcription by Garlock and Myron Souris.

[link]

[link]

Share

AlphaGo-AlphaGo Game 15: New, different and possibly bad

Friday November 10, 2017

“I don’t like to call it weird, but in this game we’re going to see some new and different stuff that AlphaGo is doing with the joseki that I don’t 2017.11.10_ag-ag-thumb-15really understand and I don’t like it,” says Michael Redmond 9p in his commentary on Game 15. “It’ll be interesting to see if eventually I change my mind, but for now I’m going to say it’s a bad move.” Redmond adds that “We’ll also see another typical AlphaGo move later in the game that’s pretty exciting too.”

Click here for Redmond’s video commentary, hosted by the AGA E-Journal’s Chris Garlock. Click here for a playlist of all the Redmond AG commentaries.

And keep an eye out here and on the AGA YouTube channel for the launch of Redmond’s commentaries on the AlphaGo Zero-Master games, coming very soon!

The Game 15 video is produced by Michael Wanek and Andrew Jackson. The sgf file was created by Redmond, with editing and transcription by Garlock and Myron Souris.

[link]

Share

Redmond announces new series on AlphaGo Master vs AG Zero

Saturday November 4, 2017

“We were expecting DeepMind to make some sort of an announcement (about a new version of AlphaGo),” says Michael Redmond 9p, “But 802017.11.04_agzupdatethumb games was a big present.” (Self-taught AlphaGo Zero bests all previous versions in record time Redmond discusses AlphaGo Zero with the E-Journal’s Chris Garlock in a brief video announcing the launch of a new series of game commentaries. DeepMind released four sets of games for the self-taught AI, including training games, games against the Fan Hui version, the Lee Sedol version and the Master version, which defeated 60 top human opponents earlier this year. “I’m going to be looking at the games where Master plays Zero, mainly because Master is such a popular version of AlphaGo,” Redmond says. Master’s tactics, including big shimaris and emphasizing the center “people wanted to play, but were afraid because that way of playing is weak in territory. Master showed us some successful ways…and is still having an effect on how professionals play. So it’s going to be really interesting to see Master playing against a stronger version of AlphaGo.”

Share

AlphaGo-AlphaGo Game 14: A double kakari and a new joseki

Saturday November 4, 2017

“In this game we’re going to see a double kakari against a star point, a first for this series of games,” says Michael Redmond 9p in his game 2017.11.03_AG-14commentary on Game 14. “In the Master vs. human series back in January, Master would play away when the opponent played a kakari against a star point, sometimes. Now we’ll get to see how Master plays this with White, and it has a special move. Its a new joseki that actually make s some sense, so it’s going to be interesting.”

Click here for Redmond’s video commentary, hosted by the AGA E-Journal’s Chris Garlock.

The Game 14 video is produced by Michael Wanek and Andrew Jackson. The sgf file was created by Redmond, with editing and transcription by Garlock and Myron Souris.

[link]

Share