DeepMind compares performance Alphastar and pro-player StarCraft II unfairly
In graphs about the match between a human pro-StarCraft II player and his AlphaStar ai, Google DeepMind has apparently not fairly compared the two parties. The number of actions per minute of the two are compared, but not the effective actions per minute.
That is the conclusion of an extensive blog post by Aleksi Pietikäinen. He has been following StarCraft II and developments in artificial intelligence for years, but he still calls himself a layman. He states firstly that a distinction must be made between apm, actions per minute , and epm, effective actions per minute ; the first consists of clicks and keystrokes and the second only consists of clicks and keystrokes that pass a command that has not yet been given. That is, the spam, the wild click, is filtered out. In the heat of the fight, a lot of people do that, maybe everyone.
DeepMind plots the apm of the pro player, MaNa, and that of AlphaStar in graphs. It did so both during the competition and in a blog post . It shows that the average apm of MaNa over the entire match is higher than that of AlphaStar. Pietikäinen notes, however, that the ‘tail’ of this apm chart yields an insincere picture; the moments when the human player enters so much apm are the times when he is spamming. AlphaStar, however, does little to no spam and its tail would consist of effective commands for a much larger proportion.
These effective commands are the moments when the two players confront the battlefield and on which the artificial intelligence wins with the help of its superhuman micro , the ability to enter commands superhuman quickly and thus win a battle where a man would not being able. In the StarCraft II community, people generally agree that the AI did not win thanks to its strategy. Pietikäinen labels the graph on the blog post as ‘dangerous close to lying through statistics’.
AlphaStar, the ai of Google subsidiary DeepMind, defeated Polish professional player MaNa on Thursday in five of the five games. The human player did, however, win a live match.
Graph Deepmind AlphaStar StarCraft II
The apm of MaNa, AlphaStar and ai-trainer TLO, from DeepMinds blog post
This post first appeared on Need Help Ask Us Now Most Important Technology New, please read the originial post: here