Thursday, 24 January, 2019

OpenAI's Dota 2 bots trounce semi-pro players

Screenshot from the DOTA OpenAI Twitch stream OpenAI's Dota 2 bots trounce semi-pro players
Sherri Watson | 10 August, 2018, 03:18

We did notice that the bots lack fear and that's what makes some Dota 2 games exciting.

The human vs machine challenge began with a warmup match against the audience, which OpenAI won easily. From a recap of the competition via The Verge, "The OpenAI Five triumphed in convincing fashion in the first game, not allowing the human players to even destroy one of their defensive towers".

The bot team, called OpenAI Five, has certainly had enough practice to hold its own: it has been playing 180 years' worth of games against itself every day, picking up the intricacies of the MOBA along the way.

And the OpenAI has the advantage of learning through rigorous reinforcement training, a machine learning technique that involves teaching AI agents through trial and error and then "rewarding" them when they carry out a good action in the game.

OpenAI Five has been working towards their goal of competing against the best pro team at The International which is the largest annual Dota tournament in the world.

Now, the next step is to beat professional and best in the league Dota 2 players at the Valve's The International 8, which is scheduled for later this month.

The bot has been developed by OpenAI which is a non-profit organisation founded by SpaceX founder Elon Musk, and Sam Altman. It predicted a 95 percent win probability after seeing the hero teams. Heroes in Dota 2 often interact in complex ways. Playing against bots and one mistake could cause end of the match.

In spite of the restrictions, though, OpenAI still completely dominated the first two games, through a combination of near-flawless coordination and a "play as five"-oriented playstyle". The firm has also been tweaking the neural networks, altering the bot team's in-game reaction time to near human levels, and helping it learn additional strategies. OpenAI had the capacity to predict its chance of winning during each stage of the game, as well as during character selection. To recall, in June this year, OpenAI Five beat an amateur team.