Stan

Under the Hood AI Improvements

21 posts in this topic

QMUB01ZO4IAQ1504903265156.jpg

AI is an important element of Heroes of the Storm and Blizzard has been working hard on improvements. The updated AI can now stutter-step and has faster reaction times.

  • Blizzard is transitioning the AI from being controlled by scripts to being controlled by new systems built into the game engine.
  • AI should feel more responsive, accurate, and execute more dynamic strategies.
  • The AI can now stutter-step to keep attacking while moving into position.
  • All Heroes released since Garrosh use the new system, and with each update, more Heroes are transitioned to the new system.

Blizzard LogoBlizzard (Source)

AI is an important part of Heroes of the Storm. A significant number of games are played versus AI, and PvP games also have AI-controlled Heroes when players are disconnected. Those ever-helpful, ever-pesky minions and mercenaries are AI, too! We are passionate about bringing the best possible experience to all our players, so the AI team has been working hard on improving our AI systems. Read on for details!

What makes good AI?

There are many ways to define “good” AI, but from our perspective it’s an AI that closely matches players’ expectations. Minions and bosses need to be predictable. AI Heroes need to be very skillful. Players expect their AI Hero allies to stay safe, but also engage in team fights at the right time. There is a delicate balance between staying safe and capitalizing on opportunities. We also try to ensure the AI supports human players a little more than AI allies.

HJ3BBMLEGF691504893687724.gif

Valla Vaults into position for a Rain of Vengeance, but Stitches rescues the human player from annihilation!

Making good AI has its challenges. Many situations are complicated enough to have several valid strategies, and expectations can vary from player to player. We work closely with the game designers on our team to develop AI that models all the factors they consider important in decision making. And although we are trying to make the AI as smart as possible, we only give them access to information a regular player would have so they don’t get to cheat!

What is changing?

We are gradually transitioning the AI from being controlled by scripts to being controlled by several new systems built into the game engine. We are not trying to make the AI drastically different, but we are building systems that can be extended easily to add a lot more detail to the AI. You may notice AI Heroes being more responsive, more accurate, and executing more dynamic strategies.

Speed!

The new AI system runs many times faster than before. This has not only resulted in a slight improvement to the frame rate of the game, but it has also allowed us to update the AI more frequently! AI now have faster reaction times and they can use abilities in rapid succession. We had to drastically limit the update rate for lower difficulty AI!

Tactics

The tactics the new AI use has been enhanced to allow for a rich set of targeting options, and better positioning during fights. Examples are being able to predict the movement of targets, find clusters of targets, and filter or prioritize targets in many ways. Our designers have had a lot of fun using these new options to create more detailed AI. Kel’Thuzad’s surgical use of his abilities is a great example of this.
 
NPHJ83R9KZTC1504893668311.gif

Rather than simply moving into range of their targets, AI Heroes also try to stay out of danger. They calculate a score for many locations around the target and move to the safest one.

VJ9S46408YUW1504895126853.jpg
The AI are also now able to stutter-step to keep attacking their target while moving into position.
 
EDIQ25WUP08P1504893684375.gif

Strategy

The AI has a new system for making strategic decisions. There are many things on a map that Heroes could be doing, and each of those is considered a potential goal for the AI. Each goal has a score calculated for it and the AI Heroes on a team are then assigned to the most suitable goal. This algorithm tries to maximize the team’s chances of winning by gaining experience in lane, taking mercenary camps, and controlling map objectives. It also looks out for lone enemies that can be easily ganked—so watch out!

Development

The team is constantly working on new Heroes, Battlegrounds, and game modes. To support this rapid development pace, we created an AI editor, which allows our game designers to quickly customize each Hero’s AI. This results in higher-quality AI that has been tuned for each Hero’s play style. You may notice this when Azmodan sees you at low health and throws a long-range Globe of Annihilation to finish you off!

A major part of the new AI is a “behavior tree” system, which is a common AI technology used in games. It is called a “tree” because it branches at every possible decision the AI can make, and the ends of the branches are the actual things that the AI can do, such as moving or attacking.

The branches of the tree are modular and can be customized for different AI behavior depending on the unit, map and game mode. This type of system is essential for supporting a diverse range of Heroes and Battlegrounds.

BNT9CSG2DAIR1504893658917.png

A very small number of the 400 nodes in Valla’s behavior tree.

Future

All Heroes released since Garrosh use the new system, and with each update of the game, more of the older Heroes are transitioned to the new system. We have plans for more improvements to AI systems too, including better danger avoidance, strategic decision making, and tactical behaviors. Please reach out on the forums with any feedback you have. We are determined to make our players’ experience with AI as enjoyable as possible.

Now, grab a friend and test your mettle versus the AI in the Nexus! Good luck.

Share this post


Link to post
Share on other sites

One thing I have been noticing is that indeed some AI Heroes are more responsive and active than others; some even respond to pings immediately.

Also, I wonder, when a player disconnects, they're is replaced by an AI of what level? Veteran? Elite? Or a completely different AI from the VS AI format?

Something else I ever wondered. Is it me or in VS AI higher difficulty Heroes deal more damage? I noticed a strikingly difference between the damage dealt by Veteran and Elite.

Share this post


Link to post
Share on other sites

This is certainly one of the best changes I've seen to this game in ages. Love how they keep improving everything and aren't forgetting about those who like to play VS AI or just happen to come across somebody who disconnects in QM. To imagine the work that goes into having them be so smart and calculate all of these things (possibilities and options are limitless) is extremely impressive. This right here is why I love Blizz.

  • Like 2

Share this post


Link to post
Share on other sites

If this is the case then it would be nice if Blizzard would list all the heroes that have had their AI versions changed over to the new system. And then ones that have been added/changed over in any new patches that come out as they do so. So we all have a better idea of this when fighting in AI matches or end up with AI controlled allies (or enemies) in any other matches.

Edited by CyberDVonaven

Share this post


Link to post
Share on other sites
14 hours ago, Valhalen said:

Something else I ever wondered. Is it me or in VS AI higher difficulty Heroes deal more damage? I noticed a strikingly difference between the damage dealt by Veteran and Elite.

I think they make different talent choices, or properly use their talents. Kael'thas is a good example, with the use of their D on different spells.

Share this post


Link to post
Share on other sites
1 hour ago, Blainie said:

I think they make different talent choices, or properly use their talents. Kael'thas is a good example, with the use of their D on different spells.

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

Share this post


Link to post
Share on other sites
2 hours ago, Valhalen said:

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

I've kinda noticed that that seems to be the case too...like I feel like I get blown up way more quickly in Elite even when I'm playing safely/well. I'm not really complaining as it does get you better/less likely to run in but it would be nice to get the exact feel for damage done to you from enemies in general (so you know how much you can push it for want of a better way of saying it)

Share this post


Link to post
Share on other sites
4 hours ago, Valhalen said:

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

I've been trying to test this, but with Auto-select AI, it's a real P.I.T.A because you can't guarantee the heroes to compare.

Share this post


Link to post
Share on other sites

Instead of reacting to a problem they should strike at its root and punish the people that leave mid game or even at spawn after blaming matchmaking.

Share this post


Link to post
Share on other sites
3 hours ago, Blainie said:

I've been trying to test this, but with Auto-select AI, it's a real P.I.T.A because you can't guarantee the heroes to compare.

Blizzard should add an option in VS AI where you can select your allies/enemies (when playing with an AI team). This would be also a good to practice against specific matchups.

Share this post


Link to post
Share on other sites

Maybe something like OpenAI that trashed Dendi, Arteezy and the others will be upon HotS soon(tm).

Also, guys, wanna listen a funny story? Was queueing for a brawl one day, it was taking a while, and you know, you get that message "AI allies & enemies may be added to shorten queue times." I get to a game eventually and... it was me vs another guy; the other 8 players were all AIs ECKS DEE.

I won in the end c:

  • Like 1

Share this post


Link to post
Share on other sites
On 9/14/2017 at 7:57 PM, Valhalen said:

Blizzard should add an option in VS AI where you can select your allies/enemies (when playing with an AI team). This would be also a good to practice against specific matchups.

Yep, not sure why they wouldn't implement it to be honest. They have AI for every hero, so why not?

Share this post


Link to post
Share on other sites

While you ask them, ask for invisible mode in the APP, please :D oh and the option to turn off "save replay" and not being forced to save them.

Share this post


Link to post
Share on other sites
7 hours ago, Caldyrvan said:

While you ask them, ask for invisible mode in the APP, please :D oh and the option to turn off "save replay" and not being forced to save them.

The community has been asking about invisible mode since the app released :p

Share this post


Link to post
Share on other sites
20 minutes ago, Caldyrvan said:

I know, that's why I mentioned it :)

We'll probably still be talking about it in 2020, thinking back to when we asked for it.

  • Like 1

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Oxygen
      Find out more about how the recently-announced 2019 gameplay changes will affect Heroes of the Storm in the long run.
      Just over a year ago, in preparation for BlizzCon 2017, I produced a lengthy article outlining some of Heroes of the Storm's most important issues. Notable among these was that of Quick Match team compositions. To me, Heroes of the Storm had always been clearly designed and balanced with tanks and healers in mind. As such, failing to enforce team compositions that included these classes caused a number of important problems across the game.
      Following disappointing BlizzCon 2017 announcements on the matter (class changes were discussed briefly, but composition changes were not), a reddit post and a blog post published six months later would confirm that changes to Quick match team compositions were indeed in the works, though no ETA was given. BlizzCon 2018 was a pretty safe bet that would turn out to be accurate.
      So, what's the big deal?
      As Heroes of the Storm's introductory - and most popular - game mode, Quick Match must absolutely accomplish two things: Groom its player base for improvement and present Heroes of the Storm in the best light possible.
      Year after year, however, the Quick Match system has continued to fail on both counts completely, discouraging new players and veterans alike with frustrating matches that taught bad habits and ultimately hindered the growth of the player base's skill level. How can players learn to follow up without a tank to initiate? How can they possibly internalize what their reasonable survivability is like against five other assassins? The answer is simple: They can't, because these situations are nonsensical and for the most part subpar in any remotely competent environment. Fortunately, this will soon be a thing of the past.
      Placing players in a tank-healer environment - around which the game was designed - leads me to believe that player base's skill level to improve across all game modes. Drafting skill is likely to improve as well, leading to fewer draft infighting situations. Further, it  will reduce the frustration caused by unreasonable team compositions to ultimately better retain new players, whom will get to experience the game as it was meant to be played as opposed to this rather ridiculous game mode.
      Needless to say, I think this is one of the best BlizzCon announcements to date, though I must still question what took so long. The most educated guess I can produce has to do with fearing longer queue times, but here's to hoping the "Call of the Nexus" incentive will be enough to entice players into checking out classes they haven't tried out just yet. A strong enough incentive could have the positive side effect of allowing players to develop a better global understanding of the game through approaching roles they're less used to.
      Classy new classes
      The new class system builds on the old system simply by further specializing the existing classes and removing specialists. Reworking the class system was necessary to allow team compositions to be reworked themselves.
      Heroes in the old warrior class were divided into the tank and bruiser classes, with tanks now being mandatory for Quick Match team compositions. This makes sense, as many bruisers were typically unable to fulfill the role of true tanks completely, which is to reliably initiate and peel. Allowing the warrior class to continue existing in its current state would have created the kind of lopsided team composition problems we experienced back when Varian was treated as a damage dealer.
      Heroes in the support class were divided into pure healers and support heroes, which is just a way of identifying heroes who do not use healing as their primary means of assisting teammates. Given that healers must now be included in team compositions to the same extent as tanks, this change also makes sense.
      The specialist class was merged with the assassin class because it hadn't made sense in a long time to treat them any differently; most of them were simply fancy damage dealers. The assassin class itself was split up into melee and ranged assassins.
      If you've been keeping up with some of the more recent versions of my tier lists - I don't blame you if you haven't - you'll note that I had already opted to further divide the classes, with a focus on play style rather than role a few months ago. Specifically, melee assassins are divided into fighters and stalkers, and ranged assassins into marksman and casters. My system has the advantage of being a bit more flexible for edge cases such as Genji and Tracer, who play more like melee assassins yet were labeled as ranged by Blizzard. Still, this distinction is of little relevance to most players.
      Conclusion
      Short conclusions mean I am happy with things.
      Oxygen discusses why the announced changes might just be the best thing to happen to HotS.
    • By Stan
      A shroud of uncertainly looms over the future of HGC and Heroes Esports as a whole due to the lack of HGC updates for the upcoming year and many pro players as well as casters are either done with the game or transferring to other games.
      Gillyweed (HGC Caster)
      The well-known female HGC caster is moving to Rocket League in 2019.
      Placeholder for tweet 1070532465503088640 Trikslyr (HGC Caster)
      Tim announced he won't be casting HGC in 2019 and he plans to make streaming his major focus.
      Placeholder for tweet 1071925490473152518 Tetcher (HGC China Caster)
      Chris voiced his uncertainty on Twitter today, following the lack of HGC information.
      Placeholder for tweet 1072029712514510849 We're going to closely monitor any announcements, so keep an eye out on the Heroes news section!
    • By Stan
      Free Hero rotation has been updated for the week of December 11.
      Free-to-Play Hero Rotation: December 11, 2018
      Raynor Muradin Sonya Nazeebo Uther Jaina Zarya Li-Ming Deckard Blaze Yrel (Slot unlocked at Player Level 5) Junkrat (Slot unlocked at Player Level 10) Tychus (Slot unlocked at Player Level 15) Whitemane (Slot unlocked at Player Level 20) (Source)
    • By Stan
      The first Season of 2019 starts next week with the release of the latest patch. New rewards are up for grabs. Check out the official preview of the Season!
      Blizzard (Source)
      Heroes of the Storm’s fourth 2018 ranked season is ending soon, and we’ve got a host of new rewards that you can earn through ranked gameplay in the coming months. Read on for details!
      Season Roll Dates
      2019 Season 1 will begin as soon as our next patch becomes available for download in each region. Check the start and end dates below to make sure you’re able to dive in as soon as the season begins:
      EVENT DATE 2019 Season 1 Start Week of December 11, 2018* 2019 Season 1 End Week of March 19, 2019* *Exact date may vary slightly by region.
      2019 Season 1 Rewards
      Players who manage to climb the ranks in the upcoming season can claim new portraits, mounts, and gold rewards for their achievements in Hero and Team League. Take a look at everything that’s up for grabs this season!
      This Season's Ranked Portraits are still in progress and will be shown at a later date. Please stay tuned!
      Mount Rewards

      HERO LEAGUE RANK REWARDS Bronze 500 Gold Bronze Hero League Portrait Silver 750 Gold Silver Hero League Portrait Gold 1000 Gold Gold Hero League Portrait Platinum 1250 Gold Season 1 Mount Platinum Hero League Portrait Diamond 1500 Gold Season 1 Mount Diamond Hero League Portrait Master 1750 Gold Season 1 Mount Epic Season 1 Mount Master Hero League Portrait Grand Master 2000 Gold Season 1 Mount Epic Season 1 Mount Grand Master Hero League Portrait TEAM LEAGUE RANK REWARDS Bronze 500 Gold Season 1 Mount Bronze Team League Portrait Silver 750 Gold Season 1 Mount Silver Team League Portrait Gold 1000 Gold Season 1 Mount Gold Team League Portrait Platinum 1250 Gold Season 1 Mount Platinum Team League Portrait Diamond 1500 Gold Season 1 Mount Diamond Team League Portrait Master 1750 Gold Season 1 Mount Epic Season 1 Mount Master Team League Portrait Grand Master 2000 Gold Season 1 Mount Epic Season 1 Mount Grand Master Team League Portrait If you’re ready to begin your Ranked Play journey in Heroes of the Storm but are unsure how, head over to our Ranked Play Guide to get started on the right foot. 
    • By Stan
      This week's brawl is Temple Arena. Harness the power of the Temples to destroy the enemy Core. The first team to win 2 rounds is victorious. Complete three matches to earn a Loot Chest.
      Blizzard (Source)
      This week’s brawl is the Temple Arena! Harness the power of the Alligator, Cobra, and Jackal Temples to destroy the enemy Core!

      Rules:
      Choose from one of three randomly selected Heroes before entering the Arena. Be quick about it though, you only have 30 seconds to choose! Everyone will begin the round at level 10 and will be asked to choose a Heroic Ability. No other talents will be available. During each round, slay the enemy team’s Heroes and capture the Temple Shrines to take shots at their Core! The Core for each team will have set amounts of health based on the number of active Shrines. Each round can have 1-3 active Shrines. The first team whose Core reaches 0 health will lose the round. Be the first team to win 2 rounds and claim victory! Rewards:
      Complete three matches of the Temple Arena to earn a Loot Chest! Find out more about the Heroes Brawl game mode on our Heroes Brawl site; and as always, you can find more information on this week’s Brawl by clicking the Brawl Info button at the bottom of the play screen when preparing to queue for the Brawl game mode.