Stan

Under the Hood AI Improvements

21 posts in this topic

QMUB01ZO4IAQ1504903265156.jpg

AI is an important element of Heroes of the Storm and Blizzard has been working hard on improvements. The updated AI can now stutter-step and has faster reaction times.

  • Blizzard is transitioning the AI from being controlled by scripts to being controlled by new systems built into the game engine.
  • AI should feel more responsive, accurate, and execute more dynamic strategies.
  • The AI can now stutter-step to keep attacking while moving into position.
  • All Heroes released since Garrosh use the new system, and with each update, more Heroes are transitioned to the new system.

Blizzard LogoBlizzard (Source)

AI is an important part of Heroes of the Storm. A significant number of games are played versus AI, and PvP games also have AI-controlled Heroes when players are disconnected. Those ever-helpful, ever-pesky minions and mercenaries are AI, too! We are passionate about bringing the best possible experience to all our players, so the AI team has been working hard on improving our AI systems. Read on for details!

What makes good AI?

There are many ways to define “good” AI, but from our perspective it’s an AI that closely matches players’ expectations. Minions and bosses need to be predictable. AI Heroes need to be very skillful. Players expect their AI Hero allies to stay safe, but also engage in team fights at the right time. There is a delicate balance between staying safe and capitalizing on opportunities. We also try to ensure the AI supports human players a little more than AI allies.

HJ3BBMLEGF691504893687724.gif

Valla Vaults into position for a Rain of Vengeance, but Stitches rescues the human player from annihilation!

Making good AI has its challenges. Many situations are complicated enough to have several valid strategies, and expectations can vary from player to player. We work closely with the game designers on our team to develop AI that models all the factors they consider important in decision making. And although we are trying to make the AI as smart as possible, we only give them access to information a regular player would have so they don’t get to cheat!

What is changing?

We are gradually transitioning the AI from being controlled by scripts to being controlled by several new systems built into the game engine. We are not trying to make the AI drastically different, but we are building systems that can be extended easily to add a lot more detail to the AI. You may notice AI Heroes being more responsive, more accurate, and executing more dynamic strategies.

Speed!

The new AI system runs many times faster than before. This has not only resulted in a slight improvement to the frame rate of the game, but it has also allowed us to update the AI more frequently! AI now have faster reaction times and they can use abilities in rapid succession. We had to drastically limit the update rate for lower difficulty AI!

Tactics

The tactics the new AI use has been enhanced to allow for a rich set of targeting options, and better positioning during fights. Examples are being able to predict the movement of targets, find clusters of targets, and filter or prioritize targets in many ways. Our designers have had a lot of fun using these new options to create more detailed AI. Kel’Thuzad’s surgical use of his abilities is a great example of this.
 
NPHJ83R9KZTC1504893668311.gif

Rather than simply moving into range of their targets, AI Heroes also try to stay out of danger. They calculate a score for many locations around the target and move to the safest one.

VJ9S46408YUW1504895126853.jpg
The AI are also now able to stutter-step to keep attacking their target while moving into position.
 
EDIQ25WUP08P1504893684375.gif

Strategy

The AI has a new system for making strategic decisions. There are many things on a map that Heroes could be doing, and each of those is considered a potential goal for the AI. Each goal has a score calculated for it and the AI Heroes on a team are then assigned to the most suitable goal. This algorithm tries to maximize the team’s chances of winning by gaining experience in lane, taking mercenary camps, and controlling map objectives. It also looks out for lone enemies that can be easily ganked—so watch out!

Development

The team is constantly working on new Heroes, Battlegrounds, and game modes. To support this rapid development pace, we created an AI editor, which allows our game designers to quickly customize each Hero’s AI. This results in higher-quality AI that has been tuned for each Hero’s play style. You may notice this when Azmodan sees you at low health and throws a long-range Globe of Annihilation to finish you off!

A major part of the new AI is a “behavior tree” system, which is a common AI technology used in games. It is called a “tree” because it branches at every possible decision the AI can make, and the ends of the branches are the actual things that the AI can do, such as moving or attacking.

The branches of the tree are modular and can be customized for different AI behavior depending on the unit, map and game mode. This type of system is essential for supporting a diverse range of Heroes and Battlegrounds.

BNT9CSG2DAIR1504893658917.png

A very small number of the 400 nodes in Valla’s behavior tree.

Future

All Heroes released since Garrosh use the new system, and with each update of the game, more of the older Heroes are transitioned to the new system. We have plans for more improvements to AI systems too, including better danger avoidance, strategic decision making, and tactical behaviors. Please reach out on the forums with any feedback you have. We are determined to make our players’ experience with AI as enjoyable as possible.

Now, grab a friend and test your mettle versus the AI in the Nexus! Good luck.

Share this post


Link to post
Share on other sites

One thing I have been noticing is that indeed some AI Heroes are more responsive and active than others; some even respond to pings immediately.

Also, I wonder, when a player disconnects, they're is replaced by an AI of what level? Veteran? Elite? Or a completely different AI from the VS AI format?

Something else I ever wondered. Is it me or in VS AI higher difficulty Heroes deal more damage? I noticed a strikingly difference between the damage dealt by Veteran and Elite.

Share this post


Link to post
Share on other sites

This is certainly one of the best changes I've seen to this game in ages. Love how they keep improving everything and aren't forgetting about those who like to play VS AI or just happen to come across somebody who disconnects in QM. To imagine the work that goes into having them be so smart and calculate all of these things (possibilities and options are limitless) is extremely impressive. This right here is why I love Blizz.

  • Like 2

Share this post


Link to post
Share on other sites

If this is the case then it would be nice if Blizzard would list all the heroes that have had their AI versions changed over to the new system. And then ones that have been added/changed over in any new patches that come out as they do so. So we all have a better idea of this when fighting in AI matches or end up with AI controlled allies (or enemies) in any other matches.

Edited by CyberDVonaven

Share this post


Link to post
Share on other sites
14 hours ago, Valhalen said:

Something else I ever wondered. Is it me or in VS AI higher difficulty Heroes deal more damage? I noticed a strikingly difference between the damage dealt by Veteran and Elite.

I think they make different talent choices, or properly use their talents. Kael'thas is a good example, with the use of their D on different spells.

Share this post


Link to post
Share on other sites
1 hour ago, Blainie said:

I think they make different talent choices, or properly use their talents. Kael'thas is a good example, with the use of their D on different spells.

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

Share this post


Link to post
Share on other sites
2 hours ago, Valhalen said:

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

I've kinda noticed that that seems to be the case too...like I feel like I get blown up way more quickly in Elite even when I'm playing safely/well. I'm not really complaining as it does get you better/less likely to run in but it would be nice to get the exact feel for damage done to you from enemies in general (so you know how much you can push it for want of a better way of saying it)

Share this post


Link to post
Share on other sites
4 hours ago, Valhalen said:

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

I've been trying to test this, but with Auto-select AI, it's a real P.I.T.A because you can't guarantee the heroes to compare.

Share this post


Link to post
Share on other sites

Instead of reacting to a problem they should strike at its root and punish the people that leave mid game or even at spawn after blaming matchmaking.

Share this post


Link to post
Share on other sites
3 hours ago, Blainie said:

I've been trying to test this, but with Auto-select AI, it's a real P.I.T.A because you can't guarantee the heroes to compare.

Blizzard should add an option in VS AI where you can select your allies/enemies (when playing with an AI team). This would be also a good to practice against specific matchups.

Share this post


Link to post
Share on other sites

Maybe something like OpenAI that trashed Dendi, Arteezy and the others will be upon HotS soon(tm).

Also, guys, wanna listen a funny story? Was queueing for a brawl one day, it was taking a while, and you know, you get that message "AI allies & enemies may be added to shorten queue times." I get to a game eventually and... it was me vs another guy; the other 8 players were all AIs ECKS DEE.

I won in the end c:

  • Like 1

Share this post


Link to post
Share on other sites
On 9/14/2017 at 7:57 PM, Valhalen said:

Blizzard should add an option in VS AI where you can select your allies/enemies (when playing with an AI team). This would be also a good to practice against specific matchups.

Yep, not sure why they wouldn't implement it to be honest. They have AI for every hero, so why not?

Share this post


Link to post
Share on other sites

While you ask them, ask for invisible mode in the APP, please :D oh and the option to turn off "save replay" and not being forced to save them.

Share this post


Link to post
Share on other sites
7 hours ago, Caldyrvan said:

While you ask them, ask for invisible mode in the APP, please :D oh and the option to turn off "save replay" and not being forced to save them.

The community has been asking about invisible mode since the app released :p

Share this post


Link to post
Share on other sites
20 minutes ago, Caldyrvan said:

I know, that's why I mentioned it :)

We'll probably still be talking about it in 2020, thinking back to when we asked for it.

  • Like 1

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Stan

      The free Hero rotation has been updated for the week of September 26.
      Free-to-Play Hero Rotation: September 26, 2017
      The following Heroes are on rotation this week:
      Raynor Muradin Sonya Nazeebo Uther Jaina Tychus Brightwing Ragnaros Tyrande Gul'dan (Slot unlocked at Player Level 5) Sgt. Hammer (Slot unlocked at Player Level 10) D.Va (Slot unlocked at Player Level 15) Rexxar (Slot unlocked at Player Level 20) (Source)
    • By Stan

      It's time for a new Heroes Brawl and this week it's Silver City - a single-lane battleground straight out of the High Heavens. Shuffle pick and standard play with no talent restrictions apply. The first team to destroy the enemy Core wins. Play two games to earn a Loot Chest.
      Update #2: The issue has been fixed.
      Update: There seems to be a bug with this week's brawl and credit toward earning a Loot Chest is tagged as completed from last week. Relogging does not solve the issue and playing a brawl does not count toward the credit or fix the problem either.
      Blizzard (Source)
      This week’s Heroes Brawl is Silver City! Battle against the enemy team on this single-lane Battleground featuring a familiar design straight out of the High Heavens, Mercenary Camps ready to be swayed to your team’s favor, and tons of action. Queue up, choose your hero, and try your best to send the enemy team to the Burning Hells!
      Rules:
      Shuffle pick - Choose from one of three Heroes before entering the battle. Standard play - no talent or level restrictions. The first team to destroy the enemy Core wins! Rewards:
      Complete two matches of the Silver City Brawl to earn a Loot Chest! Find out more about the new Heroes Brawl game mode on our Heroes Brawl site; and as always, you can find more information on this week’s Brawl by clicking the Brawl Info button at the bottom of the play screen when preparing to queue for the Brawl game mode.
    • By Stan

      Weekly sales have been updated for the week of September 26. Get Cassia, Zeratul and other skins & mounts at a reduced price.
      Blizzard (Source)
      Weekly Collection Update: Sept 26 – Oct 3, 2017
      Next week's Collection Update will begin on Tuesday, September 26! Check out the new list of featured items and Hero discounts below.  Upcoming Hero Sales
      Cassia — Sale Price: 375 Gems Zeratul — Sale Price: 375 Gems The following Skins and Mounts will enter the Featured Item Rotation, and will be unlockable using Gems until next week's Collection Update:
      Upcoming Featured Skins
      Pirate Queen Cassia Golden Unraveler Zeratul Azure Grimskull Nazeebo Techno Super Sonya Lurkablo Amber Ghost Tracer Pajamathur Abathur Storm Wolf Rehgar Upcoming Featured Mounts
      Marshal's Outrider Verdant Magic Carpet Weekly Sale Bundle
      If you’d rather pick up everything at once, we’re also going to add a new Weekly Sale Bundle to the Featured tab in your Collection. This limited-time bundle contains all of the items above at a discounted Gem price, but will only be available until next week’s Collection Update takes place.
    • By Stan

      In next week's patch, Loot Chests purchased via the Loot tab will be only of Rare quality. The change only applies to Loot Chests purchased after next week's patch goes live, so it's best to hold off Loot Chest purchases until then.
      Other changes
      Celestial Steed Mount has been removed and replaced by Celestial Raptor. The Welcome Bundle has been removed from the Collection. 1,000 Gem reward at level 5 has been removed. The collection adjustments have been taken from the latest patch notes.
      Blizzard (Source)
      Collection
      Collection Adjustments
      Loot Chests Loot Chests purchased via the Loot tab will now only grant Rare Loot Chests, rather than Normal Loot Chests. Please note: This only applies to Loot Chests purchased after this patch is applied to the live version of the game in each region. Normal Loot Chests the player already owns will not convert to Rare Loot Chests. Rewards The Celestial Steed Mount has been removed and replaced by the Celestial Raptor as a reward for purchasing Loot Chests. The 1,000 Gem reward for reaching level 5 has been removed. Please note: Veteran players who have not logged in following the release of Heroes 2.0 earlier this year will no longer be able to claim this reward once this patch is applied to the live version of the game in each region. Bundles The Welcome Bundle has been removed from the Collection.
    • By Oxygen

      We present our tenth Heroes of the Storm Meta Tier List for the Kel'Thuzad patch of September 2017.
      Our tenth Heroes of the Storm Meta Tier List for the month of September 2017 is here!
      Welcome to Icy Veins's Meta Tier List for the Kel'Thuzad patch. The goal if of this list is to try and detail game's current metagame state. The prime goal of such lists is to inform players regarding popular and trending team composition drafting strategies (i.e. the drafting metagame). Although tier listings are generally the product of balance, many factors come into play when discussing the relative perceived strengths of heroes, including player regions, maps, play style, skill level, and, of course, personal perception. As such, any tier list—including this very one—should never be interpreted as gospel, but rather, as a guide to better grasp what to expect with regards to typical drafting experiences. One useful application of such lists is to allow you know which heroes to look out for in terms of practice and counterplay, ultimately improving your knowledge of the game.
      Using the list
      As stated above, tier lists are easy to mistake for gospel. As new strategies are discovered and experimented with, so changes the perception of the relative strengths of each hero. Tier lists still prove to be useful as a snapshot of player expectations in terms of drafting. Although it is generally considered preferable to focus on high tier heroes (Prime and Core tiers), it is important to note that Heroes of the Storm's wild character and map designs make it so that any given hero's tier position is prone to fluctuate depending on the situation at hand.
      One classic example of such is that of Kerrigan on the Infernal Shrines map. Although we currently judge her to be a low-to-mid-tier hero, her drafting priority shoots up to first-pick or first-ban material on this specific map due to the nature of its objective. Certain heroes also synergise so well with each other that the sole fact of having the opportunity of drafting them together is generally enough to increase their potential. Tassadar and Tracer, for instance, are generally nightmarish to deal with for many. There are too many examples of these interactions to reasonably produce here, but we invite you to consult our guides to know exactly where and when each hero shines. The guides have been linked in the lists below for your convenience - just click any of the hero names to access them.
      A ↑ next to a hero's name means its tier list position has increased since the previous month whereas a ↓ means just the opposite. Additionally, a + or - sign indicates short-to-medium term predictions (which is to say, about a month) for tier increase(s) or decrease(s), respectively. These are often updated after significant balance patches and/or when clear trends are emerging.
      If you're newer to the game, also consider visiting our glossary for a comprehensive list of discrete Heroes of the Storm terms.
       
      Prime Tier
      Warrior Assassin Support Specialist Anub'arak- Genji Uther - Arthas↑ Greymane Tassadar   Dehaka↑ Malthael     Stitches-               Prime tier heroes are considered to be extremely strong in all situations, and show no obvious weakness. They are very often banned or picked right away, as they generally dictate the pace of most matches.
       
      Core Tier
      Warrior Assassin Support Specialist Diablo Falstad Auriel Nazeebo E.T.C. Jaina↑ Rehgar Sylvanas Garrosh Li-Ming Stukov Xul Leoric↑- Valla Malfurion↑   Sonya Zeratul     Varian (Tank)-       Core tier heroes are strong in a wide variety of situations and have few counter-picking possibility. They should form the core of your team, and be picked after Prime Tier heroes have been distributed.
       
      Viable Tier
      Warrior Assassin Support Specialist Artanis Alarak Brightwing Abathur Chen Cassia Kharazim Azmodan D.Va Chromie+? Li Li Murky↑ Johanna Gul'dan↓ Lt. Morales+? Probius Muradin+ Illidan↑ Lúcio Zagara Tyrael Kael'thas Tyrande+   Zarya Lunara       Ragnaros       The Butcher↓       Tracer       Varian (Damage)       Zul'jin       Kel'Thuzad (new!)     Viable tier heroes are generally well-rounded that have either fallen out of favour, or, inversely, are on the rise in popularity, due to the current Prime tier contenders.
       
      Niche Tier
      Warrior Assassin Support Specialist Cho'gall Cho'gall - Gazlowe Rexxar Kerrigan   Medivh   Nova   Sgt. Hammer   Raynor       Samuro↓       Valeera       Thrall↓       Tychus     Niche tier heroes have niche application on certain maps or for certain team compositions. They are generally picked to "round out" your team composition when your team composition is missing out on key components, such as a "jungler" (mercenary camps), a solo laner, or solid waveclear.
       
      Bottom Tier
      The Lost Vikings Bottom tier Heroes are deemed to be either considerably weaker than the majority of other Heroes, or much more challenging to play properly. Although they may situationally shine, these Heroes are generally avoided by most players.
       
      Metagame assessment
      Kel'Thuzad is excessively powerful under perfect conditions, but is kept in check by the numerous top tier heroes that are either too mobile to reliably hit with Chains of Kel'Thuzad or too resilient to burst down. In this regard, he fits well within Blizzard's recent obsession with making heroes have their own little niche and whatnot. He's doing really fine, sitting at a very reasonable 48%-something w/l ratio, but try to late- or last-pick him when Genji and Tracer and the likes aren't around to make your existence a living hell. I expect him to become better over time as players themselves become  better at picking him appropriately and when the typical hype finally dies down. And don't end up having to solo lane if you like completing Master of the Cold Dark.
      Self-sustain bruiser-like tanks are the hot thing nowadays. With a metagame that either tries to outsustain the other with two supports, or empower Genji-Greymane-Illidan-Malthael-Tracer-Valla-or-so, surviving a lot while outputting a reasonable amount of sustained damage is great. That's Arthas and Dehaka, right now. A bit ago, Anub'arak and Stitches had their turn, but I expect them to go down in popularity.
      Both Jaina and Leoric got significant buffs through their reworks. Jaina is just objectively better, with Frostbite providing Ice Block by level 8-12 rather than 20, and Summon Water Elemental getting its cooldown shaved by a massive 20 seconds. Leoric is more of a sidegrade, but he's exceptional at dealing with popular tanks, has neat waveclear, and can mess with combos with Omnious Wraith. And, of course, March of the Black King was buffed nicely as well to give him some more burst survivability and combo potential.
      I'm holding judgement about Chromie, but I expect she might be better than she was, and I already considered her borderline Core tier material. Of course, her new Sand Blast design will make it so that better players will do better than before with her, and worse players will do worse, so we're likely to see more fringe cases.
      The Butcher got a pretty big nerf. The hype train was short lived, but, in the end, this is probably for the best.
      Gul'dan, Samuro, and Thrall are simply falling out of meta; being a caster without baseline crowd control or an immobile melee assassin is pretty hard nowadays. I still think Gul'dan is in a great place on Braxis Holdout, though the resurgence of Jaina and the... uh, more of Chromie might push him off a bit.
      I wish I had a bit more to say, but besides the latest reworks, not that much has changed. I will underline, however, that these reworks have been solid. I didn't mention anything about Lt. Morales, but I do think she's better off than before; we'll need a bit more data to assess whether I'll give her a tier.

      Thanks for reading!