Stan

Under the Hood AI Improvements

21 posts in this topic

QMUB01ZO4IAQ1504903265156.jpg

AI is an important element of Heroes of the Storm and Blizzard has been working hard on improvements. The updated AI can now stutter-step and has faster reaction times.

  • Blizzard is transitioning the AI from being controlled by scripts to being controlled by new systems built into the game engine.
  • AI should feel more responsive, accurate, and execute more dynamic strategies.
  • The AI can now stutter-step to keep attacking while moving into position.
  • All Heroes released since Garrosh use the new system, and with each update, more Heroes are transitioned to the new system.

Blizzard LogoBlizzard (Source)

AI is an important part of Heroes of the Storm. A significant number of games are played versus AI, and PvP games also have AI-controlled Heroes when players are disconnected. Those ever-helpful, ever-pesky minions and mercenaries are AI, too! We are passionate about bringing the best possible experience to all our players, so the AI team has been working hard on improving our AI systems. Read on for details!

What makes good AI?

There are many ways to define “good” AI, but from our perspective it’s an AI that closely matches players’ expectations. Minions and bosses need to be predictable. AI Heroes need to be very skillful. Players expect their AI Hero allies to stay safe, but also engage in team fights at the right time. There is a delicate balance between staying safe and capitalizing on opportunities. We also try to ensure the AI supports human players a little more than AI allies.

HJ3BBMLEGF691504893687724.gif

Valla Vaults into position for a Rain of Vengeance, but Stitches rescues the human player from annihilation!

Making good AI has its challenges. Many situations are complicated enough to have several valid strategies, and expectations can vary from player to player. We work closely with the game designers on our team to develop AI that models all the factors they consider important in decision making. And although we are trying to make the AI as smart as possible, we only give them access to information a regular player would have so they don’t get to cheat!

What is changing?

We are gradually transitioning the AI from being controlled by scripts to being controlled by several new systems built into the game engine. We are not trying to make the AI drastically different, but we are building systems that can be extended easily to add a lot more detail to the AI. You may notice AI Heroes being more responsive, more accurate, and executing more dynamic strategies.

Speed!

The new AI system runs many times faster than before. This has not only resulted in a slight improvement to the frame rate of the game, but it has also allowed us to update the AI more frequently! AI now have faster reaction times and they can use abilities in rapid succession. We had to drastically limit the update rate for lower difficulty AI!

Tactics

The tactics the new AI use has been enhanced to allow for a rich set of targeting options, and better positioning during fights. Examples are being able to predict the movement of targets, find clusters of targets, and filter or prioritize targets in many ways. Our designers have had a lot of fun using these new options to create more detailed AI. Kel’Thuzad’s surgical use of his abilities is a great example of this.
 
NPHJ83R9KZTC1504893668311.gif

Rather than simply moving into range of their targets, AI Heroes also try to stay out of danger. They calculate a score for many locations around the target and move to the safest one.

VJ9S46408YUW1504895126853.jpg
The AI are also now able to stutter-step to keep attacking their target while moving into position.
 
EDIQ25WUP08P1504893684375.gif

Strategy

The AI has a new system for making strategic decisions. There are many things on a map that Heroes could be doing, and each of those is considered a potential goal for the AI. Each goal has a score calculated for it and the AI Heroes on a team are then assigned to the most suitable goal. This algorithm tries to maximize the team’s chances of winning by gaining experience in lane, taking mercenary camps, and controlling map objectives. It also looks out for lone enemies that can be easily ganked—so watch out!

Development

The team is constantly working on new Heroes, Battlegrounds, and game modes. To support this rapid development pace, we created an AI editor, which allows our game designers to quickly customize each Hero’s AI. This results in higher-quality AI that has been tuned for each Hero’s play style. You may notice this when Azmodan sees you at low health and throws a long-range Globe of Annihilation to finish you off!

A major part of the new AI is a “behavior tree” system, which is a common AI technology used in games. It is called a “tree” because it branches at every possible decision the AI can make, and the ends of the branches are the actual things that the AI can do, such as moving or attacking.

The branches of the tree are modular and can be customized for different AI behavior depending on the unit, map and game mode. This type of system is essential for supporting a diverse range of Heroes and Battlegrounds.

BNT9CSG2DAIR1504893658917.png

A very small number of the 400 nodes in Valla’s behavior tree.

Future

All Heroes released since Garrosh use the new system, and with each update of the game, more of the older Heroes are transitioned to the new system. We have plans for more improvements to AI systems too, including better danger avoidance, strategic decision making, and tactical behaviors. Please reach out on the forums with any feedback you have. We are determined to make our players’ experience with AI as enjoyable as possible.

Now, grab a friend and test your mettle versus the AI in the Nexus! Good luck.

Share this post


Link to post
Share on other sites

One thing I have been noticing is that indeed some AI Heroes are more responsive and active than others; some even respond to pings immediately.

Also, I wonder, when a player disconnects, they're is replaced by an AI of what level? Veteran? Elite? Or a completely different AI from the VS AI format?

Something else I ever wondered. Is it me or in VS AI higher difficulty Heroes deal more damage? I noticed a strikingly difference between the damage dealt by Veteran and Elite.

Share this post


Link to post
Share on other sites

This is certainly one of the best changes I've seen to this game in ages. Love how they keep improving everything and aren't forgetting about those who like to play VS AI or just happen to come across somebody who disconnects in QM. To imagine the work that goes into having them be so smart and calculate all of these things (possibilities and options are limitless) is extremely impressive. This right here is why I love Blizz.

  • Like 2

Share this post


Link to post
Share on other sites

If this is the case then it would be nice if Blizzard would list all the heroes that have had their AI versions changed over to the new system. And then ones that have been added/changed over in any new patches that come out as they do so. So we all have a better idea of this when fighting in AI matches or end up with AI controlled allies (or enemies) in any other matches.

Edited by CyberDVonaven

Share this post


Link to post
Share on other sites
14 hours ago, Valhalen said:

Something else I ever wondered. Is it me or in VS AI higher difficulty Heroes deal more damage? I noticed a strikingly difference between the damage dealt by Veteran and Elite.

I think they make different talent choices, or properly use their talents. Kael'thas is a good example, with the use of their D on different spells.

Share this post


Link to post
Share on other sites
1 hour ago, Blainie said:

I think they make different talent choices, or properly use their talents. Kael'thas is a good example, with the use of their D on different spells.

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

Share this post


Link to post
Share on other sites
2 hours ago, Valhalen said:

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

I've kinda noticed that that seems to be the case too...like I feel like I get blown up way more quickly in Elite even when I'm playing safely/well. I'm not really complaining as it does get you better/less likely to run in but it would be nice to get the exact feel for damage done to you from enemies in general (so you know how much you can push it for want of a better way of saying it)

Share this post


Link to post
Share on other sites
4 hours ago, Valhalen said:

I'm not sure, I think they deal slightly increased damage overall, regardless of talents.

I've been trying to test this, but with Auto-select AI, it's a real P.I.T.A because you can't guarantee the heroes to compare.

Share this post


Link to post
Share on other sites

Instead of reacting to a problem they should strike at its root and punish the people that leave mid game or even at spawn after blaming matchmaking.

Share this post


Link to post
Share on other sites
3 hours ago, Blainie said:

I've been trying to test this, but with Auto-select AI, it's a real P.I.T.A because you can't guarantee the heroes to compare.

Blizzard should add an option in VS AI where you can select your allies/enemies (when playing with an AI team). This would be also a good to practice against specific matchups.

Share this post


Link to post
Share on other sites

Maybe something like OpenAI that trashed Dendi, Arteezy and the others will be upon HotS soon(tm).

Also, guys, wanna listen a funny story? Was queueing for a brawl one day, it was taking a while, and you know, you get that message "AI allies & enemies may be added to shorten queue times." I get to a game eventually and... it was me vs another guy; the other 8 players were all AIs ECKS DEE.

I won in the end c:

  • Like 1

Share this post


Link to post
Share on other sites
On 9/14/2017 at 7:57 PM, Valhalen said:

Blizzard should add an option in VS AI where you can select your allies/enemies (when playing with an AI team). This would be also a good to practice against specific matchups.

Yep, not sure why they wouldn't implement it to be honest. They have AI for every hero, so why not?

Share this post


Link to post
Share on other sites

While you ask them, ask for invisible mode in the APP, please :D oh and the option to turn off "save replay" and not being forced to save them.

Share this post


Link to post
Share on other sites
7 hours ago, Caldyrvan said:

While you ask them, ask for invisible mode in the APP, please :D oh and the option to turn off "save replay" and not being forced to save them.

The community has been asking about invisible mode since the app released :p

Share this post


Link to post
Share on other sites
20 minutes ago, Caldyrvan said:

I know, that's why I mentioned it :)

We'll probably still be talking about it in 2020, thinking back to when we asked for it.

  • Like 1

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Oxygen
        
      Our nineteenth Heroes of the Storm Meta Tier list for the month of May is here!
      We present our nineteenth Heroes of the Storm Meta Tier List for the month of May 2018.
      Welcome to Icy Veins's Meta Tier List for the May 9 patch. The goal of this list is to try and detail game's current metagame state. The prime goal of such lists is to inform players regarding popular and trending team composition drafting strategies (i.e. the drafting metagame). Although tier listings are generally the product of balance, many factors come into play when discussing the relative perceived strengths of heroes, including player regions, maps, play style, skill level, and, of course, personal perception. As such, any tier list—including this very one—should never be interpreted as gospel, but rather, as a guide to better grasp what to expect with regards to typical drafting experiences. One useful application of such lists is to allow you know which heroes to look out for in terms of practice and counterplay, ultimately improving your knowledge of the game.
      Using the list
      As stated above, tier lists are easy to mistake for gospel. As new strategies are discovered and experimented with, so changes the perception of the relative strengths of each hero. Tier lists still prove to be useful as a snapshot of player expectations in terms of drafting. Although it is generally considered preferable to focus on high tier heroes (Prime and Core tiers), it is important to note that Heroes of the Storm's wild character and map designs make it so that any given hero's tier position is prone to fluctuate depending on the situation at hand.
      One classic example of such is that of Kerrigan on the Infernal Shrines map. Although we currently judge her to be a mid-tier hero, her drafting priority shoots up to first-pick or first-ban material on this specific map due to the nature of its objective. Certain heroes also synergise so well with each other that the sole fact of having the opportunity of drafting them together is generally enough to increase their potential. Tassadar and Tracer, for instance, are generally nightmarish to deal with for many. There are too many examples of these interactions to reasonably produce here, but we invite you to consult our guides to know exactly where and when each hero shines. The guides have been linked in the lists below for your convenience - just click any of the hero names to access them.
      A ↑ next to a hero's name means its tier list position has increased since the previous month whereas a ↓ means just the opposite. Additionally, a + or - sign indicates short-to-medium term predictions (which is to say, about a month) for tier increase(s) or decrease(s), respectively. These are often updated after significant balance patches and/or when clear trends are emerging.
      If you're newer to the game, also consider visiting our glossary for a comprehensive list of discrete Heroes of the Storm terms.
      Current ranked mode map rotation
       
      Prime Tier
      Warrior Assassin Support Specialist Diablo Genji Malfurion - E.T.C. Fenix  Stukov   Garrosh↑ Maiev-     Sonya Thrall     Prime tier heroes are considered to be extremely strong in all situations, and show no obvious weakness. They are very often banned or picked right away, as they generally dictate the pace of most matches.
       
      Core Tier
      Warrior Assassin Support Specialist Arthas Falstad Alexstrasza Abathur Blaze   Greymane Deckard (new) Azmodan Dehaka Hanzo↓ Li Li Nazeebo Johanna Jaina Lt. Morales Sylvanas- Muradin Junkrat Lúcio  Zagara Stitches Li-Ming Uther   Varian (Taunt) Malthael       Tracer     Core tier heroes are strong in a wide variety of situations and have few counter-picking possibility. They should form the core of your team, and be picked after Prime Tier heroes have been distributed.
       
      Viable Tier
      Warrior Assassin Support Specialist Anub'arak Alarak Auriel Gazlowe↑ Artanis Cassia Brightwing- Medivh+ D.Va Chromie Kharazim Murky Leoric Gul'dan Rehgar Xul Tyrael  Kael'thas Tyrande-   Zarya Kel'Thuzad+       Kerrigan       Lunara       Nova       Ragnaros       Samuro       The Butcher       Tychus+       Varian (Colossus Smash)↑       Valla       Zeratul       Zul'jin     Viable tier heroes are generally well-rounded that have either fallen out of favour, or, inversely, are on the rise in popularity, due to the current Prime tier contenders.
       
      Niche Tier
      Warrior Assassin Support Specialist Chen Cho'gall Ana Probius Cho'gall Illidan↓ Tassadar Sgt. Hammer Rexxar Raynor       Valeera       Varian (Twin Blades of Fury)     Niche tier heroes have niche application on certain maps or for certain team compositions. They may also picked to "round out" your team composition when your team composition is missing out on key components, such as a "jungler" (mercenary camps), a solo laner, or solid waveclear.
       
      Lost Vikings Tier
      The Lost Vikings The Lost Viking are deemed to be either considerably weaker than the majority of other Heroes, or much more challenging to play properly. Although they may situationally shine, this notoriously poorly designed trio is generally avoided by most players.
       
      Metagame assessment
      Tanky meta featuring a tonne of crowd control. Most fights come down to who gets caught out of position first. The natural counters to a tanky meta is typically a double support meta, but Blizzard's recent crusade against support heroes and general design trend embracing overspecialization (i.e. healers can't deal damage or have waveclear, with Deckard being the pinnacle of such) makes this unlikely to happen unless there are more radical changes inbound. In other words, I feel like we may be stuck with what we see.
      Deckard: Fits right in the current metagame with outstanding follow up to any initiation in the form of Scroll Of Sealing, high healing (though weak against displacement effects), great adaptive talents (notably, Emerald against any burst target and Kanai's Cube as a counter to burst) and armor to make him surprisingly difficult to kill. His biggest weakness might be lacking a Cleanse equivalent, though this is becoming more and more common.
      Garrosh: Doesn't do well against Diablo, but wreaks havoc against many other tanks. Particularly strong right now due to being more or less unburstable on top of bringing his super reliable cleansing effect in Indomitable. High high armor works well with sustain healers who basically populate the two highest tiers of healers, bar Uther.
      Hanzo: Excessive basic attack range allowed him to overshadow every other attack-based assassin bar Fenix. Reducing his range by about 15% puts him in right in range of a number of several movement abilities on top of giving him less breathing room against casters. This results in either reduced survivability or damage dealing potential, and in the inability to attack turrets without retaliation. His waveclear and evasiveness were also hit for good measure (through Explosive Arrows damage and Natural Agility range nerfs, respectively). He remains a fine hero, though nowhere near as oppressive, and nowhere near as safe for newer players. I don't expect him to do well in lower leagues.
      Illidan: A feast-or-famine design that feels outdated in terms of depth, overshadowed in the face of rampant mobility creep, and out of meta versus so much crowd control. This will remain the case as long as he is balanced so tightly around using Betrayer's Thirst.
    • By Stan

      Heroes of the Storm Highlights are back with episode 109 of WTF Moments.
      The latest episode starts off with a Hook & Wrecking Ball combo, executed six times in the same match. Poor Alexstrasza and Blaze! Next, we have an unlucky Fenix that gets tossed by the Dragon Knight straight into Gazlowe's Deth Lazor. Definitely check out the insane Genji gameplay at the end of the video (08:50)!
      Let us know your favorite moments in the comments below and don't forget to submit your replays here for a chance to be featured in an upcoming episode of the series.
      Previous Episodes
      WTF Moments Episode 108 WTF Moments Episode 106 & 107 WTF Moments Episode 105
    • By Stan

      The Combat Medic and the Dark Prelate will be on sale next week for 375 Gems and Abyssal Deathbringer Sonya joins the fray for the first time!
      Blizzard (Source)
      Heroic Deals: May 22 – 28, 2018 
      Our next set of Heroic Deals will begin on Tuesday, May 22! Check out the list of upcoming featured items and Hero discounts below.  Upcoming Hero Sales
      Zeratul — Sale Price: 375 Gems Lt. Morales— Sale Price: 375 Gems The following skins and mounts will be added to the featured item rotation and will become purchasable with gems until this round of Heroic Deals comes to an end:
      Upcoming Featured Skins
      Night Ronin Zeratul  Prototype Love Doctor Morales  Abyssal Deathbringer Sonya*  Dreambreaker Thrall  Cruel Queen of Ghosts Kerrigan  Kandy King Muradin  Overqueen Zagara  Elite Agent Nova  * First time featured item!
      Upcoming Featured Mounts
      Hunter Felsaber Demon  Hellboar
    • By Stan

      Mineral Madness returns as this week's brawl! The objective is to collect Minerals, gain access to special abilities and destroy the enemy Core on the single-lane Starcraft-themed battleground. Play three games to receive a Loot Chest.
      Blizzard (Source)
      Rally your troops and prepare to battle over the Koprulu Sector’s most valuable resource – Minerals! This week’s Brawl is a StarCraft themed mechanical mad dash for Minerals!
      Rules & Details
      Load into a single-lane StarCraft themed battleground and battle to collect Minerals and bring down the enemy Core. SCVs carrying Minerals will be escorted with every Minion wave SCVs are destroyed after 2 hits and are Invulnerable until their escorting Ranged Minion is killed. SCVs drop between 5 and 8 minerals when destroyed, which can be collected by Heroes. Heroes killed while holding Minerals will drop half of their current reserve. Upon reaching 50 Minerals, Heroes consume their gathered Minerals to gain an aura with the following effects:  Instantly destroy Minions Periodically damage nearby enemy Heroes Disable nearby Structures Periodically drop Minerals which enemy Heroes can gather The first team to take down the enemy Core will be declared victorious! Rewards
      Complete three matches of Mineral Madness to earn a Loot Chest! Find out more about the Heroes Brawl game mode on our Brawl site; and as always, you can find more information on this week’s Brawl by clicking the Brawl Info button at the bottom of the play screen when preparing to queue for this exciting new game mode.
    • By Stan

      Mineral Madness is here to celebrate StarCraft's 20th anniversary! The main objective is to collect Minerals and destroy the enemy Core. Complete three games to earn a a Loot Chest.
      Upon collecting 50 Minerals, players can consume them and gain access to special abilities.
      Blizzard (Source)
      Rally your troops and prepare to battle over the Koprulu Sector’s most valuable resource – Minerals! To celebrate StarCraft’s 20th anniversary, this week’s Brawl is a StarCraft themed mechanical mad dash for Minerals!
      Rules & Details
      Load into a single-lane StarCraft themed battleground and battle to collect Minerals and bring down the enemy Core. SCVs carrying Minerals will be escorted with every Minion wave SCVs are destroyed after 2 hits and are Invulnerable until their escorting Ranged Minion is killed. SCVs drop between 5 and 8 minerals when destroyed, which can be collected by Heroes. Heroes killed while holding Minerals will drop half of their current reserve. Upon reaching 50 Minerals, Heroes consume their gathered Minerals to gain an aura with the following effects:  Instantly destroy Minions Periodically damage nearby enemy Heroes Disable nearby Structures Periodically drop Minerals which enemy Heroes can gather The first team to take down the enemy Core will be declared victorious! Rewards
      Complete three matches of Mineral Madness to earn a Loot Chest! Find out more about the Heroes Brawl game mode on our Brawl site; and as always, you can find more information on this week’s Brawl by clicking the Brawl Info button at the bottom of the play screen when preparing to queue for this exciting new game mode.