Stan

Comments on Performance-Based Matchmaking by Lead Systems Designer Travis McGeathy

11 posts in this topic

MSKG7EUORNAF1456364705258.jpg

Redditor Elitesparkle gathered insightful comments by Lead Systems Designer Travis McGeathy about the upcoming performance-based matchmaking system.

Heroes of the Storm will be soon updated with a new MMR system that takes individual gameplay into account. The current system is limited to wining / losing a game. The new system is more accurate, because it uses various parameters to calculate your MMR. Lead Systems Designer Travis McGeathy answered some interesting questions about the new system over on reddit.

Screenshots from the What's Next Panel

The 2018 update is scheduled for mid-December.

CPcfp1u.jpgUTdXHOA.jpgsN0oZWC.jpg

Blizzard LogoBlizzard (Source)

Any changes also planned for uncertainty?

Uncertainty doesn't exist in the same form in the new system. The core concept of something that limits how much MMR can adjust on a per-game basis is there, but the factors that go into it are different.

Looks like new system promotes maining a few heroes rather than flexibility, true or not, and how big is the impact if true?

The most important thing is still winning the game. That hasn't changed. Sometimes, that means sticking to heroes you know really well. Other times, that means having flexibility in your hero roster and playing the heroes that best fit the situation.

Might be a stupid question, but if it's only about winning, why do we have stats-based MMR? why the win isn't the only factor? Isn't the concept of stats-based MMR less accurate than the winrate itself to calculate your odd of winning?

It's about speed more than accuracy. The current system, based entirely on wins vs loses, works, but because your skill is diluted in a team of 5, unless you are dramatically better (or worse) than the rest of the team, it can take a large number of games before the difference in skill translates to more wins (or loses) and moves your MMR to where it should be. By factoring in individual skill to the equation, it can arrive at the proper MMR much faster which means the matchmaker can make better matches overall.

Is draft/banning taken into account? Choosing the right hero in draft may be more important than performing better than peers on a certain hero.

Drafting matters in the same way as the above statement. Drafting is a skill and how well you draft affects your win rate.

All in all, do you have some additional insight into what parameters are used? How zoning, peeling, bodyblocking, skillshot blocking is taken into account? How will Force Wall-Tassadar be able to compete with Archon-Tassadar?

We have great insight into what parameters are used...but aren't going into that level of detail externally.

Also do you plan to add more parameters in the mix?

We'll add more parameters as it makes sense.

There's some concern about how reliable is data on low played heroes — maybe like Chen, Rexxar, TLV, anything on that? (Though I can't imagine any answer here but "we think our data is reliable enough" :D)

We have more than enough data on all existing heroes. For new heroes or major reworks, the performance-based adjustments will basically be disabled until enough data exists.

Are we right to assume that new MMR calculation would be applied to all game modes? For QM, it looks like a step in the direction of per-hero MMR, do you think we may end up there, or at least do you think it may be viable to maintain?

It will apply to all game modes that have MMR.

Can you win a game yet still lose MMR points? IE: a player goes full tilt, intentionally tries to throw. But the other 4 players are just dominating and still win the game.

No. You'll only gain points on a win and lose them on a loss. If you get full carried for a game, you won't lose points, but you also aren't going to gain very many either.

I think people's main concerns are along the lines of "who determines which stats are important" and "why these stats and not these other ones". I assume you guys are running some kind of adaptive machine learning, but most people are not going to understand that so maybe some kind of brief summary into how that works can help to alleviate the main concerns. Just a suggestion.

Quite right. For the "who determines which stats are important", its the players. We've chosen the stats to monitor, but which ones are important for that situation is something we are measuring, not determining ourselves.

About revealing MMR and the general clarity. Assuming "no" on "if you're going to reveal MMR" (:D) I'd like to ask whether we would be able to see when the adjustment takes place on the post-match screen, like we see PRA now.

We won't have visible MMR for this update, but I do still want to do it in the future. For now, you'll mainly see the effects through rank points. We're planning to swap out personal rank adjustment for a more direct performance adjustment which will give better insight while filling a similar role of keeping rank close to MMR. I'm not sure right now whether that will be for this season or the next yet.

Spot on and part of why visible MMR hasn't been a big priority for us but, there are some advantages to it:
- Currently, rank is the only visible indicator of skill. This forces us to link rank to MMR so they don't diverge too much because players get upset when they see people of different rank in their games even if they are actually the same skill. That's not ideal and leads to oddities with matchmaking when rank and MMR do diverge.
- Even though we don't show MMR, players have created other sources to approximate their MMR. The information isn't very accurate, but being the only source of knowledge, it gets cited frequently when players feel there are issues with matchmaking. There's two issues here: first, it gives a false impression that matchmaking is poor for some players and second, it makes it harder to understand when there are actually issues with matchmaking since the real issues can get buried. Effectively, for players that really care about MMR, we already have most of the downsides associated with visible MMR without having the upsides of it being accurate information.

But what order of magnitude are you all thinking? 10 points? 20, 50? Just trying to get a rough understanding of the overall impact it might have on gaining.

That's a tuning point we haven't settled on yet.

The system, unless specifically programmed to do otherwise, will think a death at the last moment is extremely meaningful since it is normally a 60s death timer.

Time is factored into the measurements. If you're dead for the last few seconds of a match, there wouldn't be any measurable impact relative to everything else that happened that game.

Regarding the new performance based MMR changes, does this mean if my team has captured the winning altar on Towers of Doom and for the fun of it I walk into the enemy death zone and die, my MMR will be adversely affected from this little bit of fun? Or perhaps there are 5 enemies killing my core and there are 4 allies dead. I have no chance to defend the core but rather than try and risk receiving an extra death I won't lose as much MMR if I stay in base? Curious about this.

Everything is by time, including deaths. If you die in the last second of a match, its not going to mean much. Even a full death in the last minutes would really only be a minor modifier overall once diluted against your overall performance in the game. The biggest factor for MMR adjustment is still whether you won or lost. Your overall performance is secondary to that and any particular moment is just a small part of that overall performance.

Does this mean that winning a game quickly and playing well will reward the same personal adjustment as having good stats in a long game? Some people are concerned that players will want to artificially extend game lengths to try and pad their stats before winning. Especially in games where the opponent is greatly outmatched.

Yeah, definitely. Everything factors game time into it for that exact reason.

Share this post


Link to post
Share on other sites

My conclusions:

-Win ratio is the most important

-Game lenght does not affect performance

-It might promote the usage of the same hero(he tried not to give a clear answear so this means the answear wouldn't please the players)

-We still don't know how MMR is calculated.

Share this post


Link to post
Share on other sites
11 hours ago, Stan said:

The most important thing is still winning the game. That hasn't changed. Sometimes, that means sticking to heroes you know really well. Other times, that means having flexibility in your hero roster and playing the heroes that best fit the situation.

That will force people to actually learn the Heroes in Try Mode or VS AI before compromising entire team compositions because they don't know how things work. For instance, we all know that "Nova main" who doesn't even know that the red eye icon means you've been detected.

Share this post


Link to post
Share on other sites

I was hoping new system would go away from winning being only major parameter, because it's team statistic, not something that is entirely upon you.

I'll only mention one other system from I game I used to play, WN8 for World of Tanks.
This measure is community driven, nothing official. Despite being system, well, that calls out for  stat-whoring people (don't know other word), it's really hard to do so that you aren't actively winning. Main component to WN8 was doing damage and assisting others in doing damage, only way to break system was to be able to somehow do a lot of damage on game that will be lost, really hard to do. 
Winrate is part of it, but it only made a small portion.

I'm not sure why are they persistent on winning being main driver of what happens with your MMR.
 

Can you win a game yet still lose MMR points? IE: a player goes full tilt, intentionally tries to throw. But the other 4 players are just dominating and still win the game.

No. You'll only gain points on a win and lose them on a loss. If you get full carried for a game, you won't lose points, but you also aren't going to gain very many either."

They stated it themselves, it's still not accurate in those extremities.

Edited by SleepySheepy

Share this post


Link to post
Share on other sites
2 hours ago, SleepySheepy said:

I was hoping new system would go away from winning being only major parameter, because it's team statistic, not something that is entirely upon you.

I'll only mention one other system from I game I used to play, WN8 for World of Tanks.
This measure is community driven, nothing official. Despite being system, well, that calls out for  stat-whoring people (don't know other word), it's really hard to do so that you aren't actively winning. Main component to WN8 was doing damage and assisting others in doing damage, only way to break system was to be able to somehow do a lot of damage on game that will be lost, really hard to do. 
Winrate is part of it, but it only made a small portion.

I'm not sure why are they persistent on winning being main driver of what happens with your MMR.

The main difference is that World of Tanks has 15v15 matches, where teamwork is not as crucial as in HotS (that's not to say that it is not important in WoT), and since there is no draft phase, you don't have to be able to adapt to enemy team's composition. You can simply roll with a Tier X SPG and get a high rating. If people were to do that in HotS, the team compositions would be pretty bad, so, as they said, those are reflected in the win rate. 

Share this post


Link to post
Share on other sites
4 hours ago, SleepySheepy said:

I was hoping new system would go away from winning being only major parameter...
 

Can you win a game yet still lose MMR points? IE: a player goes full tilt, intentionally tries to throw. But the other 4 players are just dominating and still win the game.

No. You'll only gain points on a win and lose them on a loss. If you get full carried for a game, you won't lose points, but you also aren't going to gain very many either."

They stated it themselves, it's still not accurate in those extremities.

And they did. Now it's not the only major parameter, but one of many. But it's still a priority, which is very logical, isn't it? Or you were hoping that even when losing a match you could still EARN mmr? I'm sorry but I couldn't help reading that between your lines.

And just skipped the rest of your post about WoT. It's completely irrelevant simply because comparing games of the same genre is a risk of running into wrong argumentation, let alone mentioning games of completely different nature.

Share this post


Link to post
Share on other sites

I understand winning and losing being the primary parameters.  If they weren't, EVERYONE would just prioritize Nova and try and go 15-0 every match, losses be damned.

Speaking as someone who hovers around a 50% win rate (keeping in mind I play my lowest ranked hero to fill quests), I have a lot of games with people who, frankly, have no idea about even basic strategy.  I also go on a ton of long (10 games+) loosing streaks.  And I almost never carry.  HotS has been VERY frustrating at times as a result.  As far as I'm concerned, MMR matchmaking can't get much worse then it currently is.

Share this post


Link to post
Share on other sites
15 hours ago, gamerk2 said:

I understand winning and losing being the primary parameters.  If they weren't, EVERYONE would just prioritize Nova and try and go 15-0 every match, losses be damned.

Speaking as someone who hovers around a 50% win rate (keeping in mind I play my lowest ranked hero to fill quests), I have a lot of games with people who, frankly, have no idea about even basic strategy.  I also go on a ton of long (10 games+) loosing streaks.  And I almost never carry.  HotS has been VERY frustrating at times as a result.  As far as I'm concerned, MMR matchmaking can't get much worse then it currently is.

Yep, matchmaking in HotS is terrible, that's why I quit. Even though I pretty much always had the best stats (xp, damage, ka/d ratio, heal) in lost matches, this system is not making me coming back.

Enough is enough.

Edited by Esmer

Share this post


Link to post
Share on other sites
Quote

 I assume you guys are running some kind of adaptive machine learning, but most people are not going to understand that so maybe some kind of brief summary into how that works can help to alleviate the main concerns. Just a suggestion.

Why people are so afraid to ask the damn question ? That question is: when will you reveal what is taken into consideration when calculating one's MMR ?

If Blizzard want HotS to be a competetive game then how players are supposed to be competetive when they don;t know how system works ?? This irritates me so much :/ If the system is as good as they describe it then there should be no problem with telling people how does it work exactly. If they don't want to reveal this info then there is sth wrong with it imo.

Share this post


Link to post
Share on other sites

I hope HotS dies out as a result of the poor matchmaking that they've had since the start. Came over to see the pretty models left after hitting master q'ing as Aba/Murky. This game is the pretty version of a League of Legends shortbus.

Share this post


Link to post
Share on other sites
On 14. 11. 2017. at 5:21 PM, Jonar said:

And they did. Now it's not the only major parameter, but one of many. But it's still a priority, which is very logical, isn't it? Or you were hoping that even when losing a match you could still EARN mmr? I'm sorry but I couldn't help reading that between your lines.

And just skipped the rest of your post about WoT. It's completely irrelevant simply because comparing games of the same genre is a risk of running into wrong argumentation, let alone mentioning games of completely different nature.

Yeah, you "read" it right. Seems silly to me that MMR will be positive or negative just depending on win/loss.

Is that wrong thinking? I would say it's not, but of course, I could be wrong.

  • Like 1

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Stan

      Sylvanas, Rehgar and Uther are on sale next week. Check out the full list of featured items added in next week's Collection Update!
      Blizzard (Source)
      Weekly Collection Update: Feb 27 – Mar 6, 2018
      Our next Collection Update will begin on Tuesday, February 27! Check out the list of featured items and Hero discounts below.  Upcoming Hero Sales
      Sylvanas — Sale Price: 312 Gems Rehgar — Sale Price: 312 Gems Uther — Sale Price: 250 Gems  The following Skins and Mounts will enter the Featured Item Rotation, and will be unlockable using Gems until next week's Collection Update: Upcoming Featured Skins
      Ash Primal Queen Kerrigan  Crimson Storm Wolf Rehgar  Night Explorer Li Li  Hyper Turbo Tracer  AzGul’dan  Viridian Super Sonya  Spectre Thunder Guard Zarya  Wild Raven Sylvanas  Cobalt Cyb’arak Anub’arak  Blazing Lil’ Ragnaros  Upcoming Featured Mounts
      Tan Horse  Cloud Serpent  Hunter Space Lord’s Starbreaker
    • By Stan

      10 Sgt. Hammers on Towers of Doom. Thrusters are always active and all players start at level 10 with no talent restrictions. Play two matches of Hammer Time to collect a Lunar Loot Chest.
      Blizzard (Source)
      This week’s brawl is Hammer Time! An explosive twist on a typical match, Hammer Time lets you call down the thunder and claim Belltowers on Towers of Doom with 10 Sgt. Hammers.

      Rules
      Queue up and battle it out on Towers of Doom with either Sgt. Doomhammer or World War Sgt. Hammer. Core health for both teams halved to 20 Modified Standard play No talent restrictions, but all players start at level 10 Extended beginning game time by 15 seconds to allow for more time to choose talents Thrusters are always active for all players! Unsieging from Siege Mode is now instant for all players! The first team to claim enough Belltowers to destroy the enemy Core is victorious! Rewards
      Complete two matches of Hammer Time to earn a Loot Chest!
      Find out more about the Heroes Brawl game mode on our Brawl site; and as always, you can find more information on this week’s Brawl by clicking the Brawl Info button at the bottom of the play screen when preparing to queue for this exciting new game mode.
    • By Stan

      Voice chat is finally available in Heroes of the Storm and this post by Blizzard will guide you through the basics of the system.
      All players must opt-in to join the team voice channel at the start of a game or upon entering a draft lobby. If you don't have a microphone, you will still be able to hear your team. The voice chat tab in the options menu can be used to adjust all settings to your liking. Use the Test button to hear how you'll sound in-game and don't forget to set up your Push-to-Talk Key.
      Blizzard (Source)
      We’re excited to announce that voice communication is now available in Heroes of the Storm! Whether you find yourself in a draft lobby, partied with a friend or two, or with your whole squad in Team League, voice communication will free your hands from the shackles of typing and make it easier than ever to coordinate with your teammates. Before you head in-game to try it out, take a moment to learn how voice channels work in Heroes and get to know the various settings you can adjust to make voice communication your own.
      Team and Party Voice
      We’ve added voice channels to Heroes of the Storm to accommodate both party voice and team voice. If you’re in a party, you’ll automatically be added to your party’s voice channel, and only party members will hear what you have to say. The opposite is also true: if you’re in a partial party and using the party voice channel, you’ll be unable to speak to or hear allies outside your party unless you switch to the team voice channel.
      By default, all players must opt-in to join the team voice channel at the start of a game or upon entering a draft lobby. A notification will appear in chat to remind you that team voice is available, and you can click it to easily join the channel. Keep in mind that voice channels—even party voice—are completely optional. You can use the new voice chat tab in the options menu to adjust auto-join settings and notification sounds to your heart’s content.
      Voice Settings
      Digging a bit further into voice settings, you can click the dropdown menus at the top to pick which device you’ll use to hear your allies’ voices, and set up the microphone you’d like to use for your own. You can click the Test button to hear how you’ll sound to your teammates in-game. However, even if you don’t have a microphone, you can still join party and team voice channels to listen-in as your allies make plans and shotcall.
      As mentioned previously, the checkboxes under Auto-Join Voice and Notification Sounds on the left side of the voice chat options menu can be used to select which voice channels you’d like to join automatically during each game, as well as to enable or disable any voice notification sounds.
      Click the Transmission Mode dropdown to decide whether you’d like to set your microphone to Push-to-Talk or Open Mic. When using push-to-talk, your allies will only hear you while you’re holding down your push-to-talk hotkey (the ` key by default). With open mic, they’ll hear everything you have to say. If you do opt for an open mic, you can adjust the sensitivity slider to stop your microphone from transmitting sound under a certain volume. Finally, run a quick test to make sure your mic is sounding good and your sensitivity is set correctly—broadcasting noise is a surefire way to get muted by your teammates!
      In addition to push-to-talk, you can set up hotkeys to quickly switch between party and team voice channels, or to turn your microphone on and off. 
      In-Game Voice
      Outside of the voice chat options menu, you’ll see a voice widget appear in the top-left corner of most game menus. Clicking this widget will allow you to quickly join, switch, or leave a voice channel. Once you enter a game, you’ll find this widget on the tab screen.
      You’ll also find microphone and speaker icons across from player names on the tab screen, which you can click to mute or unmute allies individually.
      We’ve also added a new reporting option called Abusive Voice that you can use to report players specifically for misbehavior over voice. Additionally, we’ve implemented a voice silence penalty that’s separate from chat silence penalties. This means that players who are frequently reported for Abusive Voice can receive a voice silence, which will prevent them from speaking in team voice for the duration of that penalty. They can, however, still join the team voice channel to listen to allied comms, and can still join and use the party voice channel normally.
      We hope the addition of voice in Heroes of the Storm will help you and your allies communicate more effectively on the road to your next string of victories, and perhaps make a new friend or two along the way.
      Until next time, we’ll see you in the Nexus!
    • By Stan

      Blizzard implemented voice chat and applied balanced changes and various bug fixes in this week's patch.
      Voice chat is now enabled on live servers and in addition to bug fixes, the following Heroes received balance changes:
      Maiev: The latest changes are aimed at lowering her survivability and burst damage throughput. Malthael: Healing from Soul Ripping Minions decreased, Hero-only healing increased. Mana cost of Soul Rip has been increased to 25. Zeratul: Changes to basic & heroic abilities are meant to redistribute his damage, while giving the Hero a slight buff. Xul: Base stats have been buffed and split-push potential has been toned down. Sonya: Balance changes for Sonya were supposed to go live on January 24, but Blizzard's implemented them just now. The changes include a basic attack damage reduction, Poisoned Spear & Nerves of Steel talent adjustments. Blizzard (Source)
      We’ve just released a patch to the live servers in order to implement Voice Communication, as well as apply some balance updates and bug fixes.
      General
      Voice Communication
      Voice Communication has been added to Heroes of the Storm! Read the Voice Communication blog for more information about how to use it in-game. Heroes
      Assassin
      Maiev

      Stats
      Health reduced from 2236 to 2150 Health Regeneration reduced from 4.66 to 4.48 Abilities
      Vault of the Wardens (Trait) Cooldown increased from 8 to 9 seconds Fan of Knives (Q) Damage reduced from 170 to 162 Talents
      Level 16 Armored Assault (Passive) Damage bonus reduced from 25% to 20% Vengeful Knives (E) Bonus damage per Hero hit increased from 1% to 1.2% Malthael

      Abilities
      Soul Rip (Q) Mana cost increased from 20 to 25 Healing reduced from 36 to 25 per target hit Healing from Heroic targets increased from 3% to 4% of the Hero’s maximum Health Tormented Souls (R) Cooldown reduced from 100 to 80 seconds Talents
      Level 4 Die Alone (Q) Damage bonus reduced from 75% to 50% Level 16 Soul Collector (Q) Bonus range reduced from 50% to 25% Thrall

      Abilities
      Chain Lightning (Q) Bounce range increased by 20% Zeratul

      Abilities
      Cleave (Q) Damage increased from 200 to 212 Singularity Spike (W) Damage increased from 228 to 240 Void Prison (R) Mana cost reduced from 100 to 80 Might Of The Nerazim (R) Basic Attack damage bonus reduced from 40% to 30% Specialist
      Xul

      Stats
      Health increased from 1900 to 2000 Health Regeneration increased 3.957 to 4.168 Basic Attack damage increased from 104 to 110 Abilities
      Raise Skeleton (Trait) Skeletal Warrior Health reduced from 240 to 225 Skeletal Warrior damage reduced from 23 to 21 Bone Prison (E) Cooldown reduced from 12 to 10 seconds Mana cost reduced from 80 to 70 Talents
      Level 7 Trag'Oul's Essence (Trait) Mana restoration per Skeletal Warrior attack reduced from 0.5% to 0.2% of Xul’s maximum Mana Support
      Tyrande

      Abilities
      Light of Elune (Q) Cooldown reduced from 12 to 11 seconds Warrior

      Sonya

      Stats
      Basic Attack damage reduced from 88 to 84 Talents
      Level 7 Poisoned Spear (Q) Damage reduced from 125% to 100% of Ancient Spear’s damage. Level 16 Nerves of Steel (Active) Duration reduced from 5 to 3 seconds Shield amount reduced from 30% to 25% of Maximum Health Cooldown reduced from 70 to 60 seconds Bug Fixes
      Heroes, Abilities, and Talents
      Diablo: Lightning Breath sound effects will no longer stop playing before the Ability is finished channeling. Junkrat: Heroes killed by Concussion Mine will no longer respawn at their death location and then slide across the Battleground. Junkrat: Issuing movement commands during Rocket Ride will no longer cause Junkrat to become separated from his Mount. Junkrat: Movement commands that the player did not issue will no longer appear on the terrain in front of RIP-Tire’s model. Junkrat: Targeting unpathable terrain with Rocket Ride will no longer cause Total Mayhem Grenades to visually persist on the Battleground. Junkrat: Concussion Mine can no longer displace Leoric from Wraith Walk’s starting location if the Mine is detonated in the same moment that Wraith Walk ends. Li Li: After learning the Lighting Serpent Talent, Cloud Serpent attacks that are bouncing to additional targets when the Ability expires will now correctly deal damage. Lt. Morales: The tooltip for the Healing Beam icon next to Lt. Morales’ in-game portrait will now correctly display the Ability’s cooldown duration. Malfurion: An ally who is affected by multiple Regrowths will now be correctly healed by Moonfire and have Stuns, Roots, and Slows removed by Nature's Cure. Movement Abilities: Certain movement-based Abilities, like Greymane’s Darkflight or Chen’s Flying Kick, will no longer fail to move the Hero toward a target currently affected by Varian’s Taunt or Garrosh’s Warlord's Challenge. Sgt. Hammer: Can now correctly deploy Biotic Emitters on Volskaya Foundry while in Siege Mode. The Butcher: Fixed an issue that prevented The Butcher from collecting Meat while piloting the Triglav Protector, Dragon Knight, or Garden Terror.