Jump to content
FORUMS
Sign in to follow this  
Starym

Old Dev Blog on Encounter Tuning and Exploits

Recommended Posts

55cKxHT.jpg

 

Watcher shared this old developer blog on his twitter, related to the recent discussions around exploits and bugs and how that related to encounter design. The blog itself is from the Mists of Pandaria era, so the examples may be outdated, but as the man himself says, still accurate.

Blizzard LogoWatcher, 2013

In this blog, I’d like to shed some light on an aspect of our design that may unfortunately seem inscrutable or even arbitrary: how and when we make adjustments to our raid encounters once they’re on the live servers. The only changes we jump on immediately to fix are clearly irritating bugs that never benefit the player in any way (e.g., issues that can cause players to fail to receive loot from a boss, glitches that can cause an encounter to evade or reset prematurely, etc.). Thanks to our internal QA team and the feedback from players on our test realms, those are relatively few in number.

Other than these clear-cut cases, virtually every change has some negative cost to it, such that the benefits must clearly be evident in order to justify making them. If we fix a bug that allows for an unintended strategy on a fight, then the following week there will be raid groups that previously had a working strategy on an encounter and will now have to re-learn it. If we reduce the difficulty of an encounter, there will always be groups who were very close to a kill on the “pre-nerf” version whose victory feels cheapened as a result. And so forth.

Given this background, let’s look at some of the adjustments we’ve made (or not made, in some cases) to the 5.0 raid zones over the course of the past months, broken down into a few general categories.

Q3GTU4P439QW1348241610432.jpg

Unintended Tactics

Our players are ingenious and adept at coming up with clever solutions to the challenges posed by our raid encounters. While we have learned from past experience to an extent (Rule #14 of encounter design: If it’s possible to kite adds instead of killing them, someone will kite them instead of killing them), we are still unable to always anticipate the lengths to which our players will go to overcome a difficult encounter. There’s nothing inherently wrong with that, and often one of the hallmarks of a great encounter is that it is open to multiple approaches, depending on the strengths and weaknesses of an individual raid group. I can think of three distinct approaches that we saw to handle the Molten Elementals summoned by Heroic Ragnaros, for example, and I’m sure there are more out there.

For example, a common tactic on the Heroic mode of Amber-Shaper Un’sok in the Heart of Fear is to have a dedicated transformed player who maintains a Destabilize stack on Un’sok throughout the entire second phase of the fight, when he is otherwise nearly invulnerable and the raid’s attention is focused on the Amber Monstrosity. This is only possible due to a bug. Un’sok was intended to be immune to Amber Strike during phase 2 of the fight, and he was in fact immune to it during that phase for much of the beta testing of the boss. However, fixing a separate bug late in development (ensuring that Amber Strike could always interrupt the otherwise-uninterruptible Monstrosity) caused Amber Strike to also bypass Un’sok’s shield in phase 2. Oops.

This would have been a simple bug to fix, but we chose to not do so. This was a clever tactic, and while it made phase 3 of the encounter relatively simple, it did so at the expense of adding length, challenge, and complexity to the first two phases of the fight. Kudos to the players who first came up with it.

As a general matter, unintended tactics are only a problem when they either trivialize an encounter, or when they simultaneously are the “right” (i.e., easier) way to do the fight and make it less fun in the process.

Gara’jal the Spiritbinder
On the first night of Heroic progression through Mogu’shan Vaults, Heroic Gara’jal proved to be an incredibly tough test for the damage-dealing capability of the best raid guilds in the world. A number of groups were a few percent shy of a kill, but it appeared quite possible that it would simply require another week worth of gear upgrades to get there. We would have been fine with that, but then one raid group noticed that one of the trolls before Gara’jal cast a massive haste buff on itself that was Spellstealable. The raid kept a couple of those enemies crowd controlled throughout the encounter, periodically breaking them out to let them cast their buffs for the mages to Spellsteal. This gave them the extra bit of damage that they needed, and Gara’jal fell.

Other guilds got wind of this tactic, and were attempting to utilize it as well. We definitely didn’t want the fight to require the awkward use of Spellsteal and bringing other mobs into the encounter, mandating the use of multiple mages in order to meet the DPS check for initial kills. But we also didn’t want an unfair playing field in the Heroic progression race, with one guild able to continue progressing in the instance while others were stuck behind a slightly-out-of-reach DPS check and unable to take advantage of the trick that had been used to secure the first kill. As such, we made a hotfix that prevented that buff from being Spellstolen, but also reduced Gara’jal’s health by 5% to offset for the extra damage that the mages with the buff would have done.

Exploits vs. “Creative Use of Game Mechanics” – A Brief Aside

I’d like to take a moment to note that what this guild did was not an “exploit” in the sense of being cheating, bad, wrong, or against the rules of the game. Players used Spellsteal to steal a beneficial effect from a mob, which is what the spell is supposed to do, and the beneficial effect increased the power of the mage, which is what it was supposed to do. This was the essence of “creative use of game mechanics.” (Note that this is not to say that it isn’t possible to violate the Code of Conduct by using Spellsteal in general – if you find a spell that you can steal that causes you to damage nearby allies, and you take it back to town to grief newbies, that’s a little different. . . .)

By contrast, a different group found a bug with Gara’jal where he could be dragged on top of the gate to his room such that players standing outside the gate could damage him without being susceptible to his attacks, and used this “unintended tactic” to defeat him. We fixed that bug, but also removed the loot and achievements earned from the players involved, and issued account suspensions. In general, it is never permissible to cause parts of a boss encounter to evade in order to gain an advantage, or to use line of sight or collision to get a boss stuck where you can attack it but its abilities no longer function.

Will of the Emperor
One more example, also from Heroic progression—most of the “unintended tactics” tend to be discovered and applied by cutting-edge progression guilds, since they’re the first ones to see the encounters, and are often undergeared and struggling to find every possible advantage, which usually means thinking outside the box. On Heroic Will of the Emperor, the Emperor’s Rage constructs that spawn present a real challenge. Their health is significantly increased, but each one of them also produces a deadly Titan Spark upon being destroyed, which explodes on contact to deal massive damage. The amount of damage and attention required to keep up with both the Rages and the Sparks they produce is one of the core demands the Heroic mode makes upon a raid group. It was so demanding, in fact, that most of the early groups that reached this encounter were unable to handle the overall DPS requirement.

Looking for solutions to this problem, clever players noticed that the mage spell Ring of Frost froze enemies for 10 seconds, had a 30-second cooldown, and had no target cap. Cue three mages cycling Rings of Frost to keep every Rage frozen for the entire fight. They spawn in waves of four in 25-player mode, resulting in anywhere from 52 to 64 Rages frozen in one giant clump by the end of the fight, causing client and server performance issues in the process. On the upside (for the designers observing these attempts), when this mage rotation faltered, the resulting wipes were fairly comical, bearing more than a little resemblance to an endless stream of passengers emerging from a clown car.

This was an example of a tactic that made the fight both significantly easier and significantly less fun. With so many enemies entirely neutralized by a small portion of the raid, the gameplay for many of the remaining players was reduced to standing in the middle of the room nuking the boss(es) for ten minutes and hoping the mages didn’t screw up. Not ideal. We wanted to fix it. However, the issue here wasn’t specific to the Will encounter. We had always fully intended for all forms of crowd control to work on Rages, so changing that was not an option.

The problem was Ring of Frost – being able to incapacitate an unlimited number of targets with a single spellcast caused problems. This ended up being a case where the negative cost of hotfixing the issue outweighed the upside of improving the encounter. When hotfixing spells, we do not have the ability to update the tooltips and other data that resides on each individual client. Thus, if we had added a target cap to the spell via hotfix, a mage who attempted to use it on a large pull in a dungeon, or a large group of players in a battleground, would have thought the spell was broken when it suddenly didn’t work on many of the targets. Quite simply, confusing hundreds of thousands of players in all sorts of contexts, in order to fix a problem in a situation affecting a few hundred players, was not an acceptable trade-off. As such, we changed Ring of Frost (capping it at 10 targets) in patch 5.1, allowing for ample notice through patch notes and PTR cycles, as well as a properly updated in-game tooltip. By the time this change went live, access to superior gear from Heart of Fear and Terrace of Endless Spring allowed players to much more readily handle killing the Rages as we originally intended.

OQ5ZIPW2Z9JJ1348241610383.jpg

Pure Difficulty Adjustments

Other adjustments occur simply because a boss is proving to be more difficult than we’d intended, creating a roadblock. Note that we will essentially never make pure numerical (health/damage) adjustments to a raid encounter that make it more challenging once it’s gone live. If we goof on the tuning in the players’ favor, then so be it.

On average, the self-selected pool of guilds that go through the effort of copying characters to our test servers are far more skilled and organized than the typical Normal-mode raider (and the pick-up groups that form tend to be below the target skill threshold), so there is a bit of estimation that goes into tuning Normal mode encounters. Because a disproportionately difficult Normal mode encounter presents a brick wall that entirely blocks progress, we will act to reduce the difficulty of such encounters, often shortly after they first become accessible, to avoid giving players a frustrating experience. For example, when Heart of Fear was released, we observed that even some guilds that had fully cleared Heroic Mogu’shan Vaults were struggling to meet the berserk timer on Normal Garalon; we made several adjustments to the fight to bring its difficulty in line with the rest of the instance on that first day. By the time that most others saw the encounter, it was where we wanted it to be difficulty-wise.

Over the long-run course of a raid tier, we pay close attention to the community’s overall rate of progression. We don’t have target completion numbers for each tier or for a given number of bosses; we are far more concerned with the rate of change. Progression is fun. Running into a challenge can also be quite a bit of fun. Running into a challenge that seems insurmountable is not. So when we notice that the rate at which groups are progressing is beginning to stall, we tend to take action. In Dragon Soul (and in Icecrown Citadel before that), we used a zonewide aura to reduce the difficulty of encounters over time. Some community members’ “hand on the dial” jokes notwithstanding, those processes were not automated, and reflected an assessment of the latest progression numbers from the live servers. We have the framework for such a system in place for the current raid tier, but we have not yet felt that its activation was necessary.

Our goal is not to make sure that the group that currently has defeated 4 of 6 Mogu’Shan Vaults bosses finishes Sha of Fear before our next patch; we do want to ensure, however, that they feel reasonably able to continue progressing at the rate they have been, with the assistance of gear upgrades gained along the way. As such, we recently reduced the difficulty of a few elements of the Normal difficulty Elegon encounter in a hotfix. This doesn’t necessarily mean that Elegon was “too hard” in some absolute sense – his difficulty presented a welcome challenge to the first wave of raiders who tackled the encounter this past fall. But the folks who defeated Elegon back then have moved on to Heart of Fear, Terrace, and/or Heroic raids in the meantime. A nerf to Elegon doesn’t affect them one way or another, but allows for raid groups still making those attempts to continue making progress today.

And then there’s LFR. Ultimately, LFR raids are designed to be completed by groups of players that qualify to queue for them. This does not mean that it should be impossible to fail, but unlike our Normal and Heroic raids, which are designed as progressions of increasing difficulty, LFR is designed to have a flat level of difficulty within each wing. Whereas a raiding guild will routinely give up and return another night or another week when they run into a challenge they can’t quite overcome, an LFR group that runs into a difficulty spike continues to grind away as new people cycle in to replace those who depart. Most players who ran LFR last fall will recall the ubiquitous partially-complete instances with a dense carpet of skeletons to greet arriving players—not a particularly fun experience. As such, we act quickly to adjust the difficulty of encounters in LFR when needed.

3ME67TIPAK5D1348241610286.jpg

Until Next Time

Ultimately, there is no hard-and-fast rule or formula that we follow to determine how and whether to make adjustments to encounters once they are in players’ hands, but hopefully this blog has provided some insight into the sorts of factors we consider, and our thought process with regard to a handful of specific changes during this last tier.

Ion “Watcher” Hazzikostas is Lead Encounter Designer, and really wishes you would stop making him ban you.

 

Share this post


Link to post
Share on other sites
36 minutes ago, Migol said:

...I'd like to hear his justification on Vanilla's C'thun...


/bitter old player.

Haha, dont think he was working there at the time, but yea that was one of the worst things ever. From unkillable to instadead first try, BALANCE!

Share this post


Link to post
Share on other sites
6 hours ago, Starym said:

From unkillable to instadead first try, BALANCE!

That sounds like the motto the PvP team must have on their wall in the Blizzard HQ!

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
Sign in to follow this  

  • Recently Browsing   0 members

    No registered users viewing this page.

  • Similar Content

    • By Stan
      Blizzard has put together a step-by-step guide on how to obtain Ashjra'kamas, Shroud of Resolve in Patch 8.3. The legendary cloak is mandatory for Horrific Visions and the encounter against N'Zoth in Ny'alotha. It can be upgraded and provides protection against Sanity-draining effects.
      Blizzard (Source)
      N’Zoth’s corruption is spreading across Azeroth, but with the legendary cloak— Ashjra’kamas, Shroud of Resolve—you can save your sanity and fight against the darkness. If you haven’t gotten yours yet, we’ve put together a simple step-by-step guide to help.
      Accept the starting quest “Return of the Black Prince” (Horde) or “An Unwelcome Advisor” (Alliance). You should receive this quest automatically if you meet the criteria.* Meet with Magni in the Chamber of Heart to continue the introductory quest line. Go with Magni into the Halls of Origination in Uldum and complete the challenge that awaits. Meet with King Phaoris in Ramkahen and complete an Assault in Uldum. Meet with Magni Bronzebeard in the Chamber of Heart and then speak with Wrathion about your new corrupt item to as a part of the quest Curious Corruption. Speak with MOTHER about your corrupt item to unlock Titanic Purification. While this unlocks the ability to cleanse an item, don’t cleanse your item now.** Meet Magni outside Mogu’shan Vaults in Kun-Lai Summit. Journey to the Seat of Knowledge in the Vale of Eternal Blossoms to speak with Lorewalker Cho. Go to Mistfall Village to meet with the Rajani and complete the Assault on the Vale of Eternal Blossoms. Go with Magni into the Engine of Nalak’sha in Vale of Eternal Blossoms, and face the challenge that awaits. (if you’ve completed this step on another character you can skip the Engine of Nalak’sha scenario by speaking to Ra-den.) Return to the Chamber of Heart with Ra-den. (He can take you directly there if you speak to him again.) Speak with Magni to complete the next series of quests in the Chamber of Heart then join him again in the Halls of Origination in Uldum to face a vision of what’s to come... Talk with Wrathion in the Chamber of Heart to undertake the quest “Beginning the Descent.” Enter Blackwing Descent at the top of Blackwing Mountain in the Burning Steppes and face the challenges that await to claim a corrupted prize. Return to the Chamber of Heart and speak with Wrathion to complete the quest and receive your new legendary cloak—Ashjra'kamas, Shroud of Resolve . Once you’ve received your cloak, make sure you put it on before embarking on your next quest which sends you back into the Halls of Origination, and ultimately unlocks access to Horrific Visions. These cost one Vessel of Horrific Visions to enter, and allow you to earn higher ranks for your new cloak . Each rank provides greater benefits, including higher stats, improved protection against sanity loss in Visions, and resistance to the dangerous negative effects of Corrupted gear.
      Horrific Visions can be done solo or with a group. If you’d like to team up to take one on, simply open the Group Finder (I) to find a group of like-minded adventurers to join you.
      *If you do not see this quest, make sure you meet the following requirements: level 120, Nazjatar unlocked and introduction experience complete through to “A Way Home”, Heart Forge activated, and Essences unlocked in the Heart of Azeroth.
      **Beware, cleansing an item will remove all Corruption from that item, but will also remove the additional postivie bonus effects gained from that item.
    • By Stan
      On Monday, we brought you the Fall of the Lich King Ending cinematic remastered by Pivotal, MasterVertex, and Dedrich. and the creators have now shared a side by side comparison of the original cinematic from 2008 and his recreation.
      The creators' main priority with the remaster was to update the lighting and nuance of the facial expressions.
    • By Stan
      Players with item level 410 and above can queue up and enter Gift of Flesh this week to defeat Shad'har, Drest’agath, and Il'gynoth in LFR for item level 430 loot.
      The third LFR wing of Ny'alotha has opened this week and the final Raid Finder Wing 4 opens March 10.
      Blizzard (Source)
      GIFT OF FLESH
      Shad’har the Insatiable
      One of N’Zoth’s most nightmarish creations, Shad’har the Insatiable feasts on the corrupted carcasses that the Old God’s minions discard into its domain. Tormented by ceaseless hunger, Shad’har’s body twists and mutates with every corpse it devours.
      Drest’agath
      The grotesque amalgam of flesh known as Drest’agath slumbered beneath Ny’alotha for millennia until being awakened by N’Zoth’s return. Now she rises like a revolting boil, ready to burst and spread her vile pestilence across Azeroth.
      Il’gynoth, Corruption Reborn
      Following its defeat in the Emerald Nightmare, Il’gynoth retreated into the depths of Ny’alotha to regain its strength. Now it has fused with the city’s architecture and spreads across the Black Empire like a creeping infestation. As Il’gynoth’s corrupting flesh grows ever larger, so does its power.
    • By Stan
      Blizzard has shipped a second encrypted Shadowlands Alpha build two days in a row this week and while we are not able to datamine it just yet due to the missing decryption key, it seems Alpha is coming sometime this week.
      On February 20, Blizzard shipped the first encrypted Shadowlands Alpha Build 9.0.1.33411. Yesterday, they shipped the second encrypted Shadowlands Alpha Build 9.0.1.33451 Today, they shipped the third encrypted Shadowlands Alpha Build 9.0.1.33480. This makes you probably wonder when to expect Shadowlands Alpha. The ongoing discussion over at MMO-Champion and a clip from Preach's stream, strongly hint at Shadowlands Alpha being announced this week.

      Nothing has been obviously confirmed yet by Blizzard, so take this information with a grain of salt.
    • By Starym
      Update: the daily quest Coalescing Visions reward increase was actually a typo and it's now been fixed - it is a 30% increase and not a 50% one.

      The massive February 24th hotfixes are here, featuring both the class and Horrific Vision tuning, as well as Explosive Orb M+ affix changes, Ny'alotha tuning, and even more Horrific Visions changes. In WoW Classic we have Razorgore only save raids to the instance if he was killed after all the eggs were destroyed.
      February 24 (source)
      February 24, 2020
      Classes
      Druid Restoration [With regional restarts] Rejuvenation now costs 10% base mana (was 10.5%). [With regional restarts] Efflorescence now costs 17% base mana (was 21.6%). [With regional restarts] Tranquility direct healing increased 11%. Developers’ note: These changes should improve Restoration Druid’s raid healing output, without much impact to their already strong capabilities in dungeons and Arena. Hunter Marksmanship [With regional restarts] Damage of all abilities increased by 5%. Mage Frost [With regional restarts] Damage of all abilities increased by 5%. Monk Windwalker [With regional restarts] Damage of all abilities increased by 5%. Damage unchanged in PvP. Rogue Outlaw Resolved an issue that could prevent Blade Flurry from damaging some types of creatures in Uldum and Vale of Eternal Blossoms. Shaman Enhancement Damage of all abilities increased by 3%. Warlock Demonology [With regional restarts] Damage of all abilities increased by 5%. Dungeons and Raids
      Mythic Keystone Dungeons Explosive Affix Explosive Orbs again immediately put players into combat. Explosive Orbs can again be tab-targeted. Developers’ note: When testing the Awakened affix, we found that Explosive Orbs could sometimes prevent players from entering or exiting Ny'alotha Spires and Rifts if their party was in combat inside the instance. To solve this issue, we changed them to not place players in combat immediately. However, this had the unintended side effect of breaking player expectations around tab-targeting Explosive Orbs, so we're reverting their threat-generation behavior and trying an alternate solution. Ny’alotha, the Waking City Azeroth's Radiance now properly restores Sanity to players who are under the effects of an Immunity spell on all difficulties. Vexiona Cultists now have their health adjusted based on raid size, up to a maximum 10% reduction for 10-player raids on Normal and Heroic difficulties. Ra-den the Despoiled Resolved an issue that allowed Re-origination Anchors to be attackable with area of effect spells. Horrific Visions
      Research into Synchronized Mind Stabilizer has improved, now always reviving the player with at least half their Sanity. Horrific Vision of Stormwind Magister Umbric now casts Frozen Storm twice during the encounter (was 3 times). Items and Rewards
      Torn Pages of “Fear and Flesh” The number of Torn Page of "Fear and Flesh" quest items required for the rank 13-15 cloak quests has been reduced. Rank 13 now requires 4 Torn Pages (down from 6). Rank 14 now requires 6 Torn Pages (down from 12). Rank 15 now requires 8 Torn Pages (down from 18). Developers’ note: This change should make all the quests completable by most players in the week and not require players to feel the need to save as many keys week to week. Along with our other quality-of-life changes, this should help newer characters catch up with their peers. [With regional restarts] Up to 4 Torn Page of "Fear and Flesh" quest items can now drop in Horrific Visions from objectives on the rank 7-11 legendary cloak upgrade quests (max of 2). Developers’ note: Players will need to clear more than two side areas in one run to get more than two pages. The rank 13-15 quests will still drop a max of 2 pages, only from Lost Area objectives. Coalescing Visions Coalescing Visions now drop in higher numbers from Assaults and Daily Quests. [With regional restarts] Visions of N’Zoth daily quests now reward 50% 30% more Coalescing Visions. [With regional restarts] The N’Zoth Assault now rewards 2500 Coalescing Visions (in addition to a Vessel of Horrific Visions). [With regional restarts] Lesser Threats will now reward 6500 Coalescing Visions (was 5500). Heart of Azeroth Reaping Flames (Essence) will no longer have its cooldown reduced to 5 seconds and deal additional damage when killing Twisted Appendages. Player versus Player
      Tank-specialization characters take an additional 50% damage from enemy players (was 40%). Death Knight Blood Death Strike now heals for 12.5% of damage taken when engaged in combat with enemy players (was 25%). Death Strike now heals for a minimum of 3.5% of maximum health when engaged in combat with enemy players (was 7%). Frost, Unholy [With regional restarts] Death Strike now heals for 30% of damage taken when engaged in combat with enemy players (was 40%). [With regional restarts] Death Strikee now heals for a minimum of 5% of maximum health when engaged in combat with enemy players, down from 10%. Mage Arcane [With regional restarts] Prismatic Barrier now absorbs 40% less damage when engaged in combat with enemy players. Fire [With regional restarts] Blazing Barrier absorbs 40% less damage when engaged in combat with enemy players. Frost [With regional restarts] Ice Barrier absorbs 40% less damage when engaged in combat with enemy players. Warlock Affliction, Destruction [With regional restarts] Demon Armor now increases Stamina by 5%, (was 10%). [With regional restarts] Demon Armor now increases Armor by 90% (was 150%). WoW Classic
      Razorgore the Untamed now only saves players to the raid instance if defeated after the eggs have been destroyed.
      Previous Hotfixes
      February 20th February 19th February 18th
×
×
  • Create New...