Blog Archives

Saturation

There is a fascinating quote from WoW’s Tom Chilton in this IGN interview that, I believe, conclusively discredits the notion that Wrath of the Lich King (or really any expansion) was somehow responsible for the stagnation and peaking of subscriptions:

Moving forward beyond 4.3, Chilton explained the focus of the development team. “I would say that the majority of our mindshare as a team goes toward our existing player base. How do we keep them entertained and how do we keep them enjoying World of Warcraft? I don’t know if that’s necessarily the right approach as time keeps going on. If you look at, if you look at the way the population breaks down, we’re at a point in our history where there are more people that played World of Warcraft but no longer play World of Warcraft than currently play World of Warcraft. That was totally not true four or five years ago, and so in a way the demographic of the potential returning player becomes more and more important over time.”

On the one hand, some might argue that this phenomenon is not particularly noteworthy at all. If a MMO sells 100 copies and two months later only 49 are still subscribed, then more players have played that MMO and stopped than continue to play it – that does not means that there could not be another 100 potential customers who might not have known about the MMO.

The difference with WoW, of course, is one of magnitude. Depending on when Chilton looked at the population breakdown, that means WoW could have had in the neighborhood of ~24 million players overall. How much bigger can we imagine the market for a fantasy-based Warcraft IP MMO be? While we can only speculate, I think it is reasonable to assume based on Chilton’s response that the market is saturated to the point that Blizzard’s time is better spent recapturing lapsed players than it is marketing new ones. Surely they have done the market research, and if we accept them as rational businessmen, then this interview (and their actions) confirm the hypothesis of market saturation. In which case, as I argued several months ago, raid/reward philosophy shifts in Wrath of the Lich King (and Cataclysm) likely had little to nothing to do with slower subscription growth.

Beyond that, what is similarly fascinating about that interview is the very next paragraph:

“I don’t think we’ll ever be able to stop feeding the beast,” said Chilton. “It’s kind of what we call trying to keep the players entertained, you know the guys bored right now and you know what are they going to do next month? But I think that for us to continue to be successful we have to think more and more about the new players that are coming into the game now and the potential returning players. What are we doing to the game that lowers those barriers to entry?”

I suppose it could be read multiple ways, but I got the impression that going forward Blizzard’s design will be less centered on keeping existing players happy and more on enticing back former players. Obviously, things like tier sets on vendors and more accessible raids make hardcore players unhappy, but this seems a confirmation that – in true triage form – the designers would rather make you (an existing customer) unhappy if they could potentially lure back two former customers. The ideal would be that they could both make you happy and former players happy simultaneously, of course. That said, this is the first time I have come across so candid a game designer.

As a former player myself, it will be interesting to see how this shakes out.

OT: Subscription and Correlation

Did you know that ice cream makes it more likely you will drown? It’s true. When ice cream sales increase, so do the number of drowning deaths. Clearly linked! Speaking of spurious correlations…

I fully expect Rift to now follow in the footsteps of WoW, in that it will decline. Vanilla and BC days had challenging content, and it’s not a surprise that sub numbers grew. WotLK made things ‘accessible’, and surprise surprise, the response was pretty meh (sub numbers dropped in the US/EU, but were offset globally by WoW launching in new regions, hence the overall stagnation). Cata tried to play both sides of the fence, but a combo of too little too late, a gimmick of progression (hard mode rehashes rather than straight-up new content), and a one-track, insult difficulty 1-85 game did it in. With no new regions to offset things, subs are dropping.

(SynCaine in the post “Accessibility killed Rift“)

World of Warcraft’s growth rate went from a perfectly stable 2 million subscribers per year during 2006 to 2009, to zero during WotLK. This was exactly the time when Blizzard changed the character progression mechanic.

(Nils in the post “Smoke and Mirrors“)

“If developers design a game which requires too much effort from the average player for too little gain, the average players will start leaving the game. “

This is the part I strongly disagree with, and WoW’s sub history does as well. Vanilla/BC, which had a MUCH harder end-game that fewer players saw to completion, saw massive growth. WotLK/Cata, with raids being cleared by all who stepped inside, have brought decline.

(SynCaine in a comment on Tobold’s post “Syncaine on Accessibility“)

The reason I bring these examples up is because this type of thinking (or lack thereof) is what I consider one of the most pernicious, asinine fallacies in any discussion of World of Warcraft. It is intellectual laziness at best, intellectual dishonesty at worse. Before I begin in earnest however, here is a slightly augmented graph from MMOData that most people refer to when they talk about WoW subs:

1) Correlation does not mean causation.

Standard preface to any claim that X means Y. Ice cream and drowning are only “linked” because there is a third factor involved.

2) Even if correlation did mean causation, why this particular correlation?

This specific point is the reason the argument is intellectually lazy. When you look at the graph, it is true what Nils and SynCaine said about there being a relatively rapid period of growth during vanilla and TBC that was not apparent after the release of Wrath. However, tying that solely (or even partially) to accessibility/character progression/difficulty/etc is a completely unsupported leap of logic.

There is zero evidence given by either author as to why it was “existence of more challenging content” and not, I dunno, the introduction of the PvP Honor System and BGs in the summer of 2005, which coincides with a 500k sub spike in WoW-West on graph. Or the release of ZG in September of that year, also suspiciously near another 500k sub bump. Or if I looked at WoW’s overall numbers like Nils does with his “2 million per year growth” argument, perhaps I could argue Patch 1.12 with it’s wildly successful:

The stage is set for intense, objective-based land battles as Horde and Alliance vie for control over important strategic positions and resources around Azeroth. Head out for Silithus and Eastern Plaguelands to engage the enemy on the field!

…was responsible for the corresponding bump of 1 million (!) subscribers. Clearly, clearly, more things like Silithus and the old Eastern Plagueland towers is just what WoW needs.

3) What does endgame accessibility/difficulty have to do with anything?

This is another intellectually lazy part of the argument that the authors never bother to address. What percentage of the playerbase ever actually makes it to the endgame, and is this percentage big enough to even impact subscription growth? That is an open question.

The best metric that I can come up with is to look at the number of guilds who killed Beasts of Northrend in 10m ToC after two years of it being out (86,187 guilds), multiply that by something charitable like 30 players, and then divide by the approximate population in the graph above while only taking into account the regions in which WoWProgress collects data (~6.5 million). The result is 39.77% of players killing the easiest boss in the easiest tier of which we have data (something like Noth the Lootbringer from Naxx 2.0 would have been better, but alas…). That actually sounds like a lot of people, and 19.88% assuming only 15 raiders per guild is not too shabby either when referring to raid content.

That said, there is no evidence whatsoever from those two that difficulty-related gyrations amongst the top 1/3rd of players doing raiding content has a meaningful impact in comparison to whatever the remaining 2/3rd non-raiders are doing. Between 2005 and 2009 the subscriber base was growing at ~25% per year. Is it even remotely likely that the top 40% had anything to do with a meaningful drop in growth rate?

4) Growth, or lack thereof, does not really mean anything other than what it is.

What I mean by this is that you cannot simply look at growth as anything other than what it is: growth. It does not mean anything else without further information. For all the talk about growth rate percentages and “the design decisions that caused them,” look at the pink line for a moment. That represents subscriptions in NA alone. Unfortunately MMOData stopped tracking that information individually (or perhaps Blizzard stopped giving it out), but the whole of TBC resulted in ~650k more subscriptions in NA over a two-year period.

Is 325k sub growth per year more than the apparent zero sub growth in the year of Wrath? Sure… but we have no real way of knowing why that growth was occurring. Was player churn less of a factor in vanilla and TBC? Was the growth simply due to the release of WoW in additional regions? Does market saturation have any impact? Do we simply ignore, I dunno, one of the worst global recessions in world history?

Oh, wait a minute… early 2009 was when the markets were at their worst? And yet WoW subs were relatively stable in most regions during that entire year? Clearly Wrath’s accessibility and stress-free raiding were the only things stopping WoW’s overall decline in a tough market, as evidenced by Cata’s increased difficulty leading to subscription loss once markets improved. QED, amirite?

The bottom line here is that you cannot use WoW subscription numbers as evidence of a claim without first proving said numbers have anything to do with said claim. Did World of Warcraft gain six million subscriptions worldwide in its first year? Yes. Was that because of the strength of its class balance? Its risk versus reward structure? Its accessibility? No one can really say; all of it would be conjecture.

Personally, I believe the initial rush was due to the strength of the IP – I know I certainly gave WoW a shot because of how much I enjoyed Warcraft 3 – and also due to the strength of the Blizzard brand. The designers also got a lot of things down perfectly that I feel other MMO designers stumble across to this day, such as letting characters jump, making solo-play possible, having quests with interesting plots, getting the reward faucet just right while questing, and so on. The tone and tenor of game balance has certainly shifted quite a bit from when I began in TBC, but where I disagree with Nils and SynCaine is that I feel that Wrath was actually a step in a better direction in most (not all) ways. Unfortunately, until the duo, and others who believe as they do, let go of the absurd notion that “the numbers” support their conclusions, it is impossible to have any rational discussion about it.

There is a separate argument as to linear raid progression vs episodic progression, but that is an OT for another time.

  • Archives