Sleeping Dogs Review (PS3): Undercover Gangster's Paradise

This summary is not available. Please click here to view the post.

Polygon's SimCity review is busted policy in action

I'm not a professional games writer. I've wanted to be one since I first picked up a compendium of reviews for games on the Sega Master System and Mega Drive (Genesis), but I've made peace with the fact that I'll always be a commentator more than a genuine contributor. That, and my current occupation - providing policy advice and administration services in a university context - has done a good job of putting food on my table and a roof over my head. You might see me pop up on a few different gaming sites, but rest-assured my money has and will pretty much always be earned elsewhere. I hope that with this introduction, you'll be satisfied that this examination of relatively-new games website, Polygon's review process and policy isn't sour grapes; it's me looking at games writing in the context of my day job. 

Polygon's review policy, titled Polygon's Review Scores and "The Bump" is about as toothless and cosmetic as policy documents come. There's a pretty lengthy preamble to give the reader context as to why an outlet would have an actual policy to begin with, and this primarily relates to the evolving nature of the game as a product. There's no definitive purpose spelled out in the document, and by that I mean I couldn't tell you what purpose a Polygon review is supposed to serve other than to establish and maintain the site's "legacy and credibility." There is an acknowledgement that reviews are valuable to the site's readership, but also a puzzling commitment to "being as fair as possible to the developers and publishers who pour time and money into the games you play." Is a Polygon review supposed to be a purchase recommendation or an evaluation of a game under ideal conditions? From the policy document, it's difficult to say for sure.

There is one statement in the policy for which I intend to take Polygon to task for though, and it reads as follows:

At Polygon, we operate on the supposition that reviews are a critical evaluation of a game on the day of its release, which the score we assign reflects.

If the review is supposed to be a "critical evaluation of a game on the day of its release," then this should imply a few things that would put it at odds with the typical games website milieu of assessing review code in the weeks leading up to release, sometimes at events held at the publisher's offices. Ideally, a review under this supposition would be conducted using a retail copy of the game. I wouldn't expect them to buy it - publisher supplied would be above board - but the publication's recent review of SimCity along its with subsequent revisions shows just how meaningless the policy and the concept of "The Bump" really is.

To be clear, I'm not alleging that there's any impropriety on the part of the reviewer, Russ Pitts or Polygon's Reviews Editor, Arthur Gies: it is stated in the site's forums, publicly on Twitter, and in the review itself that the game was trialled on "development servers". I am, however, implying that Polygon's review policy is for show only, with its writers being able to point to it as proof of the site's supposed integrity rather than it guiding the site's process and practices.

The flippant references to the testing conditions in the cut-away headed On "Always-Online" effectively highlights how the initial review contravenes the review policy:  "on the day of its release," readers won't be able to play the game "on one of their (EA's) reserved servers," or "offline in a private server environment with no other invited players." A quick Google search reveals a multitude of reports on how readers (and anyone else who purchased SimCity for that matter) endured great trouble playing the game that they paid for on the release date and afterwards.

The employment of The Bump seemed to be at odds with the grand scheme of the broken policy as well. To acknowledge the trouble that most consumers have endured trying to connect to EA's servers and actually play SimCity on release (March 5), Gies employed The Bump and reduced the game's review score from a near-perfect 9.5 to a still respectable 8.0. Just two days later, the score dropped significantly to 4.0 to recognise the withdrawal of certain features that apparently affected Pitts' enjoyment of SimCity. Once again, to quote the policy, review updates are supposed to chart the "timeline of that game's evolution." I would argue that it's not to document launch hiccups.

Polygon's review of another always-online PC title that endured issues with access at launch, Diablo III is proof of my assumptions regarding the intent of the policy. In another cut-away, this time titled Server Issues, Arthur Gies explains why the dungeon crawler's score remained at a perfect 10 with the following:

Ordinarily, my position as Reviews Editor at Polygon is that we review a game as it exists on release day, because our responsibility is to our audience. While we do all we can to maintain due diligence with regards to giving a game every opportunity to deliver, we choose your wallet and your time before the benefit of the doubt. 

But Diablo 3 is different. It's different because Blizzard has a track record spanning almost two decades of games that have become institutions, and they've also run the most popular MMO around for almost eight years. Put simply, Blizzard, more than any developer around, has earned that benefit of the doubt. I believe that the server issues will be resolved. With that in mind, it does both our audience and Diablo 3 a disservice to dwell on that aspect in this review.

So in this case, Blizzard, a high-profile developer that has experience delivering games with online infrastructure is spared the wrath of The Bump as "they've earned the benefit of the doubt." I can't attest to developer Maxis' experience with online-only products, but it's publisher, EA has released a vast catalogue of online-dependent or otherwise enabled titles in a variety of genres. For what reason does the Polygon review team believe that EA is unable to deliver a stable experience? How have they not earned the benefit of the doubt? At least in the case SimCity, Maxis delivered the product in full and withdrew features (and will presumably restore them once the servers become stable), as opposed to Diablo III where the real money auction house and Player versus Player features weren't ready for the release date and took varying amounts of time to be delivered.

This lack of consistency again raises the question of what purpose the review is supposed to serve - not just at Polygon, but at games writing outlets in general? Is the review supposed to be a purchase recommendation for readers? If so, Polygon did a disservice to their audience by trialing the game in conditions different to those that would be available to consumers and rendering a near-perfect score. Besides, it's not like The Bump will carry over to Metacritic - whose ratings are the only thing arguably close to an objective measure in terms of games reviews. Surely, with the collective experience of Diablo III's muddled launch, the Polygon team must've thought it prudent to test the retail servers before publishing a review for another always-online game. Then again, if the review is supposed to assess the game in ideal conditions, then The Bump should never have been applied as Pitts got to see the game at its best.

I approached both Pitts and Gies with my concerns via Twitter, and received a reply from the reviewer (Pitts) who stated (across multiple tweets) that:

We did our best to ensure we were reviewing the game in conditions as approximating the user experience as closely as possible. That's not always going to be 100%. And in this case, launch conditions were far  more terrible than anyone assumed. Hence, the repeated updates. TL;DR: This is an extreme case of almost everything.

I responded with the allegation that, as per the above, that Polygon's policy is more for show and highlighted both the breach of policy and the inconsistency with regards to the outlet's Diablo III review and was told that:

It's not that simple, but I appreciate your feedback. Definitely something to consider.

Look, I'm not naive. I know that most gaming sites live and die by their reviews, and that waiting to trial the game on retail servers would have cost Polygon no small amount of hits. Further to that, it's possible that non-disclosure agreements were signed and delivery dates may have been promised. I don't know all the factors that were at play, but I know that Pitts was being genuine with his response. When we're talking about "legacy and credibility" and integrity, however, sacrifices need to be made. I mean, why have a policy if you have no intention of honouring it? I'd point to Gamespot, and their Senior Editor, Kevin Van Ord's review of SimCity as an example of best practice: it acknowledges the broken state of the game as well as highlighting promising aspects which just weren't functional at launch. I think if you're going to apply a bump to the review score, you should start with the product that was delivered to consumers and work up (or down) from there.

I work with well-written policies and I work with dated, ineffective ones as well. A good policy accounts for most situations and variables while allowing sufficient flexibility through interpretation for the benefit of stakeholders. Polygon's review policy is not a well-written policy, and while not old, has already been rendered ineffective by the business of video games writing. If you want that audience -- or better yet, to expand it -- you've got to go to press early, first if you can. Promising to evaluate something close to what your readership will have in its collective hands is at odds with this business model, so Polygon has to make a choice: do you stand with your audience, or do you postulate to them? Whatever the answers to this question and the others published above, I think the site's management need to revise the policy or consider withdrawing it altogether.

Update (14/03/13):

Polygon's Diablo III review was published prior to the website's official launch (it was first published on The Verge) and before the review policy was actually written. Still, I think given the flippant way in which Diablo III's server issues were addressed, it's unfair and inconsistent for SimCity's score to have been reduced so drastically given that server capacity and features disabled will more than likely return in due time.

The fact remains that Polygon have previously reviewed an "always-online" title  and the server issues didn't even factor into the original score awarded because of the aforementioned "benefit of the doubt". Further to that, the review policy would've been written after the Diablo III review and the ruling regarding launch woes and "benefit of the doubt" should've factored into the outlet's approach to policy development.

The Hard Way with Metal Gear Rising: Revengeance

Note: This post contains spoilers for Metal Gear Rising: Revengeance.

When I finished DmC: Devil May Cry a few weeks ago, the first thing I did was dive into a "Son of Sparda" run - which presented vastly more difficult enemy configurations and a reworked damage model. I put on a brave face for the first mission, but before long, I was up against Butchers as well as Ghost and Blood Rages that broke me and any chance of conquering a greater challenge. I don't think I've ever completed a "Hard" playthrough of any 3D brawler, now that I think about it. I've started quite a few -- even came close to finishing the original Devil May Cry -- but never quite had the resolve or the wits to rise above Normal in anything from Maximo to Bayonetta. 

SPOILERS FROM HERE ON. YOU'VE BEEN WARNED!

Despite reading that Metal Gear Rising: Revengeance was beyond brutal via the likes of Kotaku and my Twitter feed, I thought I handled its bombastic brand of butchery with aplomb. Sure, I may have only attained a C ranking for my Normal playthrough, but Platinum seemed to be quite punitive with regards to their grading schema. I could only see one C grade on my entire report card (displayed upon completing the campaign) but all of those As and Bs weren't enough to earn me more than a pass overall. Regardless of the mediocre ranking, I felt that post Blade Wolf, I was rarely troubled by the Winds of Destruction or even the monstrous new iteration of Metal Gear that awaited me in the final stage. 

With regards to difficulty, Revengeance plateaus after the duel with the carbon canine on the default setting; which falls roughly half way through the second level or about an hour of play. There are some small spikes in the level of challenge that you'll encounter, but if you can tough out that first real obstacle, then I have faith that you're up to the task of completing the game on Normal.

I found that the flow changed slightly when I ascended the scale for a New Game Plus playthrough. The plateau still hits really early -- earlier in fact -- but so long as you as you parry often and make the most of both Blade and Ripper modes to reap as many spines as possible, you'll survive. Those sword upgrades and an expanded move list help a great deal as well, but you'll need to endure some pain to access the fruits of your lower difficulty labours. What I'm trying to say is, New Game Plus doesn't start until you finish the prologue. "No sweat," you reply, but can your confidence withstand a stronger, more durable Metal Gear Ray? I used the majority of fourteen continues in the first stage of that boss fight. The plasma cannon attack is just shy of an instakill for Raiden without the extra cyborg upgrades, so be sure to avoid Ray's wide, deadly... erm... ray. I learned that the surest way to survive the first two parts of the fight is to slice incoming missiles for repair units. It's tough going, but YouTube, as always, offers a wealth of strategies and revelations if you need them (example: you can parry the immense machine's stomp attacks!).

The level of challenge flatlines once Raiden gets a hold of his new body. The first Blade Wolf can be worn down in seconds, and the encounter with Mistral was a breeze (though I should note that it's just as visually arresting the second time around). I didn't find a need for repair paste for a couple of hours - something I'd have found hard to believe whilst initially coming to grips with Revengeance's fast-paced combat system. 

Monsoon marked the first bump in the road of my Hard run. One of the few boss fights that requires parries from beginning to end, he whittled down my stock of healing items before I cut him into one hundred tiny slivers. He still couldn't take my life though; nor could the doppelgangers, nor could Sundowner. Sam was just as delicate, if not, more so on Normal. All but the final stage was cause for any real concern. Sure, there were some instances where I had to swallow my pride: the minigun turrets couldn't survive the defense of World Mashall's lobby, I Ninja Ran to my death while traversing the rooftops of Denver, the cargo elevator fight knocked me around a bit, and I generally lost a lot more life than I should have when dealing with Mastiffs... at any time.

Metal Gear Excelsus and Senator Armstrong were the only other challenges encountered. Much like the first time I dueled with the screen-hogging mech, the seemingly-open nature of this particular battle caught me unawares and claimed my life a few times. There's a sense of intimacy that goes with battling the Winds of Destruction that is absent here: even though Raiden's still confined to a relatively small area, the vastly greater dimensions of this opponent again proved both disorienting and daunting. It was by luck that I managed to avoid some of Excelsus's more damaging attacks by performing a Zandatsu on one of the Gekkos that are thrown into the field about halfway through the fight. Blade energy and vitality restored, I managed to sneak through to the final showdown with one precious serving of repair paste.

The battle, that is to say the actual fighting against Armstrong, was surprisingly easy. The dodge attack was more effective here than in any other scenario: dealing relatively high amounts of damage and conveniently sidestepping pretty much anything in the muscle-bound politician's repertoire. It did, however, take a few attempts to cut through various parts of Metal Gear Excelsus that were hurled towards me. Having to use both sticks to line up the required angle without prematurely slicing was no small feat as I'd long grown accustomed to mashing square and triangle in Blade Mode without much care for accuracy. A few precise cuts later though and Revengeance came to a spectacularly violent close once again.

What did I earn from my victory? Not a great deal other than some pride and a few trophies that could otherwise have been earned on any other difficulty. I attained the same overall ranking, the same titles and a new skin.

I may not have attained many tangible rewards from this endeavour, but I did find enough confidence to venture into Very Hard. Two Blade Wolves and a Gekko before you even reach the first checkpoint, with no upgrades and no dodge attack. No thanks, Platinum. No thanks.

How do you like your brawlers? Do you prefer the default difficulty setting, or do you thirst for a true challenge?