With around 11,000 games and over 125 million users, Steam rules the PC games business. That kind of reach and influence means developers both large and small theoretically have access to a massive amount of potential customers.

But that kind of footprint comes with a catch: such heavy reliance on a platform means that even ostensibly subtle changes to the system can affect the businesses of countless game developers.

This week, Steam owner Valve Software announced updates to the way its platform handles Steam game reviews that are submitted by players who obtained games by using a Steam game download key. “It's too easy for Steam keys to end up being used in ways that artificially inflate review scores," Valve said in a blog post, arguing the reasoning behind the decision.

Gordon Little had his first game release on Steam just a couple of weeks ago. Spell Casting: Meowgically Enhanced Edition racked up many appreciative reviews from players on the platform, leading to an overall positive average. Then Steam changed to its review policy.

"Yesterday I had a positive rating," says Little. "This morning it's negative."

Spell Casting: Meowgically Enhanced Edition saw its average score
go from positive to negative overnight 

Valve's decision has many developers puzzled and upset. It's harmed their ratings and their reputations, or put them in a difficult position in regards to their game's future.

"Our game is late in its life cycle and I don't think it will have a significant impact on sales, but 75% of our ratings suddenly vanished," says Nicholas Laborde of Raconteur Games, developers of Close Order. "It no longer looks like a game that several thousand people purchased; now, it gives the impression of 'it made it out of early access barely and no one bought it' which isn't the case at all, so that will permanently have an effect on people who visit our Steam page."

"I'm sad that my Kickstarter backers for our game Moon Hunters don't matter anymore," says Tanya X. Short of Kitfox Games. "They were our first supporters."

Dean Razavi echoed the same sentiment. Kickstarter game backers regularly receive Steam keys in exchange for their pledges. "My game Vidar was Kickstarted last year, and I'm currently in the middle of sending out Steam keys to backers," says Razavi. "Knowing that those individuals' reviews won't be counted towards my overall review score is a little sad."

It’s not just the review ratings for games that’s being affected. Developers also saw the number of reviews on their games drop drastically overnight. Customers give more credence to a positive rating with 100 reviews than one that has a positive rating but just 10 reviews.

"I have two games on Steam at the moment, and both took a dramatic hit in terms of the number of reviews, which was extremely frustrating because they didn't have a large number of them to begin with," says Nathan Meunier. Go To Bed from his studio Touchfight Games went from 33 reviews to 7. 

His solo project This Book Is A Dungeon went from 83 reviews to 55 overnight, and actually went from Mostly Positive up to Very Positive. "Does that help me? Yes. But at what cost?" he asks.

"It took a long time to build those reviews up organically," he says. "User reviews are one of the biggest at-a-glance metrics potential players use to gauge whether your game is worth buying. If you're a small developer with niche games that have less than 100 reviews to start with, waking up one morning to have those numbers slashed is brutal."

Why the change?

Valve said it made this move in an effort to curb review score manipulation. Some developers are believed to be giving out free Steam keys in exchange for good reviews. Still, will this new policy actually stop the flow of paid-for positive reviews? Many developers do not think so.
 
"I think what they're trying to do now is a first step, but it's easily bypassed by shady devs just giving money to shady reviewers to buy and review the games." says Little.

"I understand where the policy change is coming from, but the way it was rolled out was way too heavy handed," says Meunier. "I think a lot of developers, especially indies, felt blindsided. The core of what Steam is trying to do here is great. The updated user review policy as it stands isn't. A lot of players who buy our games legitimately (and obtain a Steam Key via other platforms) now don't have an opportunity to weigh-in. There needs to be some middle ground here, because as-is this hurts a lot of small developers who struggle to get reviews in the first place."

"I think it's good that Valve have started to privilege recent reviews, and if they keep doing that, it'll address some of the concerns people have," says Alexis Kennedy, a founder of Failbetter Games who's now Bioware's first guest writer. He says score of his game Sunless Sea was not significantly affected. "We ran a successful Kickstarter and gave out Steam keys, so the change doesn't automatically penalize community-centric devs," he says. "But I know it has penalized some of my community-centric peers, and obviously that means innocent edge cases have had a horrible shock."

What can be done to make this situation better? Many of the developers Gamasutra reached out to offered suggested solutions and advice for Steam to better stop fraudulent reviews while helping developers who might be harmed by their current policy.

Using the tools at hand

Steam already has some tools that could help them stamp out fraudulent activity. There is a flagging system  in place for reviews that marks them as problematic for various reasons, but several devs say that the tools seem woefully underutilized and poorly policed.

"Instead of taking Steam key reviews out of the score mix, I would like to see Valve do a better job of responding to flagged reviews," says Logan Williams of IndieWolverine, a PR firm representing games like GRAV, Goblins & Grottos, and Heart Forth, Alicia. "I run a Steam review audit service and have seen many instances of troll-like reviews, reviews that violate Steam community guidelines and reviews that attack developers directly."
 
"When I come across these reviews, I've flagged them (when appropriate) and I have yet to notice a substantial amount of flagged reviews being removed," he says. "Honestly, the best idea I can think of is to add staff to monitor/review flagged reviews."

Touchfight’s Meunier said a more focused approached would’ve spared negatively-affected developers. "It make sense to focus more on targeting people who grossly violate and abuse the system rather than throwing down blanket measures that impact everyone across the board,” he says. “That seems liked something Steam has already been doing, so why drop a hammer on everyone else?"

The audience and other developers, in using the flagging system, could point out instances of suspicious activity to Steam, helping them find the root of the problem with these bought reviews. For Steam, though, this would mean that more work would have to be put into following up on these flags, and teams would have to be put into place and keep an eye on things.

New reporting systems

Valve was obviously made aware of the problem with fraudulent reviews, either through developers and players pointing it out to them or through their own research. People are aware that this is a problem. So, one way developers feel it could be curbed is through adding an entirely new system of reporting, building upon that idea of flagging reviews.

"If the penalty for being caught rigging the system were banning, and a simple reporting system were put in place, the few developers who did engage in these activities would surely get the message soon enough," says Kitfox’s Short.