Slashdot Mirror


Why Creators Should Never Read Their Forums

spidweb writes "One full-time Indie developer writes about why he never goes to online forums discussing his work and why he advises other creators to do the same. It's possible to learn valuable things, but the time and the stress just don't justify the effort. From the article, 'Forums contain a cacophony of people telling you to do diametrically opposite things, very loudly, often for bad reasons. There will be plenty of good ideas, but picking them out from the bad ones is unreliable and a lot of work. If you try to make too many people happy at once, you will drive yourself mad. You have to be very, very careful who you let into your head.'"

21 of 221 comments (clear)

  1. Obligatory reference to /. by PatPending · · Score: 5, Funny

    Sometimes you just have to wonder about the /. editors...

    --
    What one fool can do, another can. (Ancient Simian Proverb)
  2. If you're not going to read your forum ... by Daniel+Dvorkin · · Score: 4, Insightful

    ... don't have one. It's really that simple. If you do have a forum on your site -- any site -- then users have a reasonable expectation that you'll read it and, if not cater to their every whim, at least take their opinions into account. Failing to do this send the message "we don't care about our users," and that's not exactly a formula for success.

    BTW, this shouldn't be taken as a slam against Spiderweb Software, which has produced some really excellent games over the years. More a general note, I guess.

    --
    The correlation between ignorance of statistics and using "correlation is not causation" as an argument is close to 1.
    1. Re:If you're not going to read your forum ... by devxo · · Score: 5, Insightful

      It's still a general place for the users to go and discuss with each other. Usually you also always find other people willing to help you if you have problems with the game.

    2. Re:If you're not going to read your forum ... by Zenin · · Score: 4, Insightful

      Agreed.

      Of course you can't just stick your finger in the wind of the forums to design your game. You do need to actually judge and filter ideas that come up in forums; Design is not a democracy.

      But more then a few games with great potential have shot themselves in the face repetitively by ignoring the forums. They either never were aware of huge game-destroying issues or came up with their own incredibly horrid solutions, when in fact the users had suggested exceptionally good ideas in the forums.

      The nice thing about game forums...the users do much of the filtering for you already. Bad ideas get torn apart by other users with great haste, exuberance, and detail. They figure out every possible angle much better then developers could ever do.

      ----

      It's very disheartening to watch your favorite game crash and burn while the developers implement bad idea after bad idea, despite really great suggestions flooding the forums.

      --
      My /. uid is better then your /. uid
    3. Re:If you're not going to read your forum ... by gravos · · Score: 5, Insightful

      If you're not going to read your forum... don't have one. It's really that simple. If you do have a forum on your site -- any site -- then users have a reasonable expectation that you'll read it...

      I think this is a rather silly perspective. I personally provide a chatroom and forum services for players of a game I wrote and have similar services for other software I've written. Sometimes other users answer questions, occasionally I do, and sometimes they go unanswered. There is no "reasonable expectation" that I personally will read anything: if that's what you want, you should find a commercial product and purchase support at a nominal hourly or per-incident fee.

      Time spent reading forums is time not spent developing a product. Jeff makes a good argument in TFA that, in many cases, this is a good tradeoff.

    4. Re:If you're not going to read your forum ... by Serious+Callers+Only · · Score: 4, Insightful

      Bad ideas get torn apart by other users with great haste, exuberance, and detail.

      Or not, as the case may be; good ideas may equally be torn apart because they don't agree with the preconceptions and assumptions of the particular users on the forum. Your argument assumes that large collections of people will produce the best solution, or even a usable solution, by consensus. That's not often the case in my experience.

      Democracy is the least bad political system because it limits the power of those in charge and forces them to be held to account, not because it produces efficient or desirable results. To apply it to realms other than the political is not always useful.

    5. Re:If you're not going to read your forum ... by psetzer · · Score: 5, Interesting

      While you get an idea of what the people who post in the forum like by reading it, it's not necessarily the best choice overall. The people who post on gaming forums are going to be a self-selected subset amounting to a couple of percent of the total player base, tops. This means they're going to have opinions that may not reflect everyone who plays the game. Most notably they're going to be more hardcore than average.

      There is no war game, simulation or RPG mechanic so utterly baroque that someone won't decry streamlining it as 'dumbing down' the game. Inevitably that someone posts on the developer's forum. People got unbelievably pissed off when Dungeons and Dragons got rid of THAC0 and made higher armor classes better. All THAC0 did was complicate the rules set and give newcomers one more reason not to play past their first game. D&D 4e among many other things eliminated enemies that drain levels on touch since permanently weakening a PC sucks, it disproportionately hits melee classes, and it brings the game to a halt as you recalculate everything every time someone gets hit.

      Ultimately, designing a game is a different skill set from playing the same game. Players can give an idea of what they personally liked and disliked, but as a rule have a pretty terrible idea of what's possible and what's balanced. Designers who forget that are begging for trouble.

      --
      "Anyone who attempts to generate random numbers by deterministic means is living in a state of sin." -- John von Neumann
    6. Re:If you're not going to read your forum ... by Arancaytar · · Score: 4, Insightful

      To be honest, as a long-time member of their forum, I can confidently say it will indeed drive you mad, regardless of whether you are Jeff Vogel or not. :P

      However, the division between what Spiderweb Software does and what the forum thinks has been there for years, and its reason is simple (and kind of frustrating): Spiderweb Software made a game that its fans loved, and it bombed (Blades of Avernum). Then it made a game that the fans didn't like (partly out of They Changed It Now It Sucks, but also for real complaints like a simplified gameplay and greatly reduced impact of character mortality) and it sold very well (Avernum 4). The company had no real choice in that matter - making a small group of fans happy simply makes no economic sense compared to making games that sell.

    7. Re:If you're not going to read your forum ... by aztracker1 · · Score: 4, Insightful

      Not only that, but having support and/or marketing staff/people in place to filter suggestions, is probably a good idea... TFA has some valid points, if you've seen the way some indie games go, it's a wonder they get anything done as often there are diametrically opposed requests for changes in game metrics.

      --
      Michael J. Ryan - tracker1.info
    8. Re:If you're not going to read your forum ... by Anonymous Coward · · Score: 3, Informative

      The problem is that there are games where there are unified calls - nigh unanimous - and STILL the developers aren't f'ing paying attention.

      Your specific example notwithstanding, the wiser developers know full well that "nigh unanimous" complaints on a forum, in general, means "unanimous only among the people complaining", given the people who are happy with (or just don't mind) whatever "unanimously" needs to be changed aren't going to manically gush on and on about every bit of minutia they love about the game.

  3. On the flipside by estitabarnak · · Score: 3, Interesting

    I had a great time playing Galactic Civilizations II. The experience was certainly enhanced by interacting with the game's creators on their forums. These folks were pretty good about releasing major updates for a good while after the release date, so suggestions actually made it in to the game. If nothing else it was nice to feel like someone was listening for once.

    In short, responsive/interactive game developers can enhance the experience both in and outside of the game; taking every suggestion doesn't matter.

  4. Re:Some people aren't bothered by criticism by Lemmy+Caution · · Score: 5, Insightful

    Creative people are often sensitive. I wouldn't want to limit my world to things created only by people with thick skins: they are often unperceptive.

  5. Whaddaya mean, creators? by Kokuyo · · Score: 4, Funny

    Nobody who retains any semblance of sanity and wishes to keep that should ever engage in online discussion. It's usually pointless, annoys people and yourself to no end and you seldom feel you've accomplished anything.

    Now if only I had realised this before starting to develop this god-damned need to add my two cents whenever someone is wrong on the internet...

  6. Great example is the IMDB boards by GodfatherofSoul · · Score: 4, Insightful

    You've got all sorts of hyper-critical morons calling every moving under the sun boring or overrated. At the same time, you've got the fan boys calling Paulie Shore movies the next Citizen Kane. Open calls for criticism usually garner responses from the extremes.

    It's like looking up car reviews. You might as well throw out all the 1 and 5 stars since they're respectively the guy pissed off that the dealer took too long getting the car cleaned or the woman astroturfing for Ford.

    --
    I swear to God...I swear to God! That is NOT how you treat your human!
  7. Just make it open source.... by Mindcontrolled · · Score: 4, Funny

    Just go with the general spirit of the open source community. Set up a chatbot that post "Fix it yourself if you do not like it" to every forum entry and don't give a shit about your users. Problem solved. Or not.

    --
    Ubi solitudinem faciunt, pacem appellant.
  8. Counterpoint: Dwarf fortress by qvatch · · Score: 3, Informative

    Case in counterpoint, Dwarf Fortress and it's most active forum frequented and responded to by the game creator. He answers questions, takes (in an ineffable manner) suggestions, and otherwise participates in the enjoyment of his game. Example: http://www.bay12forums.com/smf/index.php?topic=60554.msg1848408#msg1848408 Dwarf fortress: http://df.magmawiki.com/index.php/Dwarf_Fortress:About

  9. Re:A prime example of this not working by Rik+Sweeney · · Score: 4, Informative

    The problem is that Android apps don't have any copy protection on them, so users can simply copy the app from each other. Rovio gets around the problem by simply displaying adverts and make $1M a month from this strategy.

    http://androidcommunity.com/angry-birds-android-ads-make-rovio-1m-per-month-20101208

  10. Re:Some people aren't bothered by criticism by mcvos · · Score: 4, Interesting

    There are actually creative people who can take criticism. No idea how rare they are, but they definitely exist. John Carmack has posted on Slashdot. Brad Wardell has posted on usenet (off all the hotbeds of flamewars and trolls...). And I think Brad has had very productive discussions there, which did influence his games.

    For example: Brad prided himself on the good AI for Galactic Civilizations, and it certainly had the best AI I've ever seen in a turn-based strategy game. But it still lacked true killer instinct. Brad said it'd be too frustrating if the AI truly pulled all the stops on dirty tricks. I (and others) disagreed; we argued that if a game had difficulty settings called "impossible" and "masochistic", we expected some serious punishment to come our way. We wanted the AI to trick us in the same ways we tried to trick it. In the end, I think he made one particular AI pull all the stops on the hardest difficulty levels. Not all, unfortunately, but it's still something.

    Of course there were also idiots who complained that the game was too hard because they couldn't beat the AI at "hard" difficulty, and needed someone to explain to them that they could set the difficulty to "normal" or "easy". You just need to be able to recognize the idiots and trolls and tune them out. Anything that might be useful, you need to read in the most positive light possible. But some people have mastered those tricks.

  11. Re:Some people aren't bothered by criticism by 19061969 · · Score: 3, Insightful

    Critique is fundamental to design - good & great designers actively seek out criticism. Whether the criticism is worthwhile is another question, but any designer worth paying is big enough to deal with flack. IMHE, I've found designers to be the most motivated solicitors of feedback.

    --
    bang goes my karma... again...
  12. Listen, but don't respond by gman003 · · Score: 5, Insightful

    I fully believe that there is something to be gained by reading your forums. Not every single post - just the ones that catch your eye, or seem to be highly-read. Sure, there's going to be a lot of crap, but there's plenty of good ideas out there too.

    However, there is very little to be gained by responding to your forums. At most, you might say "actually, that does seem like a good idea", or "I already discussed this in a blog article several months ago. It just doesn't work.". Responding to even half of the stupid, short-sighted and ignorant ideas people post would be a massive waste of time, and would probably drive anyone insane.

  13. Oblig Ford Reference by pak9rabid · · Score: 4, Insightful

    If I had listened to my customers, I'd have built faster horses. ~Henry Ford