<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: What is Beta Testing Good For?</title>
	<atom:link href="http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/feed/" rel="self" type="application/rss+xml" />
	<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/</link>
	<description>A Programmer's View of Game Design, Development, and Culture</description>
	<lastBuildDate>Mon, 23 Jan 2012 13:30:27 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
	<item>
		<title>By: The Players Are Wrong, But Listen Anyway &#171; Double Buffered</title>
		<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/#comment-596</link>
		<dc:creator><![CDATA[The Players Are Wrong, But Listen Anyway &#171; Double Buffered]]></dc:creator>
		<pubDate>Tue, 16 Jun 2009 08:19:36 +0000</pubDate>
		<guid isPermaLink="false">http://doublebuffered.com/?p=200#comment-596</guid>
		<description><![CDATA[[...] by JZig on June 16, 2009  When you&#8217;re deep in Beta, or you&#8217;re just taking the unusual step of actively seeking out what people think about your [...]]]></description>
		<content:encoded><![CDATA[<p>[...] by JZig on June 16, 2009  When you&#8217;re deep in Beta, or you&#8217;re just taking the unusual step of actively seeking out what people think about your [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Solving an Impossible Puzzle: MMO Controls &#171; Double Buffered</title>
		<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/#comment-559</link>
		<dc:creator><![CDATA[Solving an Impossible Puzzle: MMO Controls &#171; Double Buffered]]></dc:creator>
		<pubDate>Mon, 11 May 2009 15:06:07 +0000</pubDate>
		<guid isPermaLink="false">http://doublebuffered.com/?p=200#comment-559</guid>
		<description><![CDATA[[...] Subscribe &#160;Subscribe in a reader       &#171; What is Beta Testing Good&#160;For? [...]]]></description>
		<content:encoded><![CDATA[<p>[...] Subscribe &nbsp;Subscribe in a reader       &laquo; What is Beta Testing Good&nbsp;For? [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Luke Freiler</title>
		<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/#comment-518</link>
		<dc:creator><![CDATA[Luke Freiler]]></dc:creator>
		<pubDate>Wed, 22 Apr 2009 00:20:58 +0000</pubDate>
		<guid isPermaLink="false">http://doublebuffered.com/?p=200#comment-518</guid>
		<description><![CDATA[And to comment on your correction post - from my experience (we&#039;ve run over 300 betas, and our software used for many hundred more) - it&#039;s generally not common for product managers and developers to ignore beta feedback.  Most companies take their beta process pretty seriously and invest in it for a reason - it produces a higher quality product that makes them substantially more money.

Unfortunately gaming is one of the most complex areas to make good use of user feedback in, as the customers are just so blatantly passionate about it, combined with the fact that it&#039;s a young industry full of just as passionate people who look at game design as more of an art form than a business.  In other words, they&#039;re much more likely to &quot;trust their gut&quot; - which sometimes pays off, and sometimes doesn&#039;t.]]></description>
		<content:encoded><![CDATA[<p>And to comment on your correction post &#8211; from my experience (we&#8217;ve run over 300 betas, and our software used for many hundred more) &#8211; it&#8217;s generally not common for product managers and developers to ignore beta feedback.  Most companies take their beta process pretty seriously and invest in it for a reason &#8211; it produces a higher quality product that makes them substantially more money.</p>
<p>Unfortunately gaming is one of the most complex areas to make good use of user feedback in, as the customers are just so blatantly passionate about it, combined with the fact that it&#8217;s a young industry full of just as passionate people who look at game design as more of an art form than a business.  In other words, they&#8217;re much more likely to &#8220;trust their gut&#8221; &#8211; which sometimes pays off, and sometimes doesn&#8217;t.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Luke Freiler</title>
		<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/#comment-517</link>
		<dc:creator><![CDATA[Luke Freiler]]></dc:creator>
		<pubDate>Wed, 22 Apr 2009 00:13:12 +0000</pubDate>
		<guid isPermaLink="false">http://doublebuffered.com/?p=200#comment-517</guid>
		<description><![CDATA[Well to clarify one thing - I believe that companies should &lt;strong&gt;always&lt;/strong&gt; be listening to user feedback, and beta is no exception to that rule. Of course I&#039;m biased, but if I didn&#039;t believe I wouldn&#039;t live it.

Anyway, beta feedback in a game, especially in a public beta, and even more-so in an MMO is an extremely complex and tricky subject.  It&#039;s not something that can really be trivialized to something you should or shouldn&#039;t do.  I personally believe that it takes a great deal of skill on the role of the designer to understand what to listen to and more importantly what &lt;strong&gt;not&lt;/strong&gt; to.  The biggest challenge is the fact that user opinions are often so heated, quite often very self-interested, and generally fueled by a number of overlapping and clashing often extremely vocal minorities.  Honestly not a job I want. (:

On top of that there&#039;s the logistical nightmare of deciphering 50,000+ individual pieces of feedback, and figuring out what bucket each of them fall into. (:

I think Blizzard is a good example of a company that&#039;s earned a reputation amongst many &lt;em&gt;hardcore&lt;/em&gt; gamers (at least in regards to WoW) for not listening to user feedback, and yet nobody can hold a candle to their success - so obviously they&#039;re doing something extremely right.  I&#039;m curious what your thoughts are on that?]]></description>
		<content:encoded><![CDATA[<p>Well to clarify one thing &#8211; I believe that companies should <strong>always</strong> be listening to user feedback, and beta is no exception to that rule. Of course I&#8217;m biased, but if I didn&#8217;t believe I wouldn&#8217;t live it.</p>
<p>Anyway, beta feedback in a game, especially in a public beta, and even more-so in an MMO is an extremely complex and tricky subject.  It&#8217;s not something that can really be trivialized to something you should or shouldn&#8217;t do.  I personally believe that it takes a great deal of skill on the role of the designer to understand what to listen to and more importantly what <strong>not</strong> to.  The biggest challenge is the fact that user opinions are often so heated, quite often very self-interested, and generally fueled by a number of overlapping and clashing often extremely vocal minorities.  Honestly not a job I want. (:</p>
<p>On top of that there&#8217;s the logistical nightmare of deciphering 50,000+ individual pieces of feedback, and figuring out what bucket each of them fall into. (:</p>
<p>I think Blizzard is a good example of a company that&#8217;s earned a reputation amongst many <em>hardcore</em> gamers (at least in regards to WoW) for not listening to user feedback, and yet nobody can hold a candle to their success &#8211; so obviously they&#8217;re doing something extremely right.  I&#8217;m curious what your thoughts are on that?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: JZig</title>
		<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/#comment-516</link>
		<dc:creator><![CDATA[JZig]]></dc:creator>
		<pubDate>Tue, 21 Apr 2009 23:41:08 +0000</pubDate>
		<guid isPermaLink="false">http://doublebuffered.com/?p=200#comment-516</guid>
		<description><![CDATA[Err, I mean &quot;Luke, I understand that in other areas it may be the case that written feedback during Beta is ignored&quot;]]></description>
		<content:encoded><![CDATA[<p>Err, I mean &#8220;Luke, I understand that in other areas it may be the case that written feedback during Beta is ignored&#8221;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: JZig</title>
		<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/#comment-515</link>
		<dc:creator><![CDATA[JZig]]></dc:creator>
		<pubDate>Tue, 21 Apr 2009 23:40:34 +0000</pubDate>
		<guid isPermaLink="false">http://doublebuffered.com/?p=200#comment-515</guid>
		<description><![CDATA[Luke, I understand that in other areas it may not be the case that written feedback during Beta is ignored, but I feel that it is NECESSARY for developers to listen to feedback from MMO Betas, for the reasons above. I know from personal experience that I have used written feedback from our large-scale closed betas (the ones with around 10k players, as opposed to F&amp;F Alpha) to directly improve the quality of our products. I feel there is a strong correlation between MMO developers who ignore written beta feedback, and MMO developers who ignore ALL user feedback. And ignoring user feedback means that your game will have a large initial spike and no legs, which has happened a lot recently.]]></description>
		<content:encoded><![CDATA[<p>Luke, I understand that in other areas it may not be the case that written feedback during Beta is ignored, but I feel that it is NECESSARY for developers to listen to feedback from MMO Betas, for the reasons above. I know from personal experience that I have used written feedback from our large-scale closed betas (the ones with around 10k players, as opposed to F&amp;F Alpha) to directly improve the quality of our products. I feel there is a strong correlation between MMO developers who ignore written beta feedback, and MMO developers who ignore ALL user feedback. And ignoring user feedback means that your game will have a large initial spike and no legs, which has happened a lot recently.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Luke Freiler</title>
		<link>http://doublebuffered.com/2009/04/21/what-is-beta-testing-good-for/#comment-513</link>
		<dc:creator><![CDATA[Luke Freiler]]></dc:creator>
		<pubDate>Tue, 21 Apr 2009 22:22:04 +0000</pubDate>
		<guid isPermaLink="false">http://doublebuffered.com/?p=200#comment-513</guid>
		<description><![CDATA[This is actually what my company does (helping companies manage real beta tests), and I couldn&#039;t agree more.  Beta testing has been bastardized a bit in recent years, especially in the gaming realm - but also on the web in general.  Chances are if you&#039;re hearing about a beta test from more than a couple people or web-sites, then realistically it&#039;s a preview/demo, and your written/spoken feedback will have absolutely no effect on that product, so take that for what it&#039;s worth (on the other hand your actual playtime will generate very valuable data).  That said, just about all of these companies DO have internal betas, or at least &quot;friends and family&quot; alphas - the public just obviously doesn&#039;t know about them, and they do generally benefit a great deal from those.  Luke @ Centercode]]></description>
		<content:encoded><![CDATA[<p>This is actually what my company does (helping companies manage real beta tests), and I couldn&#8217;t agree more.  Beta testing has been bastardized a bit in recent years, especially in the gaming realm &#8211; but also on the web in general.  Chances are if you&#8217;re hearing about a beta test from more than a couple people or web-sites, then realistically it&#8217;s a preview/demo, and your written/spoken feedback will have absolutely no effect on that product, so take that for what it&#8217;s worth (on the other hand your actual playtime will generate very valuable data).  That said, just about all of these companies DO have internal betas, or at least &#8220;friends and family&#8221; alphas &#8211; the public just obviously doesn&#8217;t know about them, and they do generally benefit a great deal from those.  Luke @ Centercode</p>
]]></content:encoded>
	</item>
</channel>
</rss>

