RKG Logo

Most of the bits spilled over Facebook this week were spent beating up Beacon, but at UIE’s website, Jared Spool’s article on The Five Usability Challenges of Web-Based Applications leads with a recap of an earlier Facebook misadventure — the introduction of its MiniFeed feature.

In case you missed it: Back when MiniFeed was first launched, within 24 hours of its release, nearly 10% of Facebook’s users rejected Mini Feed (and petitioned against it). Jared points out that this type of user-behavior is unique to web-based applications- we don’t typically organize around our dissatisfaction with desktop apps.

Give Jared’s post a close read for some great insights, but here are the 5 challenges he cites, along with some quotes pulled to highlight a nagging question of my own:

Five Usability Challenges of Web-Based Applications

  1. Scalability: “A contributor to Facebook’s mini-feed debacle was the scale of their design. Facebook, making any change to their site, instantly affects eight million people. If even one percent has issues with the change, that’s 80,000 affected users.”
  2. Visual Design
  3. Comprehension
  4. Interactivity
  5. Change Management: “The designers at Facebook learned the hard way that quick changes to the application, even if the team thinks it’s an improvement, can have serious negative results if done incorrectly…. We’re now seeing teams start to design the change process along with designing the changes themselves.”

So here’s what’s got me scratching my head:

Why doesn’t Facebook use their incredible scale as an asset when they introduce changes to their site? Why not test these changes with a statistically significant fraction of their traffic, and then optimize based on this sample’s behavior? (Think about the way the Amazon redesign trickled out, and the insights likely gathered along the way.)

With our own site testing work, we’ve been fortunate to see some strong results for our clients. We encourage folks to test big differences – shouts not whispers. Whenever you’re testing, some experiments produce the anticipated result, some don’t. But each time you test, you can introduce a big change, in a well-defined area of your site – to a deliberately limited portion of your visitors.

That means that while increased conversion is almost always the ultimate goal, every test lets you methodically introduce site changes in a way that respects your users and your brand.

If you like this post, consider subscribing to our RSS feed. You can also have new posts sent to you via email.

Share this post (via email, Digg, Delicious, etc)

Similar Posts

Trackback

http://www.rimmkaufman.com/rkgblog/2007/12/07/facebook-testing/trackback/

No Comments Yet

Your comment will be first!

Your Comment

We "do-follow" links in comments. This may help your search rankings. Learn more...

Email Updates

Categories

Recent Comments

  • George Michie: Thank you for your insights, Mark! It's good to get different perspectives.
  • Mark Pilipczuk: Thanks for taking the time to look into my model and commenting back, George. I re-checked my model to make sure there were no...
  • SYP: I am honored to be mentioned in such esteemed company. Thank you. Virtual single malts all around. :) --So Young.
  • Web Design Zoo: Thanks for that. Already had Dan Cederholm's book, may use my amazon vouchers and get a few of these titles.
  • George Michie: Interesting idea, Mark, but I'm not sure I agree with your analysis. I thought of this the following way. Let's say the AOV is $100...
  • Martin Botťánek: Very interesting and well written article. Thanks. Actually, I believe almost everyone in marketing understands that spending...
  • Mark Pilipczuk: Very useful. I hope folks take the time to read and understand this. I played around with the numbers on my own because I asked...
  • George Michie: Hi Ankur, We think these are important questions, but we don't think the answer is the same for every company. Not every company...
  • Ankur Mody: Hi Alan, This is like advanced PPC from a statistician point of view. I feel you are posing a question and answering at the same time...
  • Capitol Hill Condo: This is some very interesting information about how real estate will be advertised on google.
  • Mark Pilipczuk: The inability for a lot of companies to hire within 120 days for senior level positions is a problem that, like Harry, I find far...
  • Simonbike: I love your blog...really. Did you already hear about water on mars? :)
  • John: Like I expected Google has lost money due to the recent 'slap' of 1th April. Hopefully they learned from this that there is a good...
  • j: thank u so much! i think this saved me from the recurring orders that proactiv kept sending me. i even called them to cancel and it wasn't...
  • James: 13. Tom, February 22, 2008: When I do row B, it gives an “The formula contains unrecognized text”… And so when I paste the values,...

Blog Stats

  • Posts: 723
  • Words: 319,515
  • Comments: 1,104

Administration

Close
  • Social Web
  • E-mail
Powered by ShareThis