You are reading a MIX Online Opinion. In which we speak our minds. Tim Aidlin Meet Tim Arrow

Opinions

11Comment Retweet

Usability Testing On The Cheap

May 17, 2010 In Process By Tim Aidlin

Usability testing doesn't take long, and it helps give your clients confidence in the choices you make. Here's a couple easy ways to do it quickly and inexpensively

Usability Testing on the Cheap

Recently, I’ve been doing a lot of usability testing. The great part about it is, each new person I sit down with reveals a wealth of knowledge that would otherwise have gone untapped. The bad thing is, user testing takes time out of a busy production schedule, adding to an already stretched timeline and minimal budget.

But it’s worth it.

Why Do it?

Clients always want their deliverables last week. We do our best to deliver quickly— sometimes within ridiculous timelines. Because of this, we often don’t have time to put the design, product or idea in front of potential customers. Unfortunately, this can lead to myopia , and sometimes to a displeased audience and client.

If the product you deliver doesn’t resonate with your client’s audience, the displeasure frequently reflects back on *you*: You didn’t understand the “greatness” of the product. You didn’t convey that greatness to the customer. You just didn’t get the message, and the final product doesn’t perform.

It’s rare for clients to admit that their idea needs improving. When presented with actual data, however,they have an empirical foundation on which they can judge their ideas. This is where usability testing comes in.

Usability testing doesn’t take long,and it helps give your clients confidence in the choices you make. It’s also an excellent opportunity to discover major issues and address them before releasing a product to the public, and before the client begins receiving feedback.

Doing It Inexpensively

User-testing is fairly easy to do, and inexpensive. The best way I’ve found is to just sit down with a user,watch him or her, and take notes. It’s best to find someone who’s unfamiliar with your product or service, because the goal is to make your product as easy to use for first-time users as it is for veterans.

Generally, all this testing requires is some time and patience. However, if you’re testing a user-interface, screen-capturing your session can help you evaluate data after-the-fact. If possible, your video should be accompanied by audio, which you can usually capture via the software you’re using, or even a mobile device with a microphone. Watching and listening to the user can lead to great insights.

Doing It Wisely

I mention listening to the user because I’ve found this is where they generally express frustration. It’s hard to tell when a user is really having problems just by watching where they click or move their mouse.

Ask your test subjects to narrate their actions as much as possible. Encourage them to voice their intentions, expectations and frustrations . Have them tell you what they’re doing with the mouse: What they’re looking at and what they’re looking for. Stream-of-consciousness is what you want here.

And you, you shut up. Of course, give your subjects guidance and answer questions when they ask—but do your best to stay out of the way. If you over-direct, your test subjects won’t be as likely to explore, and you might get a skewed result.

Also, keep testing informal. Meet in a comfortable spot. Relax. Talk a bit. Keeping it loose will enable people to relax, talk to you more freely and use the product like they would if you weren’t looking over their shoulders.

Telling ‘em What To Do

Users seem to fall into one of two categories: those who like specific direction, and those who like to explore.

Both of these types of users are valuable, so it’s helpful to come to your session with two scenarios in mind: one that’s very directed, in which you ask the user to perform a certain set of tasks, or a specific workflow. The other is to simply let the users “go crazy” and use the product how they see fit. This is an interesting way to see what a user would do coming to your product “blind,” and can provide valuable insights on making your product as accessible as possible.

Other Methods

Although the most valuable data is often collected after a design has been developed and is usable, doing usability testing prior to production is a good idea. It’s important to create solid wireframes, if not fully-realized composites, and go through the same process as discussed above.

As well, if you have a serious budget and giant project, it may be worthwhile to invest in large-scale, “professional” usability testing. I’ve been fortunate to have been part of many sessions where there was a group of us sitting in a little room, watching 8 or so users interact with various user-interfaces. The sessions were moderated by a professional usability tester, and were highly focused, video-recorded and analyzed later. Of course, the data from these sessions was very useful.

I think, however, the small shop or individual designer can do quite well and get similar results from doing usability testing on the cheap.

What About You?

What’s your experience with usability-testing? Do you find it useful? Are your clients reluctant to pay for it? What sort of tips could you give other small shops and freelancers to do it on the cheap? Leave a comment below, and be sure to follow us on Twitter at @Mixonline.

Follow the Conversation

11 comments so far. You should leave one, too.

Jay Lohmann Jay Lohmann said on May 17, 2010

Or, you could use http://www.UserTesting.com. It is a great tool. I am not affiliated with it in any way.

Joshua Lay Joshua Lay said on May 17, 2010

@Jay Lohmann -
I take it you''ve used this service before?
What has your experience with it being like? I''m very interested in using it due to the pricing.

@Tim Aidlin
How do you usually round up people for usability testing?

Do you try and bring in a specific type of user group. i.e. intended customer demographic?

Vinh Khoa Nguyen Vinh Khoa Nguyen said on May 18, 2010

It''s a good article. But I think it''s not really focused on the topic I thought this article is about: that is how to make it cheap. Usability testing is critical. I don''t think anyone could deny it. It''s just the matter of justifying the cost involved and what you get from doing it.

Recruiting users, sitting down with them, performing video and audio recording are very traditional methods that could be used in both small scale and large scale usability testing. Maybe the article should explain deeper or make a comparison of the cheap ways vs the expensive ways and the benefits of both to see if you can still achieve the results you want from choosing the informal/less expensive method.

Thanks for the article anyway.

Corey Machanic Corey Machanic said on May 18, 2010

Well put! There are many complex layers to successful interactive design and development—I say "interactive," because it''s not always a website—and because the vast majority of the content/solutions out there are built on shoestring budgets, it''s invaluable to know how to best simplify these layers through the process.

This article is great at sharing what you can do if your project can''t afford a full blown usability test. Any bit of testing goes a long way.

Developing your use-cases, and thinking through the eyes of these users as you design and develop is always a good and affordable start.

Guido Tapia Guido Tapia said on May 18, 2010

Hi Tim, using something like http://www.picnet.com.au/met/ is also a great way to do good usability testing on the cheap (free). Good article btw

Stickers Melbourne Stickers Melbourne said on May 24, 2010

We just used usertesting.com just now. It''s pretty good. We would be better if they had users in your country so semantics like metric to imperial measurements aren''t an issue. The videos they give you are great also. We found a few things we could greatly improve on our website by using their service.

We''re not affiliated in any way either with them.

Stephen Pratley Stephen Pratley said on May 24, 2010

Thanks for the Telling ‘em What To Do tip. There are definitely different ways people shop and forcing them to do something out of character doesn''t always work.

@Jay Lohmann The price of remote testing may look attractive but there''s absolutely no substitute for a handful of users in the same room. When there''s no budget we just take a laptop to the local coffee shop and offer to pay for coffee for anyone who looks a likely candidate. We still get useful feedback.

Henry Freeman Henry Freeman said on May 25, 2010

I really don''t have a comment being that I''m a newbie , I''m trying to listen to see what would be best for me since I;m working with a very limited budget .

coco chanel clothes coco chanel clothes said on Oct 21, 2010

I really don’t have a comment being that I’m a newbie , I’m trying to listen to see what would be best for me since I;m working with a very limited budget .

Chris West said on Apr 14, 2011

I just tried out http://www.fivesecondtest.com (no affliation at all) and it''s pretty good. Very nice user interface and it''s basically free if you''re willing to spend 10 minutes or so reviewing other people''s sites first to earn the karma.

Melbourne Printing Services said on May 1, 2012

I've seen a lot of products being pushed on the market which I doubt any usability testing has been done for it. The frustrations are pretty obvious.

One thing to keep in mind when doing a usability test is to be wise in selecting the complaints or feedback of the test user. Not everything should be taken seriously. Of course this depends on you and how you perceive the result of the test.

We'll use your email to grab your gravatar. We won't store your email or sell it to trolls.