Want to test your products? Hire a professional!

You've understood the importance of testing your products with your target audience and are eager to get started.

You plan to take a few prototypes out in the field, present them to your customers and get feedback.

It’s that simple right?

If this is what you think then you are probably unaware that testing is a field of it's own that requires specific knowledge, skills and experience.

It is not that simple.

Here are some of the pitfalls you may run into if you decide to wing it without the help of a professional:

1. You have no plan, no method and no clear goal for your test

This is a recipe for collecting a bunch of confusing or invalid feedback; not what you want not aim for...

2. You choose the wrong type of test

There are many different kinds of tests catering to different needs. Usability tests, field studies, tree testing, 5-seconds tests, desirability tests, A/B testing are just a few of them... You need to select the one that is appropriate for your context and the questions that you are trying to answer.

Ux research methods , Usability testing 101 , Quantitative user research methods

3. You don’t test with the right amount of people

Not all tests require the same amount of participants. For example, formative usability tests require as little as 5 participants, while tree testing requires at least 30 because you want to be able to identify statistically significant patterns.

4. Your questions are influencing the results

The way you ask questions and react during a test can influence the answers you get. If you have no experience or training in user testing it is very likely to unwillingly introduce bias this way.

More examples of what not to say

5. Your test participants are not your average users

Who are your participants and how did you recruit them? Sometimes the way you recruit participants can introduce bias (selection bias).

Selection bias , Wikipedia

6. You confuse opinion with behavior

What people SAY they (will) do and what they actually do are two different things! Questions like "If we had a link here saying 'view details' would you have clicked on it?" or "Do you think this button would have been more visible if it was orange?" should be banned from tests. If this surprises you, I urge you to read the following article: Interviewing users , NNgroup

Making the above mistakes influences your results and leads to false conclusions. You risk:

  • Wasting time and money developing features that have no added value for your customers
  • Making your products worse instead of better
  • Making your customers very unhappy
  • Losing market share to competitors with beter products

So, if you are a company that takes customer centricity seriously then amateur testing is NOT the way to go!

Reach out to the professionals in your organization or hire one. The investment will be worth the while.



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store