Before You Send the Survey, Test It With Three People

A wholesale distributor is considering a self-service stock checker. Its draft survey includes this question.

“How often is it difficult to check stock availability?”

In a small, hypothetical pilot, one buyer answers “often” because she checks several times per day and occasionally has to call. Another answers “rarely” because he checks once a month, even though he calls almost every time. A third thinks availability means delivery by the date a customer needs it. Each gives a plausible answer to a different question.

Run a short rehearsal

Invite three people who resemble your intended respondents. For a supplier survey, that might include a frequent buyer, someone who orders occasionally, and someone who checks stock but passes the purchase to a colleague. Give them the actual survey on the device they would normally use. Let them answer before explaining what you meant.

After each important question, ask them to put it in their own words. Ask what incident or record they used to answer, and what made them pick one option over another. Take notes when someone hesitates or reaches for a document they may not normally have. If someone asks you what a word means, write down their interpretation before you clarify it.

Revise the question around a moment people remember

For the stock checker decision, try “Think about the last time you needed to check whether an item was in stock. Where did you get the answer?” Offer relevant routes such as the supplier website, an email or call, and a response for people who could not confirm availability. Include a way to skip the question if no recent check comes to mind.

If the team also needs to know whether that answer was useful, ask separately whether the person could confirm a delivery date. The two answers may point to different fixes. A buyer could know an item was in stock while still needing to call to find out when it would arrive.

Decide what needs another test

Write down what you changed and why. If two people understood a key term differently, test the revised wording with someone who has not seen the earlier version. A three-person pilot can uncover practical problems quickly. It gives you observations to act on before launch, while the fieldwork still has to tell you how those experiences are distributed.