Who Didn’t Answer Your Survey?

Imagine a training company surveys people about its booking process. The responses are encouraging. Attendees say booking was easy, and the team starts planning improvements to the course materials. Then someone asks where the invitation went. It was sent with the attendance certificate.

That list gave the team useful feedback from people who booked and attended. It offered little evidence about people who got as far as the payment page, needed manager approval, or gave up when they could not find a date. The way the invitation was distributed had already decided whose experience the company would hear.

Trace how someone made it into the results

Draw a column for each group on a page. Start with the people eligible for the study, then add the people you invited and the people who replied. Put a short note under each column explaining how names got there. For the training company, a possible starting population is anyone who seriously considered a course during the last quarter. Invitations might go to previous attendees and people who made an inquiry. Replies could come mostly from attendees.

Look at each gap separately. If you never had a way to contact people who abandoned checkout, that is a gap in whom you could invite. If you invited people who made an inquiry and few responded, that is a gap between invitation and response. The first may require a different recruitment route. The second may call for a shorter invitation, a different time, or a clearer reason to take part.

Ask what the missing group could change

Suppose the decision is whether to add weekend sessions. Frequent attendees can tell you whether they would switch. People who asked about dates and never booked may help you understand whether weekday scheduling kept them out altogether. A few conversations with that second group can challenge your explanation and sharpen the next study. They cannot establish how common the problem is across everyone who considered booking.

When reporting the results, name the group that actually answered. Write “Among the attendees who replied, most found booking easy” if that is what you observed. Then give the open question its own line. “We still don’t know what stopped people who considered booking and left.” A reader can see both the value of the feedback and where further work would affect the decision.