In survey writing, phrasing must be clear so survey participants cannot interpret a question differently. You may need to use a qualifying question, which can narrow down the group to which they belong.
Qualifying questions often ask for age, gender, income, industry, postcode, marital status and position in the workplace. This enables you to determine how different segments of your market feel about the same question, product or service.
For example, a question like “Do you think we have good staff?” focuses on the word “good”, which may be interpreted quite differently by your neighbour, partner, children or parents, never mind your customers!
You might describe “good” staff in a restaurant as those who leave your table mostly alone, or you might consider “good” staff those who come by regularly to check if they can help you.
Avoid double-barrelled questions as you won’t know whether your participants are answering the first part, second part, or an average of both.
Check your survey writing for the “joining” words: and, whilst, also and plus. If you have used these in a question, chances are it is now double-barrelled.
Another trick to watch for, especially in interviews, is a change of order in the words used in the question which can completely alter the response. Here is an example.
A Dominican and a Jesuit priest debated whether it is a sin to smoke and pray at the same time. After failing to reach a conclusion, each consulted his respective superior. When they next met, the Dominican asked the Jesuit his superior’s response.
Want more articles like this? Check out the using surveys section.
The Jesuit replied, “He said it was all right.”
“That’s funny,” the Dominican responded. “My superior said it was a sin.”
Puzzled, the Jesuit inquired, “What did you ask him?”
The Dominican replied, “I asked him if it was all right to smoke while praying.”
“Oh,” said the Jesuit. “I asked my superior if it was all right to pray while smoking.”
It’s important to be clear whether you want to know about their most recent experience as your customer or about their entire experience of being your customer over time.
A “filter statement” can assist here.
For example: “Thinking about your most recent experience/purchase/visit, how did you find……”.
Alternatively, make it broader: “Thinking about all the experiences you’ve had with our staff/product/service, how did you find….”
If you have made a change in the way you deal with your customers, say a year ago, then ask: “Thinking about the last year, how did you find the product/service…”.
Then build on the question with: “Which of the following best describes your experiences with the product/service in the last 12 months compared to before that?”
Next time we’ll look more closely at specific wording issues when writing surveys, another critical element in effective survey design.
Comments