Today’s tortured questionnaire wording

29 May, 2009  |  Written by Mike Pritchard  |  under Questionnaire

I just have to share this in the hope that a reader will be able to enlighten me.  What could this possibly mean?

Not a provider that I would think of at first, but I probably would not consider it

OK, let me give some context. This is from a survey on business internet services. The researcher wants to know what would be my likely consideration for each of several providers if I’m choosing a new one. The choices are as follows:

  • The only provider I’d ever consider
  • One of the providers I’d consider above others
  • One of the providers I’d consider above others
  • Not a provider that I would think of at first, but I might consider it
  • Not a provider that I would think of at first, but I probably would not consider it
  • A provider I would never consider

If I think about it, especially with the ordering they’ve offered, I guess the research company wants to know if I would be unlikely to consider it (somewhere between “might consider” and “would never consider”).  But was there an actual phrase that they were trying to come up with?  Beats me.

It’s hard to tell whether they are losing any useful data from this poor question wording, other than running the risk of respondents terminating from confusing.

I saw this issue 11% of the way through the survey, so I wondered how bad the rest would be.  Fortunately there were no other major problems.

Idiosyncratically,
Mike Pritchard

Share with others


Email This Post Email This Post
Print This Article Print This Article

No Responses so far | Have Your Say!

Leave a Comment

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Search

Survey

Are you using SurveyMonkey,
SurveyGizmo, Zoomerang, or similar online survey tools?

Survey

Tell us about your experiences
What worked well and what could be improved?

  • Recent Comments

  • Categories