I sat through a qualitative research (focus) group a few weeks ago, recruited over the phone against a specific demographic list.

On the odd occasion I receive these calls, my stated occupation is never associated in any way with marketing, as that always disqualifies you, the excuse being you might learn something, which in my experience is pretty unusual.

Anyway, are we not consumers?

The moderator was a nice woman, probably had a psychology degree or something similarly disassociated from the tough task of creating value for money, and proceeded to make every research mistake in the book.

Taking ideas as gospel. Instead of digging around to understand why we said the things being tested would work, she just took the blanket statements as fact. The reality is that nobody knows for sure if something will work or not, so gathering opinions without the supporting attitudes and reasons why is dumb.

 Asking questions we could not answer. This often happens, I have seen it and fired researchers for doing it. Why waste time asking a question, then debating the silly answers when there is no way the group could know  the answer, as it requires some specific knowledge which was not in the filtering questionnaire.

Is it better? Collecting quasi quantitative data with questions like this can lead to gross misjudgements. Just ask Coke if they had the research assuring them that ‘New Coke” was better than ‘old Coke’.

Crystal balling. Asking a group to rub their crystal balls and tell you the future is dumb, dumb unless corralled by a statement such as “if A and B were to happen, what do you think would happen next?”

Defining behaviour by Demographics.  This is a general mistake in recruiting groups. Defining your target markers, which is what this is, by demographics alone went out with the turn of the century when we recognised and were able to track the impacts of the drivers of behaviour beyond simple demographics. Just because you might live in Blacktown and do not have a degree does not mean you cannot own a BMW, purchase expensive wine and go on holidays. Our cultural and social life is far more fragmented and eclectic than in past decades that demographics are now only a small part of the picture of who we are, what we want, and how we behave.

When you spend the money on consumer research, it pays to really consider the problems to be solved and how the answers might be used. If the answer to those is: ‘what problem’ and ‘To convince the boss’   or ‘because I do not what else to do’ it is better to save the research money and do something useful with it.