Not all samples are created equal April 23, 2018

Not all samples are created equal

One of the most important assets of a market researcher is the people that are used for research. Whether they are quantitative survey respondents or qualitative participants, research will fail if the people and responses are not of the highest quality.

Yet this is one area where much of the industry often turns a blind eye. Survey samples are treated as a commodity and outsourced to the lowest bidder. This race to the bottom leads to poor quality control, with people able to complete surveys multiple times, or sit and complete survey after survey.

No-one would consider running focus groups where people completed one, then went straight to the next room for another, and another, and so on. Yet with surveys, too often none of this is questioned as long as the survey is completed.

This problem is worsened when researchers try to extract too much from people through long, repetitive, or complicated surveys, or force them to complete surveys that aren’t optimized for mobile.

The result of all this is that it is too easy to produce research based on a poor sample. And ultimately clients may be making decisions based on poor quality data.

So what is the solution?

Not all research panels are created equal, and at Edentify most of our research is conducted through our exclusive Caféstudy research community to ensure you can trust the data we collect. When required, we work with a range of sample providers and select these based on whichever is best suited to the needs of each project.

Here are a few guidelines to follow when managing a research panel:

1. Treat them like people, not as numbers. It is important to ensure that people are not “over-researched” to the point where they are fatigued and treat the research as simply a financial transaction, but instead help them see that they are making a valuable contribution.

2. Keep your studies easy and fun. By ensuring that surveys work on all platforms, and keeping them simple, fun, and as easy as possible to complete, we know that our community members want to engage with our research.

3. Reward them fairly. As the saying goes, if you pay peanuts, you’ll get monkeys. Allowing people to earn enough to make it worthwhile for them, and also making it easy to get their hands on their money (via Paypal for example) will keep people coming back.


Our latest thinking

May 20th, 2024
NRL's Battle for Members

The Australian football market is one of the most cluttered in the world, with 4 codes – the big guns (NRL/rugby league, AFL) and the challengers (soccer/football, rugby union) all competing for fans.Even beyond this battle for fans is the challenge of building club membership. It's a...

Read more
April 11th, 2024
AI or Authentic Insights

As a market researcher, one of my roles has been to train colleagues and clients in how to generate deep, useful insights. Anyone who has worked in research knows that getting beyond the data and identifying meaning is a critical skill and what sets insight apart from simple information. It...

Read more
September 13th, 2022
Why brand goodness is important

In a trend that has emerged over the past few years, more and more brands are jostling to position themselves not just as products and services, but as responsible citizens. At the same time, consumers have become more focused on the impact that the brands they purchase have on the world, whether...

Read more
August 05th, 2022
COVID-19 and the Great Resignation

The COVID-19 pandemic turned many aspects of our lives upside down. One of the biggest disruptions was to how we worked.Frontline workers bore the brunt putting in shift after shift in our busy hospitals, supermarkets and essential services.Those who work in hospitality, retail and tourism among...

Read more