Sample Quality Counts
Good quality sample – making sure you are talking to the right people – is a fundamental of good research. It's the first step in ensuring good quality research and without it, our data is meaningless, or worse, misleading.
This is not just an issue when using a research panel – understanding and avoiding potential pitfalls also applies when running research on your own customer database.
What does poor sample quality look like?
There are a whole range of sample issues that can arise when conducting research.
At its most egregious examples of this involve fraud: knowingly falsifying sample, although thankfully this is rare. However, there are a range of other issues beyond this to look out for. It might be people who have signed up to a panel multiple times and complete the same survey potentially dozens of times. Others are virtually professional respondents, responding to surveys one after another. Or those who skip through surveys quickly, providing nonsense answers.
More recently, bots and AI have emerged as a threat to data quality – some of your respondents may not even be human!
How do we ensure your sample is high quality?
At Edentify, we start with our own research panel, Caféstudy, which we can ensure is not over-surveyed, and we validate panel members to ensure they are who they say they are.
It's also important to ensure that the project specifications are realistic. This means setting achievable quotas, designing the questionnaire to be as short as possible, easy to complete, and error-free, so that respondents are encouraged to answer honestly and completely.
Once the data is collected, we then run a series of quality checks, including digital fingerprinting to identify any duplicate responses, timing checks to catch anyone who may have raced through the survey, and answer checks to highlight any abnormal open-ended responses. These quality checks are a mix of AI and human to provide a full picture and allow us to make the right call.
When we use our client databases or third party panels for research, we go through the same quality checking processes so you can be confident of the data that Edentify delivers.
Maintaining sample and data quality is an ongoing challenge for research agencies, and something that we are always working on improving at Edentify. If you have any questions or would like more information, contact us.
Our latest thinking
Winning with Sponsorships
Sporting sponsorship is big business. Hundreds of millions of dollars are spent each year in Australia alone on sponsorship of professional sporting clubs. But what impact does it have, and what should clubs, and brands, look for when thinking about sponsorship?Edentify's Sporting Pulse talked to...
Read moreNRL's Battle for Members
The Australian football market is one of the most cluttered in the world, with 4 codes – the big guns (NRL/rugby league, AFL) and the challengers (soccer/football, rugby union) all competing for fans.Even beyond this battle for fans is the challenge of building club membership. It's a...
Read moreAI or Authentic Insights
As a market researcher, one of my roles has been to train colleagues and clients in how to generate deep, useful insights. Anyone who has worked in research knows that getting beyond the data and identifying meaning is a critical skill and what sets insight apart from simple information. It...
Read moreWhy brand goodness is important
In a trend that has emerged over the past few years, more and more brands are jostling to position themselves not just as products and services, but as responsible citizens. At the same time, consumers have become more focused on the impact that the brands they purchase have on the world, whether...
Read more