The Right Sample Size for AI-Moderated Interviews

Every proposal puts a number in the sample box. If you are honest, it came from what the budget would carry as often as what the design needed. Twenty interviews. It has the ring of something settled in a journal somewhere. Mostly it is a budget constraint that hardened into a rule. AI moderation is about to expose how much work it was doing.

Key Takeaways

• Saturation is segment-specific. What saturates one audience will not saturate five. Averaging across them gives you an approximation of a sample.
• Code saturation and meaning saturation are different thresholds. Your themes show up early; the nuance behind them takes considerably longer.
• Probe quality sets your effective sample size. A moderator that accepts thin answers pushes meaning saturation further out, whatever the n.

How Many Interviews Reach Saturation

The convention is a rounding of something more specific, worth knowing if you have to defend it to a client. Guest, Bunce and Johnson's foundational study analyzed 60 interviews and found saturation arrived within the first twelve, with high-level themes visible as early as six.

It is also half the picture. The missing half is the one that bites you in the debrief. Hennink, Kaiser and Marconi drew a distinction the convention ignores. Code saturation, where no new themes appear, comes early. Meaning saturation, where no further dimensions or nuances emerge, takes considerably longer, in their work 16 to 24 interviews. Stop at the first threshold and you have a complete list of topics with nothing interesting to say about any of them. That study reads fine on the summary slide and falls apart when someone asks why.

Saturation Is Segment-Specific

You already know where this breaks. A study labeled "national" with 20 interviews across five segments has four per segment. Four. Someone will still ask what lapsed users thought and someone will still answer it. That is sampling anxiety managed by averaging.

Hagaman and Wutich revisited the Guest study across four cross-cultural sites. They found that 16 or fewer interviews identified common themes within a homogeneous group. Themes cutting across all sites required 20 to 40. Within a segment the small numbers hold. Across segments they do not.

What Scale Buys

The weak argument for more AI-moderated interviews is that they are cheaper. The one that should interest you is that scale changes what you can claim in the readout.

Take a repositioning test across loyalists, lapsed users and new-to-category considerers. Traditional pricing gets you eight per cohort, under the threshold for all three. You write the deck anyway with careful hedging around the thin cells. At a fraction of the cost each cohort reaches saturation on its own terms. The finding stops being an average across an implicit blend. The same economics reach the secondary markets that get dropped for cost reasons rarely stated in the methodology. They also turn a second wave into a research decision rather than a budget exception. That is the real unlock in qual at scale: coverage of the audiences that used to get skipped.

The Constraint Moved From Budget to Design

The comfortable line most vendors give you is that the saturation logic is unchanged and only the cost differs. That is not quite right.

Meaning saturation depends on how hard the moderator pushes. Nuance surfaces because someone chased a hedge or held an earlier claim against a later one. A moderator that accepts "it's fine, I guess" and moves on hits code saturation on schedule and meaning saturation late or never. Probing quality is therefore a sample-size variable: weak probing raises the n you need to learn anything. Probe depth is the sampling question to ask when you evaluate AI-moderated interviews.

Recruitment runs the same way in reverse. This one should worry you more. Scale multiplies whatever is already in your sample. If the screener is loose or the panel is thick with professional respondents, a large sample will not rescue the study. It will hand you a more confident version of the same error. Solving a design problem with volume works even less well when volume is easy.

AI Moderated Interviews: How the Method Works

An AI moderated interview runs one-to-one and asynchronously. The respondent receives a question and types or records a response. The AI reads that answer before the conversation moves forward. If the answer meets the criteria the researcher set, the interview continues. If it falls short, the AI asks follow-ups up to a maximum the researcher configures. The researcher sets the probing logic; the AI applies it the same way for every respondent.

Consistent probing makes saturation a more stable target. Any gap in the researcher's criteria also repeats across the whole sample. Enumerate's AI Validation reads an open-ended answer while the respondent is present and probes only where it misses the researcher's criteria. Answers that already meet them are left alone.

What the Research Implies for Study Design

None of this yields a number you can drop into a proposal. What it gives you is a set of questions worth answering before you set the sample.

• Within a segment, the evidence clusters low for themes and higher for nuance, meaning saturation landing in the high teens to mid twenties. Where you sit depends on how much of your value is the nuance.
• Across segments, the counts do not pool. The question is whether cross-cutting themes are in the brief, because that is where the requirement climbed to 20 to 40.
• For longitudinal work, establishing themes is a different task from detecting whether they moved. The second has tolerated lighter waves.

What held the count down was the cost of reaching it in every segment that mattered. That cost has changed. What has not is the part that was always yours. The count only pays off if the probing is deep enough to earn it and the recruitment clean enough to trust it.

Curious how this applies to your study design? Book a demo with Enumerate.