Large language models are now embedded in how many brands do market research — simulate consumer responses, get results in hours instead of weeks, at a fraction of the cost.

But a rigorous Harvard Business School and Microsoft Research working paper finds that LLM-based preference estimates are realistic in some contexts and wrong-signed in others — with estimates sometimes off by a factor of three — and that a researcher without a human benchmark has no basis for knowing which is which. A Journal of Marketing study finds the human-LLM hybrid outperforms both approaches alone, but only when the human judgment is genuine rather than a pass-through. And research published in Harvard Business Review finds that LLMs consistently recommend strategies aligned with managerial buzzwords rather than context-specific logic — a pattern the researchers named trendslop.

Taken together, the evidence points to a specific map: LLMs for market research are reliable supplements when you have prior human data from the same category, unreliable substitutes when you don’t, and systematically biased toward the fashionable on exactly the questions where conventional industry thinking most needs challenging.

This episode makes that map practical — three questions a brand leader should ask before acting on what AI-assisted research tells them.

Synthetic respondents have gone mainstream — AI stand-ins for your customers you can question without recruiting anyone, a focus group that never closes.

But not all of them are worth listening to, and this episode is about what actually decides that: not the fact that they never end, but the depth and realness of the data the model is built on, and whether it was built for the job you’re asking it to do.

We draw on a Stanford study where AI versions of real people, built from rich interviews, far outperformed versions built from demographics alone — and on its 2026 follow-up breaking the result down by how much real data each model was given — alongside new work finding that piling demographic detail onto a generic model doesn’t reliably make it more accurate, to get specific about what these modelled respondents are, why a stand-in is only ever as good as the data underneath it, and the two questions a brand leader should ask before trusting one — what is it built on, and what was it built for?

A model grounded in deep, real customer data is an instrument; a thin guess in a persuasive font is a mirror.

For decades, brands have understood their customers through age, gender, and income — but those categories are losing their power to predict what people actually do.

This episode of Know Your Audience digs into Adobe’s 2026 consumer research, where a survey of four thousand people found that attitudes toward AI tracked comfort with the technology far more than any demographic line, and into recaps from this year’s IIEX APAC sessions showing how the rise of one-person households is quietly rewriting assumptions about who the customer is — alongside a reminder that behavioral data only means something in cultural context.

It's a shift even the most careful institutions are acknowledging — Pew Research Center now treats generational labels with caution, and McKinsey finds the segmentation that works is built on attitudes rather than demographics. The takeaway for brand leaders: relevance is now earned moment to moment, not assigned by segment, and the teams reading their customers a layer deeper are the ones changing the first question they ask.