Research without a researcher: the AI-era playbook

Chris Hlavaty
Chris Hlavaty
Co-founder, Sera
Updated 7 min read
A small figure before a vast self-operating illuminated console

You can do real user research without a researcher on staff. That sentence would have been irresponsible five years ago; today the operational layer that made research a specialist job — recruiting, scheduling, moderating, transcribing, synthesizing — is handled by AI tooling, and what remains is judgment. Judgment is learnable, and this playbook is the short version: what to run yourself, the guardrails that keep leadership trusting the output, and the honest line past which you should call a professional.

Why is research without a researcher suddenly possible?

The reason most teams skipped user research was never that PMs, designers, and marketers couldn't ask users good questions. It was operations. A single ten-person interview study meant writing a screener (the questionnaire that filters for the right participants), recruiting, three weeks of calendar Tetris, ten hours of moderation, and days of analysis. Research teams existed largely to absorb that operational load — and teams without one simply shipped on instinct.

AI collapsed the load-bearing part. A tool like Sera turns a pasted URL or Figma link into a full draft study — goals, screener, discussion guide — in about two minutes; AI-moderated interviews then run in parallel rather than one per calendar slot, so 30 sessions finish in under a day; synthesis turns the transcripts into themes and cited quotes in hours. The specialist ops job is gone.

What did not collapse is the judgment layer: deciding which question is worth asking, whether the sample can answer it, and whether the evidence actually supports the decision you're about to make. That layer is now yours. The good news is that it's a small number of rules applied consistently, not a degree.

The scarce resource was never research talent — it was research operations. Now that machines run the ops, the question stops being "who is qualified to do research?" and becomes "who is close enough to the decision to ask the right question?" Usually, that's you.

What research should you run yourself?

Run evaluative research yourself — studies that test a specific, concrete thing against real users' behavior and reactions. Evaluative work is forgiving of inexperience because the stimulus does the heavy lifting: participants react to something real, and the findings are observable rather than interpretive.

The green list:

  • Usability tests — watch users attempt a task in your product, prototype, or flow.
  • Concept and message tests — reactions to a value proposition, landing page, pricing page, or ad concept.
  • Design and copy feedback — mockups, onboarding screens, empty states.
  • "Why did you…" interviews — churn, plan downgrades, abandoned signups: conversations anchored to a specific recent event the participant actually lived.

A practical filter: if you can complete the sentence "We will do X if we learn Y," the study is yours to run. When we relaunched User Labs as Sera, the new homepage had to explain "AI-moderated research" to people who had never heard the phrase — and nobody on our team is a trained researcher. The decision sentence was concrete: we'll rewrite the hero section if visitors can't say what the product does after ten seconds. That's an evaluative question with a testable stimulus. We ran it ourselves.

What's not on the list: open-ended discovery in a problem space you don't understand yet, anything touching sensitive topics, and bet-the-company strategic questions. Those come later in this playbook, under "call a professional."

What guardrails keep your research credible?

Five rules do most of the work of a methodology education. Skip them and you'll produce fast, confident, wrong answers — the failure mode that makes leaders distrust democratized research (research done by people outside a research team) in the first place.

1. Start from a decision, not a curiosity. "I wonder what users think of the homepage" produces a pleasant, useless conversation. "We'll rewrite the hero if visitors can't say what the product does" produces findings someone can act on. Write the decision sentence before anything else; every question in the study should serve it.

2. Screen ruthlessly. Ten of the right participants beat fifty of the wrong ones. For the Sera homepage study, the screener excluded anyone who worked in user research — the page had to work on people without the vocabulary. Whatever your study, ask who could genuinely face this decision as a user, and filter for them. Screening is the single highest-leverage twenty minutes in the whole process.

3. Don't lead the witness. Ask about past behavior, not hypotheticals ("walk me through the last time you chose a research tool" beats "would you use this?"). Never embed the conclusion in the question — "how confusing was the pricing?" has already decided the answer. One honest caveat about AI here: an AI moderator asks your questions with perfect consistency, which means a leading question doesn't get softened by a moderator's in-the-moment judgment — it gets asked, identically, forty times. AI-drafted guides are phrased neutrally by default, but the guide is an editable document, and reviewing it for leading phrasing is your job, not the machine's.

4. Size the study to the claim. Five to eight participants will surface the major usability problems in a flow — that finding has held up since the nineties. But the moment your readout says "most users" or compares two segments, you need 30–50 sessions, or you're presenting an anecdote in a chart's clothing. Parallel AI moderation makes the larger number affordable; the rule is to match your sample to your sentence, and your sentence to your sample.

5. Keep an evidence trail. Every claim in your readout should link to a specific participant moment — a quote with a timestamp, not a paraphrase from memory. This is where AI tooling quietly outperforms the old way: synthesis that cites its sources produces receipts a skeptic can check, which matters enormously for the next section.

How do you get leadership to trust research from a non-researcher?

Leadership trusts research it can audit, not research with credentials attached. Four moves make a non-researcher's readout land like a professional's:

Show the method before the findings. One slide: the decision, who you talked to and how they were screened, the N, the format. Method-first signals you know rigor exists — which is precisely what skeptical leaders doubt.

Make every claim clickable. "Users didn't understand 'AI-moderated'" carries little weight from a marketer. The same claim linked to six timestamped clips of real participants misreading the phrase is not an opinion anymore — it's evidence. Findings that survive the question "says who?" are the ones that change roadmaps.

Name your limitations first. "This was 12 participants, all existing SaaS users, so it tells us about comprehension, not purchase intent" — said by you, unprompted — buys more credibility than any finding. The skeptic's objection, pre-empted, becomes proof of competence.

End on the decision. Restate the decision sentence, say what the evidence supports, recommend the action. A readout that ends in "insights" gets filed; one that ends in a recommendation gets argued with — which is what you want.

When should you call a professional researcher?

Honesty is the spine of this playbook, so here is the boundary, plainly. AI removed the operational reasons to need a researcher; it did not remove the expertise reasons.

SituationRun it yourself (with AI)Bring in a professional
Usability test of a flow or prototypeYes — the strongest solo use case
Concept, message, or pricing-page reactionsYes
Churn / onboarding "why" interviewsYes, review early transcripts
Discovery in a market you don't understand yetAdd AI breadth alongsideYes — leads the work
Sensitive topics (health, money, grief)Analysis onlyYes — human in the conversation
Repositioning, pivot, or year-of-roadmap betsSharpen the question firstYes — pay for rigor on the answer
Study-design review of your own workYes — highest-leverage engagement

The pattern in the right-hand column: professionals earn their fee where the question is unformed, the stakes are personal, or the cost of being confidently wrong dwarfs the engagement. And note the last row — the best first engagement with a professional is often not a study at all, but a quarterly review of your studies. A fractional researcher who spends two hours a month challenging your screeners and guides upgrades everything you run solo, for a fraction of a full-time hire.

How do you start this week?

Pick the decision your team is currently making on instinct — there is always one — and write the decision sentence: we will do X if we learn Y. Choose the smallest evaluative study that answers it, screen for the people who genuinely face that decision, and size the sample to the claim you want to make.

The mechanics are no longer the hard part. In Sera, pasting the URL of the thing you're deciding about produces a draft study in about two minutes — goals, screener, discussion guide, all editable before anything runs — and because the methodology guardrails above are built into what it drafts, your judgment is spent reviewing and sharpening rather than starting from a blank page. Interviews run in parallel with real recruited participants, and the readout arrives with every claim linked to its transcript moment.

Run one study end to end and the identity shift follows: you stop being someone who wishes the company had a researcher, and start being the person who brings evidence to the meeting. That person, it turns out, was never a job title.

Honest limitations

Where this playbook stops working

  • Open-ended discovery in unfamiliar territory. If you cannot yet name the question — you are exploring a new market or a fuzzy problem space — you need someone who can chase hunches off-script and reframe the study mid-flight. That is trained-researcher work. AI can add breadth alongside it, but it should not lead.
  • Nobody reviews your work. A research team gives every study a second set of eyes before it runs. Solo, your leading question or skewed screener ships unchallenged. Editable AI-drafted studies and a colleague's ten-minute review shrink this risk; they do not eliminate it. Say so in your readout.
  • Sensitive topics and regulated contexts. Research touching health, finances, grief, or vulnerable participants needs human judgment about when to probe and when to stop — and sometimes ethics review. Do not learn those skills on live participants. Use AI for analysis if you like, but put a professional in the conversation.
  • Company-defining bets. If the decision is a repositioning, a pivot, or a year of roadmap, the cost of a professional researcher is a rounding error against the cost of being confidently wrong. Run your own studies to sharpen the question, then pay for rigor on the answer.

Frequently asked questions

Can a product manager do user research without a researcher?

Yes — for evaluative research: usability tests, concept and message feedback, churn interviews. The operational skills that made research a specialist job are now handled by AI tooling. What a PM must still supply is judgment: a decision-shaped question, honest sampling, neutral questions, and a readout that shows its evidence.

What research methods are easiest to run without training?

Task-based usability tests and reaction-based concept or message tests are the most forgiving, because the stimulus is concrete and the findings are observable behavior rather than interpretation. Interviews anchored to a specific recent event — churn, onboarding, a purchase — are next. Open generative discovery is the hardest and the last to attempt solo.

How many users do I need for credible findings?

Size the study to the claim. Five to eight users reliably surface the major usability problems in a flow. Any claim shaped like "most users prefer…" or a comparison between segments needs 30–50 sessions before the pattern is more than an anecdote. State your N in the readout and size your language to it.

How do I avoid asking leading questions?

Ask about past behavior, not predictions ("walk me through the last time…" beats "would you use…"). Never embed the answer ("how confusing was this?" assumes confusion). Read your guide hunting for questions a participant could answer by agreeing with you. AI-drafted guides are phrased neutrally by default, but review them — the guide is yours.

When should I hire a professional researcher instead?

Bring in a professional for open discovery in an unfamiliar problem space, for sensitive or regulated topics, and for decisions big enough that being wrong costs more than the engagement. A fractional researcher who reviews your study designs quarterly is often the highest-leverage first hire — long before a full-time role.

Will leadership take my research seriously without a researcher title?

Leaders distrust process they cannot inspect, not job titles. Show the method before the findings, link every claim to a timestamped participant quote, name your study's limitations before anyone else can, and frame the readout around the decision it informs. Evidence they can audit beats credentials they have to take on faith.

Hear an AI-moderated interview
on your own product.

Paste a URL. Sera drafts the study, recruits participants, and runs the interviews — usually within 24 hours.

Your first 7 interviews are on us — no credit card required.