Purpose
When demand only needs to be roughly verified, it tests interest with minimal effort. It measures whether people would take a next step at all.
Product Discovery Research method
Smoke Test
Tests demand through a small observable behaviour before implementation cost grows.
A Smoke Test offers a credible pre-step and measures whether a defined audience chooses the next action. It tests interest, not complete product quality.
Does the defined audience choose the promised next action under realistic conditions?
- Participants
- Nutzertraffic
- Time
- 2–5 days for setup, exposure, and analysis; design work alone usually takes 45–90 minutes.
The steps connect experiment design, real exposure, and analysis. Elapsed time depends on the required traffic.
Hypothesis
Define assumption and audience
State an observable demand assumption with audience, problem, and desired action.
Signal
Build minimal test
Provide a credible pre-step with exactly one next action.
Traffic
Reach relevant people
Document source and inclusion criterion; do not treat arbitrary reach as evidence.
Observation
Measure behavior
Capture visits and qualified actions in the same period.
Decision
Turn learning into action
Record signal strength, uncertainty, and next test separately.
Change the hypothesis or setup deliberately after analysis; predefine threshold and observation window again for every new run.
A good fit when
Use it when a demand assumption needs a fast, bounded test of observable behavior.
Ideal for
- Demand Validation
- Messaging Tests
- Early Product Bets
Not good for
- Deep usability questions
- Sensitive promises without transparency
Outputs
Learning note with decision
Experiment report containing hypothesis, test setup, traffic source, observation window, visits, qualified actions, limitations, and next decision.
Smoke test experiment card
Fictional example
Fictional example for a pickup service. Each row connects assumption, test, observable signal, and decision.
| Experiment | Hypothesis | Test and audience | Signal and threshold | Observation and decision |
|---|---|---|---|---|
| Tool pickup slotDoes the defined audience choose the promised next action under realistic conditions? | Weekend customers reserve a Saturday pickup slot before the service is built. | Offer page sent to 80 previous weekend customers; one 'Reserve a slot' CTA. | Qualified: email plus preferred date. Pre-set rule: investigate further from 8 reservations. | 5 reservations. Threshold missed; interview people about reasons and revise the offer. |
1. Hypothesis
- Tool pickup slot
- Weekend customers reserve a Saturday pickup slot before the service is built.
2. Test and audience
- Tool pickup slot
- Offer page sent to 80 previous weekend customers; one 'Reserve a slot' CTA.
3. Signal and threshold
- Tool pickup slot
- Qualified: email plus preferred date. Pre-set rule: investigate further from 8 reservations.
4. Observation and decision
- Tool pickup slot
- 5 reservations. Threshold missed; interview people about reasons and revise the offer.
The numbers are fictional and do not demonstrate real demand.
First step
State the audience, problem assumption, desired action, and decision threshold.
Deep dive
How it works
It provides a small preliminary step that makes reaction, click, or sign-up visible. Its informative value comes from observed behavior under realistic conditions, not from agreement in conversation or elaborate product development.
In detail
A Smoke Test works because it collects early market signals for an offering with little effort, limiting costly wrong assumptions early. Good application clearly defines what behavior counts as serious interest and which distortions could skew the signal. This makes it possible to check whether an idea creates resonance at all before the team develops or technically secures it further.
Facilitation
Phrase the offering concretely enough that reactions stem from a recognizable expectation rather than mere curiosity. Things tip most clearly where positive signals appear but their quality remains unclear. Close with a sober reading of the interest and a follow-up action that sharpens the signal specifically.
The method guide walks execution through 5 phases, timing, 5 pitfalls, and clear stop criteria.
Open method guideYour perspective
Does this method help with your work?
Your feedback helps shape the next improvements to methodatlas.
Sources and topics
Artifact templates
Experiment PlanShort plan for hypothesis, test design, success criteria, and decision.markdown
Experiment PlanShort plan for hypothesis, test design, success criteria, and decision.
markdownexperiment-plan-markdown.md
Short plan for hypothesis, test design, success criteria, and decision.
Experiment Plan
Hypothesis
We believe that ...
Target audience
Who are we testing for?
Test design
What exactly will participants or users do?
Success criterion
We count the test as positive if ...
Risks and limits
What can the test not prove?
Decision afterward
If positive: ... If negative: ...
Owner and date
...
Smoke Test: WorksheetPlan the hypothesis, setup, real run, and analysis with clear ownership.markdown
Smoke Test: WorksheetPlan the hypothesis, setup, real run, and analysis with clear ownership.
markdownsmoke-test-working-template.md
Plan the hypothesis, setup, real run, and analysis with clear ownership.
Smoke Test: Worksheet
Question
To be confirmed
Desired outcome
To be confirmed
Scope
Whole initiative Time: 2–5 days for setup, exposure, and analysis; design work alone usually takes 45–90 minutes.
Complete this worksheet on paper or in your own document during the work.
Preparation for this scope
Method setup
- Materials: Hypothesis sheet, credible offer stub, one clear call to action, defined audience or traffic source, tracking plan, and privacy notice.
- Roles: Experiment owner · offer and copy owner · tracking and privacy owner · decision owner
- Advance information: Write down audience, problem, promised value, requested action, traffic source, observation window, and decision threshold before building.
- Overall time needed: 2–5 days for setup, exposure, and analysis; design work alone usually takes 45–90 minutes.
- Setup: Show only enough of the offer to enable a real behavioural choice. Test the CTA, counting rule, stop condition, and follow-up for interested people before launch.
Prepare for the work steps
Hypothesis: Define assumption and audience
- Write down audience, problem, promised value, requested action, traffic source, observation window, and decision threshold before building.
Signal: Build minimal test
- Testable demand hypothesis
Traffic: Reach relevant people
- Testable offer stub
Observation: Measure behavior
- Documented target-audience reach
Decision: Turn learning into action
- Clean behavioural data
Smoke test experiment card
| Experiment | Hypothesis | Test and audience | Signal and threshold | Observation and decision |
|---|---|---|---|---|
| Tool pickup slot |
- Tool pickup slot: Does the defined audience choose the promised next action under realistic conditions?
Complete the hypothesis and decision threshold before exposure.
Strategyzer · original teaching example
Hypothesis: Define assumption and audience
Expected artifact: Testable demand hypothesis
Testable demand hypothesis
Entry:
...
- Are audience, problem, value, action, and threshold explicit before launch?
Signal: Build minimal test
Expected artifact: Testable offer stub
Testable offer stub
Entry:
...
- Does the test promise only what the team can transparently fulfil or explain afterwards?
Traffic: Reach relevant people
Expected artifact: Documented target-audience reach
Documented target-audience reach
Entry:
...
- Does exposure reach the defined audience, with a traceable source?
Observation: Measure behavior
Expected artifact: Clean behavioural data
Clean behavioural data
Entry:
...
- Are visits and qualified actions defined for the same observation window and technically verified?
Decision: Turn learning into action
Expected artifact: Learning note with decision
Learning note with decision
Entry:
...
- Does the analysis separate observed behaviour, possible bias, and the resulting decision?
Open questions and next steps
...
Method guide: https://methodatlas.meierhoff-systems.de/en/methods/smoke-test/run-sheet
Alternatives and neighbors
Fitting alternatives with decision guidance, followed by other related methods.
Product Discovery
Landing Page Test
Instead of Smoke Test, choose Landing Page Test when you want to measure interest in an offer through a concrete offer page.
Product Discovery
Pretotyping
Tests a market claim with the smallest fitting precursor and makes real interest measurable.
Product Discovery
Fake Door Test
Measures real interest in an idea that has not been built yet, through clicks, sign-ups, or other interest signals.
Product Discovery
MVP Test Matrix
Moves customer problem, solution idea, and evidence toward a concrete result through "list assumptions", "map assumptions to dimensions", and "derive the test plan".
Product Discovery
Experiment Canvas
Moves customer problem, solution idea, and evidence toward a concrete result through "clarify the learning goal and the assumption to test", "formulate the hypothesis as an if-then statement", and "define the decision rule after the test".
Product Discovery
Learning Card
Separates hypothesis, observation, insight, and next action into four fields after a test.
Constraints and origin
LowAsync1-5 Tage
Profile
- Method form
- Research method
- Participants
- Nutzertraffic
- Time
- 1-5 Tage
- Maturity
- Established
- Origin
- Praxisgemeinschaft
Next up: A/B Testing