methodatlas
Product Discovery

Wizard of Oz Test

Turns customer problem, solution idea, and evidence into a tangible result by defining the critical experience, preparing the manual simulation, and evaluating behavior and effort.

Core question
Does the simulated automatic experience deliver recognizable value to users, and which tasks are realistically automatable?
HighWorkshop + async2-10 Tage
Open runsheetPlan sessionStart comparison
Purpose

The method helps clarify customer problem, solution idea, and evidence concretely. It separates problem, assumption, solution, and evidence. The result is captured as prototype learnings, manual effort notes, and a risk list.

How it works

The team follows the steps: define the critical experience, prepare the manual simulation, recruit test participants, run the flow, and evaluate behavior and effort. Each step is captured visibly. At the end, prototype learnings, manual effort notes, and a risk list are available so decisions, tests, or actions can follow directly.

Visual orientation

Method sketch for a quick mental model.

Wizard of Oz · Human behind the CurtainTest a seemingly finished experience while the team manually performs critical system parts behind the scenes
Wizard of Oz TestThe visual shows user experience, prototype interface, manual backstage execution, effort, risk, and learnings.Simulate complex product reactions manually behind the interfaceUsers experience the core flow while the team learns value, effort, and technical risks realistically.FrontstageBackstagelearn without full buildUser experiencefeels automatedPrototype UIlean visible interfaceBackstage teamexecute manuallyResponsehuman creates resultEffortmeasure time and stepsRiskwhat would be hard tobuild?Prototype learningsseparate value, effort, andfeasibilityBuild / Iterateautomate or adjust

Flow

  1. 1Define the critical experience
  2. 2Prepare the manual simulation
  3. 3Recruit test participants
  4. 4Run the flow
  5. 5Evaluate behavior and effort

The runsheet guides execution with 4 phases, timeboxes, 5 pitfalls, and clear stop criteria.

Open runsheet

Ideal for

  • AI Features
  • Service Prototypes
  • Automation Ideas

Not good for

  • Scalable production
  • Tests without ethical transparency

Deep dive

In detail

Wizard of Oz Test follows a clear working logic: define the critical experience, prepare the manual simulation, recruit test participants, run the flow, and evaluate behavior and effort. This turns the method into a visible thinking process rather than only a conversation. Participants move step by step from raw material, observations, or options toward a shared structure. The result is prototype learnings, manual effort notes, and a risk list that make decisions, learning, or further planning actionable.

Facilitation

Prepare a clear guiding question, the right information, and a visible workspace. Plan about 2-10 days with 5-20 participants and use the format either in a workshop or asynchronously. The method is demanding and should be prepared carefully; short timeboxes, visible intermediate results, and a parking lot for open questions help.

Output artifacts
Prototype LearningsManual Effort NotesRisk List
Tags
prototypevalidationmanual simulationMVP

Sources

The Wizard of Oz Method in UX | NN/gnngroup.comWizard of Oz Prototypes | IxDFixdf.org
Artifact templates
Wizard of Oz Test Working TemplateCompact working template for Wizard of Oz Test with context, input, output artifacts, and next step.
markdown

wizard-of-oz-test-working-template.md

Compact working template for Wizard of Oz Test with context, input, output artifacts, and next step.

Wizard of Oz Test Working Template

Goal

Manually simulates automated product behavior behind the scenes.

Context

When and for what do we use this method?

Input

Which data, observations, decisions, or materials are available?

Execution

Short notes along the runsheet.

Output artifacts

  • Prototype Learnings:
  • Manual Effort Notes:
  • Risk List:

Assumptions and open questions

  • ...

Decision / Next step

Owner, date, and success signal.

When to choose differently

Short decision aid for existing alternatives.

Concierge MVP

Statt Wizard of Oz Test, wenn du mit Concierge MVP den Wert manuell liefern und Lernsignale vor der Automatisierung bekommen willst.

Similar methods

All methods
Product Discovery
Pretotyping

Turns a product idea into a market claim and tests demand with the smallest possible real-world setup before investing in a prototype.

Product Discovery
Concierge MVP

Turns customer problem, solution idea, and evidence into a tangible result by choosing target customers, delivering the outcome manually, and extracting productizable patterns.

Statt Wizard of Oz Test, wenn du mit Concierge MVP den Wert manuell liefern und Lernsignale vor der Automatisierung bekommen willst.

Product Discovery
Solution Interview

Clarifies customer problems, solution ideas, and evidence by preparing a solution concept, recruiting target customers, and deriving risks and next tests.

Product Discovery
MVP Test Matrix

Moves customer problem, solution idea, and evidence toward a concrete result through "list assumptions", "map assumptions to dimensions", and "derive the test plan".

Product Discovery
Problem Interview

Clarifies customer problems, solution ideas, and evidence by framing problem hypotheses, recruiting the target group, and assessing problem risk.

Innovation
Design Sprint

Turns ideas, open questions, and testable next steps into a tangible result by mapping the challenge, sketching solutions, and testing with users.