methodatlas

UX Research Research method

Surveys

Collects standardized self-reports for a defined research question.

A survey collects standardized self-reports for a defined research question. Question quality, sampling and analysis limit conclusions; a large response count alone does not establish representativeness.

Core question
What can this population reliably report that informs the stated decision?
Participants
50+
Time
An initiative spanning design, pilot, fieldwork and analysis; duration depends on access and research purpose.

What can this population reliably report that informs the stated decision?

Surveys method illustration showing its working structure
  1. Goal

    Define research goal and decision

    Connect a knowledge gap, target population and decision; check that self-report can answer it.

  2. Questions

    Write neutral questions

    Ask one thing at a time, use plain language, balanced options and a relevant recall period.

  3. Sample

    Plan sample and privacy

    Define population, sampling route, field period, data collected and privacy controls.

  4. Fieldwork

    Pilot, field and analyze

    Check comprehension and operation; report denominator, missing data and uncertainty suited to the design.

Update the work record when new evidence, changed constraints or the planned review changes an assumption.

A good fit when

Use for relevant self-reported attitudes, experiences or behaviors when a suitable population and sampling approach exist. Prefer observation or records when they answer the question better.

Ideal for

  • Quantitative validation
  • Market feedback
  • Preference ranking

Not good for

  • Why questions without context
  • Exploration of unknown problems alone

Outputs

  • Reasoned survey objective

    The reasoned survey objective connects a knowledge gap, target population, and decision and states whether self-report can answer it.

  • Understandable, non-leading items

    Each question addresses one construct in plain language, with balanced response options and a suitable recall period. A not-sure option is available where useful. Cognitive checks examine comprehension, and the design follows NN/g recommendations.

  • Transparent field plan

    The transparent field plan defines the target population, sampling route, field period, required data, and privacy controls.

  • Data and bounded findings

    The analysis report records comprehension tests, technical checks, field quality, and dropouts. It states denominators, sampling, missing data, and uncertainty and interprets results within the limits of the study design.

Surveys working record

Fictional example

Method-specific prompts and a fictional worked example; template prompts remain empty.

Define research goal and decision

Compare with observation and records.

**Goal:** Learn which support route people used after their latest failed login and what they still needed.

Write neutral questions

Cognitively test the wording.

**Question:** “Which route did you use for your last login problem?” with balanced options and “don’t know/none”.

Plan sample and privacy

Sample size follows purpose, segments and required precision.

**Sampling limit:** Recruiting through support omits people who never contacted support. Results describe respondents reached through that channel.

Pilot, field and analyze

Use descriptive statistics only as supported by sampling.

**Pilot:** Check whether people understand “login problem” and the recall period as intended.

NN/g provides question-writing practices. Design and sampling constrain conclusions; response count alone does not prove representativeness.

Writing Good Survey Questions: 10 Best Practices | Nielsen Norman Group

First step

Define question, decision, target population, sampling frame, mode and privacy requirements before drafting.

Open the method guide

Deep dive

Purpose

When a topic needs to be validated broadly and many people can answer the same question, surveys gather structured feedback in a scalable form. Answers become comparable and segmentable instead of remaining merely anecdotal.

How it works

A clear question logic framework keeps the survey consistent so answers stay comparable across groups. The patterns in the distribution produce clues about differences, preferences, and possible segment breaks, which combine well with interview knowledge.

In detail

Surveys work because they can capture perceptions, frequencies, or preferences comparably across larger groups. The method is only strong when questions are precise, answer options are cleanly built, and the sample and analysis fit the actual insight question. Biases, ambiguities, and the connection to qualitative findings matter so that meaningful interpretation emerges from response numbers.

Facilitation

Decide in advance which decision the survey should support, and cut anything that's only running along out of curiosity. The situation gets especially sensitive with unclear wording or overloaded answer scales; the instrument quickly loses meaning there. Close with a concise reading of the results and note openly which questions need qualitative follow-up.

The method guide walks execution through 4 phases, timing, 4 pitfalls, and clear stop criteria.

Open method guide

Your perspective

Does this method help with your work?

Your feedback helps shape the next improvements to methodatlas.

Sources and topics

Topics
Artifact templates
Surveys: WorksheetPlan a session or initiative to match the actual scope of work.
markdown

surveys-working-template.md

Plan a session or initiative to match the actual scope of work.

Surveys: Worksheet

Question

To be confirmed

Desired outcome

To be confirmed

Scope

Prepare the full method Time: An initiative spanning design, pilot, fieldwork and analysis; duration depends on access and research purpose.

Complete this worksheet on paper or in your own document during the work.

Preparation for this scope

Method setup

  • Materials: Research brief, questionnaire, recruitment plan, privacy review, pilot and analysis plan.
  • Roles: Research owner · survey designer · privacy/data steward · target participants for piloting.
  • Advance information: Choose materials, data access and participants to fit the research or decision question.
  • Overall time needed: An initiative spanning design, pilot, fieldwork and analysis; duration depends on access and research purpose.
  • Setup: Open the method-specific structure. Fictional examples are for orientation only; keep the blank worksheet separate from actual findings.

Prepare for the work steps

Goal: Define research goal and decision

  • Define question, decision, target population, sampling frame, mode and privacy requirements before drafting.
  • Research brief, questionnaire, recruitment plan, privacy review, pilot and analysis plan.

Questions: Write neutral questions

  • Reasoned survey objective
  • Research brief, questionnaire, recruitment plan, privacy review, pilot and analysis plan.

Sample: Plan sample and privacy

  • Understandable, non-leading items
  • Research brief, questionnaire, recruitment plan, privacy review, pilot and analysis plan.

Fieldwork: Pilot, field and analyze

  • Transparent field plan
  • Research brief, questionnaire, recruitment plan, privacy review, pilot and analysis plan.

Surveys working record

Define research goal and decision

Compare with observation and records.

...

Write neutral questions

Cognitively test the wording.

...

Plan sample and privacy

Sample size follows purpose, segments and required precision.

...

Pilot, field and analyze

Use descriptive statistics only as supported by sampling.

...

Blank worksheet contains prompts only, with no example data.

Writing Good Survey Questions: 10 Best Practices | Nielsen Norman Group

Goal: Define research goal and decision

Expected artifact: Reasoned survey objective

Reasoned survey objective

Entry:

...

  • Can a survey inform this decision?

Questions: Write neutral questions

Expected artifact: Understandable, non-leading items

Understandable, non-leading items

Entry:

...

  • Could an item have multiple readings?

Sample: Plan sample and privacy

Expected artifact: Transparent field plan

Transparent field plan

Entry:

...

  • Who may be missing or answer differently?

Fieldwork: Pilot, field and analyze

Expected artifact: Data and bounded findings

Data and bounded findings

Entry:

...

  • Do analysis and inference fit the sample?

Open questions and next steps

...

Method guide: https://methodatlas.meierhoff-systems.de/en/methods/surveys/run-sheet

Alternatives and neighbors

Fitting alternatives with decision guidance, followed by other related methods.

All methods
Constraints and origin
MediumAsync3-14 Tage

Profile

Method form
Research method
Participants
50+
Time
3-14 Tage
Maturity
Canonical
Origin
UX Research Community
A paper-based illustration representing Kano Model with its core stages and visible working result.
Next up: Kano Model