Skip to content

Test demand

Route each Hypothesis to the cheapest test that can settle it, and decide in advance what result counts.

Before a Startup builds, it tests whether anyone pays. Each Hypothesis goes to the cheapest test that can settle it, with pass and kill lines fixed before the first Visitor arrives.

The test ladder

Tests form a ladder from free to costly. Each rung has a cost, a time to verdict, and the strongest Evidence grade it can yield. A Hypothesis goes to the lowest rung that can yield the grade its threshold needs.

RungWhat it isSpendDays to verdictStrongest grade
Portfolio priorwhat sibling Startups at the same template and state learned$00behavior, from siblings
Replaythe candidate scored against the kept record$01opinion
Problem interviewthe last time the Problem happened, and what it cost$03 to 7behavior
Smoke pagea Page for the Offer, counting who tries to accept it$0 to $1003 to 7behavior
Fake dooran Offer that is not open, counting Waitlist joins$07behavior
Pre-salea reserve page taking refundable deposits$014commitment
Conciergethe outcome delivered by hand, openly, for moneyhours14 to 30behavior
Manual back endan automated front with people or agents doing the work behind ithours14 to 30behavior
Paid probe$100 to $1,000 of Ads on one message$100 to $1,0003 to 7behavior
Single capabilitythe one feature that carries the promise, built and soldbuild time14 or morebehavior
Flag splitvariants of the built thing, randomized per Visitortraffic14 to 60behavior

The ladder settles most early questions in days. The customer and Problem questions go to interviews. Whether people switch goes to a pre-sale against today's workaround, and which promise wins goes to a smoke page or a paid probe.

Pass and kill lines

Every test fixes five numbers before it starts: the primary Metric, a pass line, a kill line, a minimum sample, and a window. Fixing them first is what makes the result Evidence instead of a story.

TestPrimary MetricPassKillMinimum sampleWindow
Pre-saleoutside deposits or paid pre-orders3 or more0100 qualified Visitors14 days
Conciergeoutside Customers served by hand and paying3, with 1 repeatno repeat3 Customers30 days
Paid probecost per commitmentat or below the first payment's marginabove 3 times that margin30 clicks per variant7 days
Fake doorWaitlist joins per 100 Visitors5 or moreunder 1200 Visitors14 days
Problem interviewsinterviews that describe a recent, costly instance5 of 82 of 8 or fewer8 interviews7 days

These are starting defaults. Each is a Setting that the Studio, a Portfolio, or the Startup can tighten and never loosen.

A result between the lines reads iterate: the learn step drafts the next variant, and the test runs again. A test that misses its minimum sample reads underpowered and pools forward into the next run instead of counting as a failure.

Exploring without an audience

Free exploration works where no audience is needed: search, answer engines, directory and registry listings, community threads, and cold outbound. It also works on borrowed audiences, such as the Studio's shared social accounts, house Ads across sibling Startups, and partners.

A Startup with no audience buys learning speed instead. A $100 to $1,000 paid probe is the fastest exploration instrument, and it counts as exploration, not growth spend. Spend scales only on variants that already won.

A new Startup's default demand budget is $0, so its first tests run on free rungs and borrowed audiences. A founder who funds a budget records it as a Decision with a target and a stop rule. The Smoke test, Reserve drop, and Creator probe Plays package the common rungs.

Message first

The message is the unit of a demand test. Fast Plays such as paid search and cold email return a verdict in days, so they test the message. Only a winning message earns slow Plays, such as SEO and answer engine optimization, which take months to read.

A bookkeeping Agent for independent dental practices tests three promises on $150 of search Ads: hours saved, missed deductions, and audit risk. Missed deductions wins at $11 per Waitlist join, against $34 and $52. That promise becomes the Page headline, and the editorial Plays start from it.

Reading the result

Each test ends in Evidence on its Hypothesis and a Decision. For one change, the choices are ship, kill, or iterate. For the Startup as a whole, they are persevere or pivot.

A pivot forks the Startup. The new definition runs as a sibling under the same Idea, new demand splits between the two, and existing Customers stay where they are. The loser goes Dormant, kept and revivable.

A b2a Dataset API of commercial lease comparables runs a pre-sale to buying Agents and one to analysts. Agents leave 6 deposits in 14 days; analysts leave 1. The Startup pivots to Agents, and the analyst version goes Dormant with its Evidence.

Next