Smart MarketerSMART MARKETER LIVE

SMART MARKETER LIVE 2026 · DAY 1 TAKEAWAYS

The Ad Didn’t Fail — The Test Did

Dilyana Doychinova

Updated 2026-10-27 · 1 processed session

Design tests that answer a clear question before you discard a promising idea. Separate weak creative from weak testing, and turn the results you can trust into a better next experiment.

01 / Dilyana DoychinovaThe Ad Didn’t Fail — The Test Did

2026-10-20 · Creative testing · Experiment design · Hypotheses · Measurement · Learning logs

Design tests that answer a clear question before you discard a promising idea. Separate weak creative from weak testing, and turn the results you can trust into a better next experiment.

PUT THIS SESSION TO WORK

Welcome. This session with Dilyana Doychinova can help you design tests that answer a clear question before you discard a promising idea. Separate weak creative from weak testing, and turn the results you can trust into a better next experiment.

Design tests that answer a clear question before you discard a promising idea. Separate weak creative from weak testing, and turn the results you can trust into a better next experiment.

01

Write the hypothesis and the variable first.

Name the expected outcome and the specific thing being changed; “testing creative” is not precise enough.

02

Decide how you will judge the test before launch.

Choose a measure that fits the question and give the test a meaningful opportunity to deliver.

03

Check whether the test itself was valid.

Review tracking, promotions, delivery and other changes before accepting the result. Retest when the setup cannot answer the question.

04

Keep the conclusion as narrow as the evidence.

Do not reject an audience or angle because one execution failed. Track execution differences and page fit when interpreting results.

05

Keep a prioritized test and learning log.

Record the question, setup and result so each valid test points toward a useful next test.

Which of these would be most useful for your business?

Open a choice to see the first question and what you’ll create. Continue the work in your connected Coach.

Design a fair testA test brief with hypothesis, variable, metric and conditions.

Turn an idea into a specific, interpretable experiment.

Useful inputs

  • Approved offer and persona
  • Proposed change
  • Current baseline
  • Available delivery and measurement constraints

Work through it

  1. Reuse the approved offer and persona; confirm which product, audience and decision this activity concerns.
  2. Write a hypothesis and identify the exact variable or variables.
  3. Choose the outcome measure before launch and ask what delivery would provide useful evidence.
  4. Check for confounds and define what the result will and will not justify.

If inputs are missing: Keep missing evidence explicit. Ask for the smallest useful input, or prepare a labeled draft for the user to complete; do not invent account results, customer facts or platform behavior.

Your working document

  • Hypothesis
  • Variable and comparison
  • Metric
  • Opportunity/constraints
  • Valid conclusions

Complete when: The user has reviewed the proposed output, confirmed its assumptions and chosen a next step.

Review a failed testA test-validity review and a keep, revise or retest recommendation.

Check whether the result rules out the idea or only the setup.

Useful inputs

  • Approved offer and persona
  • Test setup and results
  • Tracking and promotion history
  • Ad and page content

Work through it

  1. Reuse the approved offer and persona; confirm which product, audience and decision this activity concerns.
  2. Check what changed before and during the test and whether delivery was sufficient to inform the question.
  3. Separate observations from conclusions about a whole audience or angle.
  4. Recommend a justified next test or a limited conclusion, marking unresolved evidence.

If inputs are missing: Keep missing evidence explicit. Ask for the smallest useful input, or prepare a labeled draft for the user to complete; do not invent account results, customer facts or platform behavior.

Your working document

  • Original question
  • Observed result
  • Validity checks
  • Supported conclusion
  • Next test

Complete when: The user has reviewed the proposed output, confirmed its assumptions and chosen a next step.

Build my test roadmapA prioritized test log with clear questions and next decisions.

Organize learning into a practical sequence of tests.

Useful inputs

  • Approved offer and persona
  • Current questions
  • Previous test evidence
  • Team and timing constraints

Work through it

  1. Reuse the approved offer and persona; confirm which product, audience and decision this activity concerns.
  2. Translate each question into a hypothesis, variable and metric.
  3. Rank by business relevance and readiness with the user.
  4. Create a log for setup, results, validity notes and the next decision.

If inputs are missing: Keep missing evidence explicit. Ask for the smallest useful input, or prepare a labeled draft for the user to complete; do not invent account results, customer facts or platform behavior.

Your working document

  • Priority
  • Hypothesis and variable
  • Metric and setup
  • Result/validity
  • Next decision

Complete when: The user has reviewed the proposed output, confirmed its assumptions and chosen a next step.

The activities below are Coach-designed applications of the reviewed teaching. Before personalizing them, reuse approved business context or gather the business name and website, prepare Offer and Persona Profiles, obtain approval of both, and then resume the chosen activity. Session summaries do not require intake. Coaching paths and output templates are Coach-designed applications. This guide does not submit or store answers.

Read all takeaways ↓ · You can also ask the Coach a question about the session.

Questions about the session
Explore the full session index · 9 entries

Index of reviewed teaching from the supplied recordings. Repeated rotations are consolidated; attendee exchanges and private details are excluded.

Name the actual variable

Define the specific variable being tested. “Creative” is too broad: the hook, audience, creator and format can be different variables. Changing several at once makes the result harder to interpret.

Talk · 03:23

Begin with a hypothesis

Start with a hypothesis about the outcome you expect, then choose a setup that gives the idea a fair chance to work.

Talk · 04:29

Check events during the test

Review what happened during the test, including tracking problems, promotions or external events. A compromised test may need to be rerun rather than treated as evidence that the idea failed.

Talk · 06:16

Limit conclusions and inspect page fit

Keep conclusions proportional to what was tested. A weak hook does not establish that the broader angle or customer segment cannot work; also check whether the ad and landing page fit each other.

Talk · 07:53

Prioritize comparable tests

Plan tests in priority order and make them comparable. Changing creator, format and message together does not isolate which element caused the difference.

Talk · 09:11

Choose the metric before launch

Choose the success metric before launching. The metric should match the question, such as click-through for an attention question or conversion rate for a page question.

Talk · 04:55

Check opportunity and confounds

Check whether a test received a meaningful opportunity to deliver. Platform allocation and a concurrent promotion can affect what the result allows you to conclude.

Talk · 05:57

Several executions of the same idea

When platform delivery makes small variations hard to compare, test the same idea across several distinct executions. Keep track of the additional variables so the interpretation remains honest.

Talk · 08:27

Record results and the next question

Record tests and their results in a table so the learning informs what to test next. A failed idea can teach something; an invalid test may leave the original question unanswered.

Talk · 09:43

Key takeaways

  1. Write the hypothesis and the variable first.

    Name the expected outcome and the specific thing being changed; “testing creative” is not precise enough.

    Talk · 03:23; Talk · 04:29

  2. Decide how you will judge the test before launch.

    Choose a measure that fits the question and give the test a meaningful opportunity to deliver.

    Talk · 04:55; Talk · 05:57

  3. Check whether the test itself was valid.

    Review tracking, promotions, delivery and other changes before accepting the result. Retest when the setup cannot answer the question.

    Talk · 06:16; Talk · 05:57

  4. Keep the conclusion as narrow as the evidence.

    Do not reject an audience or angle because one execution failed. Track execution differences and page fit when interpreting results.

    Talk · 07:53; Talk · 08:27

  5. Keep a prioritized test and learning log.

    Record the question, setup and result so each valid test points toward a useful next test.

    Talk · 09:11; Talk · 09:43

Context to keep in mind

  • The recordings describe the speaker’s approach under the platform conditions she observed; delivery and controls can change.
  • No universal number of ads, spend threshold or test duration is prescribed here; the appropriate evidence depends on the question and account.