When the campaign data disagrees with your favourite ad

You can love a video, a headline or a piece of design. That is a reason to test it. It does not tell you whether the right person will enquire or become a customer.

“Data talks.” That is how I describe the role of results in our marketing decisions. At MYA, campaign results continually inform what we do next: what people watch, click and convert on. Sometimes those results contradict our own opinion.

Here is a practical way to review a campaign when the numbers and your first impression disagree.

Start with the decision you need to make

Before opening the dashboard, write down the question. Are you deciding which opening to test next? Whether the landing page answers the ad's promise? Whether enquiries are suitable for the service?

Each question needs different evidence. For an opening, examine how people respond to the beginning of the content. For a landing page, look at the journey from click to enquiry. For lead quality, bring in the follow-up outcome from the CRM.

Calling all of those things “performance” hides the distinctions that make the data useful.

Follow the response beyond the click

Consider this hypothetical example. Ad A attracts more clicks and cheaper enquiries. Ad B attracts fewer enquiries, but a larger share are suitable for the business.

Cost per enquiry may favour A. Qualification and sales outcomes may favour B. Define success before comparing the ads.

Record the outcome you actually have. An enquiry is not automatically a qualified opportunity, and a qualified opportunity is not a completed sale. Keep those stages separate when the underlying records allow it.

Review five questions in order

1. What did people see? Record the actual creative and message, not just the campaign name.
2. What did they do next? Distinguish attention, clicks and completed enquiries.
3. What happened to those enquiries? Check qualification and subsequent outcomes where they are available.
4. What could explain the difference? Consider audience, offer, landing page and follow-up as well as the ad itself.
5. What is the next test? Write down the change and the outcome that would support keeping it.

If you cannot answer one of those questions, record the gap. Missing CRM outcomes are a reason to improve the review, not to invent a conversion rate.

Check whether the comparison is fair

Before declaring a winner, compare the conditions. Did both ads promote the same offer? Did they reach similar audiences? Were they running over comparable periods? Were enquiries followed up in the same way?

If several things changed, the results may still be useful, but the explanation is less clear. Avoid attributing the entire difference to the creative because it is the part you happen to be discussing.

Allow time for follow-up. A handful of recent enquiries cannot tell the same story as a mature set with completed sales outcomes.

Use AI to organise the evidence

The creative, campaign results and sales feedback are often held in different places. AI can help organise those records, flag missing information and suggest explanations worth testing.

Ask it to separate observation from interpretation. “This ad generated fewer qualified enquiries during this period” is an observation if the records support it. “People dislike this design” is an explanation that needs more evidence.

Keep source references beside the claims so someone can check them. AI cannot repair an unreliable comparison by writing a convincing summary.

Write down the next test

Taste and experience help you decide what to try. The difficulty comes when you become so attached to an idea that you stop listening to the response.

Before launching the next test, write down what you expect to happen. At the review, put that expectation next to what actually happened. Record the decision and what remains uncertain.

An example decision-log entry

Hypothetical situation: an ad about service speed produces enquiries, but several sales notes ask what the service actually includes. Proposed test: replace the opening with a clear description of the included work, while keeping the offer and landing page unchanged. Expected response: a larger share of enquiries understand the scope. Review: compare the qualification notes and the relevant campaign outcomes, and record any changes in targeting or follow-up that complicate the comparison.

That entry is specific enough for someone else to understand why the creative changed. It also records what the test can and cannot tell you.

Every review should leave you with a clearer question or a concrete change to test. If you want a starting point for your own lead generation, try the marketing diagnostic.