OpinionTechnical

AD testing structure

Mark Builds Brands

The speaker explains an ad testing structure where each ad group represents a completely new creative concept, containing one original ad and three variations (one major, one medium, and one minor) to test which will perform best. The approach mimics a 'shotgun method' to discover winning creatives, as the original concept is never guaranteed to be the winner.

Summary

The speaker describes a structured approach to ad testing organized at the ad group level, where each ad group is treated as a completely new and untested creative concept. Within each ad group, there are four ads: one original creative concept that has never been tested in an advertising account, and three variations of that original concept. These variations differ in their degree of change from the original. The speaker emphasizes that this original is not a proven winner—it's simply a new idea being tested for the first time. The three variations serve different purposes: one is a major variation that changes the entire structure of the creative while maintaining the original concept, one is a medium variation that represents a significant but not structural change, and one is a minor variation that might only involve changing the hook or headline. The speaker uses the analogy of a 'shotgun method' to explain the rationale: by testing multiple variations simultaneously, they can identify which creative—not necessarily the original—will ultimately emerge as the winning ad in that group. The speaker stresses that there's no way to predict in advance whether the original concept or one of its variations will perform best, making this multi-variation testing approach essential for discovering top performers.

Key Insights

  • The speaker argues that each ad group level is defined as a completely new concept that has never been tested in an advertising account before, and the original creative is not a proven winner but rather a new untested idea
  • The speaker claims that only one creative typically emerges as the winner from a new ad group, but there is no way to predict in advance whether it will be the original or one of the variations
  • The speaker identifies three types of variations: minor variations (changing just the hook), medium variations, and major variations (changing the entire structure while maintaining the original concept)
  • The speaker compares the testing structure to a shotgun method where multiple variations of a new concept are tested simultaneously because it's unknown which variation will win
  • The speaker emphasizes that all four ads in an ad group are based on one original new concept, with the key difference being that some are the original idea while others are variations, but all are part of testing that single new concept

Topics

Ad group structure and organizationCreative concept testing methodologyOriginal vs. variation ad testingTypes of creative variationsShotgun testing approach

Transcript

[0:00] Every time I launch a new ad group, it's a completely new concept. The ad group level is synonymous with a completely new concept. And inside this ad group, you can have four ads. One is an original new concept. One is a big variation on this concept. So technically it's a variation, but not a winning variation, because this whole ad group is a completely new concept. And another great variation on the same original new concept. And then you can make a slight variation on the same original concept. They are all [0:31] part of one original new concept. The only difference is that this is an original idea for the creative, and the rest are just…

Full transcript available for MurmurCast members

Sign Up to Access

More from Mark Builds Brands

Get AI summaries like this delivered to your inbox daily

Get AI summaries delivered to your inbox

MurmurCast summarizes your YouTube channels, podcasts, and newsletters into one daily email digest.