Nothing anyone in marketing tells you is true. Shocked? Well, you should be. It’s the mantra of the strategist to trust nothing and test everything (ok, maybe not everything). Why? Because every company is different. Every company sells different products and has different customers.
What’s even more surprising is that one of the top challenges is the ability to test. It’s based in time, resources and money but it also involves the marketer not knowing how to test. It’s tough because the average marketer struggles to get email campaigns out the door and testing takes time. You have to be focused and look at the item you want to test, come up with a hypothesis and test it accurately. Accuracy matters. You must make sure that you test something accurately so that you don’t end up drawing the wrong conclusion.
Think about this. A marketer wants to test a Call To Action of “Buy Now” and “Learn More”. They have two pieces of creative and because of the size of the font, the “Learn More” button takes up two lines and makes the button bigger. The marketer runs the test and “Learn More” creative is determined to be the winner. Did “Learn More” really win or did a bigger button actually win? You would not know because the test you ran was invalid. The variables have to be equal in each creative. At a basic level, this means audiences have to be equal in makeup (activity, join date, purchase and other factors), creative, message and timing.
So, how do you run an accurate test? There are multiple kinds of testing.
Local Control Groups
Universal Control Groups
So, how do you test? Most marketers can accomplish the testing they need through A|B testing and as you get more advanced and skilled, you can move into other ways listed above, but the key step is to develop a plan. Take a three month period and define the goal of testing for that period. What are you going to test and what is the path that you should take.
For example, you want to test if your headline copy is truly effective. You could test having it and not having it, but what if you had a plan over three months to really be sure. You could test:
The variations are large, but if you have a plan, you can get to a point where you feel comfortable saying “My headline copy should adhere to these standards”.
Testing enables the marketer to know that what they are hearing at conferences or reading in papers work for their customers. Don’t just trust some random stat. Make sure you test what you hear to make sure it works for you.