Category Archives:A/B Testing

  • Should You Run The Same Test Across All Devices?

    An Iphone, an android phone, a laptop for running separate A/B tests to make sure the variations are rendering properly

    Should you run the same test across all devices? 

    Or let me rephrase, should you be A/B testing on mobile or desktop separately, or not? 

    Well, the correct answer is of course that you should run separate tests on mobile and desktop. 

    That is a no-brainer…

    But when you answer that question, the way I did, you generate another smaller, tangential question such as: 

    Read More
  • Why and How you Should Document your Experimentation Insights

    A computer screen showing a web application CRO experts use to document their experimentation and AB test results

    Disclaimer: This section is a TL;DR of the main article, and it’s for you if you’re not interested in reading the whole article. On the other hand, if you want to read the full blog, just scroll down, and you’ll see the introduction.

    The only way to continually learn is through rigorous experimentation and documentation. But all too often, small startups are disadvantaged by frowning upon the documentation part or viewing it as an optional formality.  Not documenting experimentation insights makes building a meaningful experimentation program challenging and impedes learning. Not to mention, it’s also good practice. What Is The

    Read More
  • What to do When your A/B Tests Keep on Losing

    An experimentation expert looking at the result of his losing AB test and thinking of how to make the next AB test win.

    Do you know what’s easy to do? 

    Setting up and running A/B tests. 

    Do you know what’s difficult to do?

    Coming up with winning A/B test ideas! 

    Yes. Anyone can come up with A/B testing ideas but not everyone can come up with winning A/B testing ideas.

    This is why 1 out of 7 tests succeed.

    Read More
  • A/B testing on Holidays: Is it Worth it? 

    An image showing an AB test variation to a website visitor trying to take advantage of the website’s holiday offer.

    Disclaimer: This section is a TL;DR of the main article, and it’s for you if you’re not interested in reading the whole article. On the other hand, if you want to read the full blog, just scroll down, and you’ll see the introduction.

    Some online retailers take weeks, while some take months to plan out their holiday strategy. It seems impossible to develop a conversion strategy in a few days, but we did so in 2019 when a client approached us. Seasonal events like Black Friday and Cyber Monday need to be approached thoughtfully, and you need all the customer

    Read More
  • What they don’t tell you about A/B testing velocity

    How many A/B tests do you run every month?

    How about every year?

    Now. How many tests should you be running every year?

    You probably don’t know the answer to the third question.

    You’re not alone – most marketers can’t answer that with confidence.

    Read More
  • Google Optimize: The Good, the Bad, and the Ugly

    the picture of the Google letters on a wooden frame inside an office structure.

    If you are new to testing and want to explore personalization, you first have to play with easy-to-use tools before taking a deep dive into a pool of complicated tools. 

    One of the most common easy-to-use testing tools is from Google and it’s known as Google Optimize. 

    When it comes to Google Optimize, I’ve realized that marketers have a love and hate relationship with the tool. 

    Some marketers enjoy using Google Optimize for their experiments. And other marketers totally hate it. 

    This is a clear indication that Google Optimize has a good, bad, and ugly side – it depends on

    Read More
  • What does it take to successfully execute a CRO Program?

    conversion rate optimization experts in a meeting discussing benchmarks for what it takes to successfully run a CRO program

    Disclaimer: This section is a TL;DR of the main article and it’s for you if you’re not interested in reading the whole article. On the other hand, if you want to read the full blog, just scroll down and you’ll see the introduction.

    The value that Conversion Rate Optimization (CRO) brings to the table is now indisputable. Although we still see top executives who are skeptical of its value, the CRO concept has proved its worth to the mainstream. There are different components that make up a good CRO program, and they’re listed below. CRO Tools: As with every

    Read More
  • How To Align Your Business Goals With Your Conversion Goals

    an image showing a bird on a mountain peak standing in front of the sun perfectly aligned

    Disclaimer: This section is a TL;DR of the main article, and it’s for you if you’re not interested in reading the whole article. On the other hand, if you want to read the full blog, just scroll down, and you’ll see the introduction.

    I bet you’d agree that you might lack a certain degree of direction in your testing program when you aren’t clear on your business goals. Essentially, you end up getting pulled in opposite directions — and that can cause a lot of confusion, which then leads to an optimization program that doesn’t add to the business’s growth.

    Read More