Did you know anywhere from 80% to 90% percent of A/B tests do not produce any significant results?
Only 1 out of 8 A/B tests drive significant change.
Done incorrectly, some marketers have begun to question the value of A/B testing…
…their A/B test reports an uplift of 20% and yet, the increase reported by the AB testing software never seems to translate into improvements or profits.
“Most winning A/B test results are illusory.” (Source: Qubit)
Furthermore, the majority of arguments that call for running A/A testing consider it a sanity check before you run …Read More
If you missed, we are conducting a Facebook live every Thursday at 12 pm EST.
Last week Ayat spoke about the SHIP method (Scrutinize, Hypothesize, Implement, Propagate). She honed in on the first letter in SHIP, Scrutinize. She summarized what it takes to build out your conversion roadmap so you have a plan for testing and moving forward.Read More
Khalid recently wrote a post on why most case studies suck. Well, it wasn’t actually that case studies that suck, but rather that the AB experiments conducted within these case studies are simply not valid. We also had an interesting discussion about in the Invesp linkedin and the Invesp facebook pages and tweeted about it as well.
The point of this long week debate came down to: process, process, process.
If you follow a sound CRO process and are careful about missteps when it comes to AB testing, you can achieve amazing results and have a successful program.
But for …Read More
The CRO industry have evolved tremendously over the last twelve years.
I still recall conversations we used to have with CMOs and VP of marketing at large online retailers trying to introduce them to conversion optimization.
We would first try to determine if they even knew what were even talking about (it was that new): “Have you considered CRO?”
The first response for the most part was, “CRO? You mean SEO. Yes, we are working on increasing traffic to our website.”
“No, I am not talking about SEO, I am talking CRO…conversion rate optimization. Increasing your website conversion rate.”Read More
You must cover all the bases to get reliable results from your A/B tests.
A/B testing mimics scientific experiments, however, it is not a tool that will give you a 100% sure answer in 100% of tests that you run. Only few marketers are aware of the limitations of the method and know how to run it to get valid results and minimize the risk of false positives and false negatives.
That’s why Martin Goodson, now the Chief Scientist at Evolution AI, wrote a paper called “Most Winning A/B Test Results Are Illusionary.” In his paper, he explained that badly …Read More
“Why do I need to learn about statistics in order to run an A/B testing?” You may be inclined to wonder, especially considering that the testing engine supplies you with data to make a judgement on the statistical significance of the test, correct?
As a matter of fact, you have plenty of reasons to learn statistics.
If you’re conducting A/B tests, you need to understand some basics about statistics to validate your tests and their results.
Nobody wants to spend time, money and effort on something that will turn out useless at the end. To use A/B testing efficiently and effectively, …Read More
What to test next in your SaaS website?
Great question. Increasing the conversion rates of a SaaS (software as a service) provider is part science, part art. That means, you need to take a look at the numbers and data from visitors’ behavior, while also looking for unique insights and solutions to some of the problems you uncover with the data.
To help you out with inspiration for future testing, we compiled real-life examples and case studies of successful and surprising A/B tests on SaaS websites.
But, first, a fundamental rule of thumb for A/B testing your way to higher conversion …Read More
“Should I run an A/B test or a Multivariate test?”
This simple yet fundamental question always pops up in planning for conversion rate optimization.
A/B testing is the default and most common procedure in CRO programs. In some cases, though, running a multivariate test can add a significant value. Other times, you have room for both tests interchangeably.
The great benefit of testing? You give your visitors a voice in the design process.
When implemented correctly, testing removes the guesswork from conversion optimization and you move to the stage where every action you take is a result of an informed …Read More
- Why you should run A/A tests in your conversion optimization program
- Your conversion optimization plan for peak seasons (including the holidays)
- The death of the average CRO
- How Digital Influences In-store Shopping Behavior – Statistics and Trends
- Review of digital marketing & SEM conferences: reflecting on my experience
- 2017 US Holiday Shopping Statistics and Trends [Infographic]
- Starting your conversion optimization project the correct way
- The Importance of Live Chat Customer Support – Statistics and Trends [Infographic]
- The not so pretty side of entrepreneurship: 12 lessons we learned the hard way
- 2 facebook live events with important CRO lessons
Latest Blog Posts