September 26

Multiple A/B Tests at Once

Have you wondered if you can run multiple A/B Tests at once? If you run more than one split test at once and do it correctly, running multiple tests can maximize your gains. If however, it is done incorrectly your testing program is put at risk.

This video will review the important considerations in making the decision to run multiple tests at once.

  • The strategy of running multiple tests at once
  • How location impacts the decision
  • How traffic levels impact the decision

Testing Theory is where professional testers turn to do better A/B testing and get more conversions.

Get more information at  https://www.testingtheory.com


Tags


You may also like

AB Testing Statistics Made Easy

A/B Testing Misconception More Traffic is More Risk

  • Sorry buddy, but there is lots of incorrect information here. 1) you can run multiple tests in the same page. 2) comparing against the control of another test is impossible because the other page is likely to have a different conversion rate.

    Reply

    • Hi, Oliver thanks for the comment. While it is possible to run more than one test on one page at a time, the likelihood of getting mixed signals goes go up. You are left wondering if any change in behavior is due to unisolated variables because a visitor is seeing multiple changes in multiple tests.

      As for comparing to the control, let me explain it a different way. If a visitor is in the control in one test and a variation in another test, that visitor is only seeing the changes of one test. So even though they are in two tests, you can isolate any impact because you can look at the visitors that are in the control experience of one test and a variation from the other test. This is what I mean when I say compare to the control of the other test. You are still calculating lift from the control of the same test of the variation you are looking at, but you are isolating the change you made by not looking at visitors in a variation of one test and variation of another test.

      I hope that makes more sense.

      Reply

  • {"email":"Email address invalid","url":"Website address invalid","required":"Required field missing"}

    Ready take your optimization to the next level?

    The optimization master class by Rhett will teach you everything you need to know to master the experience optimization. Take your A/B testing to new levels as Rhett teaches you the foundational, intermediate, and advanced principles of conversion rate optimization.

    >