On this page

Creating a Split Test (A/B)

Split Testing (A/B) is available for each step of the upsell funnel!

We recommend implementing a split test at every funnel position you're able to so that you're constantly optimizing your offers and their conversion rates.

For pre-purchase, there's even the ability to split test any/all offer types against one another I.e. "add to order single" vs "add to order multi", "add to order single" vs "upgrade order", etc. by selecting the "Different Product" option when creating a new split test.

Example ideas for types of Split Tests you can run to find your best converting offers include:

  • One product vs another (i.e. offering more of the same product vs a complimentary product).

  • Different discount levels and/or discount types ($ vs %)

  • Different text/copy for the pages (Product description, Content 1, Content 2)

  • Different Images (Content 1, Content 2)

  • Short-form content vs Longer form content, etc.

To create a split test for an offer, follow the steps below:

1. Hover your cursor over the ... "more options" icon for an offer position where you want to create a split test.

2. Hover over the "Create Split Test" option where you'll see 2 options provided; Same Product or Different Product.

  • Choosing "Same Product", OCU creates an exact copy of the offer page so you can split test the same product against itself, but with an offer page design or price variation. This way you can see which offer page design for the offer product is performing best in that specific upsell funnel position.

  • Choosing "Different Product", you can split test a different product in that upsell funnel position to see which one performs better there I.e., has a higher $ / Visit or conversion rate.

    • For Pre-Purchase offers, if you select to choose a different offer you will first be prompted to select the type of offer. You can choose the same type of offer or a different type of offer for your split-test.

3. Once you select Product B (Same Product or Different Product), the Split Test will be created.

📝The page will update to show which offer product is Page A (the control) and which is Page B (the variation) for the test.

⚠️In any split-test, if you select the Hide offer setting you may notice more views for one offer over the other. These because, even in a split test, the offer wouldn't be shown if the product is already in the cart. The data for the split test would still be accurate (the Conversion and $ / View stats provide the most useful information) but there wouldn't be an exact 50/50 split of page Views in this situation.

Starting a Split Test

Creating the split test will not cause it to work until you actually start the test. Until the test starts, 100% of traffic will continue to go to Page A.

To start the test, click the "Start Split Test" button. Then click the "Continue" button on the pop-up shown next. Pages will be split test evenly at a weight of 50/50.

📝Starting a split test will reset the statistics (number of views, conversion rate, and revenue counter) to 0 for the particular upsell/downsell offer position where the test is started. However, this will not affect the overall funnel stats.

Pausing or Stopping a Split Test and Picking a Winner

Statistics for your running offer page split tests update as soon as the action is tracked. So if someone is accepting an offer, you can check it almost in real-time by refreshing the Funnel Builder page.

Once the split test has run for some time and you're satisfied with the amount of data gathered for it (TBD by the merchant), it's time to either pause or stop the test and pick a winner.

Click the "Pause Split Test" button to Pause the test. Once the test is paused, it will direct all traffic to Page A until you either choose a winner or resume the test.

In the Paused state, you can make edits to either of the offer pages involved in the split test if desired by hovering over the "more options" menu and selecting "Edit Offer Page":

Once the test is Paused, you have 3 options available:

  • Reset Statistics (resets all statistics to 0 for the split test).

  • Resume Test

  • Choose Winner

Click on one of the three buttons depending on which action you'd like to take.

If you click the "Choose Winner" button, you will be prompted to pick either Offer A or B as the winner. Once you make your choice, the split test will be completed and you decide what to do with the losing offer variant.

You can either choose "Keep Variant" if you want to use it in the split test again at a later time or you can choose "Delete Variant" to delete the losing offer.

I added a split test to my funnels, is there anything else I should know?

Whether or not you choose to split-test your offers, it's time to track how they are doing! Learn how to track their performance with by checking out the Funnel and Offer Statistics! Click here to learn more.

OCU also offers a Statistics Suite for overall data about app and funnel performance, click here to find out more about this feature!

Did this answer your question?