Split Testing in Email Campaigns

A/B Testing In Email Campaigns allows you to test up to 6 different versions of an email!

A/B testing for Email Campaigns

Navigation

• Go to Marketing > Emails > From the Dropdown select Campaigns
• Create a new email campaign and click the A/B Testing tab and enable the toggle

• Choose whether you'd like to split-test the Email subject line or the Email content

• 2. Set the A/B Test Duration time (after this amount of time, the winning version will be sent to the rest of the contacts)

• Set the number of variations you want to test
• Set the Test Size Distribution to decide what percentage of contacts will receive different variations. You can also leave the slider at 50%.
• Set the subject variations using AI or manually
• Note - A minimum of 10 contacts are needed for each variation (creating 4 emails to split the test would require 40 contacts, 10 for each test).

• Choose whether the Winning Criteria will be Unique Open Rate or Unique Click Rate

• Set the Delivery method (Send Now or Schedule the Campaign) Note - A/B test campaigns will currently not work for batch schedule or RSS schedule.
• Once the email campaigns are sent out, you can check the enhanced statistics and reports of variations and overall email campaigns.

Use Case:

Suppose you are launching a new product and want to determine the most effective email subject line to capture your audience's attention. You can set up an A/B test with two or more variations of subject lines, run the test for a specific duration, and then automatically send the winning version to the rest of your contact list. This approach maximizes engagement and helps you optimize your email campaigns based on real-time data.

FAQ’s

What is A/B Testing in Email Campaigns, and how does it work?
A/B Testing in Email Campaigns allows you to test up to six different versions of an email to determine which version performs best. You can split-test variations of email subject lines or content to see which one generates a higher open or click rate. After a set duration, the winning version is sent to the remaining contacts based on your chosen criteria.

How do I set up A/B Testing for my email campaign?
To set up A/B Testing, navigate to Marketing > Emails > Email Campaign, create a new campaign, and click on the A/B Testing tab. Enable the toggle, choose whether to split-test the subject line or content, set the duration for the test, decide on the number of variations, and set the test size distribution. Finally, select the winning criteria (Unique Open Rate or Unique Click Rate) and choose your delivery method.

What are the minimum requirements for running an A/B test in email campaigns?
For A/B Testing, a minimum of 10 contacts is required for each variation. For example, if you're testing four email versions, you'll need at least 40 contacts, with 10 for each test. Ensure your contact list meets these requirements to run the test effectively.

What happens after the A/B Test Duration time ends?
Once the A/B Test Duration time ends, the system automatically determines the winning version based on your selected criteria (Unique Open Rate or Unique Click Rate). The winning version is then sent to the remaining contacts who were not part of the initial test.

Can I schedule A/B test campaigns, and what limitations should I be aware of?
You can set the delivery method to "Send Now" or schedule the campaign. However, A/B test campaigns currently do not work with batch schedules or RSS schedules, so you'll need to use immediate or scheduled sending for the tests.