Who This Is For / When to Use
Use this feature if you want to improve email performance by testing subject lines or email content before sending to your full contact list.
This is ideal for product launches, promotions, newsletters, or any campaign where engagement optimization matters.
What Is A/B Testing in Email Campaigns
A/B Testing in Email Campaigns allows you to create up to 6 variations of a single email.
Kyrios automatically evaluates performance based on your selected criteria and sends the winning version to the remaining contacts.
How to Set Up A/B Testing in an Email Campaign
Step 1: Navigate to Email Campaigns
Go to Marketing > Emails > Campaigns from the dropdown.
Step 2: Create a New Campaign and Enable A/B Testing
Create a new email campaign.
Click the A/B Testing tab.
Enable the A/B Testing toggle.
Step 3: Choose What You Want to Test
Select one of the following:
Email Subject Line
Email Content
Only one option can be tested per campaign.
Step 4: Set the A/B Test Duration
Set the A/B Test Duration.
After this time ends, Kyrios will automatically send the winning version to the remaining contacts.
Step 5: Configure Variations and Distribution
Select the number of variations (up to 6).
Set the Test Size Distribution to determine what percentage of contacts receive the test variations.
You may leave the slider at 50% if desired.
Create subject or content variations:
Manually
Using AI
Important Requirement:
A minimum of 10 contacts per variation is required.
Example:
4 variations = at least 40 contacts total.
Step 6: Select the Winning Criteria
Choose one:
Unique Open Rate
Unique Click Rate
This determines how Kyrios selects the winning version.
Step 7: Choose Delivery Method
Select one:
Send Now
Schedule Campaign
Limitation:
A/B Test campaigns do not work with:
Batch schedules
RSS schedules
Step 8: Manage the A/B Test
During the test, you can:
Pause the A/B test
Edit the campaign
Resume the test
Edits only apply to emails not yet sent.
Viewing Results and Reports
After emails are sent, you can view:
Performance of each variation
Overall campaign statistics
Enhanced reporting for opens and clicks
Use Case Example
You are launching a new product and want to find the most effective email subject line.
You create an A/B test with multiple subject line variations, run the test for a set duration, and allow Kyrios to automatically send the highest-performing version to the rest of your contacts—maximizing engagement based on real data.
FAQ
What is A/B Testing in Email Campaigns, and how does it work?
A/B Testing allows you to test up to six versions of an email. You can compare subject lines or email content, and Kyrios automatically sends the winning version based on open rate or click rate after the test duration ends.
How do I set up A/B Testing for my email campaign?
Navigate to Marketing > Emails > Campaigns, create a new campaign, open the A/B Testing tab, enable the toggle, choose what to test, set the duration, configure variations and distribution, select the winning criteria, and choose your delivery method.
What are the minimum requirements for running an A/B test?
Each variation requires at least 10 contacts. For example, four variations require a minimum of 40 contacts.
What happens when the A/B Test Duration ends?
Kyrios automatically determines the winning version based on your selected criteria and sends it to all remaining contacts.
Can I schedule A/B test campaigns?
Yes, you can use Send Now or Schedule Campaign.
Batch schedules and RSS schedules are not supported for A/B tests.
Can I pause or edit an A/B test after it starts?
Yes. You can pause, edit, and resume the A/B test at any time. Changes only affect emails that have not yet been sent.
Should I test the subject line or the email content?
Test the Subject Line if open rates are low.
Test the Email Content if opens are high but clicks or conversions are low.
Best Practice:
Only test one variable at a time so you can clearly identify what caused the performance change.