Send the original and variant messages of an A/B Test to the sample audiences

Although you determine the size of the audience subset to which the variants are sent by specifying an exact number or a percentage of the audience to sample, the system randomly selects the recipients from your Target List.

After you run the A/B test, you can analyze the results through the Variant Performance Report to determine which message to send to the remainder of your audience.

  1. Select Email > Email Campaigns. The Email Home page displays.

  2. Select the Campaigns tab. The Email Campaign List displays.

  3. Select Manage in the Actions column for the appropriate campaign. The Campaign Summary page displays.

  4. Select the Messages tab. The Message List displays.

  5. Select Edit in the Actions column of the appropriate message. The Message Information page displays.

  6. Select Run an A/B Test step under Related Actions.

    Tip: You can also select A/B Test in the Actions column of the appropriate message in any messages list displayed on a page.

  7. Select A/B Test in the Actions column of the appropriate message. The A/B Test Setup page displays.

  8. Enter a number between 1 and 10,000 to define the number of email test recipients.

    Note: Emails will be divided evenly between the total number of messages and variants for the campaign. The numerical limit of test recipients creates a small test group so that you can determine the best variant to send to your complete recipient list.

  9. Select Next. The Review page displays.

  10. Select Schedule in the Related Actions area.

  11. Select the appropriate date and time by selecting on the drop-down menus and select Finish. The Review page displays.

    Note: The new time and date does not take affect until you select Start in a later step.

  12. Select Select Target Audience Groups in the Related Actions area.

  13. Select the target groups for the emails, or hover over selected groups, and select the X to remove any groups.

  14. Select Finish to save your changes and return to the A/B Setup page.

  15. Select Do Not Email Groups in the Related Actions area.

  16. Select the email targets. Or hover over selected constituents and select the X to remove any groups.

  17. Select Finish to save your changes and return to the A/B Setup page.

  18. Select Select Group Rebuild Options in the Related Links area.

  19. Select the rebuilding options and select Finish to return to the A/B Setup page.

  20. Select Next. The Start page displays.

  21. Select Start. The Delivery List page displays again with the The A/B Test has been created message at the top of the page.

    Tip: After confirming that the messages have been sent, you can run the Variant Performance Report to determine which message (the original or the variant) was opened more often or had the most select-throughs to your site, and so on.