# A/B testing

### What is the A/B testing?

The A/B testing is a **powerful tool** that aims to **improve both the open rate and the click rate** of your campaigns.

Briefly explained, you create **two versions of a campaign**, and AcyMailing will send them to a sample of your recipients, wait for some statistics to be collected, then it will **send the best version** to the rest of the recipients.

### How to set it up

You'll first need to create a campaign like you are used to, but select the "A/B testing" campaign type:

<figure><img src="https://963725040-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-L_D4iy53WFAtKVs3BPA-3566562695%2Fuploads%2FYfDiG0IB3YIumWP1jH6f%2Fcreate%20type.png?alt=media&#x26;token=97d36154-6cc9-4bf2-be50-5dd39d179172" alt=""><figcaption></figcaption></figure>

Once you're happy with your first version, you can begin creating the second version of your campaign by clicking "Version B":

<figure><img src="https://963725040-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-L_D4iy53WFAtKVs3BPA-3566562695%2Fuploads%2FrfKYfGBSlrUxf6zI13rn%2Fcreate%20version%20A.png?alt=media&#x26;token=c8ea55b7-37c8-47bc-bfb8-11085baa70d4" alt=""><figcaption></figcaption></figure>

The second version can have a different subject, mailbox listing preview line and a different content. You can copy the version A to make subtle changes, or even start from an other template:

<figure><img src="https://963725040-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-L_D4iy53WFAtKVs3BPA-3566562695%2Fuploads%2FbWh9n5mCbEE7eYiIyesI%2Fcreate%20version%20B.png?alt=media&#x26;token=9337bad3-1cc7-4118-a623-2b17754a1e51" alt=""><figcaption></figcaption></figure>

### Send settings

Once both versions are ready, select the lists you want your campaign to be sent to, then on the "Send settings" step you will have to choose how AcyMailing will handle your campaign.

<figure><img src="https://963725040-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-L_D4iy53WFAtKVs3BPA-3566562695%2Fuploads%2FSVERvF2MYEO2aT8mbpBH%2Fab%20repartition.png?alt=media&#x26;token=d8f7bf9b-ffe0-4db3-a4f1-ff4886a7b904" alt=""><figcaption></figcaption></figure>

The first option lets you choose the size of the sample that will receive the test versions. In this example, the campaign is sent to 10000 users and we chose to use 10% of them as a sample.

10% of 10000 is 1000, so **500 recipients will receive the version A, and 500 will receive the version B**.

AcyMailing will then wait for two days then compare the statistics of both versions of your campaign.

In this example, we choose to send the best version: we will take the subject of the version with the higher open rate, and the content of the version with the higher click rate.

Here is the summary we have with this example:

<figure><img src="https://963725040-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-L_D4iy53WFAtKVs3BPA-3566562695%2Fuploads%2FE22ijDR8sg2mdLWkShMu%2Fimage.png?alt=media&#x26;token=1234f007-f35c-4c21-8c17-bfd7db14be9f" alt=""><figcaption></figcaption></figure>

### What do I need to do next?

Once you confirmed the A/B testing campaign, there is nothing more to do as AcyMailing will take care of the rest. After the delay you chose for the first statistics to be collected, a new campaign will be generated with the "winning version".

You can find your A/B campaigns on the campaigns listing, they will have a vial next to them:

<figure><img src="https://963725040-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-L_D4iy53WFAtKVs3BPA-3566562695%2Fuploads%2FchEfao3GKoKkcYEEj9GP%2Fimage.png?alt=media&#x26;token=b0d42339-17af-4904-90b2-6badb09bb982" alt=""><figcaption></figcaption></figure>
