# A/B testing

### What is the A/B testing?

The A/B testing is a **powerful tool** that aims to **improve both the open rate and the click rate** of your campaigns.

Briefly explained, you create **two versions of a campaign**, and AcyMailing will send them to a sample of your recipients, wait for some statistics to be collected, then it will **send the best version** to the rest of the recipients.

### How to set it up

You'll first need to create a campaign like you are used to, but select the "A/B testing" campaign type:

<figure><img src="/files/i5cGpD0m2NPKK4QD0c2q" alt=""><figcaption></figcaption></figure>

Once you're happy with your first version, you can begin creating the second version of your campaign by clicking "Version B":

<figure><img src="/files/0I5W9pRnsu6yp7bYpS7l" alt=""><figcaption></figcaption></figure>

The second version can have a different subject, mailbox listing preview line and a different content. You can copy the version A to make subtle changes, or even start from an other template:

<figure><img src="/files/BoRGmwuwwhRzK0hGy96W" alt=""><figcaption></figcaption></figure>

### Send settings

Once both versions are ready, select the lists you want your campaign to be sent to, then on the "Send settings" step you will have to choose how AcyMailing will handle your campaign.

<figure><img src="/files/zjplZ3chp5BRJjJBtPvu" alt=""><figcaption></figcaption></figure>

The first option lets you choose the size of the sample that will receive the test versions. In this example, the campaign is sent to 10000 users and we chose to use 10% of them as a sample.

10% of 10000 is 1000, so **500 recipients will receive the version A, and 500 will receive the version B**.

AcyMailing will then wait for two days then compare the statistics of both versions of your campaign.

In this example, we choose to send the best version: we will take the subject of the version with the higher open rate, and the content of the version with the higher click rate.

Here is the summary we have with this example:

<figure><img src="/files/W2X4k4wHDElsHt0wcIEQ" alt=""><figcaption></figcaption></figure>

### What do I need to do next?

Once you confirmed the A/B testing campaign, there is nothing more to do as AcyMailing will take care of the rest. After the delay you chose for the first statistics to be collected, a new campaign will be generated with the "winning version".

You can find your A/B campaigns on the campaigns listing, they will have a vial next to them:

<figure><img src="/files/qa4JZv6kBCrAsIii6pLB" alt=""><figcaption></figcaption></figure>


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.acymailing.com/main-pages/campaigns/a-b-testing.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.