Can I conduct multiple A/B tests in one campaign?
Yes, Liveclicker allows users to set up multiple A/B tests in a single campaign. There are no restrictions currently on how many A/B tests a user can set up in a single content element or in a single campaign.
It is, however, important to know that all A/B tests run independently of each other. This means that you cannot control which combination of element A/B test content pieces are shown when you have two or more separate element A/B tests set up.
Why do the total impressions for my A/B tests differ from what is Insights?
There are two reasons that impressions for different versions of your element may differ from what is seen in Insights breakdown by version:
In the A/B testing report, Liveclicker only tracks impressions marked as part of the A/B test. All impressions before an A/B test is started, or after an A/B test is disabled, or a winner is chosen, will not be shown in the A/B test report, but they will be shown in your account Insights.
Depending on the element being used, for certain email clients and scenarios, Liveclicker must serve the default version of the element.
Liveclicker does not count these impressions as part of the A/B test and those impressions will not appear in the A/B test report.
When winner picking is on, why does my data differ?
When your A/B test has winner picking turned on, and a winner is chosen, you will clearly see which version has won, how many clicks and impressions it had when it was chosen, and the timestamp for when it was chosen. Sometimes you will see that the impressions, clicks, and click-to-open rate columns do not match with the winner data. This is because the data in the column gets cached, and can sometimes take 4-6 hours to refresh.
How long does it take to get the analytics data for A/B tests?
When you set up an A/B test, the analytics data related to it can take up to 24 hours to be processed and displayed in comparison to the A/B test process itself, whereas the results related to winner picking are displayed instantly.
