The A/B testing dashboard gives you detailed data analysis on your A/B testing experiences. It can be accessed under Analytics > A/B Testing when you login to your LimeSpot admin panel. Please note that this feature is only available for customers on the Gold and Enterprise plans.
Once you've got your A/B test setup, you can go see how it is performing with the A/B testing dashboard. Filter by the dates where your experiences are running to get insight on statistics like the potential revenue, conversion rate, statistical significance, average order value, and revenue per session.
There will always be a baseline (controlled) experience and the testing experience. For each experience, clicking on the 3 dots to the right allows you to View Orders or Download Purchase Details (.csv file).
Here are some frequently asked questions that come up from the purchase details CSV file:
1) What is no-name experience under Experience Guid?
No-name experiences are the ones that are deleted from the system, so they are not associated to an experience with title, details, etc. But they can show up in our data anyways, since we keep the snapshot of the data on events when they happen and never delete them.
2) How do we assign experiences to items and orders, etc.?
Each order can contain more than 1 item. Each item may be driven from different experiences. So we cannot assign only 1 experience to 1 order.
Imagine this scenario:
Day 1: You check item A via experience ex1 (you are randomly assigned to experience ex1 in your day 1 session).
Day 2: You check item B via experience ex2 (you are randomly assigned to experience ex2 in your day 2 session).
Day 3: You check item C via experience ex1 (you are randomly assigned to experience ex1 in your day 3 session).
Day 4: You buy A, B and C.
Your order consists of A and B and C, where A and C come from experience ex1 and B comes from experience ex2.
That said, everything that we report is based on the purchased items and not an entire order.