LimeSpot Personalizer offers an advanced A/B Testing feature (Gold and Enterprise plans only) to facilitate which setup and combination of our recommendation boxes works best for your store.
Using the A/B Testing feature gives you, the store owner, the ability to create and run multiple Experiences and monitor the results using the LimeSpot Analytics to find out which experience works better in your live stores.
To start creating your A/B Tests, think of 2 different LimeSpot Personalizer setups (or "experiences") that you want to test on your store. For example, you would like to test if the Related Items or the Frequently Bought Together recommendation box is better for the Product Page of your store. The experiences you would need are the following:
- Experience A: Default with Related Items in the Product Page
- Experience B: Frequently Bought Together in the Product Page
You also need to decide how much weight you want to allocate to each of these experiences during the experimentation phase by inputting the weights for each experience and the weight calculates the odds of the experience. The weight is an integer from 0 to 100. When you put the weight as 0, this will disable the Experience from working. The higher the weight, the higher the priority of the experience to be seen by the visitors. (e.g. 10-10 weight of each experience which makes a 50%-50% odds, 5-15 weight will give a 25%-75% odds etc.)
It is very important to note that the weight of each experience corresponds to the chances a shopper gets that experience. Here is an example:
- If Experience A has a weight of 100 and Experience B has a weight of 200. This means that Experience A will have 33.3% odds that the visitors will get this experience and Experience B has 66.7% odds that the visitors will get this.
A/B Testing is very valuable so that you have data that backs up the result on what works best for your store with Personalizer.
Once you know what you would like to test and how much weights each would have, go to your LimeSpot Admin Panel > Personalizer > Recommendation Boxes. You will see a button at the top right called "A/B TEST".
Clicking on the "A/B TEST" button allows you to see your current default setup. Since the default is the only setup at the moment, its weight and live odds are both 100%. Click on "CREATE" to create a new experience.
In the Experience Settings, change the title to give details for the testing experience, the weight, a start date and start time. Click on 'APPLY' to save the changes.
Once you have created the new Experience, you will see the 2 experiences listed under "A/B Testing Experiences". From now on, each Experience has its own independent setup.
When you click on each experience, you will see what boxes are enabled on what page. Note that customizations will be disabled while A/B tests are running. So if you need to make any customization changes, you must click on "STOP NOW" to stop the A/B test and then re-run it after you have made the changes.
- Experience A: Default
- Experience B: Frequently Bought Together - Product Page
Do not forget to Publish the changes in each experience. Once you have Published and activated the Experiences, it will start running on your live store.