Understanding Popup A/B Testing Analytics

      Understanding Popup A/B Testing Analytics


        Article summary

        Products


        SMS & Email

        Supported plans

        Free, Starter, Pro, Premium, Enterprise

        eCommerce Platform

        Shopify, Shopify Plus

        Yotpo’s analytics page for popup A/B tests gives you access to up-to-date results in real time. You can dive deeper into each variation’s performance and gain insights into overall test results thanks to the wide range of available metrics.

        Finding your popup A/B test analytics

        Each popup A/B test has a dedicated analytics page.

        To reach it:

        1. In your Yotpo SMS & Email main menu, go to Audience > Subscriber Collection Tools.

        2. Find the A/B test you want to analyze and click A/B Analytics.

        Please note:

        If you delete a test that has been completed, you’ll no longer have access to its analytics page.

        Understanding your data

        The analytics page of each A/B test shows data that covers the time period during which the test was in progress. It is divided into three sections - A/B test overview, Variations performance, and Detailed variations analytics. If your test is still in progress, you can click Select winning variation in the top right corner to end it.

        A/B test overview

        In this section, you can find a summary of your A/B test including its start and end date, the winning metric, and the leading variation.

        Variations performance

        The line chart allows you to filter data per metric, including impressions. Impressions refer to the number of times a piece of content is displayed or seen by your customers.

        Detailed variations analytics

        This section is essentially a breakdown table allowing insight into your variations’ results. You can see:

        • Average CVR: The average conversion rate regardless of the channel

        • Average SMS & Email: The average conversion rate per channel

        • Revenue: The revenue generated by the variation displayed in USD

        • Orders: The number of orders attributed to the variation


        Was this article helpful?