Leave a comment
Get the GH Bookmarklet

Ask GH

Why is it better than alternative platforms?

  • HQ

    Hila Qu

    almost 3 years ago #

    We use Optimizely, mainly because it supports multi-platforms. Evaluated some mobile-only A/B testing platforms such as Apptimize, it is good but didn't see anything really standing out compared to Optimizely. Curious to hear others' experience.

    For Leanplum, I know it not only supports A/B testing, but also supports Mobile analytics/ push notifications etc. So it can work well for a mobile-only company.

  • AS

    Amirhossein Seghatoleslami

    almost 3 years ago #

    Hi Sean
    it is a good tool for A/B testing in application :

    and for app store A/B test this is good tool :

    • AG

      Aaron Glazer

      almost 3 years ago #

      Thanks for the mention! CEO of Taplytics here - we're dedicated to building the strongest mobile A/B testing solution on the market.

      A good platform should be powerful, easy to use, and trustworthy. I'm a strong believer in an inclusive culture of experimentation, so our live visual editor and smooth codeless changes empower everyone from devs to product managers and marketers to participate. We've heard great things from customers about our accessible interface and strong analytics, not to mention super dedicated customer support. :)

      Would be glad to provide further info!

  • EG

    Emily Goldring

    almost 3 years ago #

    For traditional app analytics with A/B testing I would take a look at Optimizely. They are well established and offer a technologically mature solution.

    I would also recommend that you pair Optimizely with a UX analytics platform like Appsee (where I work). Appsee allows you to see your users’ behavior using powerful tools such as user session recordings and touch heatmaps.

    Using Appsee in conjunction with Optimizely will allow you to A/B test with touch heatmaps, so you can actually see where your users are tapping, and if those taps are unresponsive.

    Being able to see your users’ behavior will help you quickly make development and optimization decisions and improve your metrics.

    To check out other A/B testing options, you can find a full list and comparison in the SDK Guide (https://www.appsee.com/ebooks/sdk-guide).

    Hope this helps!

    • SE

      Sean Ellis

      almost 3 years ago #

      Thanks @emilysgoldring really appreciate the response! Do you know any advantages of Optimizely for mobile app A/B testing vs Lean Plum (besides integrating with your product)? The company that asked me this question currently uses Lean Plum.

      • EG

        Emily Goldring

        almost 3 years ago #

        Of course, happy to help when I can :)

        So here's a bit of info on Optimizely and Leanplum:

        Optimizely - Of course is known as the giant in the A/B testing world, Optimizely offers solutions for both mobile web and mobile apps. With it you can A/B test any feature and make immediate changes to the app without the need for app store approval.

        Leanplum - As one of the three main features of Leanplum’s “Lifecycle Engine”, their A/B testing serves as a founding concept for the creation of the company. Like Optimizely, no code is required to get started with Leanplum. Leanplum also offers their entire mobile analytics suite, so you can do A/B testing, but also see all your mobile analytics in general.

      • JS

        Joyce Solano

        almost 3 years ago #

        The biggest difference between Leanplum (my company) and Optimizely is that Leanplum is an integrated solution. The platform enables you to A/B test every part of your app, from messaging campaigns to in-app content. This level of integration makes it easier to optimize the user experience as a whole.

        Outside of A/B testing, Leanplum also provides the tools that apps need for user retention, like messaging channels (push notifications, email, in-app messages, and more), analytics, and user segmentation. These features combined let app teams optimize around not just surface-level metrics, but long-term engagement.

  • AL

    Arsene Lavaux

    almost 3 years ago #

    Great topic. Would like to learn more and wonder if @prabhjot_singh could add some constructive elements to this discussion?

  • BE

    Bruno Etchepare

    almost 3 years ago #

    Hey Sean,

    I haven't personally tested any A/B testing tool with an app yet, so my answer is theoretical, but as far as I have studied #mobilegrowth during the last years, I could say that this ebook by branch.io is one of the best materials on the topic:


    If you take a look at page 37, you will find the recommended tools for A/B testing (Localytics, Mixpanel, Apptimize, Appboy) and many other activities.

    There are several different ways to work with optimization for a mobile app and some tools cover several of activities, from on-boarding tutorials, personalization or deep-linking to A/B testing. So I would answer this question without a winning tool, but saying that you have many great options to define your mobile growth stack since you can combine the tools that fit better into the specific your needs of the app according to it's stage of development and growth.

  • CM

    Claire Mackerras

    almost 3 years ago #

    I think Apptimize is also a good platform to test mobile apps and it is becoming popular nowadays. Available on iOS and Android. Its a free tool, and in case if wish to exlore upgraded features they are available in the paid feature. Read more: https://goo.gl/qwpemL

  • YY

    Yana Yelina

    almost 3 years ago #