Native Multivariate Testing at Scale With RebelMouse
What Differentiates Our Approach
There are many popular tools that allow you to perform experiments and A/B tests on your users — primarily Google Chrome Experiments and Optimizely. But all of these solutions are JavaScript additions to your web page that sidestep the problem of old, outdated, and clumsy CMSs. These solutions work by calling on a third-party JavaScript library that rewrites a page after it's rendered. This approach adds extra page weight and creates strange user experiences due to having to wait for everything to load and be rewritten on the fly.
At RebelMouse, we've solved this in a very elegant way. At the core level of our platform, we can natively render different layouts and track the exact differences in performance when comparing a test to your other layouts.
Natively Test Across Multiple Dimensions With Core KPI Measurements
Creative teams with great ideas are most successful when they have an environment where ideas can easily be tested against each other instead of trying to find total agreement on one idea. One of the biggest problems we observed while studying CMS platforms in our space was that creative teams were forced to test a "new design" or a "redesign," jamming a ton of very interesting decisions into one. The amount of lost opportunities to quickly build and test great ideas across the industry is staggering.
We're proud of how we've solved this problem with our Layout & Design tool. Any idea can easily be built out from the base of an existing one. You can be knee-deep in the middle of redesign work and then quickly pause for a moment go test a variant of an idea with users or colleagues.
For creative environments to stay focused while being enabled with this type of creative capacity, it's vital that all ideas end up getting measured. An idea might sound awesome to the group or a team member, but it may not always perform. All of the variant testing we enable is measured against the core KPIs that were established at launch by default. So pages per session, bounce rates, total engagement, and conversion goals are all easy to measure for your exact mission.
Knowing that this data will get measured also has a huge impact on how meetings end up being conducted and creative ideas are expressed. It's often easier to be passionate about the importance of a new idea when you know there will be no hard measures of its performance, and those are the types of creative ideas and passions that often misalign with actual growth. When teams know every test can and will be tested against core KPIs, it keeps everyone's creative energy focused on actually moving the needle.
In addition to all these elements, we've discovered that dynamic multivariate testing has to happen across the site and existing users. Testing should also be based on traffic sources. For example, Facebook has declared full-screen ad pop-ups to be an obtrusive user interface, and is heavily penalizing sites for it. However, that's very often the most premium and desperately needed source of revenue for a media site. On RebelMouse, we enable you to serve different layouts (and variants of those layouts) to Facebook so that you can keep that premium revenue, but serve it safely away from Facebook. The creative potential — when you understand how to test variants with our platform — is unlimited.
We always think about happiness at RebelMouse, and this feature has made our clients very happy. But it's not just because of the growth it creates. It's also the positive structure it gives teams to not only work with each other, but grow strong creatively together.
Request a proposal today to learn more about multivariate testing that works.
