multivariate testing

Native Multivariate Testing at Scale With RebelMouse

What Differentiates Our Approach

There are many popular tools that allow you to perform experiments and A/B tests on your users — primarily Google Chrome Experiments and Optimizely. But all of these solutions are JavaScript additions to your web page that sidestep the problem of old, outdated, and clumsy CMSs. These solutions work by calling on a third-party JavaScript library that rewrites a page after it's rendered. This approach adds extra page weight and creates strange user experiences due to having to wait for everything to load and be rewritten on the fly.

At RebelMouse, we've solved this in a very elegant way. At the core level of our platform, we can natively render different layouts and track the exact differences in performance when comparing a test to your other layouts.

Natively Test Across Multiple Dimensions With Core KPI Measurements

Creative teams with great ideas are most successful when they have an environment where ideas can easily be tested against each other instead of trying to find total agreement on one idea. One of the biggest problems we observed while studying CMS platforms in our space was that creative teams were forced to test a "new design" or a "redesign," jamming a ton of very interesting decisions into one. The amount of lost opportunities to quickly build and test great ideas across the industry is staggering.

We're proud of how we've solved this problem with our Layout & Design tool. Any idea can easily be built out from the base of an existing one. You can be knee-deep in the middle of redesign work and then quickly pause for a moment go test a variant of an idea with users or colleagues.

For creative environments to stay focused while being enabled with this type of creative capacity, it's vital that all ideas end up getting measured. An idea might sound awesome to the group or a team member, but it may not always perform. All of the variant testing we enable is measured against the core KPIs that were established at launch by default. So pages per session, bounce rates, total engagement, and conversion goals are all easy to measure for your exact mission.

Knowing that this data will get measured also has a huge impact on how meetings end up being conducted and creative ideas are expressed. It's often easier to be passionate about the importance of a new idea when you know there will be no hard measures of its performance, and those are the types of creative ideas and passions that often misalign with actual growth. When teams know every test can and will be tested against core KPIs, it keeps everyone's creative energy focused on actually moving the needle.

In addition to all these elements, we've discovered that dynamic multivariate testing has to happen across the site and existing users. Testing should also be based on traffic sources. For example, Facebook has declared full-screen ad pop-ups to be an obtrusive user interface, and is heavily penalizing sites for it. However, that's very often the most premium and desperately needed source of revenue for a media site. On RebelMouse, we enable you to serve different layouts (and variants of those layouts) to Facebook so that you can keep that premium revenue, but serve it safely away from Facebook. The creative potential — when you understand how to test variants with our platform — is unlimited.

We always think about happiness at RebelMouse, and this feature has made our clients very happy. But it's not just because of the growth it creates. It's also the positive structure it gives teams to not only work with each other, but grow strong creatively together.

Request a proposal today to learn more about multivariate testing that works.

Related Articles Around the Web
content marketing

Why RebelMouse Is the Best Content Marketing Platform

RebelMouse is a unique platform and company. The company was founded on the vision that media companies would need an always-modern solution to thrive in the new connected internet, and that brands would have to behave like new media companies and use the same platforms.

Keep reading... Show less
creators

Why Premium Creative Agencies and CTOs Choose to Develop on RebelMouse vs. WordPress and Drupal

The Intersection of Design and Development: Where Your Clients Thrive

We started RebelMouse seven years ago knowing that there was a fundamental design flaw in the world of traditional CMSs: Every instance, on every platform, had to be updated independently. It's similar to an era when users had to manage their own Microsoft Exchange Server for email. The costs of managing, maintaining, and iterating on a CMS to keep it awesome and world class is typically a $10 million-a-year endeavor. But even then, these cost-prohibitive CMSs are still behind the times.

Keep reading... Show less
search engine optimization

The RebelMouse Approach to SEO

An SEO Strategy That Wins With Every Publish

How exactly Google determines search ranking largely remains a mystery for publishers, but what we do know is that the search engine continuously rolls out updates to its algorithm. And while sometimes these updates are small and nearly unnoticeable, other times they result in massive changes around the way Google crawls content, often disrupting the rankings of webpages all across the globe.

With each one of these algorithm changes comes a new approach to search strategy. It's a lot to keep up with in a competitive digital landscape. Publishers are already burdened with the task of creating high-performing quality content that's easy to find on Google and, in turn, easily shared across social. It's a job that can't be solved with advertising dollars either. It's estimated that nearly 80% of users disregard paid search results. Pair this with the fact that 93% of all online experiences begin with a search query and you're left with the realization that it's never been more important to prioritize search engine optimization.

The good news is that RebelMouse has a unique approach to SEO that leverages the tools available to us from the open web alongside our proprietary technology that enables users to win key phrases with every publish. The best part? The platform is designed to empower the people who live closest to content: writers and editors. Here's how it works.

Keep reading... Show less
creators

Modern E-Commerce: Blur the Line Between Content and Design

Create Modular + Reusable Design Patterns on RebelMouse

Content saturation is an industry-wide problem, and the e-commerce space is no exception given that it's filled with big brands, small Etsy stores, and everyone in between all fighting for similar audiences. The best way to fight this symptom is to understand your audience and provide them with what they want.

Keep reading... Show less
instagram-style e-commerce features on rebelmouse

Instagram-style E-commerce Features on RebelMouse

Revolutionizing E-commerce on RebelMouse

Whether you're a brand with a blog or a media company with a site, driving purchasing behavior and building an audience that uses your content to find things they love to buy is vital. We're very proud to have built out the same functionality that everyone is now used to on Instagram, with layovers on images that lead to products with attribution.

Keep reading... Show less
communities

Building Premium Communities and User Journeys on RebelMouse

RebelMouse is much more than just a replacement for a traditional CMS. Our platform is a tremendous community-building experience. Today's social ecosystem has given us a seemingly limitless number of premium creators who understand how to create gorgeous and relevant content that drives the growth of their own audiences. These creators and influencers are either experts in certain topics, or heavily engaged in targeted content that drives their interests. They're not only consuming the content they're passionate about, but they're contributing to the conversation, too. The new role of the editor is not just to cover the most important topics and people around their expertise, but also to invite those preferred influencers into their community and get them to participate in creating premium content.

Read our deck here...

Keep reading... Show less
creators

Dynamic Voting: Grow Traffic and Engagement Organically

Help your audience find its voice.

Creating quality content is no longer on marketers alone. We live in a universe of creators who are willing to not only consume content that resonates, but play a role in the creation, promotion, and conversations surrounding it.

Since the start of RebelMouse, we've been on a journey to create dynamic media that is easier for content creators to curate and amplify on social. It's why we've built an online engagement platform centered around the power of communities that thrive naturally in the digital ecosystem.

Keep reading... Show less
revenue

How to Monetize Your Website in Today’s Publishing Environment

In order to define distributive publishing, we have to ask the following question: If you have quality content, but nobody sees it, does it even exist? The answer is no, because your content needs to be supported in a way that lets it move seamlessly across all channels, especially site, search, and social. But let's take this question a step further: If you can't monetize your content to generate the support it needs, how do you create quality content in the first place?

Keep reading... Show less
rebelmouse infrastructure

Learn More About RebelMouse’s High-Performing Infrastructure

To ensure every site powered by RebelMouse is high performing, secure, and optimized for user experience, we only use the best and most reliable methods to host our infrastructure. Here's a detailed look at some of the services and security measures we use every day to secure maximum stability and security for each of our sites.

Keep reading... Show less
social ux layout

Intelligent Social UX Layout: Data-Backed Site Design

Today's media landscape has put publishers in a tough position. They're making less money than ever before, on top of struggling with rising costs and technical inefficiencies. Our data on over 100+ high-traffic sites gives us a unique opportunity to see what kind of websites are successful in this climate and, perhaps more importantly, what sort of sites are failing. This enables us to build optimized sites with a built-in growth strategy.

For any website that needs help getting out of a rut, but might not have the funds to take on a complete design and strategy overhaul, our new intelligent Social UX Layout provides a unique solution. The layout combines the best of what we do in search engine optimization (SEO), design, and overall strategy into one iterable solution that achieves amazing results without the high cost.

Keep reading... Show less
pageviews

Trigger New Pageviews With “Keep Reading” Feature

RebelMouse supports an infinite scroll feed of content that is mobile-friendly by using expandable posts. Your users can read the beginning of your article that is "before the jump," but instead of jumping to a new page, the story expands upon click to show the rest of the post. We do this with our "Keep Reading" functionality:

Keep reading... Show less
page speed

RebelMouse Outperforms Every Other CMS. Here’s the Data to Prove It.

Our Core Web Vitals drastically outpace every competitor, and we have the receipts

In an effort to build user retention and increase conversions, publishers are making a common mistake. They're adding more features to their websites, including ad placements, but losing sight of the main revenue driver: user experience.

The key to unlocking user retention lies completely in site performance. Currently, publishers are trying to build optimized websites that translate easily across devices and platforms, but fail to deliver an experience that checks all their boxes and prioritizes their readers. It takes less than a second of delayed load time to turn away a user. This is why Google has made page speed a top ranking factor on search, and shepherded the entire open web's newfound prioritization on site performance.

Game Changer: Google's Core Web Vitals Announcement

Google cemented its seriousness about page experience with the announcement of its Core Web Vitals measurements in Google Search Console. Core Web Vitals are three specific metrics that Google uses to determine a site's overall usability. While these data points will evolve over time, the 2020 version of vitals consists of three specific metrics:

Largest Contentful Paint (LCP): A website's LCP is the time it takes to load the main content on a page. Google wants LCP to happen within 2.5 seconds of when a page first starts loading.

First Input Delay (FID): This metric quantifies a user's experience when trying to interact with unresponsive pages. This usually occurs between First Meaningful Paint (FMP) and Time to Interactive (TTI) (more on what these two mean below). You want your FID score to be low to prove the usability of your site. According to Google, pages should haven an FID of less than 100 milliseconds.

Cumulative Layout Shift Score (CLS): CLS determines how often your users experience unexpected layout shifts or changes on a page. To ensure visual stability, you want your CLS score to be low. Google wants pages to maintain a CLS score of less than 0.1.

From Google.

Google says Core Web Vitals scores will be considered across every page, and will be a ranking factor in its Top Stories feature. While relevant quality content will always be the most important, the page experience ranking is now a make-or-break metric for your site's survival.

"A good page experience doesn't override having great, relevant content. However, in cases where there are multiple pages that have similar content, page experience becomes much more important for visibility in Search." —From Google's page experience announcement, May 2020

Core Web Vitals will determine every site's performance score. You can see your site's Core Web Vitals specifically via Google Search Console, but your website's overall page performance is measured using Google's PageSpeed Insights and Lighthouse tools.

At RebelMouse, we guarantee a performance score of 90 or higher via PageSpeed Insights. To do this, we've built out a platform infrastructure that exceeds industry standards on Google's key metrics, particularly its Core Web Vitals, outperforming most industry leaders.

You can read more about how we've mastered Google's KPIs here. But the truth is in the data. Below is table that provides a snapshot into how RebelMouse-powered sites score:

And here's what the scores look like for some of the biggest sites on the open web:

As you can see, there's a lot of data Google takes into account even outside of Core Web Vitals. Here's a quick summary of the other important metrics that Google trusts to measure page performance:

First Contentful Paint (FCP): This metric measures the time from click to the time when a user's browser renders the first bit of content from the Document Object Model (DOM), which is your site's HTML structure. According to Google, this is an important milestone for your readers because it provides signals that your page is loading.

First Meaningful Paint (FMP): This is the amount of time it takes the most important content, what Google calls "hero elements," to load on site. Hero elements are different for every site, but should be intuitive based on your content. This metric helps determine your site's usability.

Time to Interactive (TTI): This is the most important metric to keep an eye on. This is when the site is fully rendered and ready for user action. This is a critical point when slow load time can occur, usually because JavaScript or other complex content hasn't fully rendered. So, in short, think of TTI as how long it takes for your site to load in its entirety.

Total Blocking Time (TBT): TBT measures a page's load responsiveness to quantify how long a page is non-interactive prior to becoming interactive. You want your site to have a low TBT to maintain its usability.

Speed Index (SI): SI is the measurement of how quickly the contents of a page are populated. You want your speed index score to be as low as possible.

Creating quality content is only half the battle in 2020, and publishers are already burdened with the around-the-clock task of creating content that resonates. This is why quality content must be supported by modern technology that can keep up with the speed of the web. RebelMouse provides publishers with a CMS that supports the new content lifecycle with an editorial suite designed for reach on site, search, and social.

Click here to read more about our modern approach to web performance. If you want to make performance a priority, request a proposal today. We can easily transform your site into one of the fastest on the web, giving you increased user retention and better conversion rates than ever before.

Related Articles Around the Web
page speed

A Modern Story of Web Performance From RebelMouse Founder + CEO Andrea Breanna

If I had more time, this website would have loaded faster

In the first months of 2020, we've focused at RebelMouse on page speed and performance. We worked very hard and found ways to take 90% of the sites we power to 90+ performance scores via Google's PageSpeed Insights tool — even with sites that are loaded with ads, embeds, third-party analytics, and other typical slow-loading elements. You can read more about our victories here.

A few months after we started this process, COVID-19 hit the world very hard. Suddenly, every media company was faced with a huge problem: Advertising fell off a cliff in what seemed like seconds. The only way to survive this unprecedented downturn is to grow traffic and control costs at the same time. So we started to shave our code and made our websites faster. We dropped costs just as dramatically as we were increasing scores.

Here are some surprises we found when doing this: If you want truly exceptional performance, none of the JavaScript and CSS frameworks that developers love so much make the cut. We thought the React version of RebelMouse was going to be the huge page speed breakthrough, until we realized the only way to achieve this goal was to write the code carefully and refactor it endlessly until it was as short as possible. As any author will tell you, like editing a book or a blog post, the revision process is never really done. By stepping away from frameworks, and methodically shaving vanilla code, our customers continue to see major improvements in performance.

As we announced this to our site network and rolled it out publicly, many of our clients asked me personally, "How did you do it?" The answer is easy to understand regardless of how technical you may be. It's perfectly summarized in this wonderful quote attributed to Mark Twain:

"If I had more time, I would have written a shorter letter."
—Blaise Pascal, 1657 (and later, more famously Mark Twain)

The universe is sometimes very beautiful, and especially when you keep it simple. If you would like to start publishing on a site optimized for both speed and sustainability, request a proposal and let's start working together.

Related Articles Around the Web
Subscribe to Our Newsletter