Inside RebelMouse’s Regression Testing

Even the smallest software update can change how entire systems function. Running tests after each update, called regression tests, ensures that every element of our platform is still working properly. RebelMouse runs regression tests continuously to increase efficiency as our functionalities expand and new features are introduced.

For each update of a production branch, we automatically begin regression tests. After tests are completed, we generate and review reports, and if there are any unexpected changes, we create tickets to revert changes and fix issues.

Here's a rundown of the different kinds of regression tests we perform:


Entry Editor as a Microservice

For our Entry Editor, regression tests check that all functions are working correctly. It's implemented through various users' content that covers about 95% of possible use cases.

Here's what a test sample test looks like:

AMP as a Microservice

To check AMP functionality, we use a pixel-to-pixel comparison of the production version page view, and then release the candidate version. We also locate several interesting post examples on each of our clients' sites and check them for integrity before each update gets deployed to production.

Lighthouse

Page score results save TeamCity's Build Artifacts and ensure correct monitoring of speed increases or decreases in a persistent environment.

Dashboards

Full-fledged regression testing on our dashboards is still in progress. Currently, we have partially implemented tests on our Posts and Users dashboards, and our rendering engine sees 90% coverage of unit tests on public pages, with smoke tests done via TeamCity on each deployment.

If you have any questions about the way we perform our regression testing, email support@rebelmouse.com or talk to your account manager today.

Related Articles

Why RebelMouse Is the Best Content Marketing Platform

RebelMouse is a unique platform and company. The company was founded on the vision that media companies would need an always-modern solution to thrive in the new connected internet, and that brands would have to behave like new media companies and use the same platforms.

Keep reading... Show less

Why Premium Creative Agencies and CTOs Choose to Develop on RebelMouse vs. WordPress and Drupal

The Intersection of Design and Development: Where Your Clients Thrive

We started RebelMouse seven years ago knowing that there was a fundamental design flaw in the world of traditional CMSs: Every instance, on every platform, had to be updated independently. It's similar to an era when users had to manage their own Microsoft Exchange Server for email. The costs of managing, maintaining, and iterating on a CMS to keep it awesome and world class is typically a $10 million-a-year endeavor. But even then, these cost-prohibitive CMSs are still behind the times.

Keep reading... Show less

Native Multivariate Testing at Scale With RebelMouse

What Differentiates Our Approach

There are many popular tools that allow you to perform experiments and A/B tests on your users — primarily Google Chrome Experiments and Optimizely. But all of these solutions are JavaScript additions to your web page that sidestep the problem of old, outdated, and clumsy CMSs. These solutions work by calling on a third-party JavaScript library that rewrites a page after it's rendered. This approach adds extra page weight and creates strange user experiences due to having to wait for everything to load and be rewritten on the fly.

At RebelMouse, we've solved this in a very elegant way. At the core level of our platform, we can natively render different layouts and track the exact differences in performance when comparing a test to your other layouts.

Keep reading... Show less

Modern E-Commerce: Blur the Line Between Content and Design

Create Modular + Reusable Design Patterns on RebelMouse

Content saturation is an industry-wide problem, and the e-commerce space is no exception given that it's filled with big brands, small Etsy stores, and everyone in between all fighting for similar audiences. The best way to fight this symptom is to understand your audience and provide them with what they want.

Keep reading... Show less

Instagram-style E-commerce Features on RebelMouse

Revolutionizing E-commerce on RebelMouse

Whether you're a brand with a blog or a media company with a site, driving purchasing behavior and building an audience that uses your content to find things they love to buy is vital. We're very proud to have built out the same functionality that everyone is now used to on Instagram, with layovers on images that lead to products with attribution.

Keep reading... Show less

Building Premium Communities and User Journeys on RebelMouse

RebelMouse is much more than just a replacement for a traditional CMS. Our platform is a tremendous community-building experience. Today's social ecosystem has given us a seemingly limitless number of premium creators who understand how to create gorgeous and relevant content that drives the growth of their own audiences. These creators and influencers are either experts in certain topics, or heavily engaged in targeted content that drives their interests. They're not only consuming the content they're passionate about, but they're contributing to the conversation, too. The new role of the editor is not just to cover the most important topics and people around their expertise, but also to invite those preferred influencers into their community and get them to participate in creating premium content.

Keep reading... Show less

Dynamic Voting: Grow Traffic and Engagement Organically

Help your audience find its voice.

Creating quality content is no longer on marketers alone. We live in a universe of creators who are willing to not only consume content that resonates, but play a role in the creation, promotion, and conversations surrounding it.

Since the start of RebelMouse, we've been on a journey to create dynamic media that is easier for content creators to curate and amplify on social. It's why we've built an online engagement platform centered around the power of communities that thrive naturally in the digital ecosystem.

Keep reading... Show less

How to Monetize Your Website in Today’s Publishing Environment

In order to define distributive publishing, we have to ask the following question: If you have quality content, but nobody sees it, does it even exist? The answer is no, because your content needs to be supported in a way that lets it move seamlessly across all channels, especially site, search, and social. But let's take this question a step further: If you can't monetize your content to generate the support it needs, how do you create quality content in the first place?

Keep reading... Show less

RebelMouse Supports TikTok Embeds

Let's be honest, we all love TikTok. And now you can easily embed TikTok videos into your articles in RebelMouse by using either an embed code or the URL of a post.

Keep reading... Show less

Customize Your Entry Editor for Newsletters

At RebelMouse, we are always trying to make our platform fit with your workflow. That's why we recently introduced customizable Entry Editors that allow for different types of content to have different creation and editorial implementations. This lets you step beyond the bounds of most CMS platforms to help your writers visually understand how to create specific types of content.

One recent entry into our list of customizable editorial experiences is for newsletters. In this post, we will describe how we've set up Entry Editor to allow you to search for past articles, drag and drop articles into the main post, and even visualize your newsletter template in Entry Editor while writing your post!

Keep reading... Show less

Integrating Rumble Player on RebelMouse

RebelMouse has recently added Rumble Player as an option for uploading video content into your articles. Rumble Player is a fast and flexible video hosting platform that we have seamlessly integrated into our content creation tools.

Keep reading... Show less

New Programmatic Ad Management on RebelMouse Yields Big Results!

If you're using AdSense Auto ads or managing other forms of programmatic, you know the struggle is real. Here at RebelMouse we are always innovating, and for publishers that includes site monetization. Thanks to Google's GAM 360 MCM account tool, RebelMouse is now able to effectively optimize Google Ad Manager for our customers, and so far we're seeing amazing results!

Keep reading... Show less
Subscribe to Our Newsletter