Conquer Your Crawl: Feed the Googlebot With Structured Data

Set up success on search with a detailed web schema

Since search took over Facebook as the top referral of web traffic a few years ago, the growth of Google hasn't let up. It's estimated organic and paid search accounts for 68% of all trackable website traffic, and, perhaps even more noteworthy, 53% of that traffic is fueled by organic search.

The revival of search has brought with it a maturation of what makes for a solid search engine optimization (SEO) strategy. The algorithm is now savvy about robotically written articles designed to win a specific set of keywords. As Google's search engine has gotten smarter, its web crawler software, casually called the "Googlebot," has also evolved in terms of how it indexes data.


But what if you could tell Googlebot the story of your website so it doesn't have to make any assumptions? This is possible through the use of structured data, or as Google describes it, a set of "clues" provided to its crawler about what defines your content. Using schema, or a vocabulary you share with Google about every page on your site, you can tell Googlebot the story of your content in human language. Let's make sure it's a good one.

The Importance of Crawl Budget

To better understand the importance of structured data, it's important to revisit the importance of Google's crawl budget. Your crawl budget is the number of pages on your website that Googlebot crawls in a certain time frame.

According to Search Engine Land, page speed and crawl budget are the most important ranking indicators for search in 2020. For the purposes of this overview, we're going to focus on crawl budget only.

It's important to note that crawl budget and load time go hand in hand because the faster your site speed is, the quicker Googlebot can crawl your content. To learn how we power some of the fastest-loading pages on the open web, click here.

Your website's crawl budget is exactly that: budgeted. You only have a limited amount of time to prove your site's relevancy to Googlebot. In fact, our friend Googlebot is so particular that it will actually be less inclined to crawl your website again if it experiences pages it deems to be low quality. And if your site isn't getting indexed, it isn't ranking on search at all. This is why high-quality structured data is so critical.

Quality content is still your biggest weapon. E-A-T is a human-centered approach to creating content that performs well on search. Click here for more information.

There are a lot of factors that can contribute to a low-quality ranking, including 404s, duplicate content, too many redirects, and, of course, poor site structure. Google's Structured Data Testing Tool is the best way to address most of these issues. By making sure every page on your site is organized with the correct schema markup, you will likely uncover examples of technical errors that need addressing at the same time.

Secure Your Ranking With Structured Data

In Google's own words, structured data is a standardized format for providing information about a page and classifying the page's content. For example, on a recipe page, what are the ingredients, the cooking time and temperature, the calories, and so on. The search engine even has its own support and integration guidelines around it. Click here to read these rules. By following Google's structured data guidelines, you're giving the search engine explicit clues about the meaning of your pages.

Google Search liaison John Mueller recently said that structured data is not a direct ranking factor in search. However, it is used by Google to show more relevant search results, which in turn brings more users to your pages. This is the enduring nuisance of modern SEO — there isn't one path to Google's page one, but a checklist of technical and content-driven points to tick off helps secure the right strategy.

Valid structured data will also make your content eligible for graphical search results, also known as rich results. This will show your page's relevance and value to potential readers before they even click on your page:

Examples of rich results on Google Search.

Structured data can and should be added to every product page, image, and/or media element on your site.

An example of how structured data can create rich results on Google Images. This example shows the importance of structured data on individual product pages. From Google.

Weave Structured Data Into Your Strategy

As you can see from the examples covered above, combing through every page on your website to make sure your schema is pristine can be a big task on top of all the other work it takes to keep your content lifecycle going.

On the RebelCMS, our out-of-the-box integration populates all of the standard schema data for you. This means every RebelMouse site automatically populates key structured data so that Google can better understand your site. This, in turn, optimizes your page to win in the search results. This works not only on desktop and mobile, but the data also gets populated for Google's AMP format.

Here's a screenshot of a live example of just how organized a RebelMouse article page is right from the start.

You can also populate structured data from our Layout & Design tool for article pages, videos, images, and lead media:

Click here to learn more about our out-of-the-box structured data integration. And click the following links to learn more about our structured data for videos and lead media.

Secure your ranking on Google with an effortless structured data strategy. Request a proposal today to get started.

Why RebelMouse Is the Best Content Marketing Platform

RebelMouse is a unique platform and company. The company was founded on the vision that media companies would need an always-modern solution to thrive in the new connected internet, and that brands would have to behave like new media companies and use the same platforms.

Keep reading... Show less

Why Premium Creative Agencies and CTOs Choose to Develop on RebelMouse vs. WordPress and Drupal

The Intersection of Design and Development: Where Your Clients Thrive

We started RebelMouse seven years ago knowing that there was a fundamental design flaw in the world of traditional CMSs: Every instance, on every platform, had to be updated independently. It's similar to an era when users had to manage their own Microsoft Exchange Server for email. The costs of managing, maintaining, and iterating on a CMS to keep it awesome and world class is typically a $10 million-a-year endeavor. But even then, these cost-prohibitive CMSs are still behind the times.

Keep reading... Show less

Native Multivariate Testing at Scale With RebelMouse

What Differentiates Our Approach

There are many popular tools that allow you to perform experiments and A/B tests on your users — primarily Google Chrome Experiments and Optimizely. But all of these solutions are JavaScript additions to your web page that sidestep the problem of old, outdated, and clumsy CMSs. These solutions work by calling on a third-party JavaScript library that rewrites a page after it's rendered. This approach adds extra page weight and creates strange user experiences due to having to wait for everything to load and be rewritten on the fly.

At RebelMouse, we've solved this in a very elegant way. At the core level of our platform, we can natively render different layouts and track the exact differences in performance when comparing a test to your other layouts.

Keep reading... Show less

Modern E-Commerce: Blur the Line Between Content and Design

Create Modular + Reusable Design Patterns on RebelMouse

Content saturation is an industry-wide problem, and the e-commerce space is no exception given that it's filled with big brands, small Etsy stores, and everyone in between all fighting for similar audiences. The best way to fight this symptom is to understand your audience and provide them with what they want.

Keep reading... Show less

Instagram-style E-commerce Features on RebelMouse

Revolutionizing E-commerce on RebelMouse

Whether you're a brand with a blog or a media company with a site, driving purchasing behavior and building an audience that uses your content to find things they love to buy is vital. We're very proud to have built out the same functionality that everyone is now used to on Instagram, with layovers on images that lead to products with attribution.

Keep reading... Show less

Building Premium Communities and User Journeys on RebelMouse

RebelMouse is much more than just a replacement for a traditional CMS. Our platform is a tremendous community-building experience. Today's social ecosystem has given us a seemingly limitless number of premium creators who understand how to create gorgeous and relevant content that drives the growth of their own audiences. These creators and influencers are either experts in certain topics, or heavily engaged in targeted content that drives their interests. They're not only consuming the content they're passionate about, but they're contributing to the conversation, too. The new role of the editor is not just to cover the most important topics and people around their expertise, but also to invite those preferred influencers into their community and get them to participate in creating premium content.

Keep reading... Show less

Dynamic Voting: Grow Traffic and Engagement Organically

Help your audience find its voice.

Creating quality content is no longer on marketers alone. We live in a universe of creators who are willing to not only consume content that resonates, but play a role in the creation, promotion, and conversations surrounding it.

Since the start of RebelMouse, we've been on a journey to create dynamic media that is easier for content creators to curate and amplify on social. It's why we've built an online engagement platform centered around the power of communities that thrive naturally in the digital ecosystem.

Keep reading... Show less

How to Monetize Your Website in Today’s Publishing Environment

In order to define distributive publishing, we have to ask the following question: If you have quality content, but nobody sees it, does it even exist? The answer is no, because your content needs to be supported in a way that lets it move seamlessly across all channels, especially site, search, and social. But let's take this question a step further: If you can't monetize your content to generate the support it needs, how do you create quality content in the first place?

Keep reading... Show less

How COVID-19 Has Changed Four Key Components of Marketing

Picking up the pieces and the importance of building trust in a pandemic

As the second half of 2020 begins to pass us by, the COVID-19 pandemic continues to rage on throughout the global community. The longevity of the pandemic has left thousands of industries struggling to find an appropriate position in the marketplace that will allow them to sustain themselves alongside daily tragedy.

The pandemic is far from over, but publishers and marketers are beginning to sift through the aftershocks of what COVID-19 has done to the web. Here's a quick look at the decline in conversion growth during the first few weeks of the pandemic in the United States:

Keep reading... Show less

Explore Careers at RebelMouse

Join RebelMouses's modern and distributive workforce responsible for the websites of media powerhouses, including legacy brands like United Airlines and new media darlings like PAPER Magazine and Protocol.

If you feel like you've never quite fit into boxes or labels within the tech space, we want to hear from you. Built on a foundation of site performance, our cloud-based platform reaches 50+ million people a month with an always-modern approach to product and strategy.

Our fully remote team spans 25+ countries and has very flexible schedules. If you don't want to be confined to an office chair, and like the idea of being able to work from any place in the world you choose, we're a match.

RebelMouse is dedicated to pursuing inclusion for all individuals, regardless of their gender identity, sexual preference, ethnicity, religion, age, or disability. We work hard to form meaningful relationships beyond our platform, and it's this passion that has formed what is now a diverse software company and creative agency that's bucking industry norms. For us, diversity is a company pillar, not just a statistic.

Click here to browse our current opportunities
Subscribe to Our Newsletter