In-House SEO vs. Agency Outsourcing:

<i> The Benefits of Both Compared </i>

In 2020, businesses spent nearly $47.5 billion on SEO or SEO-related products and services. If one thing became clear to us in 2020, it’s that the demand for search marketing became higher than ever. As the Coronavirus pandemic swept the globe, shelter-in-place restrictions and travel bans drove a great deal of uncertainty. When consumers had a question or needed to find a solution to a problem, they turned to search. 

With so many brands and online publishers creating content and websites competing for attention, to increase your chances of being seen and clicked, your website or content must appear close to the top of the rankings for relevant searches.

Now, as to how you can actually make that happen, there is debate is on which is best: managing your SEO in-house or outsourcing to an SEO agency?

In this report, you will learn more about each of these models — in-house SEO vs. outsourced SEO — and the benefits of each one. But first, what is at stake here?

Download the report to find out.

What is a Search Engine Spider?

Definition

A search engine spider is a software crawler that is also referred to as a search engine bot or simply a bot. Search engine spiders indicate data marketers, HTML, broken links, orphan pages, important key terms that indicate a page’s topics, traffic coming to the site or individual pages and more. Spiders understand how pages and sites are constructed and also, how they’re tied to other sites or internal pages. All of this information is used to help search engines like Google, Yahoo and Bing determine where pages should be ranked in the SERPs (search engine results pages.)

How Does a Search Engine Spider Work?

Spiders understand how pages and sites are constructed and also, how they’re tied to other sites or internal pages. All of this information is used to help search engines like Google, Yahoo and Bing determine where pages should be ranked in the SERPs (search engine results pages.)

Specific coding is used to tell search engine spiders more about a page. For example, schema markup is used to tell spiders exactly what a page is about. If your company is a hotel or airline, you can use schema to tell search engine spiders that you are a hotel, what accommodations you offer, the rooms you have available and more. You can read more about schema markup here.

When a bot crawls your site and it finds schema markup, sitemaps, robots.txt protocol, noindex, etc., it will detect this information and update its index to continue crawling in order to better understand your site.

What are the Different Search Engine Spiders?

Some of the most important search engine spiders you should know about include the following:

  1. GoogleBot - Google
  2. Bingbot - Bing
  3. Slurp bot – Yahoo
  4. DuckDuckBot – DuckDuckGo
  5. Baiduspider – for the Chinese search engine Baidu
  6. Yandex Bot – for the Russian search engine Yandex

What Can Search Engine Spiders See?

Spiders can see all of the technical coding and messages written in your HTML for them. They can also see all new and updated content on your site. This can include blogs, articles, glossary pages, videos, images, PDF files, etc.

What is Crawl Budget?

Google uses a crawl budget to determine how much of your website’s content to crawl and when. Search engine giant, Google, determines a site’s crawl budget based on how often and how fast their spider can crawl your site without hurting your server and the popularity of your site. This includes the freshness and relevancy of your content as well.

Gary Illyes from Google says that crawl budget should not be a main priority for sites and sites with a large volume of pages should use crawl budget as a consideration.

What Could Prevent Spiders from Seeing all of Your Site?

Some common mistakes developers make throughout a site that could keep search engine spiders from seeing your entire site include the following:

  1. Disallowing search engines from crawling your website. You can do this if you don’t want search engines bots to crawl your site but if you do want them to crawl it again at some point, be sure to remove coding that tells them to avoid crawling.
  2. Placing navigation in JavaScript rather than HTML. If you place navigation types in your JavaScript, you should also place them in your HTML as search engine spiders don’t fully understand JavaScript yet.
  3. Having orphan pages could prevent spiders from crawling all of your pages. Be sure to link important pages throughout one another internally to create a path for search spiders.

SEO vs. SEM: Combining the Two to Maximize SERP Real Estate

gregalbuto
gregalbuto
M Posted 5 years 2 months ago
t 9 min read

The quality and quantity of the traffic coming to your site matters. Using SEM and SEO together will drive traffic using both organic and paid strategies.

What is SEO?

SEO (or search engine optimization) is the practice of structuring your website’s pages to make it easier for search engines to crawl your site, making your pages more easily discoverable to users and search spiders, and providing unique information or helpful resources through content planning on topics that searchers are looking for. SEO is the process of improving your website to enhance the user experience and to increase quality traffic to your site. 

SEO includes both on and off-page elements. Some on-page SEO tactics include optimizing image alt text and title tags. Some off-page SEO strategies include backlinking and guest blogging. Combining all on-page and off-page SEO strategies will increase your opportunity for ranked pages.

Creating data-driven content that is fresh, unique and informative for users, not bots, will help drive ranks. Well-developed content that provides real value to readers is one of the most crucial parts of SEO. While keyword research and implementation are still a ranking factor, search engines are ranking content more predominantly based on the information provided to a user and the user experience. Search engines are better able to understand search intent therefore your content should be absolutely written for users in order to rank well

What is SEM?

What does SEM stand for? SEM stands for search engine marketing and is a paid marketing tactic to promote a site, drive traffic to your website through pay-per-click advertising (PPC) and increase page exposure in the search engine results pages (SERPs). Using PPC drives immediate visibility to your website through ads.

SEO vs SEM: The Battleground

Simply put, SEM is a paid strategy with an immediate impact while SEO is an organic strategy that shows results over time. 

Creating a paid ad that grabs the attention of a targeted audience using a great message and call to action (CTA), is only a conversion driver for the time being and for as long as you are willing to spend. 93% of digital marketers are investing in paid ads. 

Leveraging SEM generates traffic, clicks, leads, opportunities, etc. to your website immediately but is not necessarily a sustainable strategy for traffic. Once the spend on your advertisement is up, so is your SEM strategy. 

SEO, however, takes a different approach. It is believed that SEO has a much larger impact on users than SEM does. Why? Because the first organic result receives a 28.5% CTR while a paid ad only receives a 10% CTR. Organic search drives 53% of web traffic whereas paid drives 27%. While you can see traffic growth with both SEO and SEM separately, you’ll win biggest by doing both together.

SEO typically takes longer to gain traction but has better results and much more staying power. Creating content that is well-optimized without spending ad dollars is a long-term plan for ranking high in the SERPs.

Because search engines analyze your site content for expertise, authoritativeness and trustworthiness (E-A-T), it takes time for your pages to increase in ranks. Search engines crawl pages to find unique and high-quality content that is up to date, optimized and well-written for users. 

If your page is ranking on the first page of a search engine, this indicates search engines trust your information and your site. They are offering users your information as opposed to someone else’s. Because of this, you will see more quality traffic and leads coming to your site. 

Though your SEM campaign is targeted, sometimes you may see less quality traffic coming from your ad. This can be due to click fraud. Competitors may see your ad and click into it to inflate the number of clicks on your ad costing your company more ad spend. This is a black hat strategy to use up ad spend early on to remove your ad for the rest of the day.

Using SEO and SEM together

Can you successfully leverage SEO and SEM together? Yes! 

Is it more impactful to use SEO and SEM together? If you are doing it well and your ads complement your SEO strategy, also yes!

To successfully leverage SEO and SEM together, you need to first begin with keyword research. Performing keyword research for the pages you want to rank for is one of the most important aspects of SEO. Products like Data Cube and Instant help you perform keyword research and leverage that knowledge to create new and better-performing content.

So, what can SEO and SEM working together achieve? The most ideal result for using SEO and SEM together is that your site lands the top organic SERPs and your company is driving even more visibility with an ad, as well. Here, users have the decision to click on your ad if it is relevant to them or your organic result.

Combining insights and data for more visibility into your audience from both SEO and SEM will produce greater results. Knowing how to use SEO and SEM together is an essential strategy to the growth of your site’s traffic. SEO drives top-of-funnel leads while SEM drives bottom-funnel leads.

The Case for Developing an SEM Strategy

SEO is becoming more important and as more brands realize that more strategy is building around optimizing pages and driving ranks for the top and most competitive keywords out there. But sometimes your SEO team may find it difficult to rank for certain keywords. 

The competition for keywords that are important to you may be extremely high. If this is the case, leveraging SEM strategies can drive traffic to your site for keywords you are not able to rank for within the first few pages on the SERPs. BrightEdge Instant can help you understand and evaluate keyword competitiveness, and search intent. 

If a keyword is highly competitive, it may not be worth your team’s time to optimize pages for it. Using Instant, you can perform keyword research for keywords that are related to one another but may not have the same level of competitiveness.

Below are some additional reasons to develop an SEM strategy:

  • If you’re looking to capture more user data than organic traffic offers using PPC ads, you can link to dashboards like Google Analytics to see clicks, impressions, sessions, CTR, average cost-per-click, conversions and more.
  • If you’re looking to drive conversions. SEM is conversion-driven, and ads are created around a specific CTA. Leverage SEM to convert users.
  • If you’re looking to boost short-term campaigns or promotions that will start and end in less time than SEO will generate traffic. SEM can expedite the sales and promotions cycle. Use SEM strategy to get your message to users ASAP about an event, a sale, a new product or service, etc. You can use SEM to drive users and traffic to your site within hours of a live ad.
  • If you’re looking to drive traffic sooner while waiting for SEO to drive results. If you’re creating content based on an important keyword or topic you want to rank for, writing the post and publishing it won’t get you traffic immediately but making it the CTA of your ad will. 

Additionally, having more detailed data from ads may help you understand your audience better. You can also leverage SEM for retargeting purposes. Retargeting is when you target users that have previously clicked on your ads. If a user has taken interest in your ads before, you can drive even more brand awareness to them through retargeting.

SEM is a short-term solution to drive traffic to your site and encourage conversions instantaneously. It is most ideal to leverage SEO and SEM together to increase quality traffic to your site. But while you are working on SEO, a well-optimized SEM strategy in place will create visibility in the meantime. Once you get the hang of SEO and SEM, your combined strategies should operate well together. 

Aligning Your Content with Customer Intent:

Using Search Results to Develop a Winning Content Strategy

Aligning Your Content with Customer Intent

Using Search Results Data to Develop a Winning Content Strategy

Winning in SEO isn't just about keywords anymore. Today’s SEOs and Digital Marketers must aim to present an overall search experience that aligns to customers’ expectations and intent.

The addition of universal search adds another layer of complexity as over 50% of searches now result in zero-click results. On the bright side, marketers can directly leverage and interpret search engine results to inform the kind of content they need to be discoverable by the right audience, at the right moment. The search results can tell you when you need to be relying on images, where you need to be very transactional, and where you customers will expect long-form content.

Watch this BrightEdge how-to session as we look at what valuable insights can be gleaned from the search results pages and Data Cube, and how you can leverage both to formulate and execute a winning content strategy.

What you can expect to learn:

  1. How to identify the types of content that are driving engagement for your customers
  2. How Google is treating universal results across different industries
  3. How to use a search result page’s features to inform your content strategy

 

Featured Speakers:

Semantic Search: The Why and How to of Semantic SEO

gregalbuto
gregalbuto
M Posted 5 years 2 months ago
t 9 min read

While keywords are still an important part of SEO and ranking, search engines have evolved and are able to understand the full context of a query beyond just the keywords. Optimizing your content for semantic search can increase your chances of ranking in position 0 results like People Also Ask.

What is Semantic Search?

Semantic search is understanding a searcher or user’s search intent by understanding the language within their queries. Semantic search offers the ability to find more personalized, meaningful, and relevant results for searchers through logic.

Search engines use the context of queries, the intent behind searches, search history, location and more to offer users the best results possible for their query. Semantic search is the driving factor behind Google fully understanding a search.

The Evolution of Semantic Search

Semantic search has evolved over the last couple of years due to new innovations in artificial intelligence (AI). AI gives search engines the ability to understand natural language and the way humans speak. In late 2019, Google released a major algorithm update called BERT. BERT is a neural network-based technique for natural language processing. It can better understand the full context of your query by understanding all the words in your search including conjunctions like “are” or “but” or prepositions like “in” or “at.”

For example, if a user searches for “pictures of a wave,” Google uses natural language processing to understand “a wave” and that the user is looking for a water wave. If the user searches for “pictures of waving” Google is able to understand “waving” as a verb and offers results for people waving. Here, Google uses semantic search to understand the relationship between words to offer results. See the following images for context. 

Semantic search example - BrightEdge

Semantic search SEO - BrightEdge

It is imperative to note that Google penalizes pages and URLs for optimizing for search spiders rather than users, hence the creation of BERT. Search engines want to generate results for users that are informative and relevant to their searches.

Google’s algorithms are all designed with the goal of better understanding exactly what a user is searching to find. Google continues to progress their algo updates to drive new capabilities so search engine results pages – or SERPs – are as accurate as possible for the individual searcher. Using semantic search, Google has been able to form a deeper understanding of user intent. 

To better understand user and customer intent data to benchmark your marketing performance for specific categories, you can leverage Market Insights.

Understanding Semantic SEO

Semantic SEO is the process of optimizing content for users by understanding their full search intent. Before optimizing for a keyword, first understand what exactly the user is asking or searching for. From there, you need to ask yourself, what follow up questions will the user ask? Here, think of People Also Ask (PAA) and what these rich results offer users. Not only are they able to find the answers to their original query, but they are also able to dive deeper without leaving the SERP.

Search engines are more likely to provide results for pages that answer many of the questions a searcher is asking, rather than just one. Therefore, you will want to create content that delivers plenty of targeted information to searchers. One way to help you do this is to conduct a search on a query that you want to rank for. Look at the PAA results that appear and answer those questions within your content.

For example, if a user were to search “how to start a garden” they may also want to know what month to start a garden, how much it costs to start a garden, which tools they need to start, etc. Below you can see the PAA results for “how to start a garden” include inquiries about which month to start a garden and the cost of it. You should create content around both questions to practice semantic SEO and maximize your opportunity to rank.

Tips to otimize for semantic search - BrightEdge

Search engines are only going to become more intelligent about search intent and to rank well, it is essential that content also anticipates what the searcher is looking to find beyond the face value of the search query. Keep semantic search and semantic SEO in mind while creating content for your site in the future. 

,