The Technical SEO Dictionary of On-Page SEO Issues

Technical SEO Audit Dictionary

Setting Up 301 Redirects

Sometimes you have a reason to move a page, folder, or domain on your website – or remove it from your site altogether.
This is a common practice, but typically results in a “broken” URL. Search engines and users don’t like this because they are then unable to find the content they are looking for. It can also result in a “404” warning – which deters users from staying on your site.

What are you to do in this situation? This is where 301 redirects come in.

What is a 301 Redirect?

Redirects are used for pages, folders and domains that have moved to a different destination on your website. Search engines recommend using 301 redirects for content that has been permanently moved. However, other types of redirects may be appropriate for the changes you're making to your site.

If you change a URL on your website, using a 301 (permanent) redirect is recommended to ensure that users and search engines are sent to the correct page.

301 redirects are helpful for the following situations:

The purpose of a 301 redirect is to ensure that whenever a user or search engine follows a particular URL, they are sent to the right destination.

How to Set Up a 301 Redirect

To set up a 301 redirect, you will need access to your server’s .htaccess file. Then, follow the steps below:

  1. Open a text editor tool (like Sublime Text)
  2. Copy the code Redirect 301 /old-page/ https://domain.com/new-url/
  3. Save the file as .htaccess
  4. Upload to your website

If you have any questions about this process, contact a trusted SEO specialist.

Pages blocked by robots.txt file

When pages on your website are blocked by your robots.txt file, this means that search engines are not able to crawl these pages.

This can negatively impact your SEO, as these pages will not be visible to users in the search engine results.

It’s important to fix robots.txt file issues so that your important pages have a chance of ranking in search engines.

What is a robots.txt file?

A robots.txt file is a file that website owners create to permit or restrict access from search engine robots. It is essentially a “Go” or “Stop” sign that tells search engines whether they can crawl your website.

A “pages blocked by robots.txt” error indicates that there are pages on your website that are not accessible to search engine crawlers. These pages will not show up in the search results and will not be able to be found organically by users.

What is a robots.txt file used for?

A robots.txt file is used to manage search engine traffic to your website. You may choose to restrict access to certain pages if you don’t want them to be discovered by search engines or users.

For instance, you may want to hide certain landing pages so that users only end up there through a specific marketing campaign, not via organic search. You may also restrict access to unimportant image, style, or script files.

To see if a page has been crawled by Google, search for the page URL in Google.

How to Update Your Robots.txt File

If you discover that an important page is being blocked by your robots.txt file and you want to unblock it, or if you want to hide a page from search engines, then you will need to update your robots.txt file (or set up a new one).

How you do this will depend on the CMS and host that you use. We recommend searching for instructions on how to modify your robots.txt file for your specific host.

First, make sure that the robots.txt file is writeable by using FTP. If it is not, you may need to change user permissions.

To test your new or updated robots.txt file, submit to Google for it to be crawled.

Fixing Page Server Errors

A page server error indicates a problem with your website's hosting provider delivering a page to a search engine robot.

This can be caused by problems with the code on the page or problems with the hosting server.

404 HTTP Status Code

If you encounter a page server error, this will likely be indicated by a “404” error code on the page. This is an HTTP status code that says that the page that you were trying to reach could not be found on the server.

404 errors are bad for SEO because users can encounter these errors after clicking on a page from the search engine results. If users see a 404 or “Not Found” page, they may leave your website thinking that the page no longer exists.

To be clear, this error indicates that the server is reachable, but that the page users are trying to see is not.

Find 404 Pages on Your Website

You can use crawling tools such as Screaming Frog to find 404 errors on your website. We then suggest setting up 301 redirects to redirect the “broken” URLs to other pages on your website. This helps prevent users from leaving your website.

Common Reasons for Page Server Errors

There can be many reasons why a web page is not accessible or loading properly.

Some common reasons for experiencing page load issues are:

Learn all about 404 errors in our ABCs to 404s Guide.

Fix Page Server Errors

To address page server errors, first confirm that your server is working properly. If a page still can’t be retrieved via the correct URL, then consider the common reasons for encountering page server errors found in the previous section of this guide.

Often the best way to fix a 404 error is to set up a permanent 301 redirect of the old URL to the new URL. You should also confirm that there is no malware on your site and that you have SSL configured properly.

Removing Malware and Unwanted Software

Having malware or unwanted software on your website can create a negative experience for search engines and for users.

If search engines encounter malware on your website, they will be less likely to show your website in the organic search results. If users see a security error, they will likely leave your website in fear of contracting a virus.

That’s why it’s important to identify and remove malware and other unwanted software from your website.

What is malware and unwanted software?

Your SEO Site Audit will indicate whether malware was detected on your website.

Malware is any software designed to harm a user’s computer or device. The kinds of malware include viruses, spyware, worms, spam, Trojan horses, and more. This malware can be used by phishing sites to scrape user data and even capture their personal and credit card information.

Unwanted software is software that is deceptive or otherwise negatively affects a user’s experience on your website. Such types include software that redirects users to other websites without their consent or software that leaks a user’s personal information without consent.

Google Unwanted Software Policy

To determine whether software or applications on your website are malware, read Google’s Unwanted Software Policy here.

Some of these guidelines include:

How to Fix Malware and Unwanted Software Issues

To fix malware or unwanted software issues on your site, ensure that your site follows the guidelines found in Google’s Unwanted Software Policy above. Remove any software that goes against these guidelines or that were otherwise identified as malware in your Site Audit report.

Create good page titles in Search Results

The search results limit the number of characters that can be displayed for page titles. It’s considered best practice to optimize your page titles with the right length and keyword(s).

What is a title tag?

A title tag, otherwise known as your page title, is the title that appears in the search results. It is the HTML code that specifies the title of the page or post. Users can click on the page title directly from the search engine search results.

Titles give users and search engines context for what the page or post is about. It’s often what entices users to visit your website.

How to write optimized page titles

To increase your chances of ranking high in the search results, and of search engines showing the correct title for the page, you should follow page title SEO best practices.

Here are a few tips for optimizing your page titles: