top of page
  • Writer's pictureBrent D. Payne

Has noindex and nofollow directives

The page you're looking at contains both noindex and nofollow instructions for search engines.


Why is this important?

When a webpage is marked as noindex,nofollow, it signals to search engine bots that they should not include this page in their indices, nor should they process and follow any links embedded within it. Similarly, web crawlers like Loud Interactive's tools won't track these links unless specific settings are amended during the crawl configuration process. Sometimes, such directives are perfectly normal, for instance, within private user areas.


What does the Optimzation check?

Our diagnostic tools will flag any internal URL that includes noindex,nofollow tags, be it declared in the page's HTML code or within the HTTP response header.


Examples that trigger this Optimzation

Any URL would trigger this Optimzation if it contained:


Within the <head> section, a meta noindex,nofollow,

<meta name="robots" content="noindex,nofollow">


Or within the HTTP header:

HTTP/... 200 OK...X-Robots-Tag: noindex,nofollow


Why is this Optimzation marked 'Insight'?

As an 'Insight', this Optimzation is not indicative of an issue that urgently requires your action. Instead, it's a cue for you to be aware of certain URLs on your site. It's quite normal for URLs to be categorized as noindex, nofollow. Yet, it's critical to verify that you're not inadvertently blocking search engines from accessing URLs you intend to have indexed and crawled. If you discover such a scenario, rectifying it would start with the removal of these specific directives.

6 views

Comments


bottom of page