Home/SEO/Anti-bot: URL check

Anti-bot: URL check

VVitaly GrotUpdated February 19, 2026666 views1 min402 chars

How to set up address checking and fake-referer blocking without breaking indexing.

Scheme and path in a URL

In the context of the "block fake referer" setting, it is important to distinguish the scheme (protocol) from the path — the rules apply to them differently.

Important

Overly aggressive rules cut off search crawlers. Always check accessibility through Search Console and Yandex.Webmaster after enabling.

Sources
  1. Anti-bot service documentation