SeobilityBot: Seobility SEO Crawler and robots.txt

SeobilityBot is the crawler of Seobility, a German company that makes SEO software. It crawls sites to collect SEO data for Seobility users. You can block it in robots.txt, and Seobility publishes the IP addresses of its bots.

User agent

The Seobility bot page uses this string for the bot:

SeobilityBot (SEO Tool; https://www.seobility.net/sites/bot.html)

Block SeobilityBot

To stop all requests from the bot, Seobility gives this robots.txt group:

User-agent: SeobilityBot (SEO Tool; https://www.seobility.net/sites/bot.html)
Disallow: /

The other examples on the same page use the short name Seobility:

User-agent: Seobility
Disallow: /

For a server or firewall block, use the IP list below or match SeobilityBot in the user agent.

How SeobilityBot picks its rules

SeobilityBot follows the rules for all bots (*) as long as the file has no group for Seobility. If the file has a Seobility group, the bot follows that group. This is the example from Seobility:

User-agent: *
Disallow: /secret.html

User-agent: Seobility
Disallow: /login.html

With this file, SeobilityBot crawls /secret.html but not /login.html. The robots.txt standard, RFC 9309, works the same way: a crawler uses the group that names it, and uses the * group only when no group names it.

Let only Seobility crawl a site

Seobility suggests this file for a test subdomain, for example to test SEO changes before a release. It blocks all bots and allows Seobility:

User-agent: *
Disallow: /

User-agent: Seobility
Disallow:

IP addresses

Seobility publishes the IP addresses of its bots in bots.json. Use the list to make sure that a request with the SeobilityBot name comes from Seobility. You can also use it in firewall rules to allow or block the bot.

If the bot causes problems on your site, Seobility asks you to contact it through its bot page.