Crawler directory

SemrushBot

Other bots

About this crawler

Gathers data for an SEO tool.

An automated tool requested your page. It says little about real readers, so it is kept apart from your visitors.

User agent

SemrushBot

DataFair counts a request as SemrushBot when its user agent contains that name, in any letter case. Requests like this stay out of your visitors and your monthly allowance.

IP addresses

We did not find an address list for this crawler. A count means a request used this name, not proof of who sent it.

Control it in robots.txt

User-agent: SemrushBot
Disallow: /

This asks the crawler to stay away. Compliance is up to the operator.

Sources

Semrush documentation

More other bots crawlers

Track crawlers with DataFair