Crawler directory

Moz DotBot

Other bots

About this crawler

Gathers link data for an SEO tool.

An automated tool requested your page. It says little about real readers, so it is kept apart from your visitors.

User agent

DotBot

DataFair counts a request as DotBot when its user agent contains that name, in any letter case. Requests like this stay out of your visitors and your monthly allowance.

IP addresses

We did not find an address list for this crawler. A count means a request used this name, not proof of who sent it.

Control it in robots.txt

User-agent: DotBot
Disallow: /

This asks the crawler to stay away. Compliance is up to the operator.

Sources

Moz documentation

More other bots crawlers

Track crawlers with DataFair