Crawler directory

X Twitterbot

Other bots

About this crawler

Draws the preview when a link is posted.

An automated tool requested your page. It says little about real readers, so it is kept apart from your visitors.

User agent

Twitterbot

DataFair counts a request as Twitterbot when its user agent contains that name, in any letter case. Requests like this stay out of your visitors and your monthly allowance.

IP addresses

We did not find an address list for this crawler. A count means a request used this name, not proof of who sent it.

Control it in robots.txt

User-agent: Twitterbot
Disallow: /

This asks the crawler to stay away. Compliance is up to the operator.

Sources

We did not find a page from X that names this token. Last checked October 2026.

More other bots crawlers

Track crawlers with DataFair