Crawler directory

ByteDance Bytespider

AI training

About this crawler

Reported to collect pages for ByteDance AI products. We found no ByteDance page that confirms it.

Your page is being collected, and it may be used to build AI models. No person is waiting on this visit.

User agent

Bytespider

DataFair counts a request as Bytespider when its user agent contains that name, in any letter case. Requests like this stay out of your visitors and your monthly allowance.

IP addresses

We did not find an address list for this crawler. A count means a request used this name, not proof of who sent it.

Control it in robots.txt

User-agent: Bytespider
Disallow: /

This asks the crawler to stay away. Compliance is up to the operator.

Sources

We did not find a page from ByteDance that names this token. Last checked October 2026.

More from ByteDance

Track crawlers with DataFair