Crawler directory

xAI Grok-DeepSearch

AI answers

About this crawler

Reported to read pages during a Grok research request. We found no xAI page that confirms it.

Someone asked an AI assistant a question, and the assistant opened your page to answer. These visits show which pages AI tools are using right now.

User agent

Grok-DeepSearch

DataFair counts a request as Grok-DeepSearch when its user agent contains that name, in any letter case. Requests like this stay out of your visitors and your monthly allowance.

IP addresses

We did not find an address list for this crawler. A count means a request used this name, not proof of who sent it.

Control it in robots.txt

User-agent: Grok-DeepSearch
Disallow: /

This asks the crawler to stay away. Blocking it can also keep you out of its answers or results, so decide with care. Fetches a person triggers may not follow robots.txt, so check the operator's documentation.

Sources

We did not find a page from xAI that names this token. Last checked October 2026.

More from xAI

Track crawlers with DataFair