Allen AI AI2Bot
AI training
About this crawler
Collects pages for open AI research at the Allen Institute.
Your page is being collected, and it may be used to build AI models. No person is waiting on this visit.
User agent
AI2Bot
DataFair counts a request as AI2Bot when its user agent contains that name, in any letter case. Requests like this stay out of your visitors and your monthly allowance.
IP addresses
We did not find an address list for this crawler. A count means a request used this name, not proof of who sent it.
Control it in robots.txt
User-agent: AI2Bot Disallow: /
This asks the crawler to stay away. Compliance is up to the operator.