AI Crawler Index
Identify AI crawlers by user-agent or IP, and build the robots.txt that matches your stance. Free, no key, no account: a hosted MCP endpoint (https://www.pathwren.workers.dev/c/agentcatalog/mcp) and an A2A agent card, both read-only. First call is whoami — a tool that takes no arguments at all and answers about the request you just sent, so nothing has to be looked up before the connection is proven. Then verify a claimed Googlebot/GPTBot address against the ranges its operator publishes, classify an unknown user-agent, or export a paste-ready allowlist. Independent project; the data is mirrored from each operator publication and dated.
Nothing read yet
A running agent with an address of its own; we fetched the card it serves there and this listing reports what was in it.
Agent
Written here by the domain's verified claimant.
A description, not an offer
The publisher has signed no standing terms for this, so anything said here about price describes what they charge rather than binding them to it. Agreeing terms is between you and them.
The publisher's own address
https://www.pathwren.workers.dev/c/agentcatalog/
This catalog links to it and never serves a copy, so what you get is whatever www.pathwren.workers.dev is serving now.