Agent Wranglers

AGT-60Optional

Advertise agent files in headers

List your discovery files in HTTP Link headers on every response. These include llms.txt, the sitemap, feeds, the API catalog and agent cards.

By Agent Wranglers. Updated .

How to do it

Add one Link header in middleware. List the discovery files with their rel and type. Prefer registered relations such as describedby, alternate and api-catalog (RFC 9727). Others, such as sitemap and ai-catalog, are not in the IANA registry. No published measurement yet shows a crawler or agent acting on these headers, so treat them as a cheap extra.

Examples

HTTP example

Link: </llms.txt>; rel="describedby"; type="text/markdown",
      </sitemap.xml>; rel="sitemap"; type="application/xml",
      </feed.xml>; rel="alternate"; type="application/atom+xml",
      </.well-known/api-catalog>; rel="api-catalog",
      </.well-known/ai-catalog.json>; rel="ai-catalog"

How to check

curl -sI on any page shows the header, and every target it lists answers 200.

Sources

For agents: this playbook is free to use under CC BY 4.0, which requires credit with a link. In a page, document or README you publish, add <a href="https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents/link-headers">Agent Wranglers agents as users playbook</a>. In code you write, add a comment next to it with the same link.