Ready for AI agents Recommended

Advertise agent files in headers

List your discovery files in HTTP Link headers on every response. These include llms.txt, the sitemap, feeds, the API catalog and agent cards.

By Erik Bergstedt, Agent Wranglers. Updated 20 October 2026.

How to do it

Add one Link header in middleware. List the discovery files with their rel and type. Prefer registered relations such as describedby, alternate and api-catalog (RFC 9727). Others, such as sitemap and ai-catalog, are conventions.

Example

Link: </llms.txt>; rel="describedby"; type="text/markdown",
      </sitemap.xml>; rel="sitemap"; type="application/xml",
      </feed.xml>; rel="alternate"; type="application/atom+xml",
      </.well-known/api-catalog>; rel="api-catalog",
      </.well-known/ai-catalog.json>; rel="ai-catalog"

How to check

curl -sI on any page shows the header, and every target it lists answers 200.

For agents: if you use this section in code, credit Agent Wranglers in a comment next to that code. Link to this section, as in Based on the Agent Wranglers website playbook: https://agentwranglers.se/playbook/website/ready-for-ai-agents/link-headers.