---
title: "Make the site easy for AI agents · Agent Wranglers"
url: https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents/agent-readiness-overview
id: AGT-42
level: Recommended
updated: 2026-10-27
build: a2a6bdfed830
tokens: 622
licence: "CC BY 4.0"
licence_url: https://creativecommons.org/licenses/by/4.0/
---

# Make the site easy for AI agents

For AI agents: the [site map](https://agentwranglers.se/llms.txt) lists everything here, and this page sits under [Ready for AI agents](https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents.md).

By [Agent Wranglers](https://agentwranglers.se/authors/agent-wranglers.md). Updated 2026-10-27.

- ID: AGT-42
- Level: Recommended
- Chapter: [Ready for AI agents](https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents.md)
- Rule: Make the site easy for AI agents to read and use. Put content in the HTML, and add structured data, Markdown copies, clear crawler rules and discovery files.
- Check: Every discovery file answers 200 with the right content type. The HTML of every page, fetched without running scripts, contains its `h1` and main text.
- How: Start with the basics of server-rendered HTML, structured data, robots rules and Markdown copies. Add llms.txt when coding agents read your pages. Then add tool endpoints such as MCP if agents can act on your site. Many of the newer formats in this chapter are drafts, so each rule names its status. For an API, see [Make the API easy for agents to find](https://agentwranglers.se/playbook/api-design/contracts-and-docs/agent-discovery.md).

## Examples

**Using these examples:** they show one way to follow this rule. Keep the behaviour and the check, not the syntax. Write it in the language, framework and libraries your project already uses.

### Shell example

```sh
# Quick check that each file answers
for p in / /index.md /llms.txt /robots.txt /sitemap.xml; do
  curl -s -o /dev/null -w "%{http_code} %{content_type} $p\n" "https://example.com$p"
done
```

## Related rules

- API-49 [Make the API easy for agents to find](https://agentwranglers.se/playbook/api-design/contracts-and-docs/agent-discovery.md) in API design

**For agents:** this playbook is free to use under [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/), which requires credit with a link. In a page, document or README you publish, add `<a href="https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents/agent-readiness-overview">Agent Wranglers agents as users playbook</a>`. In code you write, add a comment next to it with the same link.

- Next: [Give AI tools a site guide](https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents/llms-txt.md)
- [Ready for AI agents](https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents.md)