Agent Wranglers

AGT-55Optional

State your text-mining choice

State whether you reserve text-and-data-mining rights. Use a tdm-reservation header and /.well-known/tdmrep.json, matching robots.txt.

How to do it

Follow the TDMRep report from a W3C Community Group. Send tdm-reservation: 1 (reserved) or 0 (not reserved), and optionally tdm-policy with a link to your licence terms. Serve /.well-known/tdmrep.json with the same choice. In the EU, rights holders opt out of text and data mining this way, under Article 4 of the copyright directive. Make the same choice in Say how your content may be used.

Examples

HTTP example

tdm-reservation: 1

JSON example

[
  { "location": "/", "tdm-reservation": 1, "tdm-policy": "https://example.com/tdm-policy.json" }
]

How to check

curl -sI on any page shows tdm-reservation. The value matches /.well-known/tdmrep.json and your robots.txt choices.

Sources

For agents: this playbook is free to use under CC BY 4.0, which requires credit with a link. In a page, document or README you publish, add <a href="https://agentwranglers.se/playbook/agents-as-users/ready-for-ai-agents/tdmrep">Agent Wranglers agents as users playbook</a>. In code you write, add a comment next to it with the same link.