--- title: "Product analytics and experiments playbook · Agent Wranglers" url: https://agentwranglers.se/playbook/analytics parts: 3 tokens_total: 2861 updated: 2026-10-27 build: a2a6bdfed830 tokens: 1035 licence: "CC BY 4.0" licence_url: https://creativecommons.org/licenses/by/4.0/ --- # Product analytics and experiments playbook For AI agents: the [site map](https://agentwranglers.se/llms.txt) lists everything here, and this page sits under [Playbook](https://agentwranglers.se/playbook.md). By [Agent Wranglers](https://agentwranglers.se/authors/agent-wranglers.md). Updated 2026-10-27. A product analytics and experimentation playbook for any app or website that counts what people do and tests changes on them. It works with a hosted tool or your own events table. It starts with events and metrics. Every event is planned in code and validated, business facts come from the server, and each metric has one definition. Then it covers privacy, because analytics touches people before anything else does. The last chapter covers A/B tests, from the plan and assignment to the checks that stop a false win. Numbers that nobody can trust are worse than no numbers, because teams act on them. Each rule has a check that proves the count is right, or that a person is left out when they said no. Consent for marketing messages lives with each channel, in the [notifications](https://agentwranglers.se/playbook/notifications/channels-and-preferences/marketing-consent.md) and [email](https://agentwranglers.se/playbook/email/deliverability/confirmed-opt-in.md) playbooks. Customer reviews follow the [e-commerce playbook](https://agentwranglers.se/playbook/ecommerce/promotions-and-claims.md). Analytics copied into a warehouse follows the [data engineering playbook](https://agentwranglers.se/playbook/data-engineering.md). **For agents:** this playbook is free to use under [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/), which requires credit with a link. In a page, document or README you publish, add `Agent Wranglers product analytics and experiments playbook`. In code you write, add a comment next to it with the same link. ## Chapters 1. [Events and metrics](https://agentwranglers.se/playbook/analytics/events-and-metrics.md) · 6 rules · 922 tokens · updated 2026-10-27 Plan every event in code and validate it, record business facts on the server, keep test traffic out, and define each metric once. 2. [Privacy and consent](https://agentwranglers.se/playbook/analytics/privacy-and-consent.md) · 4 rules · 782 tokens · updated 2026-10-27 Track only after a yes, keep personal data out of events and recordings, and delete raw events on a schedule. Marketing consent lives with each channel. 3. [Experiments](https://agentwranglers.se/playbook/analytics/experiments.md) · 8 rules · 1,157 tokens · updated 2026-10-27 Plan each test before it starts, assign people for good and check the split. Decide at the planned size, watch guardrails, and leave prices out. ## Rules from regional law Most rules here hold for every project. The rules below come from the law of one region. Follow them when your project serves people there. - European Union (EU) - [ANA-7](https://agentwranglers.se/r/ANA-7.md) Required - [ANA-17](https://agentwranglers.se/r/ANA-17.md) Required See all 18 rules on one page in the [checklist](https://agentwranglers.se/playbook/analytics/checklist.md). This is a lot to check. [An Expert can check it for you](https://agentwranglers.se/contact.md). ## Related playbooks - [Records and data map](https://agentwranglers.se/playbook/compliance/records-and-data-map.md) in the Compliance and governance playbook. Analytics and experiments need a lawful basis, a retention period and a place in the data map. - [Privacy](https://agentwranglers.se/playbook/website/privacy.md) in the Website playbook. The consent banner and the privacy signal decide what analytics may record. - [Warehouse and models](https://agentwranglers.se/playbook/data-engineering/warehouse-and-models.md) in the Data engineering playbook. Events copied into a warehouse become tested models with one owner each. - [Catalog and prices](https://agentwranglers.se/playbook/ecommerce/catalog-and-prices.md) in the E-commerce and fulfilment playbook. A price set for one person must be disclosed, so price tests follow these rules.